3 个仓库
Metrics like BLEU score that compare generated sequences against reference sequences using n-gram overlap.
Distinct from Sequence Generation: Distinct from Sequence Generation: focuses on evaluation metrics for generated sequences, not the generation process itself.
Explore 3 awesome GitHub repositories matching artificial intelligence & ml · Sequence Evaluation Metrics. Refine with filters or upvote what's useful.
This repository collects illustrated single-page cheat sheets that compress the core topics of Stanford's CS 230 deep learning course into visual reference summaries. The collection covers convolutional neural networks, recurrent neural networks, and practical training techniques, pairing schematic diagrams with mathematical notation to bridge intuition and formal understanding. The cheat sheets are organized by subject area and link related concepts across topics, such as connecting vanishing gradients to LSTM gates, to reinforce the full deep learning workflow. Practical training advice on
Describes BLEU score computation for evaluating generated sequences against reference texts.
ToolBench is an open platform for training, serving, and evaluating large language models that retrieve and call real-world APIs to complete user instructions. It provides an API-aware inference engine that selects relevant tools from a large corpus and generates sequences of tool calls to produce final answers, along with a custom API registration system that lets users add their own REST endpoints for the model to discover and invoke. The platform includes a complete instruction-tuning pipeline for training models on curated tool-use data, a multi-tool execution engine that coordinates sequ
Ships a judge-model framework that compares tool-call sequences to assess quality and preference.
ChatGLM-Efficient-Tuning is a fine-tuning framework and toolkit designed to optimize large language models using parameter-efficient fine-tuning techniques. It provides a pipeline for adjusting model behavior and reducing the memory and compute requirements necessary for training. The project features a web-based trainer and orchestration interface for configuring and executing the fine-tuning process on a single GPU. It supports quantized training in lower precision formats to enable fine-tuning on hardware with limited memory, as well as reinforcement learning from human feedback for model
Calculates linguistic accuracy using BLEU and ROUGE scoring mechanisms to evaluate generated text.