VowpalWabbit/vowpal_wabbit

Features

• Machine Learning Trainers - Provides a command-line tool for training and evaluating machine learning models with compact argument syntax.
• Contextual Bandit Executors - Selects actions for each context and learns from reward feedback to optimize decisions under uncertainty.
• Contextual Bandit Frameworks - Ships a framework for training contextual bandit models that optimize decisions through exploration and reward feedback.
• Contextual Bandit Model Trainers - Trains models that select actions based on context to maximize cumulative reward from logged or online interactions.
• Distributed Training - Distributes model training across a cluster using allreduce for parallel updates.
• File-Based Training - Reads training examples from files and runs multiple passes of online learning to update the model.
• Online Learning - Updates model parameters incrementally as new data arrives without full retraining.
• Contextual Bandit Algorithms - Implements online reinforcement learning algorithms that optimize decisions under uncertainty.
• Stochastic Gradient Descent - Updates model weights incrementally after each example using online gradient descent for streaming data.
• Learning Task Reductions - Provides a reduction-based learning framework that composes complex tasks from simpler algorithms.
• Feature Hashing - Implements a feature hashing trick that maps unbounded feature names into a fixed-size vector space.
• Contextual Bandit Evaluation - Selects actions based on context and learns from reward feedback to optimize decisions under uncertainty.
• Contextual Bandit Learners - Applies reinforcement learning algorithms that choose actions and adapt from reward feedback in interactive environments.
• Contextual Bandit Policy Trainers - Trains policies that select actions based on context to maximize cumulative reward with exploration and personalization.
• Policy Optimization Frameworks - Provides a contextual bandit framework for optimizing action-selection policies under uncertainty.
• Online Machine Learning - Trains models incrementally from streaming data without requiring full retraining from scratch.
• Feature Hashing Memory Control - Controls memory consumption independently of dataset size by hashing features and streaming data.
• Importance Weight Normalizers - Adjusts the influence of training examples by assigning importance weights during online learning.
• Multiclass - Trains classifiers that assign inputs to one of several predefined categories.
• Cost-Sensitive Classifiers - Trains models that minimize misclassification cost by learning from examples with per-class cost labels.
• Allreduce Synchronization Protocols - Ships a tree-based allreduce protocol for synchronizing gradient computations across cluster nodes.
• Exploration Rate Decay Schedulers - Gradually reduces the exploration parameter during training to shift from exploring to exploiting known rewards.
• Contextual Bandit Exploration Strategies - Runs contextual bandit algorithms to optimize exploration-exploitation trade-offs in interactive learning scenarios.
• Feature Interaction Models - Learns from pairwise combinations of feature subsets to capture interactions for ranking tasks.
• Pairwise Interaction Creators - Creates pairwise feature combinations from specified namespaces to capture cross-feature relationships.
• Large Scale Training - Distributes model training across multiple machines in a cluster to speed up learning on massive datasets.
• Linear and Logistic Regression - Trains logistic regression models for binary classification using command-line options.
• Linear Regression - Fits linear models to data using online gradient descent for regression and classification.
• Model Persistence - Saves and reloads trained models to disk, ensuring identical predictions across sessions.
• Structured Label Sequence Predictors - Learns to predict sequences of labels using structured prediction techniques like Learning to Search.
• Structured Sequence Predictors - Predicts sequences of labels using structured prediction techniques like Learning to Search.
• Regression Models - Trains regression models to predict continuous numeric outputs from input features.
• Sequence Labeling - Learns to assign labels to each element in a sequence for tasks like named entity recognition.
• Bag-of-Words Feature Extractors - Accepts raw text as input and automatically converts it into a bag-of-words feature representation for learning.
• Bag-of-Words Parsers - Parses free-form text into bag-of-words feature representations for model training.
• Python API - Sets model parameters and learning options through a Python API instead of command-line arguments.
• Active Learning - Implements an active learning query strategy that selects the most informative unlabeled examples for labeling.
• Streaming Data Pipelines - Processes examples one at a time from files or stdin without loading the entire dataset into memory.
• Training Execution CLI Commands - Trains and evaluates models directly from the terminal using a compact argument syntax for rapid experimentation.
• Command Line Model Inferences - Trains and evaluates machine learning models directly from the terminal using compact argument syntax.
• Offline Policy Evaluators - Estimates how candidate policies would perform using logged data without live deployment.
• Machine Learning Frameworks - High-performance system for online and large-scale machine learning.

Star history