google-deepmind/learning-to-learn
Learning To Learn
This project is a TensorFlow meta-learning framework and research toolkit designed to implement and train learned optimizers. It provides a library of tools for developing neural networks that learn how to optimize other models, replacing traditional gradient-based optimization algorithms.
The framework includes a problem ensemble manager that allows multiple distinct optimization tasks to be combined into a single weighted loss function for simultaneous training. It uses a factory pattern for network instantiation and supports the definition of custom objective functions and loss graphs as targets for learning algorithms.
The toolkit covers a broad range of capabilities, including gradient-based meta-optimization, model benchmarking, and the execution of training loops with configurable unroll lengths. It also provides utilities for gradient preprocessing, serialized state persistence, and the reporting of experiment statistics such as mean final error and epoch duration.
Features
- Meta-Optimization - Uses gradient-based meta-optimization to refine the learning process of target neural networks.
- Deep Learning Toolkits - Provides a set of utilities for configuring problem architectures and evaluating convergence on benchmark datasets.
- Problem Ensembling - Manages the combination of multiple distinct optimization tasks into a single weighted loss function.
- Learned Optimizers - Implements a library of tools for building and training neural networks that act as optimizers.
- Loss Graph Definitions - Provides a way to define mathematical tasks and loss graphs as targets for learned optimization algorithms.
- Custom Loss Functions - Implements custom objective functions and weighted problem ensembles to calculate error during training.
- Meta Learning Frameworks - Provides a TensorFlow-based framework for training neural networks to optimize other models.
- Learned Optimizer Training - Implements training loops with configurable epochs and unroll lengths to improve the performance of learned optimizers.
- Meta-Optimizer Training - Executes training loops that optimize a learning algorithm based on cumulative evaluation costs over specified epochs.
- Problem Ensembling - Combines multiple distinct optimization tasks into a single weighted loss function for simultaneous training.
- Meta Learning Libraries - Provides a toolkit for developing and training neural networks that learn how to optimize other models.
- Problem Ensemble Composition - Combines multiple distinct optimization tasks into a single weighted loss function for simultaneous training.
- Data Preprocessing - Transforms input gradients using logarithmic scaling and sign extraction to prepare them for model consumption.
- Gradient Distribution Transformations - Applies logarithmic transformations and preserves input signs to reshape the distribution of processing data.
- Meta-Learning Problem Definitions - Enables the creation of loss graphs for mathematical tasks to serve as training targets for learning algorithms.
- Gradient Flow Stabilizers - Applies logarithmic scaling and sign extraction to gradients to ensure numerical stability during training.
- Optimizer Convergence Evaluators - Provides utilities to test optimizer effectiveness by measuring convergence and performance on target problems.
- Model Execution Benchmarks - Evaluates the execution cost and performance of optimization algorithms across diverse mathematical problem sets.
- Benchmark Problem Configurations - Provides tools for setting up network architectures and hyperparameters for consistent testing across benchmark tasks.
- Problem Modeling - Provides a framework for defining optimization problem structures, including custom objective functions and loss operations.
- Unroll-Length Optimizations - Executes training iterations over specified sequence lengths to optimize the learning algorithm's performance.
