allenai/OLMo

Features

• Large Language Model Training Frameworks - Provides an open-source framework for training, fine-tuning, and running inference on large language models.
• Checkpointing Systems - Releases all intermediate training checkpoints publicly for reproducibility and downstream use.
• Text Generation Inference Integrations - Runs text generation with pretrained checkpoints using standard tokenization and model APIs.
• Pretrained Checkpoint Inference - Loads pretrained checkpoints and generates text responses using standard tokenization and model APIs.