awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
simplescaling avatar

simplescaling/s1

0
View on GitHub↗
arxiv.org/abs/2501.19393↗

S1

s1 is a reasoning training framework and GPU cluster orchestrator designed to build and refine large language models. It provides a system for executing supervised fine-tuning on distributed hardware, utilizing gradient checkpointing and hardware optimization to improve model reasoning.

The project features a synthetic data generator and dataset builder that produce high-quality training sets. This workflow collects questions, generates model reasoning traces, and applies automated grading loops to filter for correct answers.

The framework includes an evaluation suite to compute accuracy and statistical metrics on standardized benchmarks. It also implements test-time scaling techniques to increase reasoning accuracy by expanding the computational search space during the inference phase.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Features

  • Distributed Training Orchestration - Orchestrates the distribution of large-scale model training tasks across multiple GPU hardware nodes.
  • Automated Evaluation Loops - Implements automated loops that generate model reasoning traces and score them for inclusion in training sets.
  • Model Performance Benchmarking - Computes accuracy and token statistics by comparing model samples against standardized reasoning evaluation sets.
  • Reasoning Model Training Suites - Integrates dataset building, supervised fine-tuning, and test-time scaling to train models for complex reasoning.
  • Supervised Fine-Tuning Frameworks - Provides a pipeline for supervised fine-tuning to optimize model reasoning using gradient checkpointing and hardware acceleration.
  • Synthetic Reasoning Data Generators - Provides pipelines for creating high-quality mathematical and logical reasoning datasets through trace generation and grading.
  • Reasoning Dataset Builders - Implements a workflow for collecting questions and generating filtered model traces to create training sets.
  • Reasoning Trace Generators - Produces training data by collecting reasoning paths and filtering them through automated grading passes.
  • GPU Training Clusters - Manages GPU resources and executes supervised fine-tuning with hardware optimization and gradient checkpointing.
  • Model Evaluation Benchmarks - Measures logical performance and token efficiency using standardized benchmarks to determine reasoning accuracy.
  • Reasoning Evaluations - Analyzes sample outputs and token usage across benchmarks to evaluate a model's reasoning and comprehension abilities.
  • Test-Time Compute Scalers - Increases reasoning accuracy by expanding the computational search space and sampling during the inference phase.
  • LLM Evaluation - Computes accuracy and statistical metrics on reasoning tasks using automated judges and standardized benchmarks.
  • Reasoning Models - Simplified scaling laws for reasoning model training.
6,656 stars·757 forks·Python·Apache-2.0·17 views

Star history

Star history chart for simplescaling/s1Star history chart for simplescaling/s1

How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

Projects sharing features with S1

These projects share indexed features with S1. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
  • samsungsailmontreal/tinyrecursivemodelsSamsungSAILMontreal avatar

    SamsungSAILMontreal/TinyRecursiveModels

    6,540View on GitHub↗

    TinyRecursiveModels is a recursive training framework for small neural networks designed to solve complex logical tasks. It functions as a parameter-efficient model trainer and a reasoning dataset generator, enabling the optimization of models that refine their answers through iterative reasoning steps. The framework differentiates itself by utilizing latent-state recursive refinement, where the model maintains and updates an internal hidden representation to improve prediction accuracy over multiple sequential steps. It also includes tools for generating structured training and evaluation da

    Python
    View on GitHub↗6,540
  • petergriffinjin/search-r1PeterGriffinJin avatar

    PeterGriffinJin/Search-R1

    5,568View on GitHub↗

    Search-R1 is a distributed training system and reinforcement learning framework designed to create search-augmented language models. It provides an architecture for scaling model workloads across head and worker nodes while optimizing how models interleave internal reasoning with external tool calls. The system focuses on refining model behavior through custom reward signals and reinforcement learning to improve tool-use formatting and information retrieval. It implements an interleaved reasoning-search loop that allows models to alternate between internal thought generation and external data

    Python
    View on GitHub↗5,568
  • pageman/sutskever-30-implementationspageman avatar

    pageman/sutskever-30-implementations

    3,148View on GitHub↗

    This project is a collection of deep learning research implementations and a reproduction kit designed to translate theoretical AI papers into working code. It provides a library of neural network architectures and reference implementations for reproducing seminal research concepts through interactive notebooks. The repository distinguishes itself through the implementation of AI theory and scaling laws, covering complexity dynamics, information theory, and the simulation of universal AI agents. It also includes a benchmarking suite for synthetic reasoning, allowing for the evaluation of mode

    Jupyter Notebook
    View on GitHub↗3,148
  • oumi-ai/oumioumi-ai avatar

    oumi-ai/oumi

    8,858View on GitHub↗

    Oumi is a comprehensive large language model development platform designed for synthesizing data, fine-tuning models, and running performance evaluations. It serves as a unified environment for the entire model lifecycle, encompassing a training and fine-tuning suite, an evaluation framework, and tools for synthetic data generation and model distillation. The platform is distinguished by its iterative, failure-driven synthesis approach, which analyzes model weaknesses during evaluation to generate targeted training data. It utilizes an LLM-based judge framework to programmatically score respo

    Pythondpoevaluationfine-tuning
    View on GitHub↗8,858
Compare all 30 related projects→

Frequently asked questions

What does simplescaling/s1 do?

s1 is a reasoning training framework and GPU cluster orchestrator designed to build and refine large language models. It provides a system for executing supervised fine-tuning on distributed hardware, utilizing gradient checkpointing and hardware optimization to improve model reasoning.

What are the main features of simplescaling/s1?

The main features of simplescaling/s1 are: Distributed Training Orchestration, Automated Evaluation Loops, Model Performance Benchmarking, Reasoning Model Training Suites, Supervised Fine-Tuning Frameworks, Synthetic Reasoning Data Generators, Reasoning Dataset Builders, Reasoning Trace Generators.

Which projects share features with simplescaling/s1?

Projects with overlapping indexed features include: samsungsailmontreal/tinyrecursivemodels — TinyRecursiveModels is a recursive training framework for small neural networks designed to solve complex logical… petergriffinjin/search-r1 — Search-R1 is a distributed training system and reinforcement learning framework designed to create search-augmented… pageman/sutskever-30-implementations — This project is a collection of deep learning research implementations and a reproduction kit designed to translate… oumi-ai/oumi — Oumi is a comprehensive large language model development platform designed for synthesizing data, fine-tuning models,… internlm/opencompass — OpenCompass is a comprehensive evaluation platform, benchmarking suite, and distributed model evaluator designed to… openai/evals — Evals is a framework designed for automating, managing, and executing repeatable benchmarking suites to analyze the…