awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
afshinea avatar

afshinea/stanford-cme-295-transformers-large-language-models

0
View on GitHub↗
4,509 stars·647 forks·MIT·19 views

Stanford Cme 295 Transformers Large Language Models

This project is a comprehensive technical course study guide and reference for learning the architectures and training methods of Transformers and large language models. It serves as a technical overview for understanding how neural networks process data and how to align model behavior with specific performance goals.

The repository provides specialized guides on several key areas of model development. This includes detailed references for transformer architectures, implementation frameworks for retrieval-augmented generation and agentic workflows, and technical guides for model optimization and fine-tuning.

The content covers a broad range of capabilities, including supervised fine-tuning, low-rank adaptation, and preference-based alignment. It also addresses model efficiency through quantization, distillation, and mixture-of-experts architectures, alongside the study of self-attention and flash attention mechanisms.

Features

  • LLM Study Guides - Serves as a comprehensive study guide for large language model architectures, training, and agentic workflows.
  • Architecture References - Provides detailed technical explanations of self-attention, flash attention, and mixture-of-experts mechanisms.
  • Attention Mechanisms - Provides a technical study of transformer architectures, including self-attention and sparse attention mechanisms.
  • Attention Algorithm Optimizations - Explains algorithmic optimizations for attention mechanisms to improve processing speed and memory efficiency.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI
  • Flash-Attention Implementations - Details the implementation of Flash Attention to accelerate long-sequence processing in transformer models.
  • Fine-Tuning Reference Guides - Provides comparative visual references and technical overviews of different model adaptation and fine-tuning strategies.
  • Large Language Model Fine-Tuning - Covers the application of supervised fine-tuning and preference optimization to align model outputs.
  • Alignment Techniques - Provides a conceptual guide to alignment techniques using supervised fine-tuning and preference optimization.
  • Technique Explainers - Offers educational explainers on optimization techniques including supervised fine-tuning and knowledge distillation.
  • Architecture Deep-Dives - Details the inner workings of self-attention and architectural variants to optimize data processing.
  • Preference-Based Model Alignments - Explains preference-based alignment techniques to ensure model outputs meet safety and quality goals.
  • Efficiency Analysis - Examines prompting and quantization strategies to optimize the balance of raw power and efficiency.
  • Large Language Model Optimization - Catalogs techniques for optimizing large language model behavior and efficiency.
  • Mixture of Experts - Covers the architecture and routing mechanisms of Mixture-of-Experts (MoE) models.
  • Preference Alignment - Provides technical guidance on utilizing preference tuning and distillation for human intent alignment.
  • Low-Rank Adaptation - Provides a technical guide on using Low-Rank Adaptation (LoRA) for parameter-efficient fine-tuning.
  • Supervised Fine-Tuning Workflows - Explains supervised fine-tuning workflows and distillation to refine the learning process of large models.
  • Model Fine-Tuning Workflows - Outlines end-to-end workflows for applying supervised fine-tuning and low-rank adaptation.
  • Model Performance Optimization - Provides technical guides on optimizing model accuracy and speed through quantization and fine-tuning.
  • Model Efficiency Techniques - Teaches the use of mixture-of-experts and quantization to lower computational requirements for deployment.
  • Weight Quantization - Provides technical references for weight quantization to reduce model memory footprint.
  • Implementation Frameworks - Provides a study and framework for building retrieval-augmented generation, agentic workflows, and reasoning models.
  • Retrieval-Augmented Generation - Implements frameworks for retrieval-augmented generation (RAG) to provide factual grounding for model responses.
  • Self-Attention Mechanisms - Provides a technical study of self-attention mechanisms and how neural networks process sequence data.
  • Supervised Fine-Tuning - Offers a comprehensive guide to supervised fine-tuning using labeled instruction-response pairs.
  • Technique Evaluations - Provides a study of prompting and low-rank adaptation methods to enhance model capabilities.
  • Model Optimization Guides - Offers technical documentation and tutorials for implementing parameter-efficient fine-tuning and model optimization techniques.
  • RAG Implementation Guides - Offers implementation guides and frameworks for building retrieval-augmented generation and agentic workflows.
  • Advanced Reasoning Models - Explores the implementation of advanced reasoning models, including retrieval-augmented generation and autonomous agents.
  • Design Patterns - Offers a reference for designing agentic interaction loops including planning and tool-use strategies.
  • Iterative Refinement Workflows - Provides technical guidance on implementing iterative refinement loops and agentic workflows for complex task solving.
  • Optimization References - Provides a technical study of quantization and distillation techniques to reduce memory usage and increase efficiency.
  • Large Model Optimizations - Covers large model optimizations such as quantization and mixture-of-experts to reduce memory usage.
  • AI Agents and LLM Tools - Provides guidance on implementing agentic workflows and retrieval systems for scalable AI applications.
  • Architectural Summaries - Explains the inner workings of self-attention and flash attention to improve model design efficiency.
  • Mixture of Experts - Discusses the use of MoE and fine-tuning to improve computational efficiency.
  • LLM Application Development Curricula - Provides structured educational materials for developing retrieval-augmented generation and reasoning models.
  • LLM Application Studies - Guides learners through the implementation of RAG and autonomous agent systems.
  • Technique Analysis - Provides resources to analyze and evaluate different LLM prompting and fine-tuning methods.
  • Application Analysis - Examines the implementation and performance of retrieval systems and autonomous agents.

    • Star history

    Star history chart for afshinea/stanford-cme-295-transformers-large-language-modelsStar history chart for afshinea/stanford-cme-295-transformers-large-language-models

    How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

    Frequently asked questions

    What does afshinea/stanford-cme-295-transformers-large-language-models do?

    This project is a comprehensive technical course study guide and reference for learning the architectures and training methods of Transformers and large language models. It serves as a technical overview for understanding how neural networks process data and how to align model behavior with specific performance goals.

    What are the main features of afshinea/stanford-cme-295-transformers-large-language-models?

    The main features of afshinea/stanford-cme-295-transformers-large-language-models are: LLM Study Guides, Architecture References, Attention Mechanisms, Attention Algorithm Optimizations, Flash-Attention Implementations, Fine-Tuning Reference Guides, Large Language Model Fine-Tuning, Alignment Techniques.

    Which projects share features with afshinea/stanford-cme-295-transformers-large-language-models?

    Projects with overlapping indexed features include: modelscope/swift — Swift is a toolkit for the full-parameter and parameter-efficient fine-tuning of large language and multimodal models.… meta-llama/llama-models — This project provides a foundational framework and reference implementation for executing causal language modeling and… facebookresearch/llama-recipes — This repository is a collection of frameworks and guides for Llama models, functioning as a fine-tuning framework, an… openrlhf/openrlhf — OpenRLHF is a training framework and alignment library designed for reinforcement learning from human feedback across… ml-explore/mlx-examples — This repository provides a collection of reference implementations and code examples for training and deploying… datawhalechina/so-large-lm — This project is a comprehensive educational curriculum and structured learning path covering the full lifecycle of…

    Projects sharing features with Stanford Cme 295 Transformers Large Language Models

    These projects share indexed features with Stanford Cme 295 Transformers Large Language Models. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
    • modelscope/swiftmodelscope avatar

      modelscope/swift

      14,633View on GitHub↗

      Swift is a toolkit for the full-parameter and parameter-efficient fine-tuning of large language and multimodal models. It functions as a multimodal model trainer for text, image, video, and audio data, and includes specialized tools for model compression and reinforcement learning from human feedback. The framework provides an alignment toolkit for optimizing model behavior using preference learning algorithms and reinforcement learning. It integrates parameter-efficient fine-tuning methods to adapt models with minimal memory and compute requirements, alongside utilities for reducing hardware

      Python
      View on GitHub↗14,633
    • meta-llama/llama-modelsmeta-llama avatar

      meta-llama/llama-models

      7,643View on GitHub↗

      This project provides a foundational framework and reference implementation for executing causal language modeling and multimodal reasoning on local systems. It includes a set of core components for managing model assets, a fine-tuning framework, and structural definitions required to instantiate transformer-based architectures. The system is distinguished by its ability to process combined text and image inputs through multimodal transformer models for visual reasoning and document analysis. It also supports the deployment of quantized models, reducing memory footprints through low-precision

      Python
      View on GitHub↗7,643
    • facebookresearch/llama-recipesfacebookresearch avatar

      facebookresearch/llama-recipes

      18,379View on GitHub↗

      This repository is a collection of frameworks and guides for Llama models, functioning as a fine-tuning framework, an inference pipeline, and an AI workflow orchestrator. It provides tools for adapting large language models to specific datasets and domains. The project includes a parameter-efficient fine-tuning toolkit that utilizes techniques like low-rank adaptation to reduce memory and compute requirements. It also serves as an implementation guide for retrieval-augmented generation, combining model inference with external data retrieval to improve response accuracy. The capability surfac

      Jupyter Notebook
      View on GitHub↗18,379
    • ml-explore/mlx-examplesml-explore avatar

      ml-explore/mlx-examples

      8,254View on GitHub↗

      This repository provides a collection of reference implementations and code examples for training and deploying machine learning models using the MLX framework. It serves as a practical guide for executing distributed training, fine-tuning large language models, converting model weights, and implementing multimodal generative workflows. The project distinguishes itself through specialized examples for local hardware execution, featuring weight quantization to reduce memory usage and low-rank adaptation for parameter-efficient fine-tuning. It also includes scripts for transforming external mod

      Pythonmlx
      View on GitHub↗8,254
    Compare all 30 related projects→