1 repository
Awesome GitHub RepositoriesDecoder-Only Training Methods
Training procedures for autoregressive models that predict the next token using causal left-to-right context.
Distinct from Model Training: Distinct from Model Training: specifies the decoder-only autoregressive paradigm, not general training procedures.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Decoder-Only Training Methods. Refine with filters or upvote what's useful.
Awesome Decoder-Only Training Methods GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- datawhalechina/so-large-lm
datawhalechina/so-large-lm
7,400Vezi pe GitHubThis project is a comprehensive educational curriculum and structured learning path covering the full lifecycle of large language models. It provides a guided progression through the theory, architecture, training, and deployment of these models. The curriculum includes specialized guides on transformer architecture, model training tutorials, and frameworks for designing autonomous agents. It also provides dedicated resources for studying model safety and ethics. The material covers a wide range of technical capabilities, including distributed training strategies, parameter-efficient fine-tu
Covers training procedures for autoregressive decoder-only models using causal left-to-right context.
