2 个仓库
Awesome GitHub RepositoriesLanguage Model Architectures
Specialized constructions for building models that predict subsequent tokens in a sequence.
Distinct from Model Construction: Specifically targets the structural construction of language models rather than general model construction.
Explore 2 awesome GitHub repositories matching artificial intelligence & ml · Language Model Architectures. Refine with filters or upvote what's useful.
Awesome Language Model Architectures GitHub Repositories
用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
- fastai/course-v3
fastai/course-v3
4,914在 GitHub 上查看该项目是一个综合性教育计划和深度学习框架，旨在通过 Notebook 和代码示例教授 PyTorch 深度学习实践。它作为一个用于构建、训练和部署神经网络的高级库，充当模型训练编排器，协调 PyTorch 模型、优化器和损失函数。 该项目为计算机视觉、自然语言处理和表格数据预处理提供了专门的工具包。它通过高级训练控制脱颖而出，例如判别式学习率、用于自定义训练逻辑的双向回调系统，以及自动化设备放置和训练循环的高级学习器抽象。 该框架涵盖了广泛的能力面，包括自动化数据流水线构建、模型架构分析以及跨分类、回归和分割任务的性能评估。它还包括用于跨多个 GPU 进行分布式训练的工具、用于内存优化的混合精度训练，以及对医学影像数据的专门支持。 该项目以一系列 Jupyter Notebook 的形式交付。
fastai constructs a model for predicting subsequent tokens in a sequence using specified architectures.
Jupyter Notebookdata-sciencedeep-learningfastai - karpathy/ng-video-lecture
karpathy/ng-video-lecture
4,798在 GitHub 上查看This project is an educational implementation of a small-scale generative pre-trained transformer designed to teach the fundamentals of neural network architecture and training. It serves as a reference implementation and tutorial for constructing a text-generating neural network from scratch. The codebase demonstrates the mechanics of tokenization, self-attention, and the construction of a lightweight language model. It focuses on the step-by-step process of building a generative model to illustrate how large language models are constructed. The implementation covers transformer-based archi
Provides a framework for constructing language model architectures that predict subsequent tokens.
Python
