Awesome GitHub RepositoriesConversation Format Normalization

This project is a collection of educational resources and technical guides focused on the development and implementation of large language models. It provides a comprehensive curriculum covering transformer architectures, training methods, and deployment strategies. The materials provide detailed instructions for building autonomous agents using reasoning loops and tool integration, as well as guides for fine-tuning models through supervised learning and preference optimization. It also includes tutorials for constructing retrieval augmented generation pipelines and implementing transformer m

AdalFlow 是一个自主 AI 代理框架和 LLM 应用库，旨在构建模块化工作流。它作为一个模型无关的接口和 RAG 流水线编排器，允许用户开发 ReAct 代理，利用迭代推理和外部工具执行来解决复杂任务。 该项目通过一个提示词优化系统脱颖而出，该系统使用文本梯度下降自动优化提示词模板和少样本示例。它将模型反馈视为可微分信号，实现了一种 LLM 反向传播形式，从而根据评估指标迭代提高输出质量。 该框架涵盖了广泛的功能面，包括带有语义向量搜索和重排序的检索增强生成、用于可观测性的基于跨度的执行追踪，以及模式驱动的结构化解析。它为众多专有和开源模型提供商提供了统一的通信层，并支持将 Python 函数转换为标准化的工具接口。 该系统使用 Python 实现，并与 MLflow 集成以进行工作流跟踪和分析。

MNBVC is a dataset pipeline and toolkit designed for the collection, cleaning, and normalization of massive text and code corpora used to train large language models. It provides specialized tools for harvesting source code, commit histories, and repository metadata from version control platforms, alongside a multilingual text corpus collector for gathering parallel text and academic papers. The project distinguishes itself through comprehensive capabilities for processing diverse document types, including a PDF-to-text converter that transforms complex layouts and formulas into structured JS