Awesome GitHub RepositoriesNeural Network Model Compression

This project is a Python implementation of the Faster R-CNN object detection framework. It serves as a convolutional neural network library and tool for locating and classifying multiple objects within images. The framework provides a pre-trained model implementation that allows for object detection inference without manual training. It supports the full lifecycle of object detection, including training detectors on visual datasets to identify and bound specific object classes. The system covers capabilities for computer vision model evaluation, neural network optimization to reduce model si

这是一个教育性 Jupyter Notebook 合集，提供了使用 TensorFlow 框架构建神经网络和进行张量运算的教程。它作为机器学习教育仓库和深度学习学生的实现指南。 该套件专注于特定的高级架构，包括用于图像分类的卷积神经网络、用于训练稳定性的残差网络（带跳跃连接），以及用于生成建模和数据合成的变分自编码器。它还包含构建去噪和深度自编码器以进行特征提取和降维的指南。 该仓库涵盖了更广泛的预测建模领域，实现了用于预测连续值和二元结果的线性、多项式和逻辑回归。 内容组织为交互式 Notebook，允许用户执行数学运算并修改机器学习实验。

AutoGPTQ 是一个模型压缩工具包和训练后量化框架，旨在减少大语言模型的内存占用。它利用 GPTQ 算法压缩神经网络权重，降低硬件要求并减少 VRAM 使用量。 该项目通过提供优化内核来提高 Token 生成速度，从而充当推理加速器。它具有模型架构扩展性，允许通过可配置模式将量化能力添加到新的模型结构中。 该框架涵盖了全面的量化流水线，包括层级权重压缩、基于校准的缩放估计以及特定精度的内存映射。它还包括用于模型性能评估的系统，以衡量量化对语言和摘要任务准确性的影响。

这是一个 TensorFlow 机器学习示例集合，为各种神经网络范式提供了参考实现。它涵盖了监督学习、无监督学习、强化学习和序列学习模型。 该仓库包含了专注于图像分类和排序的卷积神经网络实现，以及用于时间序列预测和序列到序列翻译的循环神经网络。此外，它还提供了通过奖励优化训练的强化学习智能体，以及用于数据聚类的自编码器和自组织映射等无监督学习技术。 其他功能涵盖了监督回归和分类、语义嵌入生成，以及用于序列数据建模的隐马尔可夫模型。该项目还包括用于张量操作管理和通过仪表板进行模型性能可视化的实用工具。 内容以一系列 Jupyter Notebook 的形式提供。

This research framework provides a deep learning driving simulator and a multimodal data pipeline for autonomous vehicle research. It centers on the creation of synchronized autonomous vehicle datasets, which combine high-frequency vehicle telemetry with camera frames to train neural networks. The project implements a convolutional neural network trainer specifically designed to predict steering angles and vehicle transition states from visual data. It features generative capabilities, using autoencoders and transition models to synthesize driving environments and simulate future vehicle move

Pretrained-Language-Model is a machine learning library and natural language processing toolkit designed for pretraining, tokenizing, and compressing large language models using transformer architectures and specialized optimization techniques. It supports Chinese and multilingual natural language processing tasks, including text classification and conversational response generation. The framework provides specialized capabilities for training large-scale autoregressive and contextual language models, alongside model compression techniques like knowledge distillation and quantization to reduc

Instructor-embedding 是一个自然语言处理框架，旨在将非结构化文本转换为高维数值向量。通过利用基于 Transformer 的编码器架构，该系统促进了大规模数据集上的语义检索、数据分类和相似度分析。 该框架通过指令条件向量投影脱颖而出，它将自然语言指令直接纳入嵌入过程，从而在无需额外训练的情况下提高特定任务的性能。它作为一个对比学习库，允许用户在自定义数据集上微调预训练语言模型，为特定领域创建专业化的嵌入。 该项目提供了一套全面的向量表示管理工具，包括针对标准化指标对模型准确性进行基准测试，以及为快速相似度搜索建立嵌入索引的功能。为了支持在资源受限环境中的部署，该框架包含了混合精度模型量化等优化功能，以减少内存使用并加速推理速度。

Knowledge-Distillation-Zoo is a framework for neural network model compression that facilitates the transfer of learned patterns from large teacher models to smaller student architectures. It provides a modular environment for executing training pipelines designed to reduce the computational requirements of deep learning models while maintaining predictive accuracy. The library implements knowledge transfer through both logit-based mimicry and feature-map alignment, allowing students to replicate the classification behavior and internal representations of a teacher. It supports teacher-studen

This project provides a TensorFlow implementation of the Stable Diffusion model, serving as a generative engine for creating and modifying visual content. It functions as a machine learning architecture that translates natural language descriptions into high-quality images by iteratively refining noise within a compressed latent space. The system enables a variety of generative tasks, including text-to-image synthesis, image inpainting to fill missing or masked regions, and image editing to transform existing visuals based on text prompts. Beyond static imagery, the framework supports the gen

This project provides a comprehensive educational curriculum and research resource for deep learning, focusing on the theoretical and technical foundations of neural network implementation. It serves as a structured academic guide for building and training complex models from scratch, covering the essential mathematical primitives, computational graph construction, and automatic differentiation mechanisms required for modern machine learning. The repository distinguishes itself through its extensive coverage of generative modeling and specialized neural architectures. It includes practical im