Awesome GitHub RepositoriesPretrained Weight Initializers

Grok-1 is an open-weights large language model implementation featuring a sparse mixture-of-experts architecture. It is designed for high-performance text generation and natural language processing by activating only a subset of specialized expert layers per token. The model utilizes 8-bit weight quantization to reduce memory overhead and accelerate loading. To manage its high parameter count, the implementation supports activation sharding, which distributes the memory load across multiple hardware devices during execution. The project covers large-scale model inference, including text comp

GFPGAN is a generative face restoration model and Python-based image processing tool designed to restore low-resolution facial images. It utilizes generative adversarial networks to recover fine details and increase the clarity of degraded portraits. The system employs a generative facial prior to map degraded images to a high-quality manifold, enabling blind-face restoration without requiring knowledge of the specific degradation process. It utilizes a multi-stage workflow that includes face detection, alignment, and region-specific masking to separate facial areas from the background. Beyo

This project is a comprehensive Chinese translation of a technical deep learning textbook, providing an educational resource on the theory and implementation of neural networks. It functions as a collaborative technical translation project designed to make complex academic AI literature accessible to non-English speakers. The project utilizes a community-driven translation model that integrates external suggestions and pull requests to refine linguistic accuracy and reduce bias. It employs standardized terminology mapping to ensure a uniform vocabulary throughout the translated content. To i

This project is a library of pretrained computer vision architectures and backbones for image classification and feature extraction. It serves as a comprehensive model zoo and collection of standardized image encoders, including ResNet, Vision Transformers, and EfficientNet, for use in visual analysis and as backbones for object detection and image segmentation. The library provides a framework for distributed training and evaluation of image models using advanced data augmentation and optimization scripts. It includes a dedicated toolset for converting trained PyTorch vision models into the

This project is a TensorFlow and Keras implementation of the Mask R-CNN architecture. It provides a framework for performing simultaneous object detection and instance segmentation, transforming raw images into segmented masks and bounding boxes for individual object identification. The toolset enables custom computer vision training through fine-tuning pre-trained weights and integrating user-provided datasets. It includes capabilities for distributed GPU training to accelerate the optimization of large vision models. The framework covers model evaluation using standard precision metrics an

Magenta is an AI creative suite and TensorFlow generative art framework used to train and deploy models for the production of artistic media. It functions as a generative music library and a deep learning art generator, providing tools to automate the creation of original musical compositions and visual artwork. The project covers AI music composition and generative visual art through neural art generation and machine learning creativity. It enables the training of generative models to produce original songs, images, and drawings based on learned patterns.

PaddleDetection is an object detection framework designed for the end-to-end development, training, and deployment of computer vision models. It provides a comprehensive library of modular neural network architectures and pipelines that support object detection, instance segmentation, and multi-object tracking tasks. The project distinguishes itself through a configuration-driven approach that decouples model components like backbones and heads, allowing for the flexible assembly of custom vision workflows. It incorporates advanced techniques such as anchor-free detection logic, joint detecti

Wav2Lip is a deep learning lip sync model and neural talking head framework designed to synchronize the lip movements in a video to match a provided audio file. It functions as a computer vision lip synchronizer and speech-to-lip generator that maps speech patterns to visual mouth movements to produce realistic talking head videos. The system utilizes a framework for training and evaluating models that align audio and video frames. This includes the ability to train lip-sync models and visual discriminators using speech-to-lip datasets and evaluating the resulting synchronization accuracy thr

This is a PyTorch semantic segmentation library designed for building image masking frameworks. It provides a collection of over 500 pretrained convolutional and transformer-based encoders and various decoder architectures to perform binary and multiclass pixel-level classification. The library features a modular backbone integration that decouples encoder choice from decoder logic. It supports custom input channel configurations and encoder depth tuning, allowing the modification of input layers to accept non-standard channel counts while preserving pretrained weights. Some configurations al

This project is a pretrained model library for PyTorch, providing a collection of convolutional neural network architectures and weights. It serves as a computer vision model zoo for image classification and feature extraction, offering a framework for transfer learning where pretrained networks are adapted for custom image recognition tasks. The library focuses on transforming images into high-level numerical representations and calculating class probability scores. It includes utilities for downloading and initializing standard architectures such as ResNet, Inception, and Xception. Capabil

TinyLlama is a compact 1.1B parameter language model pretrained on a dataset of 3 trillion tokens. It is an edge AI model designed for high-performance text generation on memory-constrained devices. The project provides a distributed pretraining framework for training small language models across multiple GPUs and nodes. It also includes a finetuning toolkit for full-parameter weight adjustments to adapt the base model for chat and specific tasks. The system supports distributed large language model training and on-device text generation. Its architectural components include rotary positiona

This project is a Python implementation of the Faster R-CNN object detection framework. It serves as a convolutional neural network library and tool for locating and classifying multiple objects within images. The framework provides a pre-trained model implementation that allows for object detection inference without manual training. It supports the full lifecycle of object detection, including training detectors on visual datasets to identify and bound specific object classes. The system covers capabilities for computer vision model evaluation, neural network optimization to reduce model si

This project is a comprehensive collection of educational examples and reference implementations for building vision and language models using PyTorch. It serves as a deep learning tutorial covering the end-to-end process of developing neural networks, from initial architecture definition to final production deployment. The repository provides detailed guides on implementing a wide range of domain-specific models, including convolutional neural networks for object detection and segmentation, as well as transformer and recurrent architectures for natural language processing. It emphasizes gene

This project is a collection of deep learning tools for image classification and audio tagging, providing a repository of pre-trained model weights and architectures. It serves as a Keras model zoo that enables the immediate use of established neural networks for inference and transfer learning. The library includes a music tagging framework that classifies audio recordings using convolutional recurrent neural networks and mel-spectrograms. For visual data, it provides implementations of architectures such as ResNet, VGG, and Xception, alongside a repository of weights trained on large datase

MMDetection3D is an open-source toolbox for 3D perception, providing a unified framework for detecting and segmenting objects in three-dimensional environments. It supports a range of core tasks including monocular 3D object detection from single camera images, LiDAR-based 3D object detection from raw point clouds, and multi-modal fusion that combines camera images with LiDAR data. The toolbox also covers point cloud semantic segmentation, assigning class labels to every point in a scan for scene understanding. The project distinguishes itself through a config-driven pipeline that orchestrate

Este proyecto es un framework de procesamiento de lenguaje natural centrado en un preentrenador autorregresivo generalizado diseñado para la representación de lenguaje no supervisado. Implementa un modelo de lenguaje que combina el entrenamiento basado en permutaciones con un backbone Transformer-XL para funcionar como un procesador de texto de contexto largo. El sistema destaca por su capacidad para manejar secuencias de texto que exceden los límites de longitud estándar mediante el uso de recurrencia a nivel de segmento y codificación posicional relativa. Escala el preentrenamiento de alto rendimiento a través de múltiples GPUs y clusters de TPU utilizando implementaciones de entrenamiento distribuido. El código base cubre el flujo de trabajo completo de machine learning, incluyendo limpieza de texto y tokenización de subpalabras para el preprocesamiento de datos, así como ajuste fino (fine-tuning) específico para tareas de respuesta a preguntas, comprensión lectora y clasificación de texto. Incluye utilidades para optimización de parámetros, programación de tasas de aprendizaje y evaluación de probabilidades de respuesta mediante métricas de precisión-recall. El proyecto proporciona configuraciones para gestionar hiperparámetros del modelo y entrenamiento acelerado por hardware en múltiples hosts.

Open NSFW es un clasificador de imágenes y filtro de contenido basado en deep learning, diseñado para identificar contenido visual explícito o inseguro. Utiliza una red neuronal para analizar imágenes y generar puntuaciones de probabilidad que determinan si el contenido no es apto para el entorno laboral. El sistema emplea una arquitectura de modelo basada en Caffe para realizar la extracción automatizada de características visuales y la clasificación de imágenes. Admite el uso de pesos preentrenados y permite el ajuste fino (fine-tuning) de la red con conjuntos de datos personalizados para mejorar la precisión de la detección. El proyecto cubre flujos de trabajo de moderación de imágenes de extremo a extremo, incluyendo el escaneo automatizado de contenido y el filtrado visual para marcar o bloquear archivos multimedia inapropiados.

Este proyecto es un recurso educativo de deep learning que consiste en implementaciones de modelos de PyTorch y ejemplos de código. Proporciona scripts funcionales en Python y notebooks para construir, entrenar y optimizar redes neuronales utilizando computación basada en tensores. El repositorio incluye implementaciones para diseñar capas de red y funciones de pérdida personalizadas, así como ejemplos de flujos de trabajo de aprendizaje por transferencia (transfer learning) que cargan pesos de modelos preentrenados para acelerar el desarrollo. El código base cubre una amplia gama de capacidades de deep learning, incluyendo entrenamiento de redes neuronales, diseño de componentes de modelos personalizados y la implementación de arquitecturas multicapa para reconocer patrones complejos en conjuntos de datos.

facenet-pytorch es una librería de reconocimiento facial para PyTorch que proporciona redes neuronales preentrenadas para detectar rostros y extraer embeddings faciales. Incluye un detector de rostros MTCNN para localizar rostros y puntos de referencia, junto con un codificador facial InceptionResnet para convertir imágenes faciales en vectores de alta dimensión para la verificación de identidad. El proyecto proporciona herramientas para el reconocimiento de identidad comparando embeddings faciales mediante similitud de coseno. También admite el seguimiento de video facial para mantener la consistencia de la identidad a través de frames consecutivos y permite el ajuste fino de modelos preentrenados en datasets personalizados para mejorar la precisión del reconocimiento para individuos o entornos específicos. La librería cubre una amplia gama de capacidades de visión artificial, incluyendo localización facial, verificación de identidad y el procesamiento de tensores de imagen mediante normalización por lotes.

Sketch-code es una herramienta de prototipado web basada en deep learning y un conversor de imagen a HTML diseñado para transformar bocetos de sitios web dibujados a mano en código HTML estructural. Utiliza un analizador de wireframes mediante redes neuronales para reconocer elementos visuales en los bocetos y mapearlos a representaciones de diseño web correspondientes. El sistema emplea una arquitectura basada en Keras para entrenar y evaluar modelos de reconocimiento utilizando datasets de wireframes dibujados a mano y HTML de referencia. Desacopla el diseño estructural del diseño visual permitiendo la inyección de capas CSS personalizadas durante el proceso de compilación. El proyecto abarca el prototipado frontend automatizado y la generación de layouts de UI, incluyendo el mapeo supervisado de imagen a código y la evaluación de precisión de predicción para medir la salida generada frente a referencias de verdad fundamental.