Face tracking library

OpenPose is a real-time pose estimation engine designed to detect and track human body, face, hand, and foot landmarks. It functions as a multi-person motion tracker, identifying the spatial coordinates of multiple individuals simultaneously within video streams or static images. Beyond two-dimensional detection, the software acts as a three-dimensional kinematics processor, reconstructing spatial movement data from single or multiple synchronized camera perspectives. The system distinguishes itself through a bottom-up approach that utilizes part-affinity fields to associate body parts across

3DDFA is a 3D face reconstruction tool that generates three-dimensional facial meshes and 68 structural landmarks from a single two-dimensional input image. The project provides utilities for estimating facial pose and depth maps to determine the orientation and position of a face. It includes a geometry exporter to save reconstructed facial shapes into standard file formats for use in external 3D modeling software. The software further covers automated face cropping using landmark-based and landmark-free identification methods, as well as the extraction of specialized mathematical represent

PRNet is a Python library for 3D facial reconstruction. It uses a deep learning regression model to predict 3D facial geometry and vertex colors from a single 2D input image to generate a textured mesh. The project provides tools for digital face swapping, allowing the replacement of a target face with a new image and blending textures to match the original pose. It also includes a framework for face texture swapping and blending to fit specific 3D poses. Additional capabilities cover facial analysis, including the detection and alignment of facial landmarks and the estimation of head pose a

AlphaPose is a deep learning pose estimation framework and PyTorch computer vision library designed for detecting and tracking human body, face, hand, and foot keypoints in images and videos. It provides a system for skeletal posture estimation and multi-person pose tracking. The project implements tools for three-dimensional human pose reconstruction, generating joint positions and body mesh shapes from two-dimensional image data. It also includes a multi-person pose tracker capable of maintaining the identity of multiple people across consecutive video frames. The framework covers a broad

OpenFace is an affective computing framework and facial behavior analysis toolkit designed for the extraction of facial features and the recognition of muscle movements to analyze human emotional behavior. It provides a research platform for analyzing human emotion and social interaction patterns through computer vision. The software implements a suite of tools for detecting facial landmarks, calculating head pose in 3D space relative to a camera, and tracking eye gaze by analyzing eye position and orientation. It also includes capabilities for facial action unit recognition to identify speci

This project is a computer vision library designed for facial landmark detection and alignment. It provides a framework for identifying and mapping specific points on a human face in both two-dimensional and three-dimensional space, enabling the normalization of facial geometry and orientation across diverse images. The system utilizes a deep learning approach to extract precise facial coordinates, supporting tasks such as expression analysis and geometric modeling. By employing a stacked hourglass architecture, the model performs multi-stage feature refinement to capture spatial relationship

This project is a deep learning framework designed for facial landmark detection. It functions as a computer vision library that provides the necessary routines to locate precise points on human faces within images by generating spatial probability maps. The architecture distinguishes itself through high-resolution parallel branching, which maintains detailed visual representations throughout the entire network. By utilizing multi-scale feature fusion, the model repeatedly exchanges information across these parallel streams to integrate fine-grained spatial details with broader semantic conte

This is a PyTorch-based computer vision library for detecting 2D and 3D facial landmark coordinates. It functions as a facial landmark detector and reconstruction tool, utilizing deep learning to identify precise geometric points on human faces from image datasets. The library allows for the selection of specific detection backends to balance accuracy and processing speed. It supports the integration of precomputed bounding box files, which enables the system to bypass the initial detection phase and proceed directly to landmark extraction. The toolkit includes capabilities for batch image p

This library provides a deep learning framework for identifying human faces and extracting facial landmarks within digital images. It utilizes a multi-task convolutional neural network architecture to simultaneously perform face classification, bounding box regression, and landmark localization. The system processes images through three sequential stages of neural networks, incorporating image pyramid resizing to detect faces of varying scales. To ensure accuracy, it employs bounding box regression to refine coordinate predictions and non-maximum suppression to filter out redundant overlappin

Pigo is a computer vision library written in Go for locating human faces in images and video streams. It provides tools for face detection, facial landmark identification, and pupil and eye localization. The project is implemented in pure Go to ensure portable execution without external dependencies. It supports compilation to WebAssembly, enabling face detection and image processing to run directly in web browsers without a backend. The library's capabilities include real-time face detection using classifier cascades and gaze tracking localization. It maps anatomical points on the face to a

This project is a PyTorch implementation of a research architecture designed for high-resolution representation learning. It serves as a computer vision framework focused on precise keypoint detection, human pose estimation, and semantic image segmentation. The implementation provides specialized tools for identifying anatomical landmarks on the human body and predicting facial keypoint coordinates to analyze orientation and alignment. It utilizes a system of multi-resolution parallel streams and repeated multi-scale fusion to maintain high-resolution representations throughout the network.

This project is a computer vision framework designed for the detection, identification, and tracking of human subjects within video streams. It provides an integrated system for locating individuals, generating biometric models from image datasets, and maintaining identity labels across consecutive video frames. The system distinguishes itself through its ability to maintain identity persistence across multiple camera feeds. By utilizing deep learning inference to extract feature vector embeddings and applying motion prediction algorithms, it links unique identity signatures across disparate

Face-recognition.js is a computer vision software development kit for Node.js that provides tools for detecting, mapping, and identifying human faces within images and video streams. It functions as a bridge to high-performance native libraries, enabling developers to perform complex facial analysis tasks directly within JavaScript and TypeScript environments. The library distinguishes itself by combining deep learning inference with geometric landmark mapping. It utilizes pre-trained neural networks to extract facial feature vectors and employs Euclidean distance calculations to determine th

clmtrackr is a JavaScript computer vision library designed for facial landmark detection and real-time tracking. It implements Constrained Local Models to identify specific coordinate points on a human face within video feeds or static images. The project functions as a real-time face warping engine and expression analysis tool. It can distort facial images via parametric models to create caricatures or identify and label emotional states such as happiness, sadness, anger, and surprise based on feature coordinates. The library covers a broad range of capabilities including automatic and manu

This is a Python facial recognition library designed to detect, encode, and identify human faces in images and video. It functions as a biometric identification tool that converts facial features into numerical encodings to compare and match identities. The library provides a computer vision command line interface for batch processing face detection and recognition tasks across image directories. It also supports a GPU accelerated vision API that utilizes CUDA and NVIDIA hardware to increase the speed of facial analysis and identification. Its capabilities cover human face detection and faci

MMPose is a PyTorch-based pose estimation toolbox and deep learning training pipeline designed for detecting 2D and 3D keypoints on humans, animals, and faces. It serves as a computer vision model zoo and a framework for both 2D pose estimation and 3D pose lifting. The project is distinguished by its modular architecture and extensibility, employing a registry-based system and hierarchical configurations to allow for custom algorithm integration and model pipeline customization. It supports diverse estimation paradigms, including top-down, bottom-up, and two-stage pose lifting workflows. The

CompreFace is a facial recognition system designed for human face detection, identification, and biometric identity verification. It provides a registry of known people and the ability to match faces in images against this database to determine a specific identity. The system extracts facial landmarks to map geometry and analyzes physical attributes including age, gender, and head pose. It can also verify whether two different images belong to the same individual. The project is implemented as a microservice-based deployment utilizing a REST API gateway and a PostgreSQL metadata store. It in

lite.ai.toolkit is a C++ computer vision toolkit designed for edge AI deployment. It enables the execution of pre-trained models for object detection, image classification, and segmentation on resource-constrained devices. The project features a multi-backend inference engine that supports the ONNX model runtime, allowing AI models to run across different hardware targets. It includes a GPU-accelerated pipeline specifically for NVIDIA hardware to reduce latency and increase processing speed. The toolkit covers a broad range of facial analysis capabilities, including emotion detection, gender

Openface is a deep learning toolkit designed for facial recognition and identity verification. It provides a comprehensive pipeline for detecting faces, aligning landmarks, and transforming facial images into compact numerical vectors. By utilizing these embeddings, the system enables identity classification and similarity comparison through geometric distance calculations. The project distinguishes itself by integrating research-oriented diagnostic tools alongside its core recognition capabilities. It includes utilities for visualizing high-dimensional feature clusters, inspecting internal c

facenet-pytorch is a facial recognition library for PyTorch that provides pretrained neural networks for detecting faces and extracting facial embeddings. It includes an MTCNN face detector for locating faces and landmarks, alongside an InceptionResnet face encoder to convert facial images into high-dimensional vectors for identity verification. The project provides tools for identity recognition by comparing facial embeddings using cosine similarity. It also supports facial video tracking to maintain identity consistency across consecutive frames and allows for the fine-tuning of pretrained

Detectron2 is a PyTorch computer vision framework and visual recognition platform designed for training and deploying models for object detection, image segmentation, and visual recognition. It provides a research-oriented environment for training complex vision models with multi-GPU acceleration. The project includes a specialized object detection library for identifying and locating multiple objects via bounding boxes, as well as an image segmentation toolkit for creating pixel-level masks through instance, semantic, and panoptic segmentation. Additionally, it features a human pose estimati

This project is a modular PyTorch framework for training and evaluating object detection and instance segmentation models. It serves as a computer vision research tool and a deep learning inference engine designed to identify object locations, classes, and pixel-level masks within images. The framework implements a two-stage inference pipeline that utilizes region proposal networks and a symmetric mask-head architecture. It provides specialized capabilities for instance segmentation, object bounding box detection, and human pose estimation via anatomical keypoint detection. The system includ

face-api.js is a TensorFlow.js face recognition library and browser-based computer vision API. It provides tools for performing face detection, recognition, and landmark prediction within browsers and Node.js. The library includes a biometric identity descriptor generator that creates numerical vectors to compare identity and similarity between images. It features a facial landmark detection tool for mapping sixty-eight specific coordinate points on a face, as well as an age and gender estimation model. Its capabilities cover real-time facial analysis, including the recognition of facial exp

Deepface is a comprehensive deep learning library for facial recognition and demographic analysis. It provides a modular pipeline that handles the entire lifecycle of facial processing, including detection, geometric alignment, and the transformation of facial images into high-dimensional numerical vector embeddings for identity verification and similarity comparison. The library distinguishes itself through a model ensemble approach, which combines predictions from multiple pre-trained neural networks to improve classification accuracy and reduce bias. It also integrates advanced security fe

This project is a Go library designed for facial detection, landmark mapping, and identity verification. It provides a toolkit for integrating computer vision capabilities into applications, enabling the automated identification and analysis of human faces within digital images. The library utilizes a deep residual network to transform facial data into compact vector representations, which are then compared using geometric distance calculations to confirm identities. It employs histogram-based object detection to locate facial structures and maps specific points on the face to define geometry

Faceai is a computer vision toolkit designed for facial analysis, identity recognition, and image processing. It provides integrated engines for detecting human faces in static images and live video streams, matching facial encodings against identity databases, and mapping facial landmarks to understand geometric structure and alignment. The project enables real-time augmented reality applications, such as applying virtual makeup and digital accessories by scaling assets to detected facial coordinates. It also includes a suite for digital image restoration capable of removing noise, erasing w

This project is a scientific computing framework for the .NET ecosystem, providing a comprehensive suite of libraries for numerical analysis, statistics, and mathematical optimization. It serves as a foundational toolkit for developing applications in machine learning, digital signal processing, and computer vision. The framework provides specialized toolkits for training and deploying predictive models, including neural networks, support vector machines, and decision trees. It further distinguishes itself with deep integrations for real-time visual analysis, such as object tracking and facia

DeepFaceLive is a desktop application designed for real-time facial replacement and animation within live video streams. By utilizing deep learning models, the software performs high-speed identity mapping and facial feature analysis to transform video content as it is captured. The engine relies on GPU-accelerated inference to execute these complex image manipulation tasks at interactive frame rates. The application distinguishes itself through a modular video processing pipeline that chains specialized tasks to maintain high throughput and low latency. It features a virtual camera streaming

jeelizFaceFilter is a browser-based computer vision engine and WebGL face tracking library designed for AR filters and real-time facial movement tracking. It functions as a neural network face detector that identifies multiple faces and monitors mouth movements and rotation within a web browser. The system distinguishes itself through a model-swappable detection pipeline, allowing the exchange of neural network weights to balance accuracy and performance across different camera angles and devices. It features real-time lighting synchronization to match the illumination of 3D overlays with the

AR.js is a web-based augmented reality framework used to create immersive experiences directly in a browser using WebGL and WebRTC. It provides a cross-platform runtime that executes on mobile devices and head-mounted displays without requiring a dedicated application installation. The framework includes a marker-based engine for detecting physical patterns or barcodes to anchor digital overlays, a location-based tool for positioning entities via GPS coordinates, and a face tracking library for anchoring content to human facial features. It supports multi-marker simultaneous tracking, custom

Headtrackr is a JavaScript library and computer vision face tracker designed to monitor head position and orientation via a webcam. It provides a head tracking API that detects face location and spatial coordinates within a live video stream to create head-coupled perspective effects. The project functions as a tool for shifting 3D rendering perspectives in real time based on physical head movements. It utilizes WebRTC and media stream integration to capture video data and identify a user's face and rotation within a web browser. The library covers computer vision capabilities for face and h

tracking.js is a browser computer vision library written in JavaScript for performing real-time image analysis and object tracking directly within a web browser. It functions as a real-time object tracker, a color tracking tool, and a face detection utility. The library enables the detection and monitoring of specific color ranges, human faces, and known visual patterns across consecutive video frames. It extracts visual features and descriptors from images to identify distinct landmarks for matching and tracking. The project covers broad computer vision capabilities, including the ability t

This project is a computer vision system designed for real-time facial recognition and identity tracking using live camera feeds. It provides a framework for capturing, registering, and identifying multiple individuals simultaneously by comparing live video input against a local database of pre-registered facial descriptors. The system distinguishes itself through a performance-oriented processing pipeline that balances computational load during live analysis. By combining deep neural network feature extraction with centroid-based object tracking, the software maintains consistent identity la

Human is a TensorFlow.js computer vision library used for face, body, and hand tracking within the browser or Node.js. It provides a framework for human pose and gesture tracking, facial recognition, and biometric liveness detection to verify a live human presence. The project distinguishes itself through a full suite of identity and motion tools, including a facial recognition framework that generates embeddings for similarity matching and a background segmenter for separating humans from their environment. It incorporates a liveness detector to prevent spoofing during facial analysis. The

OpenCV is a comprehensive computer vision library designed for real-time performance and cross-platform deployment. It provides a native execution environment that leverages multi-threaded operations and automated memory management to handle intensive computational tasks, including image processing and machine learning model inference. The library distinguishes itself through a data-oriented matrix framework that utilizes proxy-based array abstractions to provide a consistent interface for multidimensional data. By employing factory-pattern algorithm interfaces and runtime type dispatching, i

This project is a collection of pre-trained machine learning models and conversion pipelines designed for running inference directly in the browser using TensorFlow.js. It provides a library of ready-to-use models for computer vision, audio classification, and natural language processing tasks. The suite includes specialized tools for transforming Python-based Keras models into JSON formats compatible with web environments. It enables the deployment of these models by fetching architectures and weight shards via HTTP for client-side execution. The project covers a broad range of capabilities

dlib is a C++ machine learning toolkit and data analysis framework. It provides a collection of algorithms and utilities for building predictive modeling applications and performing statistical analysis on large datasets within native C++ environments. The project functions as a binding library that wraps low-level C++ machine learning algorithms into high-level Python scripting interfaces. This allows for the integration of high-performance native implementations with Python for machine learning development. The framework covers the implementation of predictive models, the execution of mach

libfacedetection is a C++ face detection library and computer vision tool. It utilizes a neural network face detector to identify human faces in images and return bounding box coordinates. The library is designed for low latency and high throughput processing, enabling real-time face detection in image and video streams. It supports automated image analysis for identifying coordinates of human faces across large batches of photos and high-performance video processing.

This project is a computer vision tool designed to calculate the pitch, yaw, and roll of a human head in real time. It functions as a facial landmark detection library that identifies sixty-eight specific points on a face to enable precise orientation tracking from video streams. The system utilizes a high-performance inference engine to execute pre-trained machine learning models, ensuring that geometric analysis is performed efficiently on input frames. By mapping detected facial coordinates to a three-dimensional model, the software determines the camera-relative rotation of the head throu

This project is a JavaScript library designed for real-time face detection directly within a web browser. It functions as a machine learning model wrapper that enables developers to identify and track human faces in live video streams without the need for backend server processing. The library utilizes browser-native media access to stream raw camera data into application memory, where it performs pixel-level analysis. By leveraging a tensor-based inference engine and web-assembly acceleration, the tool executes complex neural network calculations locally to achieve high-performance computer

TengineKit is a mobile computer vision software development kit designed for real-time inference on local hardware. It functions as a neural network engine that executes deep learning models directly on mobile devices, enabling applications to perform complex visual analysis without relying on cloud connectivity. The framework provides specialized tools for detecting and tracking human features, including faces, hands, bodies, and irises, alongside general object detection capabilities. By utilizing a native core runtime and hardware-accelerated execution, the library processes visual data lo

OpenCV-Face-Recognition is a computer vision system designed to detect human faces and verify identities within live video streams and static images. It functions as a Python-based toolkit that processes visual data to locate facial boundaries and match detected features against a pre-trained database of profiles. The system utilizes a structured computer vision pipeline that integrates object detection with statistical analysis to perform identity verification. It employs pre-trained classifiers to scan for facial patterns and encodes facial textures into binary histograms to create represen

This project is a deep learning face classification system that detects human faces and classifies gender and emotion. It utilizes convolutional neural networks and computer vision tools to analyze facial attributes in both static images and live video streams. The system includes specialized classifiers for emotions based on the FER2013 dataset and gender based on IMDB datasets. These models are integrated into a containerized web service, allowing the classification logic to be exposed as an API that processes image data via network requests. The technical surface covers the entire pipelin

EasyVtuber is 2D avatar animation software that transforms a single static image into a real-time animated character. It functions as a face tracking animation tool and live streaming avatar driver, mapping facial movements from webcams or iOS devices to drive virtual expressions and head motion. The project distinguishes itself through a neural animation pipeline that includes AI video upscaling and frame interpolation to increase visual smoothness and resolution. It utilizes a transparent video streaming system via Spout2, allowing rendered frames with alpha channels to be sent directly to

Deep Face Recognition in PyTorch

Evolve to be more comprehensive, effective and efficient for face related analytics \& applications! (WeChat News) About the name: "face" means this repo is dedicated for face related analytics \& applications. "evolve" means unleash your greatness to be better and better. "LV" are capitalized…