1 repository
Mechanisms for evaluating and discarding low-quality data records using pre-trained model inference.
Distinct from Data Filtering: Distinct from general data filtering: focuses on using AI model inference to score and filter training data quality.
Explore 1 awesome GitHub repository matching data & databases · Inference-Based Filtering. Refine with filters or upvote what's useful.
WeClone is an end-to-end framework designed for the creation, training, and deployment of personalized conversational AI digital twins. By fine-tuning large language models on individual chat history, the platform enables the replication of unique communication styles, speech patterns, and conversational habits. The system manages the entire lifecycle of these digital avatars, from initial data preparation to final integration into messaging platforms for real-time interaction. The platform distinguishes itself through a comprehensive suite of data processing utilities that prepare raw messag
Evaluates chat record quality using inference models to automatically discard irrelevant data before training.