1 repo
Awesome GitHub RepositoriesKnowledge Distillation Tools
Utilities for transferring domain-specific knowledge or writing styles from large models to smaller ones or specific datasets.
Distinguishing note: Focuses on the transfer of domain knowledge and style rather than generic model training.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Knowledge Distillation Tools. Refine with filters or upvote what's useful.
Awesome Knowledge Distillation Tools GitHub Repositories
Find the best repos with AI.We'll search the best matching repositories with AI.
- datawhalechina/self-llm
datawhalechina/self-llm
28,285View on GitHubThis project is an open-source educational resource providing structured, step-by-step guides for fine-tuning large language models. It focuses on adapting pre-trained transformer-based causal models to custom datasets, enabling users to transfer specific writing styles or domain knowledge into generative AI models. The repository distinguishes itself by emphasizing parameter-efficient training techniques, specifically low-rank adaptation. By providing practical implementations for updating only a small subset of model weights, it allows for the customization of massive neural networks on con
Teaching a general-purpose language model to adopt a specific writing style or domain knowledge from a provided text corpus.
Jupyter Notebookchatglmchatglm3gemma-2b-it
