1 repo
Awesome GitHub RepositoriesParameter Adaptation Techniques
Methods for fine-tuning models by injecting trainable matrices into frozen layers.
Distinguishing note: Specifically covers LoRA and similar low-rank adaptation methods.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Parameter Adaptation Techniques. Refine with filters or upvote what's useful.
Awesome Parameter Adaptation Techniques GitHub Repositories
Find the best repos with AI.We'll search the best matching repositories with AI.
- zai-org/ChatGLM-6B
zai-org/ChatGLM-6B
41,232View on GitHubChatGLM-6B is a generative AI inference engine designed for local execution of transformer-based language models. It provides a comprehensive runtime environment that allows users to load and run pre-trained neural network weights directly on their own hardware, ensuring data privacy and independence from external cloud services. The project distinguishes itself through a hardware-agnostic execution backend that supports deployment across diverse environments, including standard processors, Apple Silicon, and multi-GPU configurations. It incorporates advanced optimization techniques such as w
Injects low-rank adaptation matrices into frozen model layers to enable efficient fine-tuning with minimal overhead.
Python
