b4rtaz/distributed-llama

Features

• Inference Engines - Cluster-based inference acceleration using multiple home devices.
• LLM Development Utilities - Cluster-based acceleration for local LLM inference.