How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
whichllm is a command-line tool that detects a machine's GPU, memory, and memory bandwidth, then recommends open large language models that will actually run on it. Candidates are ordered by benchmark quality and estimated generation speed rather than parameter count, so the list reflects what the hardware can handle.
The main features of andyyyy64/whichllm are: GPU Engine Recommenders, Generation Speed Estimators, Recency-Weighted Benchmark Merging, Memory Fit Checks, LLM Benchmarking, Local Model Launchers, Local LLM Installers, Expert Offloading to System Memory.
Projects with overlapping indexed features include: snowkylin/tensorflow-handbook — This project is a comprehensive educational resource and tutorial handbook for building, training, and deploying… open-jarvis/openjarvis — OpenJarvis is a local-first personal AI assistant and agent framework. It runs language models on a user's own laptop,… internlm/opencompass — OpenCompass is a comprehensive evaluation platform, benchmarking suite, and distributed model evaluator designed to… fchollet/arc-agi — This project is a standardized set of abstraction and reasoning problems designed for benchmarking the ability of… open-compass/opencompass — OpenCompass is an open-source framework for standardized benchmarking of large language models. It provides a… zjunlp/easyedit — EasyEdit is a framework and toolkit designed for updating, inserting, or erasing specific factual information within…
This project is a comprehensive educational resource and tutorial handbook for building, training, and deploying machine learning models using TensorFlow 2. It serves as a structured learning guide covering core deep learning concepts, including neural network architectures, automatic differentiation, and tensor operations. The handbook provides technical guidance on optimizing execution efficiency through GPU memory management, distributed training, and model quantization. It also includes detailed manuals for constructing high-performance data pipelines and exporting models for production s
OpenJarvis is a local-first personal AI assistant and agent framework. It runs language models on a user's own laptop, workstation, or server, keeps agent memory and state on the device, and treats cloud services as optional extras. Agents reason over multiple steps, call tools, search documents, and can run on demand, on a cron schedule, or continuously in the background. Core functionality stays available offline. A unified inference layer connects local runtimes and optional cloud providers behind one interface. It detects the installed GPU vendor, model, and memory, then recommends a suit
This project is a standardized set of abstraction and reasoning problems designed for benchmarking the ability of artificial intelligence models to learn new rules. It functions as a fluid intelligence test and a reasoning benchmark, utilizing a collection of grid-based puzzles and a program synthesis dataset to evaluate how agents generate algorithms from examples. The project focuses on measuring general fluid intelligence and the capacity for zero-shot generalization, testing whether a system can apply learned logic to unseen problems without relying on task-specific training. It provides
OpenCompass is a comprehensive evaluation platform, benchmarking suite, and distributed model evaluator designed to measure the performance and accuracy of large language models. It provides a framework for benchmarking both open-source and API-based models against diverse datasets using standardized metrics and reproducible pipelines. The project features an automated judging framework that uses language models as judges to score and verify the quality of generated text. It includes a performance leaderboard system for comparing the relative capabilities of various models across industry-sta