# a-ghorbani/pocketpal-ai

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/a-ghorbani-pocketpal-ai).**

5,719 stars · 555 forks · TypeScript · mit

## Links

- GitHub: https://github.com/a-ghorbani/pocketpal-ai
- awesome-repositories: https://awesome-repositories.com/repository/a-ghorbani-pocketpal-ai.md

## Description

PocketPal AI is an on-device LLM chat application for Android that runs small language models locally, enabling private AI conversations without requiring an internet connection. It functions as an offline inference engine that downloads and executes quantized language models directly on the device, with adjustable parameters like temperature and chat templates to control how the AI behaves.

The application lets users create custom AI personalities by configuring unique system prompts and contextual settings for different conversational roles. It integrates with the Hugging Face Hub to download and load both public and gated models, supporting authentication tokens for models that require special permissions. Users can download, load, and switch between multiple small language models from a built-in list or external hub, and benchmark model performance by measuring tokens per second and memory usage on the device.

## Tags

### Artificial Intelligence & ML

- [Offline Chat Clients](https://awesome-repositories.com/f/artificial-intelligence-ml/ai-chat-clients/offline-chat-clients.md) — Runs small language models directly on the device for private conversations without needing an internet connection. ([source](https://cdn.jsdelivr.net/gh/a-ghorbani/pocketpal-ai@main/README.md))
- [Custom AI Assistant Development](https://awesome-repositories.com/f/artificial-intelligence-ml/custom-ai-assistant-development.md) — Building personalized AI personalities with custom system prompts and settings for different conversational roles.
- [Inference Parameters](https://awesome-repositories.com/f/artificial-intelligence-ml/inference-parameters.md) — Adjusts model parameters like system prompt, temperature, and chat templates to control how the AI behaves. ([source](https://cdn.jsdelivr.net/gh/a-ghorbani/pocketpal-ai@main/README.md))
- [Local Chat Applications](https://awesome-repositories.com/f/artificial-intelligence-ml/local-chat-applications.md) — An Android application that runs small language models locally for private AI conversations without internet connectivity.
- [Inference Configuration Parameters](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-inference-serving/model-integration-pipelines/model-inference/inference-configuration-parameters.md) — Adjusts model behavior through configurable parameters like system prompt, temperature, and chat templates.
- [On-Device Inference Engines](https://awesome-repositories.com/f/artificial-intelligence-ml/on-device-inference-engines.md) — Runs quantized language models on-device with adjustable temperature and chat template parameters.
- [On-Device Models](https://awesome-repositories.com/f/artificial-intelligence-ml/on-device-models.md) — Runs small language models directly on the device using local inference without requiring an internet connection.
- [Personal AI Assistants](https://awesome-repositories.com/f/artificial-intelligence-ml/personal-ai-assistants.md) — Builds custom AI personalities by setting unique system prompts and contextual settings for different conversation roles. ([source](https://cdn.jsdelivr.net/gh/a-ghorbani/pocketpal-ai@main/README.md))
- [Model Performance Benchmarking](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-evaluation-analysis/model-analysis/model-performance-benchmarking.md) — Measures tokens-per-second and memory usage of loaded models to compare local AI performance.
- [Runtime Model Swapping](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-training-and-tuning/data-and-checkpointing/model-loading/runtime-model-swapping.md) — Supports downloading, loading, and switching between multiple small language models from a built-in list or external hub.
- [Model Downloaders](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-training-and-tuning/data-and-checkpointing/model-loading/runtime-model-swapping/model-downloaders.md) — Downloads, loads, and switches between multiple small language models from a built-in list or the Hugging Face Hub. ([source](https://cdn.jsdelivr.net/gh/a-ghorbani/pocketpal-ai@main/README.md))

### Part of an Awesome List

- [Model Downloaders](https://awesome-repositories.com/f/awesome-lists/ai/hugging-face-ecosystem/model-downloaders.md) — Downloads and loads models from the Hugging Face Hub, including gated models requiring authentication tokens.

### Security & Cryptography

- [Hugging Face Authenticators](https://awesome-repositories.com/f/security-cryptography/token-authentication/hugging-face-authenticators.md) — Authenticates with a Hugging Face token to download and run models that require special permissions. ([source](https://cdn.jsdelivr.net/gh/a-ghorbani/pocketpal-ai@main/README.md))