awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
cyclotruc avatar

cyclotruc/gitingest

0
View on GitHub↗
14,970 stars·1,117 forks·Python·MIT·14 viewsgitingest.com↗

Gitingest

Gitingest is a tool for extracting, converting, and estimating the token size of codebases to facilitate ingestion by large language models. It transforms GitHub repositories and local directories into a single formatted text file that serves as a structured context window for model analysis.

The utility includes a codebase token estimator to calculate file structure and total token counts, helping to determine the scale of the extracted content. It supports both public and private repositories through token-based authentication and respects gitignore configurations to filter out irrelevant paths and assets.

The system provides capabilities for repository-to-text conversion, local directory ingestion, and codebase statistics analysis. It can export the resulting digests to text files or standard output streams.

Features

  • Git Repository to Text Conversion - Transforms a complete codebase into a single formatted text file designed for LLM context windows.
  • LLM Context Preparation - Converts repository data into a formatted text structure specifically prepared as context for LLM prompts.
  • Code Repository to LLM-Ready Text Transformers - Converts GitHub repositories and local directories into structured, LLM-optimized text formats.
  • Source Code Ingestors - Converts local folders of source code into a structured text format for machine processing or sharing.
  • Codebase Text Serializers - Concatenates entire codebase contents into a single formatted text block optimized for LLM context windows.
  • Repository Text Exporters - Transforms remote GitHub repositories into prompt-friendly text files while respecting access permissions and ignore rules.
  • Size and Gitignore Filtering - Implements filtering based on .gitignore rules and file size to optimize codebase ingestion for LLMs.
  • Repository Content Extractors - Fetches and aggregates repository files while filtering out gitignored content and private data.
  • Unified Repository Ingestors - Handles both local filesystem directories and remote repository URLs through a unified ingestion interface.
  • Heuristic Token Estimators - Calculates approximate token counts using rule-based heuristics to estimate model context usage.
  • Codebase Analysis Tools - Extracts source files and directory structures to analyze project layout and calculate total token size.
  • Codebase Size and Token Count Reporters - Computes and reports the file structure, total extraction size, and estimated token count of a codebase.
  • Codebase Size and Token Count Reporters - Analyzes codebase scale by calculating file structure, extraction size, and estimated token counts.
  • Private Repository Access - Provides secure authentication to retrieve content from private version control repositories using tokens.
  • Token-Based Authentication - Uses personal access tokens to securely authenticate and request data from private version control repositories.
  • Web Scraping and Crawling - Converts Git repositories into text for LLM analysis.

Star history

Star history chart for cyclotruc/gitingestStar history chart for cyclotruc/gitingest

How this analysis was created: This summary and feature list were written by an AI model that read the project's README and public documentation pages. Each feature links to the documentation it came from; stars, license and language come straight from the GitHub API. The model does not read the source code, and the analysis is refreshed when the project is re-analysed. Learn more on our About page.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Open-source alternatives to Gitingest

Similar open-source projects, ranked by how many features they share with Gitingest.
  • mufeedvh/code2promptmufeedvh avatar

    mufeedvh/code2prompt

    7,145View on GitHub↗

    code2prompt is a codebase-to-prompt converter and LLM context generator that transforms source code and directory structures into formatted text blocks for large language models. It functions as both a utility for generating prompts and an AI agent context server that exposes codebase files and metadata to coding assistants via a standardized server protocol. The tool distinguishes itself through git-aware capabilities, integrating commit messages and branch diffs to provide version control context for AI-generated code changes. It also utilizes the Model Context Protocol to allow external AI

    Rustaichatgptclaude
    View on GitHub↗7,145
  • mendableai/firecrawlmendableai avatar

    mendableai/firecrawl

    139,399View on GitHub↗

    Firecrawl is a headless browser automation tool and web crawling engine designed to extract structured data from the web. It functions as an API that transforms raw website content and documents into clean markdown and JSON formats to serve as context for large language models. The project distinguishes itself by using natural language prompts to translate human instructions into targeted data extraction tasks and browser actions. It can execute interactive page navigation, such as clicking and scrolling, and perform automated web research to retrieve structured data without manual interventi

    TypeScript
    View on GitHub↗139,399
  • ovity/octotreeovity avatar

    ovity/octotree

    23,206View on GitHub↗

    Octotree is a source code browsing tool for GitHub that provides a navigable file tree sidebar for exploring repository folder structures without downloading files locally. It enables the navigation of directory hierarchies and the location of specific files through text-based search queries. The tool includes specialized workflows for reviewing pull requests by filtering the visible file tree to show only modified files. It also supports access to private repositories through the use of personal access tokens and multi-account management. The interface features customizable sidebar behavior

    JavaScriptbrowser-extensionchromecode-files
    View on GitHub↗23,206
  • hackjutsu/leptonhackjutsu avatar

    hackjutsu/Lepton

    10,335View on GitHub↗

    Lepton is a cross-platform snippet manager and cloud-synced code library designed to organize and synchronize reusable code fragments and text snippets across different operating systems. It functions as a developer productivity tool and a markdown-enabled code editor for managing technical documentation. The application supports synchronization via remote backends and private enterprise server instances, including GitHub Enterprise integration. It utilizes token-based authentication to secure private code repository syncing and ensures connectivity in restricted corporate environments throug

    JavaScriptdesktop-clientelectronelectron-app
    View on GitHub↗10,335
See all 30 alternatives to Gitingest→

Frequently asked questions

What does cyclotruc/gitingest do?

Gitingest is a tool for extracting, converting, and estimating the token size of codebases to facilitate ingestion by large language models. It transforms GitHub repositories and local directories into a single formatted text file that serves as a structured context window for model analysis.

What are the main features of cyclotruc/gitingest?

The main features of cyclotruc/gitingest are: Git Repository to Text Conversion, LLM Context Preparation, Code Repository to LLM-Ready Text Transformers, Source Code Ingestors, Codebase Text Serializers, Repository Text Exporters, Size and Gitignore Filtering, Repository Content Extractors.

What are some open-source alternatives to cyclotruc/gitingest?

Open-source alternatives to cyclotruc/gitingest include: mufeedvh/code2prompt — code2prompt is a codebase-to-prompt converter and LLM context generator that transforms source code and directory… mendableai/firecrawl — Firecrawl is a headless browser automation tool and web crawling engine designed to extract structured data from the… ovity/octotree — Octotree is a source code browsing tool for GitHub that provides a navigable file tree sidebar for exploring… hackjutsu/lepton — Lepton is a cross-platform snippet manager and cloud-synced code library designed to organize and synchronize reusable… techgaun/github-dorks — This project is a GitHub secret scanner and dorking tool designed to identify leaked credentials and private keys… coderamp-labs/gitingest — Gitingest is a Git repository analysis and conversion service that transforms code repositories into structured…