awesome-repositories.com
Blog
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectAboutHow we rankPressMCP server
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·
dqbd avatar

dqbd/tiktokenizer

0
View on GitHub↗
1,620 stars·177 forks·TypeScript·MIT·1 viewtiktokenizer.vercel.app↗

Tiktokenizer

Features

  • Development Frameworks - Utility for calculating token counts for prompts.

Star history

Star history chart for dqbd/tiktokenizerStar history chart for dqbd/tiktokenizer

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Open-source alternatives to Tiktokenizer

Similar open-source projects, ranked by how many features they share with Tiktokenizer.
  • bentoml/bentomlbentoml avatar

    bentoml/BentoML

    8,456View on GitHub↗

    BentoML is a machine learning model serving framework and GPU-accelerated inference server designed to package, deploy, and scale AI models as production-ready REST APIs. It functions as an AI model lifecycle manager and an inference graph orchestrator, enabling the chaining of multiple models and custom logic into complex pipelines for advanced task sequences. The framework distinguishes itself through a dynamic batching engine that optimizes GPU throughput and an artifact-based packaging system that bundles model weights and dependencies into immutable archives for consistent deployment. It

    Pythonai-inferencedeep-learninggenerative-ai
    View on GitHub↗8,456
  • berriai/litellmBerriAI avatar

    BerriAI/litellm

    50,579View on GitHub↗

    LiteLLM is a unified gateway and proxy server designed to centralize access to over one hundred language model providers. It provides a standardized API interface that abstracts vendor-specific schemas, allowing developers to interact with diverse models through a single, consistent format. By acting as a central traffic management layer, it enables organizations to route, secure, and govern model interactions across multiple deployments. The platform distinguishes itself through its policy-driven architecture, which uses configuration-based routing to manage traffic distribution, load balanc

    Pythonai-gatewayanthropicazure-openai
    View on GitHub↗50,579
  • egoist/openai-proxyE

    egoist/openai-proxy

    0View on GitHub↗
    View on GitHub↗0
  • arc53/docsgptarc53 avatar

    arc53/DocsGPT

    17,939View on GitHub↗

    DocsGPT is a retrieval-augmented generation platform and private knowledge base used to build AI agents that perform grounded search and analysis. It functions as a multi-model AI orchestrator and enterprise agent builder, allowing for the integration of various local and cloud language models to customize reasoning and text generation. The project provides a visual environment for developing automated assistants using conditional logic and third-party API connectivity. It enables the creation of private AI agents capable of performing enterprise search and detailed document analysis using pr

    Pythonagent-builderagentsai
    View on GitHub↗17,939
See all 14 alternatives to Tiktokenizer→

Frequently asked questions

What are the main features of dqbd/tiktokenizer?

The main features of dqbd/tiktokenizer are: Development Frameworks.

What are some open-source alternatives to dqbd/tiktokenizer?

Open-source alternatives to dqbd/tiktokenizer include: bentoml/bentoml — BentoML is a machine learning model serving framework and GPU-accelerated inference server designed to package,… berriai/litellm — LiteLLM is a unified gateway and proxy server designed to centralize access to over one hundred language model… egoist/openai-proxy. embedchain/embedchain — Embedchain is an LLM memory management framework and RAG orchestration engine designed to provide AI agents with a… hunkim/es-gpt. arc53/docsgpt — DocsGPT is a retrieval-augmented generation platform and private knowledge base used to build AI agents that perform…