awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
ekzhu avatar

ekzhu/datasketch

0
View on GitHub↗
ekzhu.github.io/datasketch↗

Datasketch

MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++, LSH Ensemble and HNSW

Features

  • NLP - Probabilistic data structures for large-scale data.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI
  • Data Containers - Probabilistic data structures for large-scale data estimation.
  • Data Processing - Probabilistic data structures for fast large-scale data searching.
  • Data Processing Tools - Probabilistic structures for fast, large-scale data deduplication.
  • 2,932 stars·316 forks·Python·MIT·20 views

    Star history

    Star history chart for ekzhu/datasketchStar history chart for ekzhu/datasketch

    How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

    Frequently asked questions

    What does ekzhu/datasketch do?

    MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++, LSH Ensemble and HNSW

    What are the main features of ekzhu/datasketch?

    The main features of ekzhu/datasketch are: NLP, Data Containers, Data Processing, Data Processing Tools.

    Which projects share features with ekzhu/datasketch?

    Projects with overlapping indexed features include: jpmens/jo — Jo is a command-line utility designed to construct and manipulate JSON objects and arrays directly from shell… catchthetornado/pdf-extract-api — Document (PDF, Word, PPTX ...) extraction and parse API using state of the art modern OCRs + Ollama supported models.… 599yongyang/datasetloom — 一个面向多模态大模型训练的智能数据集构建与评估平台. allenai/olmocr — Olmocr is a distributed document processing framework designed to convert PDF and image files into structured… bytedance/dolphin — Dolphin is a multimodal layout analyzer and image-to-structure converter that transforms photographed or digital… argilla-io/distilabel — Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable…

    Projects sharing features with Datasketch

    These projects share indexed features with Datasketch. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
    • jpmens/jojpmens avatar

      jpmens/jo

      4,867View on GitHub↗

      Jo is a command-line utility designed to construct and manipulate JSON objects and arrays directly from shell arguments and standard input. It functions as a data processing tool that transforms raw input into structured formats, enabling the generation of complex payloads for APIs, configuration files, and automated data pipelines. The tool distinguishes itself through its ability to resolve hierarchical data structures using delimiter-based path definitions and its integrated type-inference engine, which automatically casts input values into native boolean, numeric, or null types. Users can

      C
      View on GitHub↗4,867
    • argilla-io/distilabelargilla-io avatar

      argilla-io/distilabel

      3,277View on GitHub↗

      Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

      Python
      View on GitHub↗3,277
    • 599yongyang/datasetloom599yongyang avatar

      599yongyang/DatasetLoom

      298View on GitHub↗

      一个面向多模态大模型训练的智能数据集构建与评估平台

      TypeScript
      View on GitHub↗298
    • allenai/olmocrallenai avatar

      allenai/olmocr

      17,396View on GitHub↗

      Olmocr is a distributed document processing framework designed to convert PDF and image files into structured markdown. It functions as a vision-based document parser that utilizes multimodal neural networks to interpret complex visual layouts and translate them into standardized text representations. The system operates as a remote inference orchestrator, offloading heavy document analysis tasks to external servers or cloud APIs to minimize local computational requirements. By employing a stateless worker architecture, it decouples document ingestion from inference, allowing for the distribu

      Python
      View on GitHub↗17,396
    Compare all 30 related projects→