1 रिपॉजिटरी
Awesome GitHub RepositoriesAPI-Based Splitting
Offloading text segmentation to specialized external APIs for domain-specific structural requirements.
Distinct from Recursive Text Splitting: Distinct from Recursive Text Splitting: relies on external specialized services for domain-specific boundaries rather than internal recursive logic.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · API-Based Splitting. Refine with filters or upvote what's useful.
Awesome API-Based Splitting GitHub Repositories
AI के साथ बेहतरीन रिपॉजिटरी खोजें।हम AI का उपयोग करके सबसे सटीक रिपॉजिटरी खोजेंगे।
- chonkie-inc/chonkie
chonkie-inc/chonkie
4,170GitHub पर देखेंChonkie is a text chunking library designed for retrieval-augmented generation pipelines. It functions as a semantic text splitter and RAG ingestion pipeline, transforming raw text into embedded segments for storage in vector databases. The project distinguishes itself through specialized splitting strategies, including an AST-based code splitter for preserving logical boundaries in source code and a semantic text splitter that uses embedding models to determine boundaries based on meaning. It also provides a vector database ingestor to automate the generation of embeddings and their export t
Segments text using specialized external APIs for domain-specific requirements such as legal documents.
Pythonaichonkiechunker
