1 repository
Awesome GitHub RepositoriesTokenization Testing
Utilities to evaluate how text analyzers break down raw text into tokens before indexing.
Distinct from Tokenization Pipelines: Focuses on testing the analyzer's output for correctness, while the parent refers to the operational pipelines themselves.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Tokenization Testing. Refine with filters or upvote what's useful.
Awesome Tokenization Testing GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- zombodb/zombodb
zombodb/zombodb
4,730Vezi pe GitHubZombodb is a database extension and relational data indexer that integrates PostgreSQL with Elasticsearch. It provides a SQL search interface, allowing users to execute complex search queries and aggregations using standard SQL functions and syntax instead of native JSON APIs. The project synchronizes relational data from PostgreSQL to a remote search engine to enable high-performance full-text search and analytics. The system distinguishes itself by bridging relational structures with search engine capabilities, specifically through geospatial search integration for geometry and geography ty
Evaluates how custom analysis pipelines and tokenizers process text before it is applied to a search index.
PLpgSQL
