1 个仓库
Applies user-defined tokenizers and term processors to control text splitting and normalization during indexing and search.
Distinct from Tokenization Pipelines: Distinct from Tokenization Pipelines: allows user-provided tokenizers and term processors, not a fixed pipeline.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Customizable Pipelines. Refine with filters or upvote what's useful.
Accepts custom tokenizers and term processors for controlling text splitting and normalization during indexing and search.