1 repository
Awesome GitHub RepositoriesLexical Tokenizers
Specialized lexers that break down SQL strings into tokens based on dialect-specific keywords and delimiters.
Distinct from Database Dialects: Distinct from Database Dialects as it focuses on the lexing phase of parsing rather than connectivity or drivers.
Explore 1 awesome GitHub repository matching data & databases · Lexical Tokenizers. Refine with filters or upvote what's useful.
Awesome Lexical Tokenizers GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- tobymao/sqlglot
tobymao/sqlglot
9,336Vezi pe GitHubsqlglot is a SQL parser and transpiler that represents queries as abstract syntax trees to enable structural analysis, modification, and semantic transformation. It functions as a dialect translator and query optimizer, converting SQL code between different database engines and simplifying syntax trees through rule-based normalization. The project provides a framework for defining custom SQL dialects by overriding tokenizers, parsers, and generators. It includes a lineage analyzer to track data flow from source tables through complex queries to identify the origin of specific columns. Additi
Implements specialized lexers to handle unique keywords and delimiters for various database engines.
Python
