1 Repo
Numerical representations of source code using specialized vocabularies tailored for programming syntax.
Distinct from Source Code Tokenizers: Focuses on the numerical embedding/encoding for LLMs rather than the lexical analysis of a compiler tokenizer.
Explore 1 awesome GitHub repository matching programming languages & runtimes · Code Vocabulary Encodings. Refine with filters or upvote what's useful.
CodeGen is a trained large language model and program synthesis model designed to generate functional source code. It utilizes a neural network architecture to synthesize executable code from natural language descriptions or partial code snippets. The model enables automated program synthesis and AI-assisted coding by predicting and filling in missing sections of code within a program. It transforms natural language descriptions into functional programming logic to automate the creation of boilerplate and logic.
Converts source code into numerical representations using a specialized vocabulary optimized for programming language syntax.