This repository is a deep learning for natural language processing course and curriculum. It provides educational material and guides focused on neural network architectures used for processing natural language, speech signals, and text classification. The content includes instructional tutorials on sequence modeling and neural language modeling, covering the implementation of n-gram and recurrent neural networks. It also provides a framework for studying word embeddings to map linguistic meanings into numerical representations. The curriculum covers a broad range of capabilities, including
An Open-source Toolkit for LLM Development
This project is a framework for managing generative AI services through a unified provider interface and adapter layer. It provides a standardized API for calling multiple cloud-based and locally hosted models, translating provider-specific parameters and responses into a uniform format. The system includes an agent orchestrator designed for long-running tasks, featuring state persistence for resuming runs and execution tracing to monitor decision-making processes. It integrates the Model Context Protocol to connect models to external servers and filesystems and employs a policy-based executi
Olmocr is a distributed document processing framework designed to convert PDF and image files into structured markdown. It functions as a vision-based document parser that utilizes multimodal neural networks to interpret complex visual layouts and translate them into standardized text representations. The system operates as a remote inference orchestrator, offloading heavy document analysis tasks to external servers or cloud APIs to minimize local computational requirements. By employing a stateless worker architecture, it decouples document ingestion from inference, allowing for the distribu
CodeTF: One-stop Transformer Library for State-of-the-art Code LLM
The main features of salesforce/codetf are: Language Model Development, Model Utilities.
Open-source alternatives to salesforce/codetf include: oxford-cs-deepnlp-2017/lectures — This repository is a deep learning for natural language processing course and curriculum. It provides educational… alpha-vllm/llama2-accessory — An Open-source Toolkit for LLM Development. andrewyng/aisuite — This project is a framework for managing generative AI services through a unified provider interface and adapter… arcee-ai/mergekit — MergeKit is a toolkit for combining multiple pre-trained large language models into a single entity using algorithmic… dagworks-inc/burr — Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute… allenai/olmocr — Olmocr is a distributed document processing framework designed to convert PDF and image files into structured…