Projects sharing features with ChatIE

This project is a collection of scripts and workflows for training, fine-tuning, and deploying large language models using the Hugging Face Transformers toolkit. It functions as a distributed training framework, a library for natural language processing task implementations, and a system for building retrieval-augmented generation chatbots. The repository includes specialized tools for model optimization, such as a Bayesian hyperparameter optimizer for automatically tuning model settings. It provides implementations for scaling model training across multiple graphics processors using data par

Reor is a local AI knowledge management application that stores, links, and searches personal notes using large language models and vector embeddings entirely on the user's device. It functions as a private AI note assistant, keeping all data and processing local for full privacy without relying on external cloud services. The application integrates with Ollama to manage the lifecycle of local LLMs and embedding models, handling downloads, updates, and execution. Notes are imported from markdown files, preserving existing file structure, and are automatically linked through vector-similarity

MindSearch is an LLM-based multi-agent search engine that decomposes complex user questions into targeted sub-queries and routes each to a specialized agent for parallel investigation. The system orchestrates multiple agents through a large language model, coordinating their tasks and interpreting search results to produce coherent answers from multiple sources. The project provides a configurable search backend interface that allows switching between Google, DuckDuckGo, Brave, and Bing search APIs by updating a configuration attribute. It includes a terminal-based debug interface for testing

BioGPT is a biomedical large language model and domain-specific transformer designed for processing and creating specialized medical text. It functions as a generative tool and knowledge extraction engine trained on large-scale scientific literature to produce human-like scientific prose and factual responses to queries. The project provides specialized capabilities for biomedical named entity recognition and the extraction of complex relations from unstructured medical corpora. It is designed to identify and classify biological entities through data mining and relation extraction to support

The Hugging Face Hub Python client is a library that provides programmatic access to the Hugging Face Hub, a centralized platform for hosting and collaborating on machine learning models, datasets, and demo applications. It serves as the primary SDK for interacting with the Hub's API, enabling users to download and upload models and datasets, manage repositories, authenticate via tokens or OAuth, and run inference on hosted models through a unified interface. The client distinguishes itself through a comprehensive set of capabilities that go beyond basic file transfer. It includes a CLI exten

This project provides a framework for executing large language models and performing document-based question answering entirely on local consumer hardware. By integrating a CPU-based inference engine with a local vector database, it enables users to process information without relying on cloud-based APIs or specialized graphics processing units. The system functions as a command-line tool that manages the full lifecycle of private information processing. It transforms local text files into searchable vector embeddings, allowing the model to retrieve relevant context and ground its generated r

DeepPavlov is a conversational AI framework and deep learning NLP library designed for building end-to-end dialogue systems and chatbots. It functions as an NLP pipeline orchestrator that allows users to compose pre-trained models and text processing components into sequential data flows for complex linguistic tasks. The system is distinguished by its ability to act as a chatbot deployment server, exposing trained conversational models as web services via REST and Socket APIs. It utilizes JSON-based pipeline configurations and dynamic variable interpolation to decouple model logic from infras

This project is a comprehensive educational curriculum and structured learning path covering the full lifecycle of large language models. It provides a guided progression through the theory, architecture, training, and deployment of these models. The curriculum includes specialized guides on transformer architecture, model training tutorials, and frameworks for designing autonomous agents. It also provides dedicated resources for studying model safety and ethics. The material covers a wide range of technical capabilities, including distributed training strategies, parameter-efficient fine-tu

Tools for using Maluuba's news questions and answer data. The code in the repo is used to compile the dataset since it cannot be made directly available due to legal reasons.

This is the codebase of the paper: ERA-CoT: Improving Chain-of-Thought through Entity Relationship Analysis.

The source code of paper DILUIE: Constructing Diverse Demonstrations of In-context Learning with Large Language Model for Unified Information Extraction

https://aclanthology.org/2023.emnlp-main.745.pdf

-->

Source code repo for paper DeepStruct: Pretraining of Language Models for Structure Prediction, ACL 2022.

Official repo for paper Code4Struct: Code Generation for Few-Shot Structured Prediction from Natural Language.

This is the code for ACL2021 paper A Unified Generative Framework for Aspect-Based Sentiment Analysis

Code for "Leveraging ChatGPT in Pharmacovigilance Event Extraction: An Empirical Study" (EACL 2024).

Code, data, and results described in the paper "Mining experimental data from materials science literature with large language models: an evaluation study", https://www.tandfonline.com/doi/full/10.1080/27660400.2024.2356506

This repo contains code for our paper Simple and Effective Multi-Paragraph Reading Comprehension. It can be used to train neural question answering models in tensorflow, and in particular for the case when we want to run the model over multiple paragraphs for each question. Code is included to…

Code for the paper "Structured Prediction as Translation between Augmented Natural Languages" (ICLR 2021) and fine-tuned multi-task model.

This is the official repository for "CodeIE: Large Code Generation Models are Better Few-Shot Information Extractors" (ACL 2023).

This repo releases our implementation for the InstructUIE model. - It is built based on the pretrained Flan T5 model, and finetuned on our data (IE INSTRUCTIONS). - If you are looking for NER datasets or models, you may also refer to our recent work: B2NER. It provides a standardized and…