Open-source alternatives to PICa

Emu Series: Generative Multimodal Models from BAAI

An implementation for ACL 2023 paper Learning In-context Learning for Named Entity Recognition

Updates | Datasets | Models | Environment | Running | Results | Website | Paper

This is the github repository for the paper to be appeared at NAACL 2024 main conference: Self-Improving for Zero-Shot Named Entity Recognition with Large Language Models.

MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU

Zhao Zhang 3   Ziwei Liu &#x2709,1 1 S-Lab, Nanyang Technological University  2 Shanghai Jiao Tong University  3 SenseTime Research  4 Ningbo Institute of Digital Twin, Eastern Institute of Technology, Ningbo, China   Equal Contribution  † Project Lead …

Please save your dataset in data folder. Note that CoNLL2003 and WNUT2017 are open-source datasets, ACE2004 and ACE2005 are not free. We keep our CoNLL2003 and WNUT2017 train and test JSON files in data folder.

Code, data, and results described in the paper "Mining experimental data from materials science literature with large language models: an evaluation study", https://www.tandfonline.com/doi/full/10.1080/27660400.2024.2356506

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".

Code for ICCV 2023 Paper : “ICL-D3IE: In-Context Learning with Diverse Demonstrations Updating for Document Information Extraction”

This is the implementation of filter-then-rerank pipeline in Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples!. EMNLP'2023 (Findings).

JARVIS is a system for large language model task orchestration, deployment management, and automation benchmarking. It utilizes a task orchestrator to decompose complex requests into actionable steps and coordinates various expert models to synthesize final responses. The project includes an AI model deployment manager to handle the local deployment of expert models across different hardware scales. It further provides an AI workflow API consisting of web endpoints used to trigger automated task workflows and retrieve results from model selection stages. The framework incorporates an automat

Official repo for MM-REACT

Implementation of CVPR 2023 paper "Prompting Large Language Models with Answer Heuristics for Knowledge-based Visual Question Answering".

The original implementation of the paper. You can cite the paper as below.

Data and code for ACL 2023 Findings: Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation Extractors.

This repo contains code for the paper GPT-NER: Named Entity Recognition via Large LanguageModels. ``latex @article{wang2023gpt, title={GPT-NER: Named Entity Recognition via Large Language Models}, author={Wang, Shuhe and Sun, Xiaofei and Li, Xiaoya and Ouyang, Rongbin and Wu, Fei and Zhang,…

This is the code repo for the Med-Flamingo paper.

CHisIEC: An Information Extraction Corpus for Ancient Chinese History

This is the source code of the model RT (Retrieving and Thinking). For the full project, please check the file RTBC5CDR/3RT and RTNCBI/3RT, the implementation of GPT-NER and PromptNER is in the BC5CDR.zip and NCBI.zip. we refer to the source of code of GPT-NER and paper of GPT-NER in our project…

Code for PromptNER: Prompt Locating and Typing for Named Entity Recognition, accepted at ACL 2023.

Implementation and dataset for paper "Can MLLMs Perform Text-to-Image In-Context Learning?"

Official repo for paper Code4Struct: Code Generation for Few-Shot Structured Prediction from Natural Language.

Large Language Model Tagging for Named Entity Recognition with Contextualized Entity Marking

NeurIPS2023 Exploring Diverse In-Context Configurations for Image Captioning