Open-source alternatives to RLAIF V

ICLR'24 Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning

This repository is the official implementation of paper Look, Compare, Decide: Alleviating Hallucination in Large Vision-Language Models via Multi-View Multi-Path Reasoning.

Project Page | Paper

Paper: PAINT: PAYING ATTENTION TO INFORMED TOKENS TO MITIGATE HALLUCINATION IN LARGE VISION-LANGUAGE MODEL

Diagram of Self-Introspective Decoding.

ACL 2024 Logical Closed Loop: Uncovering Object Hallucinations in Large Vision-Language Models. Detect and mitigate object hallucinations in LVLMs by itself through logical closed loops.

This repo contains the code for the paper: Mitigating Hallucinations in Large Vision-Language Models by Adaptively Constraining Information Flow. AAAI 2025

Authors: Jinhao Duan, Fei Kong, Hao Cheng, James Diffenderfer, Bhavya Kailkhura, Lichao Sun, Xiaofeng Zhu, Xiaoshuang Shi, Kaidi Xu (equal contribution) - paper

This repository contains the code for "Mitigating Hallucinations in Multimodal Spatial Relations through Constraint-Aware Prompting," NAACL Findings 2025. You can access the paper here

\NAACL 2024\ This is the official github for "Volcano: Mitigating Multimodal Hallucination through Self-Feedback Guided Revision". Volcano employs a single LMM to generate initial responses, feedback, and revisions, as well as decisions to accept revisions. It follows a sequential procedure of…

Poison as Cure: Visual Noise for Mitigating Object Hallucinations in LVMs What doesn't kill me makes me stronger!

CVPR 2025 Mitigating Object Hallucinations in Large Vision-Language Models with Assembly of Global and Local Attention

ECCV 2024 Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs

Following the VCD, use `bash conda create -yn imccd python=3.9 conda activate imccd cd IMCCD pip install -r requirements.txt `

This repository contains the official pytorch implementation of the CVPR2025 paper: "Octopus: Alleviating Hallucination via Dynamic Contrastive Decoding".

Aligning LMMs with Factually Augmented RLHF

This is the official implementation of the paper "The Hidden Life of Tokens: Reducing Hallucination of Large Vision-Language Models via Visual Information Steering".

TODO

ICLR '25 Official Pytorch implementation of "Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations"

AAAI 2024: Visual Instruction Generation and Correction

Shangpin Peng\ 1 ,  Senqiao Yang\ 2 ,  Li Jiang 3 ,  Zhuotao Tian 1 ✉️

This repository contains the official pytorch implementation of the paper: "Don't Miss the Forest for the Trees: Attentional Vision Calibration for Large Vision Language Models".

This repository contains the official pytorch implementation of the paper: "RITUAL: Random Image Transformations as a Universal Anti-hallucination Lever in Large Vision Language Models".