Back to cmmmu-benchmark/cmmmu
Projects sharing features with CMMMU
30 open-source projects similar to cmmmu-benchmark/cmmmu, ranked by shared indexed features. Tags may describe platforms or build tools rather than the same primary purpose. Check each project’s use case, license, and deployment requirements before treating it as a replacement.
- open-compass/vlmevalkit
open-compass/VLMEvalKit
3,824View on GitHubVLMEvalKit is a vision-language model evaluation framework and inference engine designed to run standardized benchmarks and measure model accuracy across diverse visual datasets. It serves as a multimodal model benchmark and performance toolkit for calculating metrics and comparing model responses. The toolkit includes a specialized visual reasoning evaluator that uses adversarial samples to distinguish actual image understanding from reliance on language patterns. It also provides capabilities for image generation evaluation, testing a model's ability to create or modify visuals based on tex
Pythonchatgptclaudeclip - alenai97/miceval
alenai97/MiCEval
An automatic evaluation framework for Multimodal Chain-of-Thought.
Python - bradyfu/video-mme
BradyFU/Video-MME
✨✨CVPR 2025 Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis
- bytedance/lynx-llm
bytedance/lynx-llm
paper: https://arxiv.org/abs/2307.02469 page: https://lynx-llm.github.io/
Pythonresearch - damo-nlp-sg/m3exam
DAMO-NLP-SG/M3Exam
Data and code for paper "M3Exam: A Multilingual, Multimodal, Multilevel Benchmark for Examining Large Language Models"
Pythonai-educationchatgptevaluation
