6 dépôts
Methods for aggregating features from multiple images using a shared model backbone.
Distinct from Image Processing: Focuses on multi-image input aggregation for a single sample, not animation or sequential processing.
Explore 6 awesome GitHub repositories matching graphics & multimedia · Multi-Image Sample Processing. Refine with filters or upvote what's useful.
Spectacle is a React-based presentation framework that enables developers to author slide decks using JSX and MDX syntax. It provides a component-driven approach to building presentations, where slides are composed as React components with declarative layouts, theme-driven styling, and step-based animation sequencing. The framework distinguishes itself through its support for live coding demonstrations within slides, allowing presenters to execute and display code directly during a talk. It includes a presenter mode with dual-view architecture that shows speaker notes, a timer, and upcoming s
Ships a layout component for positioning multiple images on a single presentation slide.
AutoGluon is an automated machine learning framework and multimodal library designed to automate the end-to-end pipeline from data preprocessing to high-accuracy model training and validation. It functions as an automated model trainer for tabular, image, text, and time series data, as well as a tool for time series forecasting and foundation model finetuning. The project is distinguished by its ability to jointly process and fuse different data types, allowing for the construction of multimodal neural networks that integrate images, text, and structured tables. It supports zero-shot inferenc
Aggregates features from multiple image columns or paths using a single model backbone.
Accepts multiple images in a single turn for cross-image comparison and reasoning.
LLaVA-NeXT est un framework de modèle de langage multimodal et une boîte à outils d'entraînement conçus pour traiter des séquences entrelacées d'images et de vidéos afin de générer du texte. Il fonctionne comme un modèle de langage visuel qui combine des encodeurs de vision avec des modèles de langage pour effectuer des raisonnements complexes, répondre à des questions et comprendre la vidéo. Le système est capable d'analyser des images haute résolution et des trames vidéo temporelles pour décrire des événements, résumer des actions et raisonner à travers plusieurs entrées visuelles. Il prend en charge l'interprétation de documents et de graphiques, l'analyse de l'environnement spatial et la génération de légendes descriptives pour les images et les vidéos. Le framework inclut des outils pour ajuster les modèles multimodaux via l'optimisation des préférences afin de réduire les hallucinations et améliorer la précision. Il fournit également un serveur d'inférence pour déployer ces capacités en tant que service API via un backend HTTP.
Processes sequences of alternating text and visual tokens to enable complex reasoning across multiple images.
Imageflow is a high-performance image manipulation library and composition engine available as a C-compatible library, a command-line image processor, and a dynamic image processing server. It provides the means to decode, encode, and apply complex visual transformations to images through programmatic interfaces, JSON job files, or on-the-fly URL query strings. The system distinguishes itself through a graph-based processing pipeline that allows for single-pass multi-format encoding, generating multiple image sizes and formats from a single decode to reduce overhead. It further features a res
Generates several different image sizes and formats in a single job to minimize redundant decoding.
Otter is a framework and toolkit for the pretraining, fine-tuning, and evaluation of vision-language models. It provides a pipeline for training large language models to process high-resolution images and video frames, integrating visual encoders with textual token spaces. The system is designed for multi-visual input processing, allowing models to interpret multiple images or video sequences within a single prompt. It supports multi-round conversation management to maintain context across interactions for detailed scene comprehension and visual reasoning. The framework covers a full develop
Interprets multiple images or video frames within a single prompt to follow instructions spanning different visual contexts.