1 repo
Deep learning architectures that process raw inputs into high-dimensional mathematical representations.
Distinguishing note: Specifically addresses the use of transformer-based backbones for multi-modal feature extraction.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Transformer Feature Extractors. Refine with filters or upvote what's useful.
CLIP is a neural network architecture designed to map visual and textual data into a shared latent vector space. By utilizing transformer-based feature extraction and multi-modal tokenization, the system aligns images and natural language strings, enabling cross-modal similarity analysis and semantic classification. The project functions as a zero-shot classification engine, identifying image content by calculating the cosine similarity between visual features and arbitrary text labels without requiring task-specific retraining. Beyond inference, it serves as a research toolkit for evaluating
Uses deep neural network layers to transform raw pixel data and tokenized text into high-dimensional mathematical representations.