10 repositorios
Functions for aggregating collection values into single results.
Distinguishing note: Focuses on folding or reducing operations rather than simple mapping.
Explore 10 awesome GitHub repositories matching data & databases · Data Reducers. Refine with filters or upvote what's useful.
This project is a command-line processor designed for the parsing, filtering, and transformation of structured data streams. It functions as a declarative programming environment that treats data as immutable streams, allowing users to perform complex structural modifications through the composition of small, reusable functions. By utilizing a recursive tree traversal engine, the system enables the navigation, inspection, and modification of deeply nested hierarchical data structures. The engine distinguishes itself through a stream-oriented architecture that processes input records one by on
Aggregates multiple values into a single result by iteratively applying an update expression to an initial value across a collection.
This library provides a comprehensive collection of modular building blocks and research-backed architectures for implementing vision transformers within the PyTorch framework. It serves as a centralized repository for constructing, training, and analyzing attention-based models, offering a wide array of specialized variants designed for image classification and visual representation learning. The project distinguishes itself through a focus on architectural efficiency and flexibility, supporting diverse input formats including non-square images and volumetric data like video. It incorporates
Compresses transformer token sequences using patch merging to improve computational efficiency.
This project is an educational platform and tutorial series designed to teach the Go programming language through the practice of test-driven development. It provides a structured path for developers to master language fundamentals, concurrency, and standard library usage by building functional applications in small, verifiable increments. The core methodology centers on the test-driven development cycle, where failing tests are written before implementation to define requirements and ensure code correctness. This approach is applied across a wide range of practical scenarios, including the c
Aggregates collection elements into single values using combining functions.
Vector is a high-performance observability data pipeline designed to collect, transform, and route logs, metrics, and traces across distributed infrastructure. It functions as a modular engine that decouples data ingestion from processing and transmission, utilizing a component-based architecture to connect diverse sources to multiple destinations. The project distinguishes itself through a focus on reliability and flow control. It implements backpressure-aware data movement to prevent data loss during traffic spikes and utilizes disk-backed event buffering to ensure durability during network
Collapses multiple events into single records or summarizes metrics to reduce data volume.
This is a Python machine learning library featuring a collection of core algorithms implemented from scratch to demonstrate foundational AI concepts. It provides a comprehensive toolkit for supervised learning, unsupervised learning, and neural network development. The project is distinguished by its custom implementation of a neural network framework, which includes multi-layer perceptrons with backpropagation, gradient descent, and weight regularization. It also includes a specialized anomaly detection toolkit that identifies outliers and rare events using Gaussian probability distributions
Determines the ideal number of principal components to reduce feature count while preserving variance.
Removes low-value or redundant columns to focus model attention on the most predictive attributes.
Cats es una biblioteca de programación funcional y type classes para Scala, diseñada para implementar patrones algebraicos y abstracciones funcionales. Proporciona un conjunto estandarizado de interfaces y un kit de herramientas modular de wrappers y contenedores funcionales para permitir el polimorfismo ad-hoc y la programación genérica entre tipos dispares. El proyecto sirve como estándar de abstracción funcional, ofreciendo una suite de transformadores de mónadas para componer contextos con efectos anidados y manejar múltiples efectos secundarios computacionales dentro de un solo pipeline. Además, permite la construcción de lenguajes específicos de dominio (DSL) embebidos al representar la lógica del programa como estructuras de datos que se interpretan por separado de sus definiciones. La biblioteca cubre amplias áreas de capacidad, incluyendo la manipulación algebraica de datos para combinar y reducir valores, gestión de estado con seguridad de tipos y manejo funcional de errores para formalizar la acumulación y recuperación de errores. También proporciona herramientas para la gestión de computación con efectos y la extensión de tipos de colección estándar con capacidades funcionales. La biblioteca incluye mecanismos para la validación de leyes algebraicas, asegurando que las instancias de type classes cumplan con las propiedades matemáticas.
Provides folding and reduction operations to aggregate elements of a data structure into a single summary value.
This project is a collection of educational resources and reference implementations for neural network development using TensorFlow. It serves as a comprehensive learning course, machine learning curriculum, and practical implementation guide for building deep learning architectures. The codebase provides instructional materials and examples covering a wide range of model types, including convolutional neural networks for image classification, recurrent networks and long short-term memory cells for sequential data, and autoencoders for generative modeling. It also includes implementations for
Reduces the spatial dimensions of feature maps using max or average pooling to decrease computational complexity.
Text2Video-Zero es un modelo de difusión de texto a video y un framework diseñado para sintetizar secuencias de video temporalmente consistentes a partir de prompts textuales. Funciona como un generador de video zero-shot, reutilizando modelos de difusión de imágenes preentrenados para crear contenido de video sin requerir entrenamiento adicional en conjuntos de datos de video. El sistema incluye un sintetizador de video condicional que permite la generación guiada utilizando mapas de profundidad, bordes o poses para controlar el diseño estructural y el movimiento. También proporciona capacidades de edición de video basadas en texto para modificar el estilo o el contenido de clips de video existentes mediante instrucciones en lenguaje natural. Para gestionar los requisitos computacionales, el proyecto implementa inferencia optimizada para memoria de GPU. Esto se logra mediante técnicas como la fusión de tokens y la fragmentación de fotogramas para reducir el uso de VRAM durante el proceso de generación.
Reduces GPU memory consumption during inference by merging redundant visual tokens in the transformer sequence.
This project is a data mining algorithm library and machine learning reference implementation. It provides a collection of tools for performing classification, clustering, and association rule mining, as well as a toolkit for nature-inspired optimization. The library includes specialized utilities for graph and sequence mining, enabling the extraction of frequent subgraphs and sequential patterns. It also features a dimensionality reduction utility that uses rough set theory to remove redundant attributes from datasets. The project covers a broad range of analytical capabilities, including n
Provides utilities to eliminate redundant attributes from datasets using rough set theory.