1 repositorio
Awesome GitHub RepositoriesChunked File Processing
Splits large files into independently processed chunks that are aggregated after parallel execution.
Distinct from Parallel Processing: Distinct from general Parallel Processing: focuses on file-splitting and result-merging patterns for data aggregation workloads.
Explore 1 awesome GitHub repository matching data & databases · Chunked File Processing. Refine with filters or upvote what's useful.
Awesome Chunked File Processing GitHub Repositories
Encuentra los mejores repositorios con IA.Buscaremos los repositorios que mejor coincidan usando IA.
- gunnarmorling/1brc
gunnarmorling/1brc
8,062Ver en GitHubThe 1BRC (One Billion Row Challenge) is a Java performance benchmarking exercise that processes one billion temperature records from a text file to compute the minimum, mean, and maximum temperature per weather station. At its core, it is a large-scale data aggregation challenge designed to test how efficiently a Java program can parse and aggregate structured data from a plain text file, serving as both a programming exercise and a benchmark for Java performance optimization. The project distinguishes itself through a collection of performance-oriented architectural patterns for high-through
Splits the file into chunks processed concurrently by multiple threads, aggregating partial results before merging.
Java1brcchallenges
