awesome-repositories.com
Blog
awesome-repositories.com

Descoperă cele mai bune repository-uri open source cu căutare AI.

ExploreazăCăutări recomandateAlternative open-sourceSoftware self-hostedBlogHartă site
ProiectDespreCum realizăm clasamentulPresăServer MCP
LegalConfidențialitateTermeni
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

19 repository-uri

Awesome GitHub RepositoriesData Compression

Libraries for archiving and reducing data size using various algorithms.

Explore 19 awesome GitHub repositories matching part of an awesome list · Data Compression. Refine with filters or upvote what's useful.

Awesome Data Compression GitHub Repositories

Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
  • facebook/zstdAvatar facebook

    facebook/zstd

    27,259Vezi pe GitHub↗

    Zstandard is a lossless data compression library and archive format designed for high compression ratios and fast real-time processing. It functions as a real-time data compressor and multi-threaded compression engine capable of distributing workloads across multiple CPU cores to increase throughput. The system features a dictionary-based compressor that trains on sample data to improve the compression ratio and speed of small files. It also provides long distance pattern matching to identify repeated sequences across large files. The library covers a broad range of capabilities including st

    Reduces the size of data streams in real-time to balance high throughput and efficient compression ratios.

    C
    Vezi pe GitHub↗27,259
  • lz4/lz4Avatar lz4

    lz4/lz4

    11,882Vezi pe GitHub↗

    This project provides a lossless compression algorithm and a byte-oriented compression library designed for high-speed data reduction and maximum decompression speed. It functions as a stream-oriented compression engine, a software library for encoding and decoding data blocks, and a command-line tool for managing interoperable compressed frames. The system distinguishes itself through the use of predefined pattern dictionaries to improve compression ratios for small data sets and small packets. It supports multiple processing modes, including high-speed block compression for minimal latency

    Provides a lossless compression algorithm ensuring perfect recovery of original content with tunable speed and ratio.

    Cccompressionlz4
    Vezi pe GitHub↗11,882
  • linkedin/school-of-sreAvatar linkedin

    linkedin/school-of-sre

    8,093Vezi pe GitHub↗

    This project is a comprehensive educational resource and curriculum focused on site reliability engineering, distributed systems, and infrastructure operations. It provides technical guides, a systems engineering course, and instructional manuals designed to teach the principles of managing large-scale computing environments. The curriculum covers high-level architectural design for scalability and resilience, including fault-tolerant infrastructure, high-availability patterns, and microservices decomposition. It emphasizes the practical application of site reliability engineering through the

    Provides guidance on using libraries and algorithms for archiving and reducing data size.

    HTMLgithadooplinux
    Vezi pe GitHub↗8,093
  • c3lang/c3cAvatar c3lang

    c3lang/c3c

    5,147Vezi pe GitHub↗

    c3c is the compiler for the C3 programming language, transforming source code into executable binaries, static libraries, or dynamic libraries using an LLVM backend. It implements a system based on result-based error handling, scoped memory pooling, and a semantic macro system. The compiler provides first-class support for hardware-backed SIMD vectors that map directly to processor instructions and enables runtime polymorphism through interface-based dynamic dispatch. The project covers a broad set of low-level capabilities, including manual and pooled memory management, inline assembly inte

    Implements data size reduction using Gzip, Deflate, and Zip algorithms.

    C3c3compilerlanguage
    Vezi pe GitHub↗5,147
  • apache/nuttxAvatar apache

    apache/nuttx

    3,912Vezi pe GitHub↗

    NuttX este un sistem de operare în timp real (RTOS) compatibil POSIX, conceput pentru microcontrolere de la arhitecturi pe 8 biți până la 64 de biți. Oferă un mediu de execuție determinist cu un scheduler de task-uri în timp real și un kernel embedded POSIX pentru a asigura execuția portabilă a codului pe diverse ținte hardware. Proiectul se distinge printr-un strat de abstractizare hardware cuprinzător care oferă drivere standardizate pentru I2C, SPI, CAN și USB pe diverse chipset-uri semiconductoare. De asemenea, dispune de un stack de rețea embedded care suportă TCP, UDP, IPv4 și IPv6, alături de protocoale industriale precum Modbus și DroneCAN. Sistemul acoperă o gamă largă de capabilități, inclusiv gestionarea avansată a memoriei cu paginare la cerere, operațiuni criptografice securizate și un sistem de fișiere virtual pentru gestionarea tipurilor de stocare disparate. De asemenea, integrează interfețe de nivel înalt pentru interfețe grafice (GUI), sinteză audio și execuția mai multor limbaje de scripting și workload-uri WebAssembly. Mediul este construit folosind Make sau CMake pentru a viza configurații specifice de plăci și chipset-uri.

    Reduces data size using LZF or zlib compression libraries to optimize storage and bandwidth.

    Cembeddedmcumicrocontroller
    Vezi pe GitHub↗3,912
  • synopse/mormotAvatar synopse

    synopse/mORMot

    823Vezi pe GitHub↗

    Synopse mORMot 1 ORM/SOA/MVC framework - Please upgrade to mORMot 2 !

    High-speed compression units featuring multiple industry-standard algorithms.

    Pascal
    Vezi pe GitHub↗823
  • alexcrichton/tar-rsAvatar alexcrichton

    alexcrichton/tar-rs

    724Vezi pe GitHub↗

    Documentation

    Utilities for reading and writing tar archives.

    Rust
    Vezi pe GitHub↗724
  • avaneev/lzavAvatar avaneev

    avaneev/lzav

    534Vezi pe GitHub↗

    Fast In-Memory Data Compression Algorithm (header-only C/C++) 480+MB/s compress, 2800+MB/s decompress, ratio% better than LZ4, Snappy, and Zstd@-1

    High-speed LZAV compression algorithm implementation.

    C++
    Vezi pe GitHub↗534
  • alexcrichton/bzip2-rsAvatar alexcrichton

    alexcrichton/bzip2-rs

    169Vezi pe GitHub↗

    Documentation

    Bindings for the bzip2 compression library.

    C
    Vezi pe GitHub↗169
  • turbopack/abbreviaAvatar TurboPack

    TurboPack/Abbrevia

    137Vezi pe GitHub↗

    Abbrevia is a compression toolkit for Delphi and C++Builder.

    Advanced toolkit for data compression and archiving.

    Pascal
    Vezi pe GitHub↗137
  • alexanderbagel/fwzipAvatar AlexanderBagel

    AlexanderBagel/FWZip

    64Vezi pe GitHub↗

    Набор классов для архивирования.

    Work with Zip archives using standard compression methods.

    Pascal
    Vezi pe GitHub↗64
  • jzebedee/thumbhashJ

    jzebedee/ThumbHash

    0Vezi pe GitHub↗

    Compact image placeholder representation for data storage.

    Vezi pe GitHub↗0
  • cysharp/nativecompressionsC

    Cysharp/NativeCompressions

    0Vezi pe GitHub↗

    High-performance native compression bindings for .NET.

    Vezi pe GitHub↗0
  • brantburnett/snappierB

    brantburnett/Snappier

    0Vezi pe GitHub↗

    Native .NET port of the Snappy compression format.

    Vezi pe GitHub↗0
  • jaime-olivares/zipstorerJ

    jaime-olivares/zipstorer

    0Vezi pe GitHub↗

    Lightweight library for creating and reading ZIP files.

    Vezi pe GitHub↗0
  • ikpil/dotfastlzI

    ikpil/DotFastLZ

    0Vezi pe GitHub↗

    FastLZ implementation for .NET environments.

    Vezi pe GitHub↗0
  • ikpil/dotcompressorbenchmarkI

    ikpil/DotCompressorBenchmark

    0Vezi pe GitHub↗

    Performance benchmarking suite for .NET compression libraries.

    Vezi pe GitHub↗0
  • mjebrahimi/easycompressorM

    mjebrahimi/EasyCompressor

    0Vezi pe GitHub↗

    High-level abstraction for various compression algorithms.

    Vezi pe GitHub↗0
  • lifthrasiir/rust-zipAvatar lifthrasiir

    lifthrasiir/rust-zip

    2Vezi pe GitHub↗

    A simple rust library to read and write Zip archives, which is also my pet project for learning Rust. At the moment you can list the files in a Zip archive, as well as extracting them if they are either stored (uncompressed) or deflated, but I plan to add write support soon.

    Support for reading and writing ZIP archives.

    Rust
    Vezi pe GitHub↗2
  1. Home
  2. Part of an Awesome List
  3. Developer Tools
  4. Data Compression

Explorează sub-etichetele

  • Real-TimeThe application of compression specifically for live data streams to maintain high throughput. **Distinct from Data Compression:** Focuses on the operational context of real-time streams rather than just the general library capability.