45 Repos
Libraries for archiving, compressing, and extracting various file formats.
Explore 45 awesome GitHub repositories matching part of an awesome list · File Compression. Refine with filters or upvote what's useful.
Hutool is a standard utility library for Java application development designed to simplify common programming tasks and reduce boilerplate code. It provides a comprehensive collection of reusable helper classes and static utilities to streamline development across the Java ecosystem. The project implements a wide array of specialized toolkits, including systems for cryptography and security, network communication via HTTP and JSON clients, and the processing of office documents and file system IO. It also features a concurrency and scheduling framework for managing asynchronous tasks and recu
Provides libraries for archiving, compressing, and extracting Zip, Gzip, and Zlib file formats.
Zstandard is a lossless data compression library and archive format designed for high compression ratios and fast real-time processing. It functions as a real-time data compressor and multi-threaded compression engine capable of distributing workloads across multiple CPU cores to increase throughput. The system features a dictionary-based compressor that trains on sample data to improve the compression ratio and speed of small files. It also provides long distance pattern matching to identify repeated sequences across large files. The library covers a broad range of capabilities including st
Provides utilities for compressing and reducing the size of individual files using simple or streaming modes.
This project is the .NET Base Class Library, providing the foundational types and APIs required for .NET applications. It serves as a cross-platform runtime library and a standardized managed API framework, acting as the primary set of namespaces for memory management, collections, and asynchronous programming. The library enables the development of enterprise backend infrastructure and the execution of managed code consistently across different operating systems and hardware architectures. It includes capabilities for cross-platform application deployment using self-contained binaries, frame
Includes algorithms for reducing file size and restoring compressed archives.
Guetzli is a lossy image compression tool and perceptual JPEG encoder. It converts PNG or JPEG inputs into high-density JPEG files, reducing file size by removing data that the human eye cannot easily detect. The tool utilizes human vision models to optimize the balance between file size and visual fidelity. It employs perceptual quality metrics and psychovisual similarity estimation to maintain high visual quality while maximizing compression density. The project includes a visual difference analyzer capable of generating spatial difference heatmaps and calculating scalar similarity scores.
Creates high-quality sequential JPEG images with increased compression density to minimize file sizes.
This project provides a lossless compression algorithm and a byte-oriented compression library designed for high-speed data reduction and maximum decompression speed. It functions as a stream-oriented compression engine, a software library for encoding and decoding data blocks, and a command-line tool for managing interoperable compressed frames. The system distinguishes itself through the use of predefined pattern dictionaries to improve compression ratios for small data sets and small packets. It supports multiple processing modes, including high-speed block compression for minimal latency
Provides a simplified interface that automatically manages compression and decompression of read and write operations.
jsZip is a JavaScript library for creating, reading, editing, and extracting ZIP archives within the browser or Node.js. It functions as an in-memory ZIP compressor and archive manager that generates compressed data streams and blobs from file collections without requiring a local filesystem. The library provides specific support for the ZIP64 extension, allowing it to handle archives and individual files that exceed the four gigabyte limit. It enables the dynamic modification of existing ZIP files to add, remove, or update internal folder structures and metadata. The project covers a broad
Creation, reading, and editing of ZIP archives.
LMMS is a digital audio workstation and MIDI sequencer designed for composing, arranging, and mixing music. It functions as a comprehensive production environment that integrates a MIDI sequencer, a sample-based synthesizer, and an audio mixing console. The project distinguishes itself through a versatile synthesis engine that includes additive synthesis, wavetable generation, and emulations of vintage hardware such as NES audio and FM chips. It also serves as a VST plugin host, allowing for the integration of third-party virtual instruments and audio effects via a standardized interface. Be
Offers the option to save project files in compressed formats to optimize disk space.
jetson-inference is a set of libraries and tools for executing optimized deep learning models on embedded GPU hardware. Its primary purpose is to enable real-time computer vision and AI inference at the edge with low latency and high throughput. The project distinguishes itself through high-performance streaming analytics and the ability to execute concurrent AI pipelines on auto-grade silicon. It provides specialized support for multi-sensor stream processing, utilizing zero-copy data transport to load camera frames directly into GPU memory. The codebase covers a broad surface of capabiliti
Creates highly compressed texture files directly from image sources for optimized graphics use.
This repository is a comprehensive collection of functional 2D and 3D demo projects and implementation samples for the Godot Game Engine. It serves as an interactive tutorial and reference library, providing a working codebase to demonstrate how to apply engine features in real-world scenarios. The collection focuses on practical implementation guides, covering a wide array of technical capabilities from basic engine fundamentals to advanced rendering and scripting techniques. It allows users to study the application of node-based composition, asset pipelines, and game logic through direct ex
Provides multiple texture compression modes including Lossless, Lossy, VRAM Compressed, and Basis Universal.
CompactGUI is a graphical manager for the Windows Compact OS API. It serves as a transparent compression tool and filesystem optimizer that reduces disk space for programs and folders while maintaining full application functionality and accessibility. The project distinguishes itself through a community compression database, which allows users to retrieve and submit estimated compression ratios and times for specific software. This shared data system enables the prediction of potential space savings before applying compression. The tool covers several operational areas, including performance
Reduces the size of programs and folders using native system APIs while maintaining full functionality and accessibility.
meshoptimizer is a 3D mesh optimization library designed to compress geometry and animation data, reduce memory usage, and improve rendering performance. It functions as a geometry simplification tool, a mesh compression codec, and a utility for preparing data for mesh shaders and raytracing acceleration. The library provides specialized toolsets for partitioning meshes into clusters and meshlets to optimize hardware-accelerated rendering pipelines. It also includes helpers for generating opacity micromaps and spatial clusters to increase the speed of hardware ray-triangle intersection tests.
Converts textures to efficient GPU-ready formats to reduce memory footprint and decrease loading times.
SD Maid SE ist ein Dienstprogramm zur Speicheroptimierung und Systemwartung für Android. Es konzentriert sich auf die Rückgewinnung von Speicherplatz durch die Analyse der Speichernutzung und das Entfernen doppelter, verwaister oder ungenutzter Dateien. Das Projekt zeichnet sich durch die Nutzung von Accessibility-Services aus, um repetitive Geräteaufgaben und manuelle Dateiüberprüfungen durch die Simulation von Benutzerinteraktionen zu automatisieren. Es enthält zudem spezialisierte Tools zur Reduzierung der Dateigröße von Bildern und Videos durch Medienkompression. Das System bietet ein breites Spektrum an Fähigkeiten, einschließlich Anwendungs-Lebenszyklusverwaltung zum Einfrieren oder Entfernen von Software, Junk-Bereinigung für Anwendungscaches und die Erkennung redundanter Daten durch Signaturvergleich. Es nutzt zudem hierarchisches Speichermapping zur Visualisierung der Festplattennutzung und unterstützt geplante Wartungsroutinen zur Erhaltung der Gerätegesundheit.
Compresses large images and videos to optimize the limited storage capacity of mobile devices.
zlib is a lossless data compression library that implements the deflate compression algorithm, combining LZ77 sliding window and Huffman coding. It provides the core compression and decompression engines, along with support for gzip, zlib, and raw deflate stream formats, enabling data to be compressed and restored without any loss of information. The library offers a range of capabilities for handling compressed data, including single-call memory and file operations, as well as incremental stream-based processing for working with data larger than available memory. It includes mechanisms for a
Writes compressed data directly to a gzip file, handling file I/O and compression in one operation.
Masuit.Tools is a comprehensive static utility library for .NET and ASP.NET Core development. It provides a broad collection of reusable helper methods and infrastructure components that cover common programming tasks without requiring dependency injection or instance management. The library is organized as flat utility classes, making its functionality directly accessible from anywhere in a project. The toolkit distinguishes itself through a wide range of integrated capabilities that go beyond typical utility libraries. It includes a multithreaded range-request file downloader with pause and
Creates and extracts ZIP archives from files and directories using built-in compression utilities.
Converts source images into highly compressed texture formats suitable for real-time rendering applications.
Pako is a pure JavaScript compression library that ports the C zlib library to JavaScript, providing deflate and gzip compression and decompression capabilities. It runs in both browser and Node.js environments by using typed arrays and universal JavaScript, avoiding platform-specific APIs for cross-platform compatibility. The library handles data through bitwise operations for Huffman coding and LZ77 matching, and automatically encodes string inputs to UTF-8 before compression while decoding them back on decompression. It supports streaming chunk-based processing, allowing incremental data h
High-performance zlib implementation for compression.
You-Dont-Need-GUI is a curated reference of terminal commands that replace common graphical interface operations with equivalent shell one-liners. It maps everyday GUI actions—file management, archive handling, system monitoring, and network diagnostics—to standard POSIX utilities like find, grep, and awk, all composed as self-contained shell pipelines. The project distinguishes itself by requiring no external dependencies or installations; every solution runs with built-in shell commands and coreutils. Its documentation follows Unix man-page conventions, presenting each command with a
Lists the contents of any compressed archive format without extracting it, from the terminal.
Compressorjs is a client-side image compression library that reduces file sizes in the browser before upload, using the HTML Canvas API to re-encode images into smaller File or Blob objects. It supports JPEG, PNG, and WebP formats, with configurable quality and dimension controls to balance file size and visual fidelity. The library distinguishes itself through several integrated capabilities. It reads Exif orientation metadata from JPEG images and automatically rotates or flips the canvas to ensure correct display after compression. An AbortController integration allows cancellation of an in
Ships a configurable quality parameter on a zero-to-one scale for JPEG and WebP output.
This is a high-performance Go compression library providing implementations of Zstandard, Snappy, and Huffman coding. It includes a parallel compression framework for distributing gzip and stream workloads across multiple CPU cores and a specialized Huffman codec optimized for modern CPU architectures. The library features a Zstandard implementation that supports custom dictionaries and allocation-free decoding, alongside a Snappy compatible encoder for high-throughput data processing. It provides specific tools for dictionary generation and optimization to improve compression ratios for smal
Implements a parallel compression framework that utilizes multiple threads to increase stream throughput.
This is a collection of academic programming projects that accompany an operating systems textbook, designed to teach core OS concepts through hands-on implementation. The projects span the major subsystems of an operating system, including process scheduling, memory management, file systems, and concurrency, with students building components from scratch in a simulated environment. The projects are structured to cover the full range of OS internals, from low-level kernel development to user-space system programming. Students implement lottery-based CPU schedulers, dynamic heap memory allocat
Implements parallel file compression that speeds up operations by using multiple threads.