190 Repos
Systems for storing temporary data and session state to improve performance.
Distinguishing note: Focuses on persistent local caching for application state.
Explore 190 awesome GitHub repositories matching data & databases · Data Caching. Refine with filters or upvote what's useful.
FFmpeg is a cross-platform multimedia framework designed for the recording, conversion, and streaming of audio and video content. It functions as a comprehensive toolkit that provides both a command-line utility for direct media manipulation and a collection of low-level libraries for integration into custom applications. At its core, the project utilizes a packet-based stream engine and a format-agnostic abstraction layer to handle diverse media standards, containers, and network protocols. The framework distinguishes itself through a modular, graph-based filter execution model that allows f
Stores remote stream data in temporary files to enable seeking and playback stability.
Streamlit is a Python framework designed to transform data scripts into interactive web applications. It utilizes a reactive execution engine that automatically reruns scripts from top to bottom whenever a user interaction triggers a state change, ensuring the interface remains synchronized with the underlying data. By providing a declarative interface, it allows developers to build functional applications without requiring extensive knowledge of frontend web technologies. The framework distinguishes itself through an identity-based widget reconciliation system that persists user input across
Stores temporary data, session variables, and URL parameters in a persistent local cache.
Lottie-android is a native vector animation engine and library for Android that parses JSON specification files into high-fidelity animations. It functions as a JSON animation parser and renderer, translating After Effects exported data into native draw calls to maintain design fidelity on mobile devices. The library supports dynamic user interface control by allowing the modification of animation properties, such as colors, text, and shape attributes, during runtime playback. It also integrates with system-level accessibility settings to adjust playback and visibility in accordance with redu
Persists parsed animation source objects to a local cache to accelerate subsequent playback runs.
Glide is an image loading and caching library for Android that fetches and decodes images, GIFs, and video stills from local or remote sources. It functions as a media rendering framework and memory management tool designed to resize and downsample assets to fit specific view dimensions. The system prioritizes scrolling performance through a multi-level caching strategy that stores decoded media in memory and raw data on disk. It employs resource pooling to reuse bitmap memory and binds image loading tasks to component lifecycles to automatically release resources and prevent memory leaks. T
Implements a multi-level caching system that saves network-fetched images to local storage.
This project is a privacy-focused, self-hosted metasearch engine that aggregates results from a wide array of web, academic, and media sources into a single, unified interface. By acting as a proxy between the user and external search providers, it strips identifying headers and tracking parameters from requests, ensuring that search activity remains anonymous and protected from third-party profiling. The platform distinguishes itself through a modular, plugin-based architecture that allows for extensive customization of search behavior, result filtering, and interface branding. It supports a
Stores temporary search responses in a persistent database with automatic expiration to reduce redundant network requests.
RocksDB is a high-performance, embeddable persistent key-value library and storage engine based on Log-Structured Merge-trees. It is designed to provide durable storage for large-scale datasets, integrating directly into applications to manage data on flash and RAM-based hardware. The engine is distinguished by its focus on minimizing read and write amplification through multi-threaded compaction and custom memory allocators. It features specialized optimizations for flash storage, including support for zoned block devices, and provides the ability to extend store behavior via external plugin
Improves read throughput by storing frequently accessed data on local disks or SSDs.
This project is an educational platform and research toolkit designed to teach deep learning through a combination of mathematical theory, visual diagrams, and executable code. It provides a comprehensive environment for building, training, and evaluating neural networks, grounding complex concepts in interactive computational notebooks that allow for hands-on experimentation. The framework distinguishes itself by interleaving theoretical foundations—including linear algebra, calculus, and probability—with practical implementations across multiple industry-standard libraries. It supports flex
Retrieves remote data files, extracts compressed archives, and caches them locally to avoid redundant network requests.
This project is a Python framework for building autonomous, event-driven agent systems. It provides a unified runtime for orchestrating multi-agent workflows, managing persistent conversation state, and executing code within secure, isolated sandbox environments. The framework is designed to handle complex task delegation, allowing agents to invoke other agents as tools while maintaining context across multi-turn interactions. The framework distinguishes itself through its deep integration with the Model Context Protocol, enabling agents to connect to external data sources and remote services
Stores tool lists locally to minimize network latency and avoid redundant requests to remote servers.
This project is a command line package manager and dependency management engine used for installing, updating, and removing software packages across different operating systems. It functions as a package recipe system and software repository administrator, utilizing declarative scripts to define software sources, build arguments, and installation steps. The system operates as a binary distribution platform that compiles source code into pre-compiled binaries and distributes them through remote repositories. It includes an automated version tracker that monitors upstream software releases and
Reclaims disk space by removing stale lock files and outdated versions of downloaded packages.
SDWebImage is an asynchronous image downloader and caching library for iOS and macOS applications. It provides a core identity centered on a network utility for fetching images from URLs, a tiered memory and disk caching engine, and a processing framework for decoding and encoding media. The library features a specialized rendering engine for animated formats such as GIF and WebP, including support for progressive animation rendering. It distinguishes itself through a plugin system that allows for extended image format support and the ability to replace default loading or storage logic with c
Implements a tiered memory and disk caching system to persist remote image data and minimize network requests.
SDWebImage is an asynchronous image loading library for iOS that provides a framework for fetching, decoding, and caching images. It consists of a core loading library, a decoding engine, a processing pipeline, and a caching system designed to reduce network traffic and improve load times. The project features a two-tier caching architecture that stores assets in both volatile memory and persistent disk storage. It distinguishes itself through a modular loader pattern and a plugin-based decoding system, which allow for the integration of custom storage engines and the support of non-standard
Saves network-fetched images to local storage to minimize data usage and improve load times.
NativeScript is a cross-platform mobile development framework that enables the creation of native iOS and Android applications using JavaScript or TypeScript. It provides a direct bridge to native platform APIs, allowing developers to invoke native classes, methods, and properties directly from script code while maintaining full access to underlying mobile operating system features. The framework distinguishes itself through its direct native UI rendering, which maps declarative markup components to actual platform-native widgets rather than web-based views. This architecture is supported by
Saves network images to local storage to minimize data usage and speed up display.
Redisson is a Java library and Redis client that functions as a distributed Java object mapper, caching provider, and locking framework. It maps Java collections and concurrency primitives to distributed implementations backed by Redis and Valkey, providing synchronous, asynchronous, and reactive APIs for interacting with these data stores. The project distinguishes itself by providing a comprehensive suite of distributed coordination tools, including a locking framework for managing semaphores and countdown latches across multiple application nodes. It also serves as a distributed messaging
Caches frequently accessed remote data locally to reduce network latency and server load.
Kingfisher is a library for downloading, caching, and displaying remote images in Swift applications. It provides an integrated framework that manages the entire lifecycle of remote assets, from initial network retrieval to final rendering within user interface components. The library distinguishes itself through a two-tiered storage mechanism that balances rapid access via volatile memory with persistent availability through disk caching. It features a modular processing pipeline that allows for dynamic image transformations, such as applying filters or geometric modifications, during the re
Caches remote images in memory and on disk to ensure rapid access and reduced data usage.
Octotree is a source code browsing tool for GitHub that provides a navigable file tree sidebar for exploring repository folder structures without downloading files locally. It enables the navigation of directory hierarchies and the location of specific files through text-based search queries. The tool includes specialized workflows for reviewing pull requests by filtering the visible file tree to show only modified files. It also supports access to private repositories through the use of personal access tokens and multi-account management. The interface features customizable sidebar behavior
Persists sidebar visibility and theme preferences locally on the client to maintain UI configurations across sessions.
CodeHub is a mobile client for GitHub designed for browsing repositories, managing pull requests, and reviewing code changes. It provides a specialized interface for iOS devices to navigate project files and organizational data via the GitHub API. The application focuses on mobile project coordination and remote code review. It includes a dedicated pull request manager that allows users to track proposed changes and perform line-level reviews of file differences by adding targeted comments. The system incorporates OAuth-based authentication to secure user access and utilizes asynchronous bac
Stores recently accessed repository metadata locally to reduce network requests and speed up navigation.
This project is a feature-rich Go client library designed for interacting with Redis. It serves as a comprehensive interface for managing remote data stores, enabling developers to execute standard database commands, handle complex data structures, and perform asynchronous operations within Go applications. The library distinguishes itself through its support for advanced Redis capabilities, including connection pooling, pipelining, and transactional integrity. It provides specialized primitives for managing distributed clusters, including automated topology updates and request routing to sha
Caches results from slower backend databases or API calls to accelerate read performance and reduce load on primary data sources.
Prefect is a workflow orchestration platform designed to define, schedule, and monitor complex data pipelines as Python code. It functions as a container-native engine that wraps individual tasks in isolated environments, ensuring consistent dependencies and resource allocation across diverse infrastructure. By utilizing a state-machine-based orchestration model, the system tracks execution progress through discrete transitions and persistent event logs to maintain reliable and observable task processing. The platform distinguishes itself through a decoupled worker-API architecture, which sep
Directs cached data records to specific local or remote storage locations to optimize result persistence.
mypy is a static type checker for Python that analyzes source code to detect type errors and inconsistencies without executing the program. It functions as a static analysis tool and type inference engine, providing a gradual typing system that allows type hints to be added to a codebase incrementally while maintaining compatibility with dynamic typing. The project distinguishes itself through a combination of performance and precision features. It utilizes a daemon-based incremental checking system and multi-process parallel analysis to manage large codebases, supported by binary cache persi
Stores previously analyzed module states in binary format to avoid re-processing unchanged source files.
Eleventy is a JavaScript-based static site generator designed to transform templates, data files, and markdown into optimized HTML. It functions as a versatile template rendering engine and content management framework, allowing developers to aggregate data from diverse sources—including local files, databases, and external APIs—to populate structured web content. The project is distinguished by its template-engine-agnostic pipeline, which decouples the build process from specific rendering languages. This allows users to integrate multiple template formats, such as Liquid, Nunjucks, Handleba
Retrieves external network resources during the build process and caches them to improve performance.