6 dépôts
Specialized mechanisms for streaming binary content that exceeds standard document size limits.
Distinct from Chunked File Storages: Distinct from Chunked File Storages: focuses on the streaming of oversized blobs within a document database context.
Explore 6 awesome GitHub repositories matching data & databases · Binary Data Streaming. Refine with filters or upvote what's useful.
POCO is a comprehensive C++ application framework that provides a cross-platform set of libraries for building network-centric applications. It offers a unified abstraction layer that wraps platform-specific APIs, enabling the same code to run across desktop, server, mobile, IoT, and embedded systems. The framework is organized into modular libraries that can be compiled and linked selectively, allowing developers to include only the components their application needs. The framework distinguishes itself through its broad coverage of application infrastructure needs, including threading and sy
Reads and writes binary data with automatic byte-order conversion for portable serialization.
LiteDB is a serverless, embedded NoSQL document database for .NET applications. It persists data into a single portable file, functioning as a BSON data store that resides within the application process rather than running as a separate server. The system is ACID compliant, utilizing write-ahead logging to ensure atomic, consistent, isolated, and durable transactions. It includes built-in encryption to provide secure local data storage and protect files on disk from unauthorized access. The project covers object-document mapping to convert classes into document formats, indexed search capabi
Provides a specialized storage mechanism for streaming binary data that exceeds standard document size limits.
Lance is a versioned columnar data format and storage engine designed as a multimodal AI lakehouse. It serves as a vector database storage engine and a cloud object store dataset manager, organizing images, video, audio, and embeddings into a unified format optimized for machine learning workflows. The project distinguishes itself by combining a columnar layout for structured data with a specialized blob store for large multimodal tensors. It implements a hybrid search engine that integrates vector similarity search, full-text search, and SQL analytics on a single dataset, supported by a stor
Retrieves large objects as lazy handles to stream bytes on demand without loading the entire object.
The Missing Semester is a free, open-source educational curriculum designed to bridge the gap between theoretical computer science and the practical tooling every software engineer needs. Organized as a structured course, it covers Unix shell mastery, version control with Git, software debugging and profiling, system administration fundamentals, and computer security practices — the skills often left out of traditional degree programs. The project is maintained as a collaborative set of lecture notes, exercises, and guides that function as both a professional development tools course and a Uni
The Missing Semester teaches processing and transferring binary data between machines using ffmpeg, compression, and SSH.
H2 is a JDBC-compliant relational database management system written in Java. It functions as an embeddable SQL database that can run directly within an application process to remove network latency, or as an in-memory database for high-performance volatile storage. It also includes a web-based console for executing SQL commands and administering schemas. The system is characterized by its flexible deployment modes, including a standalone server mode for remote TCP/IP access and a mixed mode for simultaneous local and remote connectivity. It features a dialect emulation layer and compatibilit
Implements binary data streaming by splitting large objects into blocks for random access.
n8n-skills is a collection of technical guides and architectural frameworks for designing, building, and deploying automation workflows and AI agents within n8n. It provides a structured approach to creating autonomous agents by combining large language model chains with memory systems and custom toolsets. The project focuses on extending AI capabilities through the development of custom tool functions using structured input schemas and the integration of Model Context Protocol servers. It emphasizes the use of specific architectural patterns to manage webhooks, APIs, and binary data handling
Manages the separation of binary data from JSON and controls data boundaries between storage and agents.