11 个仓库
Mechanisms to fetch database results as arrays or binary buffers instead of mapped objects for performance.
Distinct from Raw Data Accessors: Shortlist focused on AI completions or metadata, not raw value retrieval from database result sets.
Explore 11 awesome GitHub repositories matching data & databases · Raw Data Retrieval. Refine with filters or upvote what's useful.
This project is a PostgreSQL client library and SQL query builder for JavaScript and TypeScript. It provides a low-level database driver and connection manager to handle database sessions, along with a logical replication client for monitoring real-time changes. The library distinguishes itself with a high-performance bulk data streamer that utilizes the database copy command for importing and exporting large datasets. It also implements a logical replication protocol to facilitate real-time database synchronization through change subscriptions and channel-based notifications. The toolset co
Allows retrieving results as arrays of values or binary buffers instead of objects to increase performance.
本项目是一个大规模手绘草图数据集,提供数百万个带时间戳的矢量图和位图,用于训练机器学习模型。它作为一个计算机视觉训练语料库和神经网络数据集,由用于开发图像分类和识别算法的分类人类草图组成。 该数据集以矢量绘图语料库的形式提供,具有逐笔序列和元数据,以及处理后的 numpy 数组。这些资源支持绘图分类器的开发和人类绘图模式的研究。 数据以多种格式提供,包括换行符分隔的 JSON 原始矢量数据、归一化矢量序列和灰度位图。它包括基于类别的分区和坐标缩放功能,以确保不同样本之间的一致性。
Retrieves unsimplified drawings containing pixel coordinates, timing information, and metadata in JSON format.
Webhook.site is a web-based tool that captures, inspects, and debugs incoming HTTP requests and emails sent to a unique URL, without requiring any server setup. It also functions as an API mocking and response modification tool, capable of generating mock APIs from OpenAPI specifications and altering HTTP responses, headers, and status codes for testing purposes. Beyond inspection, it serves as a platform for webhook automation and workflow orchestration, triggering multi-step automations—including database queries, SSH commands, and HTTP calls—when a webhook is received. The service distingu
Webhook.site returns the raw body and content-type of a specific or latest request as a direct response.
Timber is a PHP library that integrates the Twig template engine into WordPress themes, providing an object-oriented framework for theme development. It wraps WordPress data — posts, terms, users, menus, and comments — in structured PHP classes, allowing developers to work with objects instead of raw arrays while keeping HTML markup separate from PHP logic through Twig templates. The library distinguishes itself by offering a complete set of tools for modern WordPress theme building. It includes a file-based template hierarchy with fallback chains, dynamic image manipulation with resizing, cr
Retrieves unformatted theme header values for programmatic use in templates.
Grafana Tempo is a high-scale distributed tracing backend and columnar trace database. It serves as an observability data store that persists and queries spans and traces using OpenTelemetry standards, allowing for the analysis of request flows across microservices. The system distinguishes itself by using an object-store based backend with columnar Parquet storage. This architecture enables efficient attribute searching and large-scale data retrieval through dedicated attribute columnization and block-based data partitioning. It includes a specialized TraceQL query engine for filtering trace
Provides mechanisms to dump raw data or summaries for specific identifiers by iterating over storage blocks.
Connexion 是一个规范驱动的框架,用于构建自动将 OpenAPI 规范映射到应用逻辑的 API。它使用这些规范来自动化路由、请求验证和响应序列化,并通过操作 ID 将 API 操作链接到后端处理函数。 该项目通过提供一个模式驱动的 Mock 服务器来区分开来,该服务器使用规范中的示例响应来模拟 API 行为,而无需后端逻辑。它还包括一个动态文档托管系统,将 API 规范转换为实时交互式控制台,用于探索和测试端点。 该框架涵盖了广泛的功能领域,包括通过基于中间件的身份验证和作用域验证实施安全性、可插拔的请求和响应验证逻辑,以及向类型化函数参数自动注入参数。它还提供了用于应用生命周期管理、自定义中间件集成和请求模拟测试的实用工具。 该项目可用于引导独立 Web 应用,或包装在现有框架周围以添加规范驱动的功能。
Allows retrieval of the raw request body and content-type directly during the request lifecycle.
这是一个漏洞搜索引擎和安全知识库,旨在收集并索引公开的安全披露信息。它作为一个漏洞数据库爬虫,从网站中提取技术报告和安全漏洞,以创建可搜索的本地存档。 该系统利用安全知识索引器和全文倒排索引,将非结构化的爬取数据转换为结构化格式。这支持基于关键字的信息检索,通过专门的搜索界面定位特定的安全漏洞和技术细节。 该平台涵盖了广泛的安全研究能力,包括威胁情报收集和公开漏洞利用研究。它通过解析 HTML 内容并组织安全模式,自动化了漏洞数据收集过程,从而实现更快的查询。
Retrieves raw content from security forums and disclosure pages via simulated HTTP requests.
Liveblocks is a realtime collaboration infrastructure platform that synchronizes application state, documents, and user presence across multiple participants using conflict-free replicated data types. It provides a managed backend for collaborative text editors, threaded commenting and annotation systems, in-app notifications, and AI copilot deployment, all built on a WebSocket transport layer with server-side room management APIs. The platform distinguishes itself through a headless component primitive system that exposes unstyled React hooks and composable building blocks, allowing develope
Liveblocks retrieves a specific version of a room's Yjs document as a binary Yjs update.
REFramework is a runtime modding framework for games built on the RE Engine, providing a C# plugin system with typed proxy code generation, a Lua scripting interface, an ImGui-based UI system, a runtime debugging toolkit, and a VR integration layer. At its core, it intercepts and modifies internal game engine functions and state at runtime through hooking and scripting APIs, enabling deep inspection and manipulation of live game objects. The framework distinguishes itself through typed proxy code generation that auto-creates C# interfaces from the game's type database, giving compile-time saf
Provides deserialization of proprietary RSZ binary data into managed objects for game modding.
MNBVC is a dataset pipeline and toolkit designed for the collection, cleaning, and normalization of massive text and code corpora used to train large language models. It provides specialized tools for harvesting source code, commit histories, and repository metadata from version control platforms, alongside a multilingual text corpus collector for gathering parallel text and academic papers. The project distinguishes itself through comprehensive capabilities for processing diverse document types, including a PDF-to-text converter that transforms complex layouts and formulas into structured JS
Supplies vast collections of internet-sourced Chinese text and raw PDF data for training models.
Jet is a schema-driven code generation tool and type-safe SQL builder for Go. It introspects database schemas to automatically generate builders and data models, enabling compile-time type checking for table and column references to prevent runtime errors. The project distinguishes itself through a fluent interface that mirrors native SQL syntax, allowing for the orchestration of complex queries including common table expressions, recursive queries, and nested JSON structures. It further optimizes data retrieval by binding query outputs directly into generated Go structures or raw byte slices
Retrieves objects or arrays directly from database columns and maps them to structured data formats.