18 个仓库
Capabilities for adding new records to database tables.
Distinguishing note: No existing candidates for insert operations.
Explore 18 awesome GitHub repositories matching data & databases · Insert Operations. Refine with filters or upvote what's useful.
Drizzle ORM is a TypeScript-native database toolkit providing type-safe SQL query building, schema management, and automated migrations across PostgreSQL, MySQL, SQLite, and SingleStore.
Supports type-safe insertion of new records into database tables.
This project is a feature-rich Go client library designed for interacting with Redis. It serves as a comprehensive interface for managing remote data stores, enabling developers to execute standard database commands, handle complex data structures, and perform asynchronous operations within Go applications. The library distinguishes itself through its support for advanced Redis capabilities, including connection pooling, pipelining, and transactional integrity. It provides specialized primitives for managing distributed clusters, including automated topology updates and request routing to sha
Transfers large volumes of data using a specialized protocol mode to minimize network latency and maximize throughput.
Dapper is a lightweight object-relational mapper for .NET that functions as a high-performance data access library. It operates by extending standard database connection interfaces, allowing developers to execute raw SQL queries while automating the mapping of database results to strongly-typed objects. The library distinguishes itself through its use of runtime code generation, which creates high-performance instructions to map database rows to object properties with minimal overhead. It provides flexible data retrieval options, supporting both memory-buffered loading for speed and row-by-ro
Adds large collections of objects to database tables in a single operation.
Apache DataFusion is an extensible, columnar SQL query engine that runs embedded within a host application without requiring a separate server process. It processes data in columnar batches using Apache Arrow for memory-efficient analytics, and can scale analytic workloads across multiple nodes for parallel execution. The engine supports both SQL and DataFrame queries through a modular, streaming architecture that allows custom operators, data sources, functions, and optimizer rules. The engine distinguishes itself through its modular extension framework, which enables building custom query e
Supports INSERT and COPY commands for modifying data in tables.
Delta is a lakehouse table format that brings ACID transactions and data warehouse consistency to large scale data lakes on cloud object storage. It serves as an ACID transaction manager, coordinating atomic commits and serializable isolation for concurrent reads and writes across distributed compute engines. The project provides a multi-engine interoperability layer that uses format translation to allow diverse SQL engines and processing frameworks to read and write the same tables. It functions as a data versioning system, utilizing a transaction log to enable time travel, historical snapsh
Provides capabilities for adding new records to tables via atomic commits.
This project is a Go client library and API wrapper for interacting with Elasticsearch clusters. It serves as a programmatic interface for managing documents, indices, and cluster health, allowing Go applications to perform search and indexing operations via the REST API. The library functions as a distributed search orchestrator, providing specialized tools for high-throughput data ingestion and cluster administration. It features a buffered bulk processor with exponential backoff retries for optimizing write performance and supports automated index lifecycle transitions and historical data
Optimizes write performance through buffered bulk operations for high-throughput data ingestion.
Eve is a REST API framework that maps database collections to web resources through declarative configuration files. It functions as a database-to-API mapper, automatically exposing data as RESTful endpoints with built-in support for CRUD operations and schema-based request validation. The project distinguishes itself through a HATEOAS API engine that generates hypermedia links and resource schemas for dynamic client discovery. It also includes an automated Swagger documentation generator that produces interactive specifications for client SDK generation and testing. The framework provides a
Supports inserting multiple records in a single request to optimize performance and reduce overhead.
Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis
Ships built-in connectors for bulk ingestion of processed data into search indices.
pgloader is a command-line tool that automates the migration of data and schema from various source databases and file formats into PostgreSQL. It combines schema discovery, parallel data pipelines, and type casting into a single, declarative workflow, using PostgreSQL's COPY protocol for high-throughput bulk loading. The tool distinguishes itself by compiling a dedicated command language into concurrent reader-writer pipelines that handle schema introspection, data transformation, and error-resilient batch processing. It supports migrating entire databases from MySQL, MS SQL, SQLite, and Pos
Drops indexes and disables triggers before copying data to speed up bulk inserts.
GreptimeDB is a distributed, open-source time-series database built for unified observability. It stores and queries metrics, logs, and traces together in a single columnar engine, supporting both SQL and PromQL for analysis. The database is designed as a Kubernetes-native operator with a decoupled compute and storage architecture, enabling horizontal scaling and multi-region deployment. What distinguishes GreptimeDB is its role as a multi-protocol ingestion gateway, accepting data through OpenTelemetry, Prometheus Remote Write, InfluxDB, Loki, Elasticsearch, Kafka, and MQTT protocols without
Accepts NDJSON data through the Elasticsearch _bulk HTTP endpoint, mapping each index to a table.
SqlSugar is an object-relational mapping library for .NET that translates C# and VB objects into database queries and tables without requiring raw SQL. It is designed as a multi-database ORM supporting SQL Server, MySQL, PostgreSQL, Oracle, MongoDB, ClickHouse, and other databases through a unified API, and it is compatible with .NET AOT compilation for native ahead-of-time deployment. The library distinguishes itself through high-speed bulk data operations that can insert or update millions of records in seconds using batch processing instead of row-by-row handling. It also provides multi-te
Performs high-speed bulk inserts and updates for millions of records using batch operations.
pg is a PostgreSQL object-relational mapper (ORM) for Go that maps Go structs to database tables and provides a fluent query builder for constructing SQL statements programmatically. At its core, it automatically generates CREATE TABLE statements from Go struct definitions using struct tags and naming conventions, and builds queries through method chaining with placeholder-based parameter binding to prevent SQL injection. The library distinguishes itself through relation-aware join generation that automatically constructs JOIN clauses for has-one, has-many, many-to-many, and polymorphic assoc
Performs batch inserts, updates, and deletes on multiple rows in a single database round trip.
ServiceStack 是一个高性能 .NET Web 框架,专为使用强类型请求和响应对象构建类型安全的 API 而设计。它作为一个基于消息的 API 引擎,将业务逻辑与传输层解耦,允许通过包括 HTTP、gRPC 和各种消息队列提供商在内的多种协议公开服务。 该框架的特点是其类型安全的 API 生成器,它从跨多种语言的服务元数据中生成原生客户端 SDK 和数据传输对象。它还包括用于微服务编排的分布式服务网关、将 C# 对象直接转换为数据库记录的代码优先 ORM,以及用于安全令牌访问的集中式身份和访问管理系统。 其更广泛的功能面涵盖通过 Pub-Sub 和服务器发送事件(SSE)进行的异步消息传递和实时事件流。它为 JSON、XML、ProtoBuf 和 MessagePack 等格式提供全面的数据序列化支持,以及包括 JWT、API 密钥和阶梯式认证在内的集成认证流程。其他工具包括自动 CRUD API 生成、后台作业执行和管理仪表盘模板。
Writes large volumes of data to relational databases using high-performance bulk ORM implementations.
ActiveAndroid is a persistence framework for managing local SQLite databases on Android. It provides an active record object-relational mapping system that binds database tables to classes, allowing for data persistence and retrieval without writing manual SQL. The project distinguishes itself through a dedicated schema migration tool that updates database structures using versioned scripts loaded from application assets. It also includes a framework for sharing database content between different Android applications via a standard URI-based content provider interface. The library covers bro
Provides high-speed bulk insert and update operations for records using batch processing.
Infinity 是一个分布式向量数据库和多模态向量存储,旨在管理用于检索和相似性搜索的大规模数据集。它通过存储和检索稠密向量、稀疏向量和全文数据,作为大语言模型应用和检索增强生成流水线的后端。 该系统作为一个混合搜索引擎,结合了向量嵌入和全文搜索以及重排序算法,以识别最相关的文档。它支持多模态数据存储,允许在单一环境中维护包括张量、字符串和数值在内的多种数据类型。 该数据库提供管理数据库模式和记录的功能,包括数据导入、导出和结构化查询。它包含用于索引管理和存储优化的工具,并通过系统或表快照提供状态恢复。 该数据库可以作为单一二进制文件部署或通过 Docker 部署,并可通过 HTTP API 和 Python SDK 进行访问。
Implements comprehensive data manipulation operations including inserting, updating, deleting, importing, and exporting rows.
FreeSql 是一个 .NET 对象关系映射器(ORM)和数据访问层,可将面向对象的代码转换为适用于多种关系型数据库提供程序的 SQL。它作为一个流畅的 SQL 查询构建器和数据库架构同步器,允许开发者将数据库表和索引结构与实体类定义保持一致。 该框架专门针对 .NET Native AOT 进行了优化,以确保更小的内存占用和更快的启动时间。它包含一个数据库流量管理器,通过读写分离、动态分表和基于租户的数据隔离来分配负载。 其广泛的功能包括使用特定于提供程序的批量复制机制实现高性能数据摄入,利用窗口函数和递归 CTE 进行高级查询,以及基于 AOP 的数据变更审计监控。该系统还提供用于自动迁移的架构管理工具,以及用于从数据库元数据生成实体类的开发实用程序。
Performs high-speed bulk inserts, updates, and deletes for millions of records using ORM-level batch operations.
MongoDB Python Driver 是一个客户端库和 NoSQL 数据库客户端,用于使用 Python 编程语言执行 CRUD 操作并管理 MongoDB 数据库中的数据。它作为一个数据库连接库,处理身份验证和连接池,同时还提供了一个用于管理嵌入索引并基于语义相似度检索数据的向量搜索客户端。 该驱动程序支持同步和异步数据库驱动模型,以执行非阻塞 I/O 操作并从数据库集群流式传输数据。它的独特之处在于专门的搜索能力,包括全文搜索和执行向量搜索以基于数学相似度检索数据。 其更广泛的能力涵盖数据存储和同步,包括多阶段聚合管道、索引生命周期管理和 BSON 二进制序列化。该库还实现了安全原语,如客户端字段级加密、TLS 连接安全以及与云身份提供商的集成。其他功能包括通过文件系统接口进行的大文件存储和实时数据变更监控。
Executes high-speed bulk insert, update, and delete operations in a single request to optimize network traffic.
EFCore.BulkExtensions 是一个用于在 Entity Framework Core 生态系统中执行高性能批量插入、更新和删除操作的库。它充当数据库批量处理工具包,并作为原生 SQL Bulk Copy 的包装器,以实现跨多个数据库提供商的更快数据摄取和同步。 该库为关系数据同步提供了专门的功能,允许用户通过批量更新插入 (upsert) 和条件同步将数据库表与本地实体列表对齐。它还支持关系数据图插入,这使得在维护外键关系的同时,能够跨多个表添加大量父子记录。 该工具涵盖了广泛的批量数据操作,包括常规 CRUD 处理、表截断和直接表对表数据复制。它还包括用于服务器端批量更新和高性能数据库迁移的实用程序,无需将实体加载到应用程序内存中即可移动大量数据。
Executes bulk operations across related parent-child tables to maintain strict referential integrity.