18 dépôts
Capabilities for adding new records to database tables.
Distinguishing note: No existing candidates for insert operations.
Explore 18 awesome GitHub repositories matching data & databases · Insert Operations. Refine with filters or upvote what's useful.
Drizzle ORM is a TypeScript-native database toolkit providing type-safe SQL query building, schema management, and automated migrations across PostgreSQL, MySQL, SQLite, and SingleStore.
Supports type-safe insertion of new records into database tables.
This project is a feature-rich Go client library designed for interacting with Redis. It serves as a comprehensive interface for managing remote data stores, enabling developers to execute standard database commands, handle complex data structures, and perform asynchronous operations within Go applications. The library distinguishes itself through its support for advanced Redis capabilities, including connection pooling, pipelining, and transactional integrity. It provides specialized primitives for managing distributed clusters, including automated topology updates and request routing to sha
Transfers large volumes of data using a specialized protocol mode to minimize network latency and maximize throughput.
Dapper is a lightweight object-relational mapper for .NET that functions as a high-performance data access library. It operates by extending standard database connection interfaces, allowing developers to execute raw SQL queries while automating the mapping of database results to strongly-typed objects. The library distinguishes itself through its use of runtime code generation, which creates high-performance instructions to map database rows to object properties with minimal overhead. It provides flexible data retrieval options, supporting both memory-buffered loading for speed and row-by-ro
Adds large collections of objects to database tables in a single operation.
Apache DataFusion is an extensible, columnar SQL query engine that runs embedded within a host application without requiring a separate server process. It processes data in columnar batches using Apache Arrow for memory-efficient analytics, and can scale analytic workloads across multiple nodes for parallel execution. The engine supports both SQL and DataFrame queries through a modular, streaming architecture that allows custom operators, data sources, functions, and optimizer rules. The engine distinguishes itself through its modular extension framework, which enables building custom query e
Supports INSERT and COPY commands for modifying data in tables.
Delta is a lakehouse table format that brings ACID transactions and data warehouse consistency to large scale data lakes on cloud object storage. It serves as an ACID transaction manager, coordinating atomic commits and serializable isolation for concurrent reads and writes across distributed compute engines. The project provides a multi-engine interoperability layer that uses format translation to allow diverse SQL engines and processing frameworks to read and write the same tables. It functions as a data versioning system, utilizing a transaction log to enable time travel, historical snapsh
Provides capabilities for adding new records to tables via atomic commits.
This project is a Go client library and API wrapper for interacting with Elasticsearch clusters. It serves as a programmatic interface for managing documents, indices, and cluster health, allowing Go applications to perform search and indexing operations via the REST API. The library functions as a distributed search orchestrator, providing specialized tools for high-throughput data ingestion and cluster administration. It features a buffered bulk processor with exponential backoff retries for optimizing write performance and supports automated index lifecycle transitions and historical data
Optimizes write performance through buffered bulk operations for high-throughput data ingestion.
Eve is a REST API framework that maps database collections to web resources through declarative configuration files. It functions as a database-to-API mapper, automatically exposing data as RESTful endpoints with built-in support for CRUD operations and schema-based request validation. The project distinguishes itself through a HATEOAS API engine that generates hypermedia links and resource schemas for dynamic client discovery. It also includes an automated Swagger documentation generator that produces interactive specifications for client SDK generation and testing. The framework provides a
Supports inserting multiple records in a single request to optimize performance and reduce overhead.
Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis
Ships built-in connectors for bulk ingestion of processed data into search indices.
pgloader is a command-line tool that automates the migration of data and schema from various source databases and file formats into PostgreSQL. It combines schema discovery, parallel data pipelines, and type casting into a single, declarative workflow, using PostgreSQL's COPY protocol for high-throughput bulk loading. The tool distinguishes itself by compiling a dedicated command language into concurrent reader-writer pipelines that handle schema introspection, data transformation, and error-resilient batch processing. It supports migrating entire databases from MySQL, MS SQL, SQLite, and Pos
Drops indexes and disables triggers before copying data to speed up bulk inserts.
GreptimeDB is a distributed, open-source time-series database built for unified observability. It stores and queries metrics, logs, and traces together in a single columnar engine, supporting both SQL and PromQL for analysis. The database is designed as a Kubernetes-native operator with a decoupled compute and storage architecture, enabling horizontal scaling and multi-region deployment. What distinguishes GreptimeDB is its role as a multi-protocol ingestion gateway, accepting data through OpenTelemetry, Prometheus Remote Write, InfluxDB, Loki, Elasticsearch, Kafka, and MQTT protocols without
Accepts NDJSON data through the Elasticsearch _bulk HTTP endpoint, mapping each index to a table.
SqlSugar is an object-relational mapping library for .NET that translates C# and VB objects into database queries and tables without requiring raw SQL. It is designed as a multi-database ORM supporting SQL Server, MySQL, PostgreSQL, Oracle, MongoDB, ClickHouse, and other databases through a unified API, and it is compatible with .NET AOT compilation for native ahead-of-time deployment. The library distinguishes itself through high-speed bulk data operations that can insert or update millions of records in seconds using batch processing instead of row-by-row handling. It also provides multi-te
Performs high-speed bulk inserts and updates for millions of records using batch operations.
pg is a PostgreSQL object-relational mapper (ORM) for Go that maps Go structs to database tables and provides a fluent query builder for constructing SQL statements programmatically. At its core, it automatically generates CREATE TABLE statements from Go struct definitions using struct tags and naming conventions, and builds queries through method chaining with placeholder-based parameter binding to prevent SQL injection. The library distinguishes itself through relation-aware join generation that automatically constructs JOIN clauses for has-one, has-many, many-to-many, and polymorphic assoc
Performs batch inserts, updates, and deletes on multiple rows in a single database round trip.
ServiceStack est un framework web .NET haute performance conçu pour construire des API typées en utilisant des objets de requête et de réponse fortement typés. Il fonctionne comme un moteur d'API basé sur les messages qui découple la logique métier de la couche de transport, permettant aux services d'être exposés via plusieurs protocoles incluant HTTP, gRPC et divers fournisseurs de files d'attente de messages. Le framework se distingue par son générateur d'API typé, qui produit des SDK clients natifs et des objets de transfert de données (DTO) à partir des métadonnées de service dans plusieurs langages. Il inclut également une passerelle de service distribuée pour l'orchestration de microservices, un ORM code-first pour traduire directement les objets C# en enregistrements de base de données, et un système centralisé de gestion des identités et des accès pour un accès sécurisé basé sur des jetons. Sa surface de capacités plus large couvre la messagerie asynchrone et le streaming d'événements en temps réel via Pub-Sub et Server-Sent Events. Il fournit une prise en charge complète de la sérialisation des données pour des formats tels que JSON, XML, ProtoBuf et MessagePack, aux côtés de flux d'authentification intégrés incluant JWT, clés API et authentification step-up. L'outillage supplémentaire inclut la génération automatisée d'API CRUD, l'exécution de tâches en arrière-plan et des modèles de tableau de bord administratif.
Writes large volumes of data to relational databases using high-performance bulk ORM implementations.
ActiveAndroid est un framework de persistance pour gérer les bases de données SQLite locales sur Android. Il fournit un système d'ORM (Object-Relational Mapping) de type active record qui lie les tables de base de données aux classes, permettant la persistance et la récupération de données sans écrire de SQL manuel. Le projet se distingue par un outil dédié à la migration de schéma qui met à jour les structures de base de données à l'aide de scripts versionnés chargés depuis les assets de l'application. Il inclut également un framework pour partager le contenu de la base de données entre différentes applications Android via une interface standard de content provider basée sur des URI. La bibliothèque couvre de larges domaines de capacités, notamment l'ORM pour gérer les relations entre tables et les types de données personnalisés, le traitement de transactions en masse pour l'ingestion de données, et l'initialisation automatisée de la base de données à partir de fichiers pré-remplis. Elle fournit en outre des utilitaires pour les requêtes programmatiques et l'indexation de colonnes afin de gérer la recherche et la récupération de données.
Provides high-speed bulk insert and update operations for records using batch processing.
Infinity is a distributed vector database and multimodal vector store designed to manage large-scale datasets for retrieval and similarity search. It serves as a backend for large language model applications and retrieval augmented generation pipelines by storing and retrieving dense vectors, sparse vectors, and full-text data. The system functions as a hybrid search engine, combining vector embeddings and full-text search with reranking algorithms to identify the most relevant documents. It supports multimodal data storage, allowing the maintenance of diverse data types including tensors, st
Implements comprehensive data manipulation operations including inserting, updating, deleting, importing, and exporting rows.
FreeSql is a .NET object-relational mapper and data access layer that translates object-oriented code into SQL for multiple relational database providers. It functions as a fluent SQL query builder and database schema synchronizer, allowing developers to align database table and index structures with entity class definitions. The framework is specifically optimized for .NET Native AOT to ensure reduced memory footprints and faster startup times. It includes a database traffic manager to distribute load through read-write splitting, dynamic table sharding, and tenant-based data isolation. Bro
Performs high-speed bulk inserts, updates, and deletes for millions of records using ORM-level batch operations.
Le pilote MongoDB pour Python est une bibliothèque cliente et un client de base de données NoSQL utilisé pour exécuter des opérations CRUD et gérer les données au sein des bases de données MongoDB en utilisant le langage Python. Il sert de bibliothèque de connectivité de base de données qui gère l'authentification et le pool de connexions, tout en fournissant un client de recherche vectorielle pour gérer les index d'embeddings et récupérer des données basées sur la similarité sémantique. Le pilote prend en charge les modèles de pilotes de base de données synchrones et asynchrones pour effectuer des opérations d'E/S non bloquantes et diffuser des données depuis des clusters de bases de données. Il se distingue par des capacités de recherche spécialisées, notamment la recherche plein texte et l'exécution de recherches vectorielles pour récupérer des données basées sur une similarité mathématique. Sa surface de capacités plus large couvre le stockage et la synchronisation des données, y compris les pipelines d'agrégation multi-étapes, la gestion du cycle de vie des index et la sérialisation binaire BSON. La bibliothèque implémente également des primitives de sécurité telles que le chiffrement côté client au niveau des champs, la sécurité des connexions TLS et l'intégration avec des fournisseurs d'identité cloud. Les fonctionnalités supplémentaires incluent le stockage de fichiers volumineux via une interface de système de fichiers et la surveillance des changements de données en temps réel.
Executes high-speed bulk insert, update, and delete operations in a single request to optimize network traffic.
EFCore.BulkExtensions is a library for executing high-performance batch insert, update, and delete operations within the Entity Framework Core ecosystem. It functions as a database batch processing toolkit and a wrapper for native SQL Bulk Copy to enable faster data ingestion and synchronization across multiple database providers. The library provides specialized capabilities for relational data synchronization, allowing users to align database tables with local entity lists through bulk upserts and conditional synchronization. It also supports relational data graph insertions, which enable t
Executes bulk operations across related parent-child tables to maintain strict referential integrity.