13 Repos
Programmatic interfaces for iterating through collections to execute multiple insert statements.
Distinct from Data Insertion Interfaces: Distinct from Data Insertion Interfaces: focuses on the iteration and batching logic for multiple records.
Explore 13 awesome GitHub repositories matching data & databases · Batch Insertion Interfaces. Refine with filters or upvote what's useful.
Dapper is a lightweight object-relational mapper for .NET that functions as a high-performance data access library. It operates by extending standard database connection interfaces, allowing developers to execute raw SQL queries while automating the mapping of database results to strongly-typed objects. The library distinguishes itself through its use of runtime code generation, which creates high-performance instructions to map database rows to object properties with minimal overhead. It provides flexible data retrieval options, supporting both memory-buffered loading for speed and row-by-ro
Processes collections of objects by iterating through them to execute individual insert statements.
This project is a type-safe database toolkit and object-relational mapper designed to enforce structural consistency between database schemas and application code. By leveraging compile-time validation, it ensures that SQL queries and data structures remain synchronized, preventing common errors before the application executes. It provides a comprehensive framework for relational data modeling, allowing developers to define table associations and map database results directly into strongly-typed language objects. The library distinguishes itself through its focus on compile-time safety and au
Supports efficient batch insertion of multiple records to reduce query overhead.
This is a Laravel Excel integration library used for importing and exporting spreadsheet files within the Laravel framework. It functions as both a spreadsheet data exporter for converting database queries and collections into files and a spreadsheet data importer for mapping workbook data to database models. The library includes an HTML to spreadsheet converter that transforms HTML table templates into downloadable documents to preserve specific layout designs. It supports large dataset exports via background queuing and processes bulk data imports through chunked reading and batch inserts.
Implements programmatic interfaces to execute multiple database insert statements in batches during spreadsheet imports.
EmDash is an open-source content management system built on Astro that combines a visual admin panel with a plugin-driven architecture and server-side rendering. It provides a complete content management system with structured content modeling, a rich text editor using Portable Text format, and a TypeScript API for type-safe content queries. The system supports authentication through passkeys, OAuth 2.1, and external providers, with role-based access control and fine-grained permission scopes. What distinguishes EmDash is its plugin development framework, which supports both native plugins ru
Reads, writes, or deletes multiple records in a single call to reduce round trips and improve throughput.
A lightweight client for managing MariaDB, MySQL, SQL Server, PostgreSQL, SQLite, Interbase and Firebird, written in Delphi and Lazarus/FreePascal
Reads multiple files in a batch into BLOB columns with macros for neighbor fields in a binary-safe manner.
pg is a PostgreSQL object-relational mapper (ORM) for Go that maps Go structs to database tables and provides a fluent query builder for constructing SQL statements programmatically. At its core, it automatically generates CREATE TABLE statements from Go struct definitions using struct tags and naming conventions, and builds queries through method chaining with placeholder-based parameter binding to prevent SQL injection. The library distinguishes itself through relation-aware join generation that automatically constructs JOIN clauses for has-one, has-many, many-to-many, and polymorphic assoc
Combines multiple row insertions, updates, or deletions into single SQL statements to reduce round trips.
Inngest is a durable execution framework and event-driven automation engine designed to orchestrate background workflows. It enables developers to build resilient, stateful processes by memoizing function steps, ensuring that long-running tasks can automatically resume from the last successful operation after failures, timeouts, or infrastructure restarts. The platform distinguishes itself through its event-driven architecture, which uses a schema-validated bus to trigger functions and coordinate complex, multi-step logic. It employs an onion-model middleware approach for cross-cutting concer
Aggregates multiple individual database events into a single execution to improve efficiency when performing bulk operations.
Querydsl ist ein Framework für die Konstruktion typsicherer Abfragen. Es verwendet eine Fluent-API und annotationsbasierte Codegenerierung, um Spiegelklassen aus Domänenmodellen zu erstellen, was eine Validierung von Datenbankabfragen zur Kompilierzeit ermöglicht und die Notwendigkeit manueller String-Verkettung beseitigt. Das Projekt bietet eine einheitliche Abfragesyntax, die in spezifische Dialekte für mehrere Backends übersetzt wird, einschließlich SQL, MongoDB, Lucene und JDO. Es unterstützt fortgeschrittene Abfragefunktionen wie Common Table Expressions, Window-Funktionen, geospatiale Operationen und komplexe verschachtelte Subqueries. Über den Datenabruf hinaus deckt das Framework die typsichere DML-Ausführung für Massenaktualisierungen und -löschungen sowie das Result-Mapping in Java-Beans, Konstruktoren oder Tupel ab. Es beinhaltet Unterstützung für In-Memory-Collection-Abfragen und integriert sich in das Spring-Framework für Transaktionsmanagement und Verbindungsverwaltung.
Bundles multiple consecutive insert, update, or delete operations into a single database round trip.
Bun ist ein typsicherer Object-Relational-Mapper für Go, der SQL-first-Abfragekonstruktion und Result-Mapping priorisiert. Er fungiert als programmierbarer SQL-Abfrage-Builder, Datenbank-Verbindungsmanager und Tool zur Abbildung von Datenbanktabellen auf Go-Structs. Das Projekt zeichnet sich durch ein Multi-Dialekt-SQL-Unterstützungssystem aus, das es einer einzigen Codebasis ermöglicht, über eine konsistente Schnittstelle mit verschiedenen Datenbank-Engines zu interagieren. Es enthält ein integriertes Datenbank-Observability-Tool für Abfrage-Interzeption, verteiltes Tracing und Logging sowie ein Schema-Migrations-Tool zur Versionierung struktureller Änderungen. Die Bibliothek deckt ein breites Spektrum an Datenoperationen ab, einschließlich Bulk-Verarbeitung, Upserts, Soft-Deletes und der Verwaltung relationaler Daten wie polymorpher Assoziationen. Sie bietet Funktionen für fortgeschrittene SQL-Analysen unter Verwendung von Common Table Expressions und Window-Funktionen, neben atomarem Transaktionsmanagement und Connection-Pooling. Das Schema-Management wird über eine Kommandozeilenschnittstelle zur Anwendung versionierter Migrationsskripte unterstützt.
Synchronizes data by performing combined insert, update, or delete operations in a single SQL statement.
Orioledb is a cloud-native storage engine for PostgreSQL designed to replace the default storage layer to improve vertical scalability and performance on modern hardware. It functions as an index-organized table store, organizing table rows directly within the primary index to accelerate data retrieval. The engine utilizes an undo log storage system to manage data versioning, which eliminates the need for manual vacuuming and prevents table bloat. It further reduces the disk footprint through block-level and page-level data compression. The project provides capabilities for advanced index ma
Implements a batch page insertion path to reduce lock contention and increase write throughput.
EFCore.BulkExtensions ist eine Bibliothek zur Ausführung hochperformanter Batch-Insert-, Update- und Delete-Operationen innerhalb des Entity-Framework-Core-Ökosystems. Sie fungiert als Toolkit für die Batch-Verarbeitung von Datenbanken und als Wrapper für natives SQL Bulk Copy, um eine schnellere Datenaufnahme und Synchronisierung über mehrere Datenbankanbieter hinweg zu ermöglichen. Die Bibliothek bietet spezialisierte Funktionen für die Synchronisierung relationaler Daten, die es Benutzern ermöglichen, Datenbanktabellen mit lokalen Entitätslisten durch Bulk-Upserts und bedingte Synchronisierung abzugleichen. Sie unterstützt zudem das Einfügen relationaler Datengraphen, was das Hinzufügen großer Mengen von Eltern- und Kinddatensätzen über mehrere Tabellen hinweg unter Wahrung von Fremdschlüsselbeziehungen ermöglicht. Das Tool deckt ein breites Spektrum an Bulk-Datenoperationen ab, einschließlich allgemeiner CRUD-Verarbeitung, Tabellen-Truncation und direktem Kopieren von Daten von Tabelle zu Tabelle. Es enthält zudem Dienstprogramme für serverseitige Batch-Updates und hochperformante Datenbankmigrationen, um große Datenmengen zu verschieben, ohne Entitäten in den Anwendungsspeicher zu laden.
Executes multiple row modifications or deletions in a single round trip to the database using filtered queries.
linq2db is a type-safe object-relational mapper that translates LINQ expressions into optimized SQL queries for multiple database providers. It functions as a database mapper that links classes to tables and includes a SQL query builder and a command-line schema tool for generating data classes from existing databases. The project provides high-performance bulk data processing for inserting and loading large volumes of records via batch or binary copy methods. It also supports advanced SQL operations, including window functions, common table expressions for recursive hierarchical querying, an
Inserts large collections of records using efficient batching or binary copy interfaces.
Drift is a type-safe SQL persistence library and relational mapper that provides a structured way to map database tables to classes and execute SQL queries with build-time validation. It functions as a type-safe query builder and a wrapper for SQLite and PostgreSQL, eliminating manual result set parsing by binding query outputs to native objects. The project distinguishes itself through a build-time code generation system that produces type-safe APIs and validates raw SQL statements against database versions before execution. It features reactive query streaming, which transforms SQL queries
Groups multiple insert statements into a single operation to improve write performance.