encode/databasesArchived
Databases
This project is an asyncio database abstraction layer that provides a common interface for performing non-blocking database operations in Python. It functions as an asynchronous database driver wrapper and a SQL expression builder, allowing for the construction of raw SQL strings from structured Python objects.
The library includes an asyncio connection pool manager that utilizes task-local storage to handle connection lifecycles and reduce resource overhead. It also serves as an async database transaction manager, wrapping operations in atomic transactions and savepoints to maintain data integrity.
The system covers broad capabilities including asynchronous data streaming for processing large result sets without high memory usage and the management of database schemas. Additionally, it provides tools for automated database testing by isolating test data through transaction rollbacks.
Features
- Database Abstraction Layers - Provides a unified asyncio interface for performing non-blocking database operations across multiple drivers.
- Database Driver Abstractions - Provides a common abstraction layer that wraps multiple asynchronous database drivers for a consistent API.
- Asynchronous Database Drivers - Provides non-blocking database operations via asynchronous drivers and structured query expressions.
- Connection Pooling - Implements an asynchronous connection pooling system to optimize resource efficiency across Python tasks.
- Connection Pools - Maintains a cache of reusable database connections to improve efficiency across asynchronous tasks.
- Task-Local - Utilizes task-local storage in its connection pool manager to ensure connection reuse throughout specific asynchronous chains.
- Connection Pool Managers - Automatically manages the lifecycle of database connections to optimize resource utilization.
- Database Query Execution - Enables execution of SQL queries for data retrieval and schema modification through a common interface.
- Database Transaction Management - Manages database transaction boundaries and savepoints to ensure atomic changes and data integrity.
- Database Transactions - Ensures data consistency by wrapping multiple operations in ACID-compliant transactions and savepoints.
- SQL Expression Builders - Ships a SQL expression builder that translates structured Python objects into raw SQL strings for execution.
- Query Result Fetching - Offers asynchronous methods to retrieve single values, individual rows, or complete result sets.
- Non-Blocking Event Loops - Implements a non-blocking event loop architecture to execute database I/O without pausing the Python main thread.
- Cursor-Based Result Streamers - Provides asynchronous cursors to stream large database result sets incrementally and minimize memory usage.
- Nested Transactions - Supports nested transactions and savepoints to group multiple database operations into atomic units.
- Row-Based Result Streaming - Iterates through database records sequentially using asynchronous cursors to prevent high memory consumption.
- SQL Query Builders - Offers a programmatic builder to construct raw SQL strings from structured Python objects.
- Asynchronous Database Result Streams - Processes large database result sets by iterating over rows one by one to avoid high memory usage.
- Transaction-Based Test Isolation - Provides automated database testing by isolating test data through mandatory transaction rollbacks.
- Test Data Isolation - Isolates test data by wrapping each test case in a transaction that is rolled back upon completion.
- Database Clients - Async database support.
- Database Drivers - Async database access layer for SQLAlchemy core.
- Query Builders - Async SQL query builder for SQLAlchemy Core.
