33 repositorios
General-purpose tools for data import, export, and transformation.
Explore 33 awesome GitHub repositories matching part of an awesome list · Data Utilities. Refine with filters or upvote what's useful.
graphql-engine is an automated GraphQL API engine that transforms database tables and relationships into a queryable GraphQL schema. It functions as a federation gateway and mapper, instantly generating APIs with built-in filtering, pagination, and mutations from existing databases and remote schemas. The project distinguishes itself through a fine-grained access control layer that enforces row-level and field-level permissions. It further provides a real-time data subscription server that converts standard queries into live streams and a system for triggering event-driven webhooks and notifi
Real-time GraphQL API engine for PostgreSQL.
PostgREST is a standalone server process that automatically transforms a relational database schema into a fully functional RESTful API. By querying system catalogs at startup, it maps tables, views, and stored procedures into standardized web endpoints, allowing developers to build backend services by focusing exclusively on database design. The service functions as a declarative engine that translates HTTP requests and query parameters directly into native SQL operations. It maintains stateless request processing and integrates connection pooling to manage high-frequency interactions effici
RESTful API server for PostgreSQL.
PostGraphile is an automated tool that converts a PostgreSQL database schema into a fully functional GraphQL API. It serves as a GraphQL execution engine and schema orchestrator, utilizing database schema introspection to retrieve strongly typed metadata directly from PostgreSQL. The project features a modular system for composing and standardizing GraphQL schemas through plugins, which manage naming conventions and connections. It includes a PostgreSQL query builder that constructs dynamic, SQL-injection-proof queries using tagged template literals. The system employs a declarative query pl
Instant GraphQL API generator.
pgloader is a command-line tool that automates the migration of data and schema from various source databases and file formats into PostgreSQL. It combines schema discovery, parallel data pipelines, and type casting into a single, declarative workflow, using PostgreSQL's COPY protocol for high-throughput bulk loading. The tool distinguishes itself by compiling a dedicated command language into concurrent reader-writer pipelines that handle schema introspection, data transformation, and error-resilient batch processing. It supports migrating entire databases from MySQL, MS SQL, SQLite, and Pos
High-speed data loading utility.
PostgREST es una herramienta que transforma automáticamente un esquema de base de datos PostgreSQL en una API RESTful lista para producción. Sirve como capa de acceso a base de datos y motor de consultas que mapea solicitudes HTTP directamente a consultas SQL, proporcionando una interfaz low-code para ejecutar operaciones de creación, lectura, actualización y eliminación (CRUD) sin requerir código boilerplate manual. El proyecto se distingue por utilizar la generación de API basada en esquemas y el descubrimiento basado en metadatos para exponer las tablas de la base de datos como recursos navegables. Extiende las capacidades CRUD estándar mediante la ejecución de SQL personalizado y con plantillas, un sistema de middleware basado en plugins para inyectar lógica de negocio y la capacidad de cargar librerías compartidas externas en tiempo de ejecución. El sistema cubre una amplia gama de capacidades, incluyendo consultas de datos complejas con joins de tablas, agregaciones y búsqueda de texto completo. Implementa un framework de seguridad integral que incluye autenticación basada en tokens, permisos granulares a nivel de tabla y gestión de CORS. Las características operativas adicionales incluyen caché de resultados local, monitoreo de salud del servidor y conectividad para SQL distribuido y Amazon Redshift. La instalación es compatible con múltiples entornos, incluyendo como binario independiente o mediante plantillas de automatización de Docker Compose y Heroku.
Golang-based RESTful API server.
Sync data from one Postgres database to another
Tool for syncing database data locally.
Automatically identify anti-patterns in SQL queries
SQL anti-pattern detection tool.
Anonymization and synthetic data generation tool.
Import CSV and JSON into PostgreSQL the easy way
CSV and JSON import utility.
ZSON is a PostgreSQL extension for transparent JSONB compression
JSONB compression extension.
Export data from PostgreSQL into different data formats
Data export tool for various formats.
Regression Testing your SQL queries
Regression testing suite for SQL queries.
database gateway for building data-driven applications
Database gateway for building data-driven applications.
:elephant: :bustsinsilhouette: Manage PostgreSQL roles and privileges from YAML or LDAP
Role and privilege synchronization tool.
A command line client for the PostgreSQL Extension Network
CLI for the PostgreSQL Extension Network.
The legacy distributed object storage server developed by PitchPoint Solutions can store billions of large and small files using minimal resources. Object data is stored in replicated volumes implemented like Facebooks Haystack Object Store. Object metadata which essentially maps an object name to a volume position is stored in an elasticsearch index. (Development by PitchPoint Solutions has been discontinued)
Distributed object storage server compatible with OpenStack Swift.
A PostgreSQL SQL syntax beautifier.
SQL syntax beautifier.
Efficient, asynchronous batching and caching in clustered environments, port of Facebook DataLoader
Batching and caching utility for data layers.
This module allows you to schedule an event using a Cron specification. It can either send or publish a message to the address of your choice. If the consumer of that message returns a response, you can specify where to send that response when the consumer completes. You can also cancel the…
Event bus and Observable-based cron scheduler.
The goal of this micro-library is to offer a simple way to deploy verticles from a HOCON configuration. More specifically, it allows to:
Deployment of verticles using HOCON configuration files.