33 مستودعات
General-purpose tools for data import, export, and transformation.
Explore 33 awesome GitHub repositories matching part of an awesome list · Data Utilities. Refine with filters or upvote what's useful.
graphql-engine is an automated GraphQL API engine that transforms database tables and relationships into a queryable GraphQL schema. It functions as a federation gateway and mapper, instantly generating APIs with built-in filtering, pagination, and mutations from existing databases and remote schemas. The project distinguishes itself through a fine-grained access control layer that enforces row-level and field-level permissions. It further provides a real-time data subscription server that converts standard queries into live streams and a system for triggering event-driven webhooks and notifi
Real-time GraphQL API engine for PostgreSQL.
PostgREST is a standalone server process that automatically transforms a relational database schema into a fully functional RESTful API. By querying system catalogs at startup, it maps tables, views, and stored procedures into standardized web endpoints, allowing developers to build backend services by focusing exclusively on database design. The service functions as a declarative engine that translates HTTP requests and query parameters directly into native SQL operations. It maintains stateless request processing and integrates connection pooling to manage high-frequency interactions effici
RESTful API server for PostgreSQL.
PostGraphile is an automated tool that converts a PostgreSQL database schema into a fully functional GraphQL API. It serves as a GraphQL execution engine and schema orchestrator, utilizing database schema introspection to retrieve strongly typed metadata directly from PostgreSQL. The project features a modular system for composing and standardizing GraphQL schemas through plugins, which manage naming conventions and connections. It includes a PostgreSQL query builder that constructs dynamic, SQL-injection-proof queries using tagged template literals. The system employs a declarative query pl
Instant GraphQL API generator.
pgloader is a command-line tool that automates the migration of data and schema from various source databases and file formats into PostgreSQL. It combines schema discovery, parallel data pipelines, and type casting into a single, declarative workflow, using PostgreSQL's COPY protocol for high-throughput bulk loading. The tool distinguishes itself by compiling a dedicated command language into concurrent reader-writer pipelines that handle schema introspection, data transformation, and error-resilient batch processing. It supports migrating entire databases from MySQL, MS SQL, SQLite, and Pos
High-speed data loading utility.
PostgREST هي أداة تقوم تلقائياً بتحويل مخطط قاعدة بيانات PostgreSQL إلى API RESTful جاهز للإنتاج. تعمل كطبقة وصول لقاعدة البيانات ومحرك استعلام يقوم بتعيين طلبات HTTP مباشرة إلى استعلامات SQL، مما يوفر واجهة منخفضة الكود لتنفيذ عمليات الإنشاء والقراءة والتحديث والحذف دون الحاجة إلى كود أساسي يدوي. يتميز المشروع باستخدام توليد API القائم على المخطط والاكتشاف القائم على البيانات الوصفية لكشف جداول قاعدة البيانات كموارد قابلة للتنقل. يوسع قدرات CRUD القياسية من خلال تنفيذ SQL مخصص وقائم على القوالب، ونظام برمجيات وسيطة قائم على المكونات الإضافية لحقن منطق الأعمال، والقدرة على تحميل مكتبات مشتركة خارجية في وقت التشغيل. يغطي النظام مجموعة واسعة من القدرات بما في ذلك استعلام البيانات المعقد مع انضمامات الجداول، والتجميعات، والبحث بالنص الكامل. ينفذ إطار عمل أمني شاملاً يتميز بالمصادقة القائمة على الرموز، وأذونات دقيقة على مستوى الجدول، وإدارة CORS. تشمل الميزات التشغيلية الإضافية التخزين المؤقت للنتائج المحلية، ومراقبة صحة الخادم، والاتصال بـ SQL الموزع وAmazon Redshift. يتم دعم التثبيت عبر بيئات متعددة، بما في ذلك كملف ثنائي مستقل أو عبر قوالب أتمتة Docker Compose وHeroku.
Golang-based RESTful API server.
Sync data from one Postgres database to another
Tool for syncing database data locally.
Automatically identify anti-patterns in SQL queries
SQL anti-pattern detection tool.
Anonymization and synthetic data generation tool.
Import CSV and JSON into PostgreSQL the easy way
CSV and JSON import utility.
ZSON is a PostgreSQL extension for transparent JSONB compression
JSONB compression extension.
Export data from PostgreSQL into different data formats
Data export tool for various formats.
Regression Testing your SQL queries
Regression testing suite for SQL queries.
database gateway for building data-driven applications
Database gateway for building data-driven applications.
:elephant: :bustsinsilhouette: Manage PostgreSQL roles and privileges from YAML or LDAP
Role and privilege synchronization tool.
A command line client for the PostgreSQL Extension Network
CLI for the PostgreSQL Extension Network.
The legacy distributed object storage server developed by PitchPoint Solutions can store billions of large and small files using minimal resources. Object data is stored in replicated volumes implemented like Facebooks Haystack Object Store. Object metadata which essentially maps an object name to a volume position is stored in an elasticsearch index. (Development by PitchPoint Solutions has been discontinued)
Distributed object storage server compatible with OpenStack Swift.
A PostgreSQL SQL syntax beautifier.
SQL syntax beautifier.
Efficient, asynchronous batching and caching in clustered environments, port of Facebook DataLoader
Batching and caching utility for data layers.
This module allows you to schedule an event using a Cron specification. It can either send or publish a message to the address of your choice. If the consumer of that message returns a response, you can specify where to send that response when the consumer completes. You can also cancel the…
Event bus and Observable-based cron scheduler.
The goal of this micro-library is to offer a simple way to deploy verticles from a HOCON configuration. More specifically, it allows to:
Deployment of verticles using HOCON configuration files.