24 repositorios
Declarative languages for defining data structures and record types.
Distinguishing note: Focuses on schema-based object definition for CRM data models.
Explore 24 awesome GitHub repositories matching data & databases · Schema Definitions. Refine with filters or upvote what's useful.
Polars is a high-performance columnar data processing library designed for efficient analytical workflows. It functions as a structured data library that organizes information into typed columns, utilizing the Apache Arrow memory format to enable zero-copy data sharing and cache-friendly, vectorized operations. The engine is built to handle large-scale tabular datasets, providing both local and distributed analytical runtimes that scale from single-machine environments to multi-node clusters. The project distinguishes itself through a sophisticated lazy query engine that constructs abstract e
Maps column names to specific data types to enforce structure during dataset creation.
TypeORM is an object-relational mapper for TypeScript and JavaScript that bridges the gap between object-oriented application code and relational database tables. It provides a comprehensive data persistence layer that allows developers to define database entities using class decorators or configuration objects, enabling seamless interaction with data through object-oriented patterns. The project distinguishes itself through a flexible architecture that supports both the data mapper and repository patterns, alongside a fluent query builder that translates high-level method calls into platform
Configures database entities using objects to separate model definitions from application logic.
gbrain is an agent framework and retrieval-augmented generation system that combines a durable task queue, a git-synced vector store, and a knowledge graph engine. It provides a foundation for building AI agents that interact with structured knowledge bases using the Model Context Protocol. The system synchronizes markdown files from a git repository into a database for high-performance semantic retrieval and creates typed edges between data pages by extracting entity references and wikilinks. It uses a database-backed queue to execute persistent background jobs and tool loops, ensuring relia
Organizes information using customizable schema packs that define page types and taxonomies based on filesystem structure.
Yup is a JavaScript schema validation library used to define data shapes and validate runtime values. It functions as an object schema validator and a data coercion engine, allowing developers to transform raw input values into desired types before performing validation checks. The library is distinguished by its support for dynamic schema validation, where rules can be adjusted at runtime based on sibling field values or external context. It also enables recursive data structuring for polymorphic fields and provides a system for extracting static TypeScript interfaces from runtime schema def
Combines multiple schemas into a new instance by concatenating settings or merging object shapes.
Joi is a JavaScript data validation library used to define schemas that validate, cast, and sanitize data objects. It functions as an object schema validator and parser, ensuring that input data matches specific types and formats before it is processed by an application. The library features a conditional validation engine capable of dynamic schema enforcement, where validation logic and dependencies change based on the values of other keys within an object. It also serves as a data casting and sanitization tool, transforming input values into target types and removing sensitive keys from the
Supports flexible input types by matching values against multiple possible schema definitions.
Knex is a multi-dialect database client that provides a programmatic SQL query builder, a connection pool manager, and a versioned schema migration tool. It enables programmatic database interaction across multiple SQL engines, including PostgreSQL, MySQL, SQLite3, SQL Server, CockroachDB, and Oracle. The project distinguishes itself through a fluent interface for constructing complex SQL statements and a dedicated framework for database seeding. It utilizes specialized dialects to translate generic query representations into database-specific syntax while maintaining a consistent API across
Enables the programmatic definition and modification of table structures across various SQL database engines.
Presto is a distributed SQL query engine designed for high-performance analytical processing across heterogeneous data sources. It functions as a data federation platform and massively parallel processing engine, allowing users to execute interactive queries against diverse storage systems without requiring data migration. By mapping remote metadata and structures to a unified relational namespace, it enables seamless cross-platform analysis through a standard SQL interface. The engine distinguishes itself through a pluggable connector architecture and a shared-nothing distributed processing
Modifies existing schema metadata and names.
Ajv is a high-performance data validation framework that compiles JSON schemas into optimized, standalone JavaScript functions. By transforming declarative schema definitions into executable code, it eliminates runtime interpretation overhead and provides a secure, efficient way to enforce data integrity across both browser and server environments. The library distinguishes itself through its focus on performance and type safety. It employs advanced compilation techniques, including abstract syntax tree optimization and function caching, to ensure rapid validation. Beyond standard checks, it
Supports extending or modifying existing schema definitions by applying standard merge or patch operations to base schemas.
Gel is an object-relational database system that models data as a graph of interconnected objects. By utilizing a strongly typed schema, it enables complex relational queries and polymorphic data structures without the need for traditional join tables. The system integrates native vector storage and similarity search operators, allowing it to function as both a relational and a vector database for semantic data retrieval. The platform distinguishes itself through a comprehensive suite of developer-centric automation tools. It features a declarative migration system that tracks and versions sc
Integrates schema modifications from development branches into the primary database branch.
dbt-core is a command-line framework for transforming data within a warehouse using modular SQL and version control. It functions as a data transformation engine that enables users to define data structures and business logic through declarative configuration files, which the system then compiles into executable code. By managing complex data dependencies through a directed acyclic graph, it ensures that transformation tasks execute in the correct order while maintaining a manifest-driven state to track lineage and execution history. The project distinguishes itself through an adapter-based d
Automatically updates snapshot tables to ensure historical data remains consistent with current source structures.
Sea-ORM is an asynchronous SQL object-relational mapper and database toolkit for mapping relational tables to strongly typed objects. It provides a relational database mapper for performing CRUD operations across MySQL, PostgreSQL, and SQLite, and includes a programmatic dynamic query builder for constructing complex SQL statements. The project distinguishes itself by providing a GraphQL schema generator that transforms database entities into typed schemas with built-in pagination and filters. It also features a dedicated database migration tool for defining and applying versioned schema chan
Provides a unified toolset for the declarative definition and management of relational database schemas.
Mikro-ORM is a TypeScript-based object-relational mapping system that provides a unified persistence layer for Node.js applications. It translates TypeScript entities into relational or document-based database schemas, supporting a variety of engines including PostgreSQL, MySQL, MariaDB, MS SQL Server, SQLite, and MongoDB. The project implements the data mapper pattern to decouple in-memory domain models from the database persistence layer. It utilizes a unit of work pattern to track entity changes in memory and commit them in a single coordinated database transaction. The library covers com
Provides a declarative system for defining data object structures using schemas and decorators.
Jeesite is a full-stack low-code development framework designed for building enterprise administrative portals using Spring Boot, MyBatis, and Vue. It functions as a comprehensive platform for creating administrative dashboards with integrated role-based access control and organizational data permission systems. The framework distinguishes itself through a combination of automated CRUD code generation and an integrated RAG platform that connects large language models to enterprise data via vector stores. It further incorporates a BPMN-based workflow engine to automate complex business process
Automatically transitions database schemas to new versions using modular update scripts.
CUE is a constraint-based configuration language designed for data validation, schema definition, and code generation. At its core, it unifies types and values into a single concept, enabling compile-time validation that catches structural and value errors before runtime. The language treats data and constraints as the same thing, allowing a single definition to serve as both a schema and concrete configuration data. CUE distinguishes itself through its constraint-based unification engine, which combines multiple configuration sources into a single coherent result by merging their constraints
Declares definitions with # prefix that are automatically closed, enforcing fixed field sets across all usages.
Swashbuckle.AspNetCore es una herramienta de especificación de API y generador de documentación para ASP.NET Core. Extrae metadatos del código fuente y modelos para producir especificaciones OpenAPI estandarizadas e interfaces de navegador interactivas para explorar y probar APIs web. El proyecto integra un componente de middleware para servir estas especificaciones y una Swagger UI para pruebas interactivas de API directamente desde una aplicación en ejecución. También proporciona un exportador de línea de comandos para extraer archivos de especificación de ensamblados de aplicaciones para su uso en pipelines de CI/CD. La herramienta cubre una amplia gama de capacidades, incluyendo la gestión de esquemas para tipos complejos, anotación de metadatos mediante atributos y comentarios XML, y configuración de seguridad para OAuth 2.0 y claves API. Soporta además la gestión de contratos de API, versionado de especificaciones y pipelines de generación personalizables para filtrar o modificar operaciones.
Executes custom logic to modify the schema of specific types instead of applying changes to all schemas.
Zombodb es una extensión de base de datos e indexador de datos relacionales que integra PostgreSQL con Elasticsearch. Proporciona una interfaz de búsqueda SQL, permitiendo a los usuarios ejecutar consultas de búsqueda complejas y agregaciones utilizando funciones y sintaxis SQL estándar en lugar de APIs JSON nativas. El proyecto sincroniza datos relacionales de PostgreSQL a un motor de búsqueda remoto para habilitar la búsqueda de texto completo y analítica de alto rendimiento. El sistema se distingue por tender un puente entre estructuras relacionales y capacidades de motores de búsqueda, específicamente mediante la integración de búsqueda geoespacial para tipos de geometría y geografía. Implementa una capa de mapeo de consultas SQL-a-JSON que permite un análisis de texto avanzado —incluyendo coincidencia difusa, búsquedas de proximidad y puntuación de relevancia— directamente dentro de un entorno relacional. El proyecto cubre áreas de capacidad amplias, incluyendo la gestión del ciclo de vida de índices, sincronización automatizada de datos relacionales y agregaciones analíticas complejas. Soporta indexación espacial para consultas basadas en ubicación, tuberías de análisis de texto personalizadas y herramientas de monitoreo para auditar estadísticas de índices y salud del clúster. La seguridad se maneja mediante conexiones cifradas entre la base de datos y el motor de búsqueda usando TLS.
Automatically generates search index mappings from relational table schemas, supporting nested objects.
This repository is a collection of technical knowledge and solutions focused on mobile application development, particularly for Android and iOS platforms. It covers a wide range of practical engineering challenges, including hotfix and patching techniques, database management and repair, network communication, logging, and video processing. The content is presented as shared knowledge, documenting real-world problems and their implementations. The project provides detailed guidance on applying hotfixes to running Android applications through multiple methods, such as class replacement, full
Automatically upgrades database schemas by updating ORM definitions and calling create table methods to add or modify columns.
apollo-ios is a GraphQL client library for iOS and Apple platforms that enables type-safe network communication. It transforms GraphQL operations into generated Swift models, ensuring that network responses are validated at compile time to eliminate manual mapping. The library features a normalized cache manager that stores entities in a flat structure to maintain data consistency across different application views. It also optimizes network performance using hash-based persisted queries to reduce payload sizes and supports real-time data streaming via WebSockets or HTTP subscriptions. The p
Implements a reconciliation process to merge changes from a source schema variant into a proposal.
This project is a command-line schema-to-code converter designed to transform diverse data specifications into type-safe Python data structures. It functions as a generator for Pydantic models, dataclasses, and typed dictionaries, enabling developers to maintain synchronization between evolving data contracts and application code. By parsing formats such as JSON Schema, OpenAPI, AsyncAPI, Protobuf, and Avro, the tool automates the creation of native classes that reflect the constraints and metadata defined in the source specifications. The generator distinguishes itself through a highly confi
Identifies and merges identical model or enum definitions across a schema to reduce redundancy and simplify the generated codebase.
This project is a code scaffolding tool and database-to-code mapper for Laravel. It functions as a CRUD generator and REST API generator that automates the creation of models, controllers, and administrative interfaces based on database schemas. The tool is distinguished by its template-driven approach, using customizable stub files that allow developers to override default blueprints to enforce specific architectural standards. It provides complete administrative dashboard boilerplates, including integrated authentication, themed UI layouts, and searchable data tables. The system covers a b
Specifies database fields and data types to automatically build framework-specific model definitions.