19 个仓库
Techniques for merging rows from multiple tables using various join types based on related columns.
Distinct from Table Data Processing: Specifically focuses on table joins and data combination, rather than general row-level processing.
Explore 19 awesome GitHub repositories matching data & databases · Table Joining Operations. Refine with filters or upvote what's useful.
Perspective is a columnar data analytics engine and high-performance visualization component powered by WebAssembly. It provides a system for analyzing and visualizing large or streaming datasets through interactive data grids and charts, utilizing a compiled binary to achieve near-native performance within the browser. The project distinguishes itself through a WebSocket-based data streaming interface and deep Apache Arrow integration, which minimize memory overhead when synchronizing tables between servers and clients. It acts as a remote query proxy capable of translating visualization con
Combines two source tables on a shared key to create a reactive read-only joined table.
pysheeet 是一个技术参考库,提供了一系列精选的代码片段和实现模式,用于高级 Python 开发、系统集成和高性能计算。它充当实现底层网络编程、原生 C 扩展以及异步和并发编程的综合指南。 该项目为大语言模型的开发和部署提供了专门的框架,包括用于分布式 GPU 推理和高性能服务的工具。它还包括用于高性能计算集群编排的详细模式,涵盖 GPU 资源分配和多节点工作负载管理。 该库涵盖了广泛的功能,包括安全网络通信和加密、对象关系映射和数据库管理,以及复杂数据结构和算法的实现。它还提供用于内存管理、通过外部函数接口(FFI)进行原生互操作以及系统级 OS 集成的实用程序。
Implements data combination from multiple tables using inner and outer joins based on foreign keys.
Jeesite is a full-stack low-code development framework designed for building enterprise administrative portals using Spring Boot, MyBatis, and Vue. It functions as a comprehensive platform for creating administrative dashboards with integrated role-based access control and organizational data permission systems. The framework distinguishes itself through a combination of automated CRUD code generation and an integrated RAG platform that connects large language models to enterprise data via vector stores. It further incorporates a BPMN-based workflow engine to automate complex business process
Retrieves data from associated tables and maps results back to primary entities using various join types.
xorm is a relational mapper and object-relational mapping tool for Go. It translates Go structures into SQL queries and maps database rows back into native objects, providing a multi-dialect database driver that supports MySQL, PostgreSQL, SQLite, Oracle, SQL Server, and TiDB. The project features a read-write splitting manager that routes modification requests to a primary database and read requests to replicas. It includes a database schema synchronizer to automatically align table structures and indexes with application data models, as well as a fluent SQL query builder for constructing co
Combines data from multiple tables using various join types based on related columns.
Pinot is a distributed, columnar analytical database designed for high-concurrency, low-latency query processing. It functions as a real-time OLAP datastore, enabling interactive, user-facing analytics by ingesting and querying massive datasets from both streaming and batch sources. The system architecture relies on a centralized controller for cluster coordination and a distributed segment-based storage model to ensure horizontal scalability. The platform distinguishes itself through a hybrid ingestion pipeline that unifies real-time event streams and historical batch data into a single quer
Optimizes join performance by ensuring data is partitioned identically across tables to eliminate network shuffling.
pg is a PostgreSQL object-relational mapper (ORM) for Go that maps Go structs to database tables and provides a fluent query builder for constructing SQL statements programmatically. At its core, it automatically generates CREATE TABLE statements from Go struct definitions using struct tags and naming conventions, and builds queries through method chaining with placeholder-based parameter binding to prevent SQL injection. The library distinguishes itself through relation-aware join generation that automatically constructs JOIN clauses for has-one, has-many, many-to-many, and polymorphic assoc
Adds JOIN clauses with custom conditions to SELECT queries.
这是一个关系型数据库速查表和 SQL 参考指南。它提供了一系列语法示例和查询文档,用于使用结构化查询语言管理关系型数据库。 该工具实现为一个带有客户端可搜索文档的静态网站,允许通过基于浏览器的索引即时过滤技术内容。 该参考涵盖了关系型数据库管理,包括数据检索、数据库模式管理和记录维护。它还包括关于通过表连接进行关系数据操作以及生成聚合报告的指导。
Provides syntax examples for combining data from multiple tables using various SQL join types.
本项目是一个全面的 pandas 数据分析教程和指南,旨在帮助学习数据处理与分析。它涵盖了表格数据处理、时间序列分析,并提供了清洗、合并及转换数据集的结构化方法。 该仓库还充当数据特征工程课程,提供关于构建和选择数据集特征以提升机器学习模型性能的教程。此外,它还包含用于执行逐元素数学计算和矩阵操作的向量化数据处理指南。 内容涵盖了广泛的功能,包括数据清洗工作流、数据集成任务和表格数据分析。它还提供了处理文本信息、处理分类数据以及优化大规模数据集执行速度的指导。 项目以一系列 Jupyter Notebook 的形式呈现,包含实践练习和针对性的练习题。
Provides tutorials on merging rows from multiple tables using various relational join types.
dplyr 是一个 R 语言数据处理库,为转换表格数据框提供了语法。它充当内存数据框处理器和关系数据代数工具,使用一组一致的动词来过滤、选择和汇总数据。 该项目包含一个 SQL 翻译引擎,可将高级数据处理表达式转换为优化后的查询。这允许用户直接在远程关系数据库和云存储上执行转换,而无需将数据拉取到本地。 该库涵盖了广泛的表格操作,包括列变异、行子集化和关系数据连接。它还提供了分组数据分析功能,允许对数据集进行分区以进行独立的聚合和汇总。
Combines tables using equality, inequality, or rolling joins to find the closest matches.
Sequel is a relational database toolkit for Ruby that provides object-relational mapping, a fluent SQL query builder, and schema migration capabilities. It maps database tables to Ruby classes with support for associations, validations, lifecycle hooks, and eager loading, offering a comprehensive ORM layer for building data-centric applications. Sequel distinguishes itself through a plugin-based extension architecture that allows composable customization of models, databases, and datasets without relying on deep inheritance hierarchies. It includes a thread-safe connection pool with support f
Supports inner, left, and other join types to combine data from multiple tables.
Bun 是一个 Go 语言的类型安全对象关系映射器(ORM),优先考虑 SQL 优先的查询构建和结果映射。它作为一个可编程 SQL 查询构建器、数据库连接管理器以及将数据库表映射到 Go 结构体的工具。 该项目通过多方言 SQL 支持系统脱颖而出,允许单个代码库通过一致的接口与不同的数据库引擎交互。它包括一个用于查询拦截、分布式跟踪和日志记录的内置数据库可观测性工具,以及一个用于版本化结构变更的模式迁移工具。 该库涵盖了广泛的数据操作,包括批量处理、Upsert、软删除以及多态关联等关系数据的管理。它提供使用公用表表达式(CTE)和窗口函数进行高级 SQL 分析的功能,以及原子事务管理和连接池。 模式管理通过用于应用版本化迁移脚本的命令行界面支持。
Provides capabilities for combining rows from multiple tables using various SQL join types.
PostgREST 是一个自动将 PostgreSQL 数据库模式转换为生产就绪 RESTful API 的工具。它作为一个数据库访问层和查询引擎,将 HTTP 请求直接映射到 SQL 查询,提供了一个低代码接口,用于执行创建、读取、更新和删除操作,而无需手动编写样板代码。 该项目通过使用模式驱动的 API 生成和基于元数据的发现,将数据库表公开为可导航资源,从而脱颖而出。它通过执行自定义和模板化 SQL、用于注入业务逻辑的基于插件的中间件系统,以及在运行时加载外部共享库的能力,扩展了标准的 CRUD 功能。 该系统涵盖了广泛的功能,包括具有表连接、聚合和全文搜索的复杂数据查询。它实现了一个全面的安全框架,具有基于令牌的身份验证、细粒度的表级权限和 CORS 管理。其他操作功能包括本地结果缓存、服务器健康监控以及对分布式 SQL 和 Amazon Redshift 的连接支持。 安装支持多种环境,包括作为独立二进制文件或通过 Docker Compose 和 Heroku 自动化模板。
Combines data from two tables in one request using specified join types and conditional operators.
FreeSql 是一个 .NET 对象关系映射器(ORM)和数据访问层,可将面向对象的代码转换为适用于多种关系型数据库提供程序的 SQL。它作为一个流畅的 SQL 查询构建器和数据库架构同步器,允许开发者将数据库表和索引结构与实体类定义保持一致。 该框架专门针对 .NET Native AOT 进行了优化,以确保更小的内存占用和更快的启动时间。它包含一个数据库流量管理器,通过读写分离、动态分表和基于租户的数据隔离来分配负载。 其广泛的功能包括使用特定于提供程序的批量复制机制实现高性能数据摄入,利用窗口函数和递归 CTE 进行高级查询,以及基于 AOP 的数据变更审计监控。该系统还提供用于自动迁移的架构管理工具,以及用于从数据库元数据生成实体类的开发实用程序。
Modifies data in one table based on matching values found in another related table through a join.
test_db is a collection of tools for validating database integrity, benchmarking system throughput, and generating synthetic schemas and datasets. It includes a sample corporate employee database for MySQL, a SQL dataset generator for creating representative records, and an integrity validator that uses checksums and record counts to verify data consistency across different database engines. The project provides a database performance benchmark consisting of complex queries and stored procedures designed to measure system response times and throughput. These tools simulate real-world workload
Evaluates system throughput by executing complex aggregation queries that force heavy resource usage across multiple tables.
Velox 是一个高性能 C++ 查询执行引擎和列式数据处理库。它作为一个用于实现分析型查询引擎的可组合框架,提供了向量化表达式评估器和数据管理系统工具包。 该项目以使用向量化列式执行和基于 Arena 的内存分配来处理大规模数据集而著称。它具有专门的优化功能,如广播连接表缓存、动态过滤器下推和字典编码,以减少内存开销并加速分析读取。 该引擎涵盖了广泛的分析能力,包括实现哈希连接、合并连接和半连接,以及多阶段并行聚合和窗口函数计算。它提供了用于列式内存存储、Parquet 数据解码以及与云存储集成的原语。 通过用于自定义标量和聚合函数的函数注册系统提供可扩展性,并提供高级绑定以将 C++ 逻辑连接到 Python。
Stores hash tables in a global cache to let subsequent tasks reuse data without rebuilding it.
该项目是一个针对 R 的高性能表格数据处理框架,旨在以内存效率和速度处理海量数据集。它提供了一种增强的数据结构,利用引用语义和就地修改来执行复杂的转换,而无需不必要的对象复制开销。 该库凭借其底层架构优化脱颖而出,包括多线程并行处理、基数排序和内存映射文件解析。通过将关键的数据操作和聚合例程卸载到编译后的 C 代码,它实现了对原本计算昂贵的任务的快速执行。其核心引擎支持高级关系操作,如非等值连接、滚动连接和重叠区间连接,以及用于加速重复数据访问的自动二级索引。 除了主要的处理功能外,该项目还提供了一套全面的数据生命周期管理工具。这包括具有自动类型检测的高速摄取和序列化工具,以及对时间序列分析和多维聚合的专门支持。该框架旨在实现可扩展性,允许用户在包含数十亿行的数据集上执行复杂的分组、过滤和重塑操作,同时保持系统稳定性和性能。
Combines multiple datasets using equi, non-equi, rolling, range, or interval join methods.
Camelot is a Python library and processing engine designed to extract tabular data from PDF documents. It converts unstructured tables into machine-readable formats such as CSV, JSON, and Excel. The project provides specialized toolsets for different document types, using line detection for ruled tables and whitespace analysis for borderless tables. It includes an optical character recognition system to recover structured data from image-based scanned PDFs that lack a digital text layer. The library handles complex document layouts, including encrypted files, rotated pages, and tables that s
Combines table continuations spanning across multiple pages into a single unified data structure.
Jet is a schema-driven code generation tool and type-safe SQL builder for Go. It introspects database schemas to automatically generate builders and data models, enabling compile-time type checking for table and column references to prevent runtime errors. The project distinguishes itself through a fluent interface that mirrors native SQL syntax, allowing for the orchestration of complex queries including common table expressions, recursive queries, and nested JSON structures. It further optimizes data retrieval by binding query outputs directly into generated Go structures or raw byte slices
Enables updating records in one table based on values or filters from another table using joins.
Drift is a type-safe SQL persistence library and relational mapper that provides a structured way to map database tables to classes and execute SQL queries with build-time validation. It functions as a type-safe query builder and a wrapper for SQLite and PostgreSQL, eliminating manual result set parsing by binding query outputs to native objects. The project distinguishes itself through a build-time code generation system that produces type-safe APIs and validates raw SQL statements against database versions before execution. It features reactive query streaming, which transforms SQL queries
Supports merging rows from multiple tables using various join types to filter results based on referenced table conditions.