2 个仓库
Processes for combining data from columns with the same name across multiple data structures using custom logic.
Distinct from Column-Major Storage: The provided candidates focus on extraction, name listing, or storage architecture, not the logic of merging contents of columns.
Explore 2 awesome GitHub repositories matching data & databases · Column Data Merging. Refine with filters or upvote what's useful.
Spark NLP 是一个构建在 Apache Spark 分布式计算框架之上的可扩展文本分析和机器学习工具包。它提供了一个多模态机器学习框架和一个用于对标注器进行排序以处理大规模语言数据的分布式流水线系统。该库包含一个用于生成上下文向量嵌入的 Transformer 文本处理器,以及一个用于管理大型语言模型的专用推理引擎。 该项目通过其在统一视觉-语言架构内处理异构数据类型(包括文本、音频和图像)的能力而脱颖而出。它支持高级生成式 AI 功能,如提示工程、具有约束 JSON 输出的结构化实体提取,以及消除网络延迟的本地推理。此外,它还提供跨文本和图像模态的跨语言翻译和零样本分类工具。 该框架涵盖了广泛的功能,包括用于实体识别和情感分析的监督模型训练,以及抽取式问答和文档摘要。它集成了向量数据库支持以进行相似性搜索,并为 GPU 加速和通过集中式注册表进行模型生命周期管理提供了基础设施。 该工具包允许通过公共仓库分发自定义模型和流水线,并支持通过 REST API 部署模型。
Concatenates multiple annotation metadata columns into a single consolidated column while preserving metadata.
DataFrame is a C++ tabular data library and manipulation engine designed for managing heterogeneous data in contiguous memory. It functions as a statistical analysis framework and time series analysis toolkit, providing the means to store, index, and transform multidimensional datasets. The project distinguishes itself through a high-performance execution model that utilizes column-major storage, SIMD-aligned memory allocation, and a thread-pool for parallel computations. It employs a visitor-based algorithm dispatch system and policy-driven transformations to decouple data processing logic f
Merges contents of the same named column from multiple dataframes using a custom functor for logic.