2 个仓库
Pipelines that scale, encode, and transform streaming data features incrementally before model training.
Distinct from Data Preprocessing Pipelines: Distinct from Data Preprocessing Pipelines: operates on streaming data incrementally rather than batch processing.
Explore 2 awesome GitHub repositories matching data & databases · Streaming Preprocessing Pipelines. Refine with filters or upvote what's useful.
This project is an educational resource providing practical code examples and implementations of machine learning algorithms using the Python language. It serves as a guide for constructing predictive pipelines, clustering models, and dimensionality reduction within the Scikit-Learn ecosystem. The repository includes comprehensive demonstrations for supervised and unsupervised learning, as well as detailed examples for implementing neural networks and deep architectures. It also provides practical guidance on exporting model parameters to JSON and wrapping trained models in web APIs for produ
Provides implementations of pipelines that sequence data preprocessing and estimator steps into a single workflow.
River 是一个用于在线机器学习的 Python 框架,旨在对流式数据进行模型训练和评估。它通过一次处理一个观测值来更新模型参数,从而实现增量学习,无需在内存中存储完整的训练数据集。 该库通过专门的概念漂移(Concept Drift)检测系统脱颖而出,该系统监控数据分布的变化以触发模型自适应。它还提供了一个渐进式验证框架,通过在训练前对样本进行测试来模拟实时部署。 该系统涵盖了广泛的流式处理功能,包括实时特征工程、时间序列预测和在线异常检测。它支持通过增量聚类和决策树进行无监督学习,以及用于模型选择的集成聚合和 Bandit 策略。 该项目包括从 CSV 文件和 API 等来源进行流式数据摄取的实用程序,以及用于计算运行统计信息和内存高效数据草图(Data Sketches)的工具。
Chains preprocessing and estimation steps into sequential workflows for transforming raw streaming features.