awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
analysiscenter avatar

analysiscenter/batchflow

0
View on GitHub↗
analysiscenter.github.io/batchflow↗

Batchflow

BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.

Features

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI
Data Pipelines - Tools for working with random or sequential data batches.
205 stars·45 forks·Python·Apache-2.0·10 views

Star history

Star history chart for analysiscenter/batchflowStar history chart for analysiscenter/batchflow

How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

Projects sharing features with Batchflow

These projects share indexed features with Batchflow. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
  • akfamily/akshareakfamily avatar

    akfamily/akshare

    16,358View on GitHub↗

    This project is a Python library designed for the programmatic retrieval and analysis of diverse financial datasets. It functions as a comprehensive toolkit for quantitative research, providing a unified interface to fetch historical and real-time market data across asset classes including equities, futures, bonds, cryptocurrencies, and foreign exchange. By abstracting complex network requests into simple, parameter-driven functions, it enables users to integrate financial data into research workflows and automated trading systems. The library distinguishes itself through its scraper-based ag

    Pythonacademicakshareasset-pricing
    View on GitHub↗16,358
  • apache/airflowapache avatar

    apache/airflow

    47,414View on GitHub↗

    Airflow is a platform for programmatically authoring, scheduling, and monitoring complex data pipelines. It functions as a workflow automation engine that manages the lifecycle of recurring business processes by executing code-defined task dependencies. By representing workflows as directed acyclic graphs, the system ensures that task execution order and data flow are explicitly defined and reliably maintained across distributed computing environments. The platform distinguishes itself through a highly modular, provider-based architecture that decouples core orchestration logic from external

    Pythonairflowapacheapache-airflow
    View on GitHub↗47,414
  • apache/beamapache avatar

    apache/beam

    8,612View on GitHub↗

    Apache Beam is a distributed data pipeline framework and unified data processing model designed to handle both bounded batch data and unbounded real-time streams. It provides a system for building scalable, data-parallel workflows that operate across compute clusters using a single programming model. The framework utilizes a cross-runner pipeline abstraction that decouples the data processing logic from the underlying execution backend, allowing the same pipeline to run on different distributed compute engines. It supports multi-language pipeline development by translating high-level code fro

    Java
    View on GitHub↗8,612
  • activeloopai/deeplakeactiveloopai avatar

    activeloopai/deeplake

    9,265View on GitHub↗

    DeepLake is AI data infrastructure consisting of a multimodal data lake, a hybrid search engine, and a serverless vector database. It provides a PostgreSQL-based AI data runtime that combines multimodal storage with streaming pipelines to load and shuffle datasets from cloud storage directly into deep learning training pipelines. The system utilizes lazy indexing to store and slice images, audio, and video without loading entire files into memory. It enables retrieval-augmented generation by persisting high-dimensional embeddings in a serverless vector store and implementing hybrid search tha

    C++agentagentic-ragai
    View on GitHub↗9,265
Compare all 30 related projects→

Frequently asked questions

What does analysiscenter/batchflow do?

BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.

What are the main features of analysiscenter/batchflow?

The main features of analysiscenter/batchflow are: Data Pipelines.

Which projects share features with analysiscenter/batchflow?

Projects with overlapping indexed features include: akfamily/akshare — This project is a Python library designed for the programmatic retrieval and analysis of diverse financial datasets.… apache/airflow — Airflow is a platform for programmatically authoring, scheduling, and monitoring complex data pipelines. It functions… apache/beam — Apache Beam is a distributed data pipeline framework and unified data processing model designed to handle both bounded… apache/flume — Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving… apache/incubator-pulsar — Apache Pulsar is a cloud-native message queue and distributed publish-subscribe messaging system. It serves as a… activeloopai/deeplake — DeepLake is AI data infrastructure consisting of a multimodal data lake, a hybrid search engine, and a serverless…