awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
Back to twitter/elephant-bird

Projects sharing features with Elephant Bird

19 open-source projects similar to twitter/elephant-bird, ranked by shared indexed features. Tags may describe platforms or build tools rather than the same primary purpose. Check each project’s use case, license, and deployment requirements before treating it as a replacement.

  • alibaba/jstormalibaba avatar

    alibaba/jstorm

    3,877View on GitHub↗

    jStorm is a distributed stream processing engine designed for executing low-latency computations on high-volume data streams using Apache Storm topologies. It functions as a real-time data analytics platform and distributed task orchestrator that manages complex data pipelines via directed acyclic graph execution. The system provides a scalable framework for data pipeline management, incorporating backpressure-aware flow control to regulate ingestion rates and dynamic resource allocation to adjust computing resources based on real-time demand. It maintains compatibility with Apache Storm conf

    Java
    View on GitHub↗3,877
  • apache/flinkapache avatar

    apache/flink

    26,086View on GitHub↗

    Apache Flink is a distributed processing engine designed for both high-throughput, low-latency data streams and finite batch workloads. It functions as a stateful stream processor and a SQL stream processing engine, providing a unified runtime to execute relational queries and event-based transformations. The system is distinguished by its ability to manage persistent operator state to ensure exactly-once processing guarantees and consistency during failures. It features specialized capabilities for complex event processing to detect temporal patterns and handles out-of-order events using eve

    Java
    View on GitHub↗26,086
  • apache/hadoopapache avatar

    apache/hadoop

    15,567View on GitHub↗

    Hadoop is a big data infrastructure suite and distributed data processing framework designed to store and process massive datasets across clusters of computers. It consists of a distributed storage system for managing large files across multiple nodes and a parallel computing engine for processing data across a distributed cluster. The framework implements a distributed file system to ensure fault tolerance and high throughput, paired with a programming model that processes large datasets in parallel. It manages the underlying hardware and software environment required for distributed big dat

    Java
    View on GitHub↗15,567

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Find more with AI search
  • apache/stormapache avatar

    apache/storm

    6,683View on GitHub↗

    Storm is a distributed stream processing framework designed to execute unbounded computations across a cluster to process real-time data streams. It functions as a data pipeline orchestrator that allows users to define and deploy declarative data flow graphs connecting streaming sources to processing components. The system operates as a multi-tenant distributed compute engine that isolates workloads and limits resource usage across shared clusters using dedicated pools and access control. It is also a secure distributed processing engine that employs encrypted node communication and SSL-secur

    Java
    View on GitHub↗6,683
  • cloudera/oryxC

    cloudera/oryx

    0View on GitHub↗
    View on GitHub↗0
  • etsy/oculusetsy avatar

    etsy/oculus

    707View on GitHub↗

    The metric correlation component of Etsy's Kale system

    Java
    View on GitHub↗707
  • google/mr4cgoogle avatar

    google/mr4c

    901View on GitHub↗

    Introduction to the MR4C repo

    Java
    View on GitHub↗901
  • h2oai/h2o-2h2oai avatar

    h2oai/h2o-2

    2,253View on GitHub↗

    Please visit https://github.com/h2oai/h2o-3 for latest H2O

    Java
    View on GitHub↗2,253
  • hortonworks/gohadoopH

    hortonworks/gohadoop

    0View on GitHub↗
    View on GitHub↗0
  • hydrospheredata/mistHydrospheredata avatar

    Hydrospheredata/mist

    324View on GitHub↗

    Serverless proxy for Spark cluster

    Scala
    View on GitHub↗324
  • landoop/schema-registry-uiLandoop avatar

    Landoop/schema-registry-ui

    425View on GitHub↗

    This is a web tool for the confluentinc/schema-registry in order to create / view / search / evolve / view history & configure Avro schemas of your Kafka cluster.

    JavaScript
    View on GitHub↗425
  • linkedin/datafuL

    linkedin/datafu

    0View on GitHub↗
    View on GitHub↗0
  • linkedin/gobblinlinkedin avatar

    linkedin/gobblin

    2,267View on GitHub↗

    A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.

    Java
    View on GitHub↗2,267
  • mara/data-integrationmara avatar

    mara/data-integration

    2,087View on GitHub↗

    A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

    Python
    View on GitHub↗2,087
  • oryxproject/oryxoryxproject avatar

    oryxproject/oryx

    1,783View on GitHub↗

    Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

    Java
    View on GitHub↗1,783
  • spotify/luigispotify avatar

    spotify/luigi

    18,676View on GitHub↗

    Luigi is a Python framework designed for building and managing complex batch data pipelines. It functions as a workflow orchestration engine that organizes tasks into directed acyclic graphs, ensuring that jobs execute in the correct logical order based on their dependencies. By utilizing a centralized scheduler, the system coordinates task execution across distributed environments, tracks global workflow state, and prevents redundant processing by verifying the existence of output targets before triggering any work. The project distinguishes itself through a robust state-tracking mechanism t

    Pythonhadoopluigiorchestration-framework
    View on GitHub↗18,676
  • spring-projects/spring-xdspring-projects avatar

    spring-projects/spring-xd

    476View on GitHub↗

    Spring XD makes it easy to solve common big data problems such as data ingestion and export, real-time analytics, and batch workflow orchestration

    Java
    View on GitHub↗476
  • twitter/herontwitter avatar

    twitter/heron

    3,632View on GitHub↗

    Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter

    Java
    View on GitHub↗3,632
  • yahoo/samoaY

    yahoo/samoa

    0View on GitHub↗
    View on GitHub↗0