Open-source alternatives to Apache Spark Tutorial

Apache Spark is a unified distributed data processing engine designed for large-scale data analysis and computation graphs. It functions as a distributed machine learning framework, a graph processing system, a real-time stream processor, and a SQL analytics engine. The system enables the execution of distributed SQL querying, large-scale graph analysis, and real-time stream analytics across clusters of machines. It also provides a scalable environment for implementing machine learning algorithms and predictive model development on massive datasets. The engine incorporates relational query e

A curated list of awesome Apache Spark packages and resources.

This project is a community-maintained, open-access directory of high-quality public datasets. It serves as a centralized reference point for researchers, developers, and data scientists to locate reliable information sources across a wide spectrum of industries and scientific fields. By providing a structured index, the repository facilitates the discovery of data necessary for exploratory analysis, machine learning model training, and the development of data-intensive applications. The directory distinguishes itself through a lightweight, platform-agnostic approach to resource indexing that

A curated list of awesome network analysis resources.

A schema-aware Scala library for data transformation

Elasticsearch权威指南中文版

a curated list of awesome streaming frameworks, applications, etc

Scala library for accessing various file, batch systems, job schedulers and grid middlewares.

This project is a curated directory of software, frameworks, and educational resources designed for building, scaling, and maintaining distributed data processing and storage architectures. It serves as a comprehensive index for the distributed computing ecosystem, helping users identify the appropriate tools for managing large-scale information systems. The repository functions as a central hub for data engineering, offering categorized access to technologies that support batch and stream processing, machine learning, and interactive querying. By organizing these resources, it assists in the

A collection of awesome resources for Splunk

A Scala API for Apache Beam and Google Cloud Dataflow.

Low-code tool for automating actions on real time data | Stream processing for the users.

A curated list of amazingly awesome Hadoop and Hadoop ecosystem resources