Data Processing Engines — Data & Databases

Pathway is a high-performance data processing framework designed for building unified batch and streaming pipelines. It functions as an orchestrator for complex data transformations, utilizing a differential dataflow engine to process updates incrementally. By treating static datasets and continuous event streams with

FFmpeg is a cross-platform framework and multimedia processing suite designed for the manipulation, transcoding, and streaming of audio and video data. It functions as a comprehensive collection of command-line tools and low-level libraries that provide high-performance encoding and decoding capabilities for a wide ran

This project is a data processing engine and AI application platform designed for building production-grade machine learning workflows. It provides a unified programming model that handles both historical batch data and live stream ingestion, enabling the development of real-time ETL pipelines and scalable data transfo