Python task queue using Redis
The main features of closeio/tasktiger are: Data Pipelines.
Open-source alternatives to closeio/tasktiger include: akfamily/akshare — This project is a Python library designed for the programmatic retrieval and analysis of diverse financial datasets.… analysiscenter/batchflow. apache/airflow — Airflow is a platform for programmatically authoring, scheduling, and monitoring complex data pipelines. It functions… apache/beam — Apache Beam is a distributed data pipeline framework and unified data processing model designed to handle both bounded… apache/flume — Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving… activeloopai/deeplake — DeepLake is AI data infrastructure consisting of a multimodal data lake, a hybrid search engine, and a serverless…
This project is a Python library designed for the programmatic retrieval and analysis of diverse financial datasets. It functions as a comprehensive toolkit for quantitative research, providing a unified interface to fetch historical and real-time market data across asset classes including equities, futures, bonds, cryptocurrencies, and foreign exchange. By abstracting complex network requests into simple, parameter-driven functions, it enables users to integrate financial data into research workflows and automated trading systems. The library distinguishes itself through its scraper-based ag
Airflow is a platform for programmatically authoring, scheduling, and monitoring complex data pipelines. It functions as a workflow automation engine that manages the lifecycle of recurring business processes by executing code-defined task dependencies. By representing workflows as directed acyclic graphs, the system ensures that task execution order and data flow are explicitly defined and reliably maintained across distributed computing environments. The platform distinguishes itself through a highly modular, provider-based architecture that decouples core orchestration logic from external
DeepLake is AI data infrastructure consisting of a multimodal data lake, a hybrid search engine, and a serverless vector database. It provides a PostgreSQL-based AI data runtime that combines multimodal storage with streaming pipelines to load and shuffle datasets from cloud storage directly into deep learning training pipelines. The system utilizes lazy indexing to store and slice images, audio, and video without loading entire files into memory. It enables retrieval-augmented generation by persisting high-dimensional embeddings in a serverless vector store and implementing hybrid search tha