How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
flAPI is a powerful service that automatically generates read-only APIs for datasets by utilizing SQL templates. Built on top of DuckDB and leveraging its SQL engine and extension ecosystem, flAPI offers a seamless way to connect to various data sources and expose them as RESTful APIs.
3FS is a distributed file system and RDMA storage cluster designed for high-performance AI training and inference workloads. It functions as a strongly consistent storage layer that utilizes a disaggregated architecture to pool SSDs and memory resources across multiple nodes. The system provides specialized storage implementations including an AI training checkpoint store for parallel state preservation and a distributed key-value cache store for decoder layer vectors to optimize inference processing. It ensures data integrity through chain replication and apportioned query distribution. The
omilayers is a Python data management library. It is suitable for multi-omic data analysis, hence the omi prefix, that involves the handling of diverse datasets usually referred to as omic layers. omilayers wraps the APIs of SQLite and DuckDB and provides a high-level interface for frequent…
BemiDB is an open-source Snowflake and Fivetran alternative bundled together. It seamlessly connects to different data sources, syncs data in a compressed columnar format to S3, and allows you to run complex queries using its Postgres-compatible analytical query engine.
A lightweight data processing framework built on DuckDB and [3FS].
The main features of deepseek-ai/smallpond are: Data Frameworks and Libraries, Data Infrastructure.
Projects with overlapping indexed features include: datazoode/flapi — flAPI is a powerful service that automatically generates read-only APIs for datasets by utilizing SQL templates. Built… deepseek-ai/3fs — 3FS is a distributed file system and RDMA storage cluster designed for high-performance AI training and inference… dkioroglou/omilayers — `omilayers is a Python data management library. It is suitable for multi-omic data analysis, hence the omi prefix,… eakmanrq/sqlframe — Turning PySpark Into a Universal DataFrame API. fugue-project/fugue — | Tutorials | API Documentation | Chat with us on slack! | | ----------------------------------------------------------… bemihq/bemidb — BemiDB is an open-source Snowflake and Fivetran alternative bundled together. It seamlessly connects to different data…