61 repos
Awesome GitHub RepositoriesData Engineering and Infrastructure
Foundational tools for large-scale data collection, ingestion, storage management, and reliability.
Explore 61 awesome GitHub repositories matching data & databases · Data Engineering and Infrastructure. Refine with filters or upvote what's useful.
Awesome Data Engineering and Infrastructure GitHub Repositories
We'll search the best matching repositories with AI.
- etcd-io/etcd
etcd is a distributed, strongly consistent key-value store designed to provide reliable storage for critical system metadata and coordination primitives. It functions as a distributed consensus engine, utilizing a replicated log and leader-based state machine to ensure that all nodes in a cluster maintain a synchronize
Gocncfconsensusdatabase
Explore sub-tags
- Backup and Recovery Utilities4 sub-tagsUtilities for automating database dumps, file storage backups, and managing retention policies or recovery operations.
- Caching and Performance2 sub-tagsTechniques and implementations focused on reducing latency and improving system throughput by storing frequently accessed data.
- Data Engineering7 sub-tagsInfrastructure and frameworks used to build, manage, and scale complex systems for processing and analyzing large datasets.
- Data Extraction & Ingestion11 sub-tags