dragonflyoss/dragonfly-archivedArchived
Dragonfly Archived
Dragonfly is a peer-to-peer file distribution system designed to accelerate large-scale file and container image delivery across clusters. It splits files into small pieces that peers exchange independently, enabling parallel downloads from multiple sources while a central scheduler assigns parent peers based on real-time load metrics. The system integrates with existing tools through an HTTP proxy interface and uses gRPC for internal communication between peers and the scheduler.
The system distinguishes itself through automatic integrity verification at the piece level, ensuring every downloaded file matches the original without manual checks. It provides fault isolation at multiple levels—service, peer, or task—so a single failure cannot cascade across the network. Per-host bandwidth throttling caps download speed at the machine level, limiting total bandwidth used by all concurrent tasks on that host, while passive CDN caching stores downloaded files on content delivery nodes to serve subsequent requests without contacting the original source.
Dragonfly includes a web-based cluster management console for configuring, monitoring, and managing peer-to-peer distribution clusters and their activity. It supports container image acceleration by distributing layers through the P2P network instead of pulling directly from a registry, and authenticates file source requests through standard HTTP header fields. The system also automatically detects and excludes malfunctioning peers or managers from the distribution network to maintain download reliability.
