5 مستودعات
Analyzing information spread across multiple distributed servers while maintaining strict data access control.
Distinct from Decentralized Data Aggregators: Broader than consensus-based aggregation; covers general orchestration of analysis across remote private hosts.
Explore 5 awesome GitHub repositories matching data & databases · Decentralized Data Analysis. Refine with filters or upvote what's useful.
PySyft is a privacy-preserving machine learning framework and remote computation engine. It functions as a decentralized data analysis orchestrator that allows for the execution of data science workflows on remote servers without requiring the transfer of raw private data from the host device. The platform provides a secure collaboration environment where data owners manage permissions and authorize specific collaborators to run computations. It differentiates its workflow by utilizing mock data for local development and validation before submitting final analysis jobs to private remote serve
Orchestrates the analysis of information spread across multiple offline or cloud-connected servers.
Flower is a federated learning framework and distributed machine learning orchestrator designed to train models across decentralized devices. It functions as a privacy-preserving toolkit that enables model training and data analysis on local hardware, ensuring raw data remains on the device while contributing to a synchronized global model. The system employs an agnostic wrapper and integrator to connect diverse machine learning libraries, allowing different frameworks to operate within the same training loop. It uses a remote procedure call orchestrator to manage the exchange of model weight
Performs data analysis across separate decentralized datasets without requiring the raw information to be centralized.
This repository is the official documentation for TensorFlow, a machine learning framework. It provides comprehensive guides, tutorials, and API references for building, training, and deploying machine learning models. The documentation covers the full lifecycle of machine learning projects, from constructing data pipelines and building neural networks with high-level APIs to customizing training loops and deploying trained models in production, on edge devices, or in browsers. The documentation includes step-by-step tutorials for a range of tasks, including reinforcement learning, ranking mo
Documents federated learning workflows for training models on decentralized data.
FedML is a distributed machine learning training library, federated learning framework, and GPU workload orchestrator. It provides the core system components necessary to execute large-scale model training and fine-tuning across multi-cloud, on-premise, and decentralized GPU clusters, while offering a dedicated engine for scalable model serving and an MLOps pipeline manager for end-to-end lifecycle management. The platform distinguishes itself by enabling privacy-preserving federated learning across decentralized edge devices and organizational silos, keeping raw data on local hardware. It al
Trains shared machine learning models across decentralized edge devices and organizational silos without centralizing private data.
This project is a research-oriented platform designed for simulating decentralized machine learning environments. It provides a framework for training models across multiple client nodes while keeping raw data localized, enabling the evaluation of model convergence and performance under various distributed network conditions. The system utilizes a parameter-server architecture to coordinate training, where a central coordinator manages the global model state and aggregates weight updates from distributed participants. By decoupling the training orchestration logic from the underlying neural n
Enables research into training machine learning models across decentralized data sources while preserving local data privacy.