Kinto/kinto
Kinto
Kinto is a cloud state backend designed for storing and synchronizing JSON data across multiple devices. It provides a centralized service for managing schema-less JSON records organized into buckets and collections, ensuring a consistent state through a REST API.
The system supports collaborative data sharing by granting read and write access to specific documents or collections via user groups and permissions. It enables document synchronization using change feed tracking and deletion markers to update clients with the latest state.
Capabilities include fine-grained access control, JSON schema enforcement for data consistency, and optimistic locking to prevent concurrent write conflicts. The service also provides real-time client notifications, partial document updates, and support for pluggable storage backends such as PostgreSQL.
The project includes a local development server and an administrative web interface for configuration.
Features
- JSON Document Storage - Provides native storage for semi-structured JSON records organized into collections and buckets.
- ETag-Based Concurrency Controls - Uses HTTP ETag checksums to detect and prevent lost updates during concurrent write operations.
- API Data Synchronization - Synchronizes JSON data across multiple devices using a centralized storage service and HTTP API.
- JSON Document Sharing - Allows sharing specific stored JSON documents with other users.
- Schema Validators - Validates incoming JSON documents against predefined schemas stored in collection metadata to ensure data consistency.
- JSON State Synchronizers - Synchronizes the state of JSON objects across multiple devices using a centralized service.
- JSON Document Containers - Organizes JSON documents into logical containers such as buckets, collections, and groups.
- Soft Deletion Tracking - Retains soft-deletion markers in the database to notify synchronized clients that records have been removed.
- Revision-Based Change Feeds - Tracks document versions via a sequential ledger to enable clients to synchronize changes efficiently.
- Backend-as-a-Service - Provides a managed infrastructure for storing and synchronizing application state via a REST API.
- Collaborative Data Sharing - Provides capabilities to share specific JSON documents and collections with other users via group permissions.
- REST Resource Authorizers - Provides fine-grained authorization for REST resources using ownership, role, group, and hierarchy-based models.
- User Account Management - Manages internal user identities and data ownership by associating usernames with hashed passwords.
- Identity Provider Integrations - Integrates with external identity providers to manage user identities and authentication tokens.
- OpenID Connect Support - Implements the OpenID Connect protocol to handle user authentication via external identity providers.
- User Authentications - Identifies incoming requests via headers and integrates with identity providers to assign user IDs.
- Revision Ledgers - Tracks document versions via a sequential ledger to let clients efficiently fetch only the changes since a specific point.
- Data Schema Validation - Ensures data consistency by validating incoming records against defined schemas.
- Fine-Grained Access Control - Enforces precise read, write, and create permissions for users and groups at the individual record level.
- JSON Schema Validation - Enforces data consistency by validating records against JSON schemas stored in bucket metadata.
- Distributed Sharding Architectures - Distributes JSON records across multiple database instances based on authorization or collection identifiers for horizontal scaling.
- Horizontal Scaling - Increases capacity by distributing data across multiple shards based on authorization or collection identifiers.
- JSON Document Filtering - Provides advanced retrieval of records using substring matching and sub-object navigation.
- Pluggable Storage Backends - Decouples the API from the data layer via a driver interface supporting PostgreSQL and in-memory stores.
- High Availability Deployments - Ensures continuous service by distributing requests across multiple nodes and database replicas.
- Real-Time Data Synchronization - Sends real-time alerts to connected devices to notify them of document updates and trigger synchronization.
- Web Administration Interfaces - Provides a browser-based administrative interface to oversee and configure the storage service.
- Bucket Visibility Controls - Controls which user groups can view the list of available buckets to manage data visibility.
- Event-Driven Logic - Executes custom logic in response to data changes or system events via notifications.
- Extensible Plugin Architectures - Utilizes a plugin architecture to load custom modules for behaviors like admin interfaces or authentication.
- Plugin-Based Logic Extensions - Supports loading external modules at startup to inject custom authentication logic and administrative interfaces.
- User Group Management - Organizes users into functional groups to simplify the assignment of roles and permissions to buckets.
- Partial Update Operations - Supports partial updates of record attributes using JSON Patch and JSON Merge formats.
- Data Management - Lightweight JSON storage service with synchronization capabilities.
- Database and Storage Tools - JSON document store with synchronization capabilities.
- Python Projects - Listed in the “Python Projects” section of the Awesome For Beginners awesome list.
- More to explore - Minimalist JSON storage service.
