hwholiday/learning_tools
Learning Tools
Ce projet est un framework de microservices pour construire des systèmes backend scalables en Go. Il fournit une architecture pour les systèmes distribués avec une prise en charge intégrée de la découverte de services, de l'équilibrage de charge et des mécanismes de tolérance aux pannes.
Le framework se distingue par une architecture en couches pilotée par le domaine et un système de configuration orienté distant qui synchronise les paramètres entre les magasins distants et les fichiers locaux avec basculement automatique. Il implémente un modèle de communication haute performance utilisant gRPC pour l'échange de données unaires et en streaming, ainsi que des systèmes de notification en temps réel pour gérer les connexions clients persistantes.
Le système couvre un large éventail de capacités distribuées, notamment la gestion du trafic via le circuit breaking et la limitation de débit (rate limiting), ainsi que l'observabilité via le traçage distribué, la journalisation centralisée et la surveillance de la santé. Il intègre également des outils d'infrastructure de données tels que les filtres de Bloom probabilistes, le verrouillage distribué et l'authentification de service basée sur des jetons.
Le projet inclut une prise en charge du déploiement pour les environnements Elasticsearch et HBase conteneurisés.
Features
- Microservice Frameworks - Provides a comprehensive framework for building resilient, production-ready distributed microservices in Go.
- gRPC Data Streaming - Provides high-performance bidirectional and server-side data streaming using the gRPC protocol.
- Layered Architectures - Employs a domain-driven layered architecture to isolate core business logic from technical infrastructure.
- External Configuration Loading - Loads application settings from external remote sources to update system behavior without restarts.
- Remote Configuration Synchronization - Synchronizes application settings between remote stores and local files with automatic failover.
- Dynamic Configuration Management - Synchronizes application settings between remote stores and local files with automatic failover and reloading.
- Registry-Based Balancing - Distributes requests across healthy service instances based on real-time registration data and heartbeats.
- Middleware-Based Request Pipelines - Implements modular request pipelines to intercept and process network traffic for cross-cutting concerns.
- Inter-Service RPCs - Uses gRPC unary and streaming calls to exchange structured data between distributed backend services.
- Load Balancers - Distributes incoming network traffic across healthy service instances using various load distribution algorithms.
- gRPC Service Implementations - Implements gRPC service definitions and code generation for high-performance inter-service communication.
- Service Address Resolution - Maps standardized logical naming conventions to network addresses to locate services across a cluster namespace.
- Service Communication Libraries - Provides libraries for routing and serializing requests between internal microservice components.
- Identity Token Services - Uses cryptographically signed tokens to authenticate users and verify the origin of requests to service endpoints.
- Token-Based Authentication - Secures service endpoints using cryptographic tokens to verify identity and request origins.
- Go Microservices Architectures - Implements architectural patterns specifically tailored for building scalable distributed systems using the Go language.
- Resilience Patterns - Implements essential stability patterns including circuit breaking and rate limiting.
- Service Discovery Registries - Maintains a dynamic registry of active service instances and health status for cluster-wide discovery.
- Etcd Integrations - Enables service instance registration and availability tracking using Etcd for distributed cluster traffic balancing.
- Domain-Driven Designs - Provides architectural support for aligning software design with business domains through layered organization.
- Service Middleware Pipelines - Implements composable middleware pipelines to handle cross-cutting concerns like logging, authentication, and tracing.
- Distributed Locks - Provides global locks to coordinate access to shared resources across multiple service instances.
- Service Scaling - Automatically adjusts the number of running service instances to match workload demand.
- Request Rate Limiting - Prevents system overload by capping the number of incoming requests using rate-limiting patterns.
- Push Notification Managers - Coordinates a gateway and logic server to manage real-time connections and delivery of push notifications.
- Gateway-Based Request Routings - Implements routing rules at the API gateway to direct external requests to specific versions of internal services.
- Real-Time Message Push - Manages persistent connections to push real-time updates and notifications to clients via Go-based gateways.
- Tracing Context Propagation - Injects and extracts distributed tracing headers across network boundaries to maintain request correlation.
- Circuit Breakers - Protects the system from cascading failures by stopping requests to dependencies that become unresponsive.
- Task Execution Engines - Ships a task execution engine that decouples job submission from processing via persistent worker pools.
- Worker Pool Models - Implements a worker-pool execution model to process tasks asynchronously and increase system throughput.
- Centralized Logging Systems - Aggregates and indexes logs from distributed service components to enable efficient troubleshooting.
- Application Logging - Provides application-level logging with automatic file rotation and request context tracking.
- Distributed Observability Systems - Provides a unified observability environment for tracking requests and identifying bottlenecks via distributed tracing.
- Distributed Tracing - Tracks requests across multiple services using unique identifiers to analyze latency and execution flow.
- Service Health Monitoring - Tracks the operational status and performance of internal application services via health check interfaces.
