7 dépôts
Utilities for grouping multiple individual events into a single batch for optimized downstream processing.
Distinct from Event-Time Processing: None of the candidates cover the specific pattern of batching events for throughput optimization in serverless environments.
Explore 7 awesome GitHub repositories matching software engineering & architecture · Batch Event Processors. Refine with filters or upvote what's useful.
Countly is a self-hosted product analytics and engagement platform that tracks user behavior across mobile, web, and desktop applications. It collects and analyzes device properties, user actions, and session lifecycle data to understand engagement patterns, while also providing crash reporting, push notification delivery, and A/B testing capabilities. The platform is designed for privacy-first deployment, with built-in consent management and the ability to run entirely on private infrastructure. The platform distinguishes itself through its comprehensive feature set that combines analytics w
Combines multiple recorded events into a single request when the event queue reaches a configurable threshold.
CloudEvents is an open specification for describing event data in a common format across cloud platforms and services. It defines a standard structure and set of metadata attributes for events, enabling interoperability across different systems so producers and consumers can exchange events without custom translation. The specification provides a protocol-agnostic serialization framework that maps CloudEvents attributes and payloads to multiple serialization formats including JSON, Avro, and Protobuf, and defines transport bindings for mapping events onto protocols like HTTP, AMQP, Kafka, MQTT
Combines multiple events into a single HTTP request or response body for efficient transport.
fswatch is a cross-platform file change monitor that watches files and directories for modifications using the native event API of each operating system. It functions as a multi-backend file watcher library that selects from platform-specific backends such as inotify, kqueue, and FSEvents, with a polling fallback when no native API is available. The tool groups multiple file changes into a single event batch and triggers one command per batch, while also executing user-specified commands each time monitored files or directories are modified. The project applies include, exclude, event-type, a
Groups multiple file changes into a single event batch and triggers one command per batch.
fswatch est un outil multiplateforme de surveillance des changements de fichiers et d'automatisation d'événements. Il suit les modifications du système de fichiers sur différents systèmes d'exploitation en utilisant les API d'événements natives du noyau ou un mécanisme de polling portable en secours. Le projet implémente des wrappers spécifiques pour les systèmes Linux utilisant inotify et fanotify, ainsi qu'un watcher pour BSD et macOS utilisant kqueue. Il traduit ces API spécifiques à chaque plateforme en un format d'événement unifié pour offrir un comportement de surveillance cohérent. L'outil permet l'exécution automatique de programmes ou de scripts externes en réponse aux changements détectés. Il inclut des capacités de filtrage d'événements par motifs, de regroupement de changements rapides en notifications uniques, et de streaming des chemins de fichiers modifiés via des formats délimités par des caractères nuls pour une intégration dans des pipelines shell.
Implements a buffer that groups rapid file system changes into single notifications to prevent overloading downstream scripts.
Inngest is a durable execution framework and event-driven automation engine designed to orchestrate background workflows. It enables developers to build resilient, stateful processes by memoizing function steps, ensuring that long-running tasks can automatically resume from the last successful operation after failures, timeouts, or infrastructure restarts. The platform distinguishes itself through its event-driven architecture, which uses a schema-validated bus to trigger functions and coordinate complex, multi-step logic. It employs an onion-model middleware approach for cross-cutting concer
Groups multiple incoming events into a single function execution to improve efficiency and reduce the overhead of processing items individually.
Jitsu est une plateforme de données client conçue pour collecter, transformer et router les événements d'application vers des entrepôts de données et des outils marketing. Il fonctionne comme un moteur d'ingestion d'événements et un routeur d'entrepôt de données, capturant les données comportementales via des API et des SDK pour un traitement et un stockage en temps réel. La plateforme dispose d'un pipeline de données JavaScript programmable qui permet le filtrage, l'enrichissement et le remodelage des données d'événement pendant le transit. Elle inclut un outil de réconciliation d'identité client qui fusionne les identifiants d'utilisateurs anonymes et connus pour maintenir des profils clients persistants au sein d'un entrepôt. Le système couvre un large éventail de fonctionnalités, incluant la collecte d'événements multi-sources depuis des environnements web et mobiles, l'évolution automatique des schémas pour les entrepôts de destination et le routage multi-destination vers des plateformes SaaS et des bases de données SQL. Il fournit une suite d'outils développeur pour tester la logique de transformation et prend en charge le déploiement via Kubernetes ou des environnements Docker auto-hébergés.
Groups multiple events into single HTTP requests to optimize network throughput and reduce transmission overhead.
AWS Powertools for Python is a utility framework designed for building production-ready Python functions on AWS Lambda. It provides a comprehensive suite of tools for observability, event parsing, routing, and idempotency management to streamline the development of serverless applications. The project distinguishes itself through specialized capabilities for event-driven architectures and AI agent orchestration. It enables the implementation of AI agents by exposing functions as tools via OpenAPI schemas and managing conversation states. Additionally, it features an idempotency library that p
Handles multiple events for a channel as a single list to optimize downstream operations.