4 个仓库
Mechanisms to ensure data integrity when multiple threads write to shared flat files like CSVs.
Distinct from Concurrent Write Optimizations: Focuses on file-system write synchronization for data export, unlike row-level database locking or message broker locks.
Explore 4 awesome GitHub repositories matching data & databases · Concurrent File Write Synchronizations. Refine with filters or upvote what's useful.
This project is a collection of Python scripts and tools designed for web scraping, browser automation, and large-scale data extraction. It provides a set of implementations for retrieving information from websites and private APIs, including tools for multimedia downloading and social media data archiving. The toolset includes specialized mechanisms for bypassing anti-scraping measures through IP proxy pool rotation and multi-threaded crawlers. It also features capabilities for simulating browser sessions to handle authentication, intercepting session cookies, and decrypting network payloads
Employs synchronization locks to prevent data corruption when multiple threads write to a shared CSV file.
NLog is an open-source logging framework for .NET that functions as a structured logging library and log routing engine. It captures log events with named parameters as searchable data rather than plain text and directs these messages to various output destinations based on severity and source. The framework is designed as an extensible platform, supporting custom targets, layout renderers, and filters that can be loaded from external assemblies or defined in code. It features a dynamic configuration system that allows logging targets, rules, and layouts to be updated via XML or programmatic
Allows multiple processes to write to the same log file without locking conflicts.
EasyLogger 是一个轻量级的 C/C++ 日志库和异步框架,专为嵌入式系统、物联网设备和可穿戴设备设计。它作为资源高效的记录器和闪存管理器,为低级调试和系统事件记录提供了工具,且对 ROM 和 RAM 的要求极低。 该项目的特色在于异步日志模型,将消息缓冲到独立线程,防止日志操作阻塞实时应用执行。它包含一个专门的闪存管理器,利用循环缓冲将日志持久化到非易失性存储中,确保关键数据在设备重启后得以保留。 该库涵盖了广泛的可观测性功能,包括用于状态验证的系统断言、编译时和运行时的严重性过滤,以及原始二进制十六进制转储的生成。它支持通过时间戳和线程标识符进行元数据增强,并提供了一个可移植接口,用于将日志路由到串口或文件等自定义目的地。 该系统通过写入同步确保数据完整性,并提供了手动缓冲区刷新和存储日志检索的机制。
Uses semaphores to synchronize concurrent writes and prevent data corruption in the log storage.
H2 是一个用 Java 编写的 JDBC 兼容关系型数据库管理系统。它作为一个可嵌入的 SQL 数据库,可以直接在应用程序进程内运行以消除网络延迟,或者作为内存数据库用于高性能的易失性存储。它还包含一个基于 Web 的控制台,用于执行 SQL 命令和管理模式。 该系统的特点是其灵活的部署模式,包括用于远程 TCP/IP 访问的独立服务器模式,以及用于同时进行本地和远程连接的混合模式。它具有方言模拟层和兼容模式,允许其模仿其他数据库系统的行为和语法。 该引擎提供了一套广泛的功能,涵盖具有多版本并发控制(MVCC)的 ACID 事务、地理空间和 JSON 数据支持,以及高级分析窗口函数。它包括通过压缩备份、SQL 脚本恢复和堆外内存管理来处理大数据集的数据保护工具。 该数据库使用标准的 Java 数据库连接驱动程序和连接 URL 与应用程序集成。
Ensures data integrity by preventing multiple concurrent processes from writing to the same database file.