604 مستودعات
Libraries and protocols that define how data is encoded, structured, and serialized for storage or network transport.
Explore 604 awesome GitHub repositories matching data & databases · Data Serialization Formats. Refine with filters or upvote what's useful.
هذا المشروع عبارة عن دليل شامل منسق من قبل المجتمع ينظم مشهداً واسعاً من مكتبات وأطر عمل وأدوات برمجيات Python. يعمل كقاعدة معرفية مركزية مصممة لتسهيل التنقل في النظام البيئي وتسريع اكتشاف المطورين عبر دورة حياة تطوير البرمجيات بأكملها. يتميز الدليل بتوفير فهرس منظم للموارد مصنف حسب المجال التقني، بدءاً من أدوات التطوير الأساسية وصولاً إلى المجالات الهندسية المتخصصة. ويغطي قدرات عالية المستوى بما في ذلك الذكاء الاصطناعي، وعلوم البيانات، وتطوير الويب، وإدارة البنية التحتية، مما يسمح للمطورين بتحديد حلول موثوقة لتحديات تقنية محددة. يشمل المشروع نطاقاً واسعاً من القدرات، بما في ذلك أدوات إدارة التبعيات، والتحليل الثابت للكود، والاختبار الآلي. كما يقوم بفهرسة موارد تخزين البيانات المستمرة، وأوركسترا البنية التحتية السحابية، وتطوير الواجهات، مما يوفر مرجعاً موحداً لبناء وصيانة الأنظمة البرمجية المعقدة.
Standardizes data exchange by serializing complex objects into portable, machine-readable structures.
هذا المشروع عبارة عن دليل منسق من قبل المجتمع للبرمجيات مفتوحة المصدر المصممة للنشر في بيئات الخوادم الخاصة والمختبرات المنزلية. يعمل كمورد شامل لاكتشاف بدائل مستقلة ذاتية الاستضافة لخدمات السحابة السائدة، مما يمكن المستخدمين من الحفاظ على ملكية كاملة للبيانات والتحكم في بنيتهم التحتية الرقمية. يتم تنظيم الدليل من خلال تصنيف هرمي ينظم مجموعة واسعة من التطبيقات في فئات منطقية، تتراوح من إدارة الوسائط وتحليل البيانات إلى التواصل الخاص وأدوات إنتاجية الفريق. يتميز بعملية مراجعة أقران تعاونية، حيث يقوم أعضاء المجتمع بالتحقق من جودة وملاءمة كل طلب لضمان بقاء الدليل دقيقاً وموثوقاً. يغطي المشروع نطاقاً واسعاً من القدرات، بما في ذلك أتمتة البنية التحتية، ونشر الخدمات القائمة على الحاويات، وإدارة التكوين التصريحي. تساعد هذه الأدوات المستخدمين في الحفاظ على بيئات خادم قابلة للتكرار وإدارة تبعيات الخدمات المعقدة عبر الأجهزة الخاصة. يتم الحفاظ على الدليل كمستودع خاضع للتحكم في الإصدار، مما يضمن تتبع جميع التحديثات والتغييرات التي يقودها المجتمع وأنها شفافة.
Provides a lightweight service for storing and synchronizing structured JSON data objects across client applications.
This project serves as a comprehensive language ecosystem index, functioning as a centralized, community-curated directory for the Go programming language. It organizes a vast landscape of software components, libraries, and development tools into a structured, navigable hierarchy, enabling developers to efficiently discover resources tailored to specific functional domains. The repository distinguishes itself through a decentralized contribution model, where community-driven updates ensure the index remains current with the rapidly evolving software landscape. Beyond simple resource listing,
Features libraries for parsing, manipulating, and querying data structured in JSON.
This project is a command-line media downloader designed for the systematic retrieval and organization of digital content from diverse online platforms. It functions as an extensible extraction engine that utilizes a declarative format-selection pipeline to automate the identification, merging, and downloading of specific audio and video streams based on user-defined criteria. The system distinguishes itself through a modular architecture that supports custom plugins and site-specific scripts, allowing for the bypass of platform restrictions and the handling of complex authentication challeng
Constructs dynamic filesystem paths and filenames by mapping extracted metadata to flexible string-formatting templates.
This project is a command-line video downloader and web media extractor written in Python. It is designed to retrieve video and audio streams from various hosting platforms for local storage or real-time streaming via standard output. The system utilizes a framework of custom extractor classes to handle different websites and allows for the development of new extractors to extend compatibility. It supports accessing restricted, private, or region-locked content through the use of session cookies, user-agent headers, and proxy server routing. Capabilities include media format selection based
Generates organized local file paths using metadata templates and dynamic placeholders.
This project is an open-source JavaScript runtime built on the V8 engine. It provides a comprehensive environment for executing JavaScript code outside of a web browser, offering foundational primitives for process management, multi-core load distribution, and parallel execution through worker threads. The runtime includes a broad set of built-in modules for system-level operations, such as file system interaction, network communication across various protocols, and cryptographic security. It supports multiple module systems, native binary addon integration, and diagnostic tools for monitorin
Bundles stream-based compression capabilities to handle data transformation using standard algorithms.
ComfyUI is a node-based generative AI orchestration engine designed for constructing, testing, and executing complex image and video synthesis pipelines. By utilizing a directed acyclic graph execution model, the platform allows users to build reproducible workflows through modular, interconnected processing blocks without requiring manual code implementation. It serves as both a local environment for high-performance model inference and a production-ready server for deploying generative capabilities. The platform distinguishes itself through its focus on workflow portability and extensibilit
Persists complex visual pipelines as structured files to enable version control, portability, and programmatic reconstruction.
App-ideas is a development platform that integrates autonomous AI agents into local environments to orchestrate code review, automated fix application, and workflow management. It functions as a command-line interface that connects external AI assistants to your codebase, enabling iterative development cycles through plugin-based integration and natural language triggers. The platform distinguishes itself through a robust static analysis engine that traverses syntax trees to enforce structural coding standards and identify violations. Users can define custom review rules, architectural prefer
Transforms analysis results into multiple formats, including plain text and JSON, for diverse downstream consumption.
Hugo is a high-performance static site generator that transforms source content and templates into optimized web assets. Built with a focus on speed and scalability, it provides a comprehensive framework for managing large-scale documentation and editorial projects through structured content organization, taxonomies, and a flexible template-driven rendering engine. The project distinguishes itself through a sophisticated build system that utilizes incremental caching to minimize redundant processing during site updates. It supports complex content requirements by enabling multidimensional mod
Transforms source data into multiple output formats including HTML, JSON, and RSS with granular control over site structure.
Home Assistant is a centralized home automation platform designed to orchestrate diverse internet-connected devices and services. It functions as a local-first control system that normalizes heterogeneous hardware protocols into a unified set of entities, attributes, and services. The core architecture relies on an event-driven state bus and a modular integration model, allowing the system to manage state changes and communicate across decoupled components through standardized interfaces. The platform distinguishes itself through a highly flexible, declarative configuration framework that all
Transforms internal datetime objects into human-readable strings using standard formatting patterns for UI display or log output.
This project is a curated directory of software repositories specifically selected to help newcomers make their first open-source contributions. It serves as a collaborative knowledge base that aggregates entry-level development opportunities, providing a structured path for novice developers to practice version control and engage with active software communities. The repository distinguishes itself through a community-driven model where project listings are populated and verified by external contributors. This distributed peer review process ensures the directory remains current, while the u
Encourages learners to explore data-driven projects that involve working with structured information formats.
This project is a comprehensive Java backend engineering guide and technical reference focused on high-concurrency design, distributed systems, and microservices architecture. It provides detailed strategies for decomposing monolithic applications, managing service discovery, and implementing the architectural patterns required for scalable backend environments. The repository distinguishes itself through an extensive collection of big data algorithmic references and database scaling strategies. It covers memory-efficient techniques for analyzing massive datasets, such as Top-K element extrac
Provides guidelines for choosing between binary and text-based data encoding schemes to optimize transmission speed and payload size.
Tesseract is a neural network-based optical character recognition engine designed to convert scanned images and digital documents into machine-readable, searchable text. It functions as both a command-line utility for automating large-scale digitization workflows and a cross-platform library that can be embedded into desktop, mobile, or server-side applications. By utilizing long short-term memory networks, the engine provides robust text extraction across more than one hundred languages and dozens of scripts. The project distinguishes itself through a sophisticated document layout analysis f
Produce structured results in JSON or XML formats to facilitate integration with external data processing and layout analysis tools.
This project is a comprehensive, curated directory of high-quality libraries, tools, and educational resources for C and C++ development. It serves as an ecosystem discovery index, helping developers navigate the vast landscape of third-party components, frameworks, and technical documentation available for the language. The collection is distinguished by its focus on high-performance systems programming and technical mastery. It provides deep coverage of specialized domains including SIMD-accelerated data processing, compile-time template metaprogramming, and asynchronous event-driven archit
Parse and serialize YAML formatted data using these dedicated library implementations.
SecLists is a centralized library of security assessment data designed to support vulnerability discovery and penetration testing. It functions as a comprehensive repository of wordlists, payloads, and testing methodologies used to audit software, firmware, and internet-connected hardware for technical vulnerabilities. The project distinguishes itself through a standardized taxonomy and a language-agnostic data format, which allows security tools to predictably ingest and utilize its assets regardless of the underlying programming environment. By decoupling raw testing data from execution log
Uses a language-agnostic, raw character data format for payloads and wordlists.
Protocol Buffers is a binary serialization framework used to encode structured information into compact payloads to reduce network bandwidth and storage. It functions as a cross-language data interchange standard that enables different platforms and languages to exchange structured data using a shared schema. The project includes an interface definition language compiler that transforms schema definitions into type-safe source code for multiple target programming languages. This mechanism decouples data structures from specific language memory layouts and ensures consistent data handling acro
Implements the Protocol Buffers binary format for language-neutral, platform-agnostic serialization of structured data.
Protocol Buffers هي آلية محايدة للغة ومستقلة عن النظام الأساسي لتسلسل البيانات المهيكلة. توفر سلسلة أدوات قائمة على المخطط (schema) تقوم بتجميع تعريفات البيانات التعريفية إلى كود مصدري آمن من حيث النوع، مما يتيح تواصلاً متسقاً وعقود API مكتوبة بقوة عبر الخدمات المكتوبة بلغات برمجة مختلفة. يتميز المشروع بتنسيق ثنائي عالي الكفاءة يستخدم ترميزاً قائماً على العلامات وضغط الأعداد الصحيحة متغير العرض لتقليل حجم الحمولة وعبء المعالجة. وهو يدعم إدارة المخطط التطوري القوية، مما يسمح للمطورين بتحديث هياكل البيانات تدريجياً مع الحفاظ على التوافق مع الإصدارات السابقة واللاحقة. يتم دعم ذلك بشكل أكبر من خلال نظام إصدارات يدير مجموعات الميزات ومنطق التسلسل عبر مكونات البرمجيات الموزعة. بعيداً عن التسلسل الثنائي الأساسي، يتضمن المشروع قدرات لتحويل JSON القانوني مع التحقق من المخطط، والتحكم الدقيق في رؤية الرموز، وتتبع وجود الحقول للتمييز بين القيم الافتراضية وغير المعينة. كما يوفر تحسينات متخصصة، مثل إدارة الذاكرة القائمة على الساحة (arena-based) لتطبيقات C++، لتحسين الأداء أثناء إنشاء وتنظيف أشجار الرسائل المعقدة.
Delivers a compact, platform-agnostic format for serializing structured information across diverse computing environments.
MinerU is a document parsing pipeline designed to transform unstructured files into machine-readable, structured data. It utilizes deep learning models to perform layout analysis, identifying document regions and extracting complex content such as mathematical expressions. By combining these neural network inferences with geometric heuristics, the system reconstructs the reading order and structural hierarchy of documents to ensure accurate data representation. The project distinguishes itself through a multi-stage processing workflow that integrates layout detection, optical character recogn
Exports parsing results as structured JSON files to facilitate deeper data analysis through automated scripts.
This project is a community-driven directory that aggregates essential software projects and educational content for the Node.js ecosystem. It functions as a centralized knowledge base and discovery index, designed to simplify the navigation of a fragmented technical landscape by providing a structured collection of high-quality links, tools, and learning materials. The repository distinguishes itself through a decentralized, peer-reviewed curation model. By utilizing standard version control workflows and pull requests, the community ensures that all listed resources undergo human verificati
Discover libraries designed to transform raw machine data into readable, user-friendly formats.
Keras is a high-level deep learning framework designed for constructing and training neural networks through the composition of modular, functional layers. It serves as a comprehensive modeling toolkit that provides standardized procedures for defining, evaluating, and deploying complex architectures. By utilizing a directed acyclic graph approach, the framework allows users to build intricate models with multiple inputs, outputs, and shared layers, ensuring consistent numerical execution through functional state management. The project distinguishes itself as a multi-backend machine learning
Serializes neural network architectures and weights into standardized, cross-platform formats for deployment across diverse computing backends.