awesome-repositories.com
المدونة
awesome-repositories.com

اكتشف أفضل مستودعات المصادر المفتوحة باستخدام بحث مدعوم بالذكاء الاصطناعي.

استكشفعمليات بحث منسقةبدائل مفتوحة المصدربرمجيات ذاتية الاستضافةالمدونةخريطة الموقع
المشروعحولكيفية ترتيب النتائجالصحافةخادم MCP
قانونيالخصوصيةالشروط
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

546 مستودعات

Awesome GitHub RepositoriesData Storage

Components and utilities that facilitate the saving, retrieving, and managing of data within an application environment.

Explore 546 awesome GitHub repositories matching data & databases · Data Storage. Refine with filters or upvote what's useful.

Awesome Data Storage GitHub Repositories

اعثر على أفضل المستودعات باستخدام الذكاء الاصطناعي.سنبحث عن أفضل المستودعات المطابقة باستخدام الذكاء الاصطناعي.
  • donnemartin/system-design-primerالصورة الرمزية لـ donnemartin

    donnemartin/system-design-primer

    353,387عرض على GitHub↗

    هذا المشروع عبارة عن مورد تعليمي شامل ودليل دراسي يركز على بنية الأنظمة الموزعة وتصميم البنية التحتية للـ backend. يوفر منهجاً منظماً لإتقان مبادئ القابلية للتوسع، والموثوقية، والأداء المطلوبة لتصميم أنظمة برمجية معقدة. يتميز المستودع بتقديم نهج منهجي للتحضير للمقابلات التقنية، حيث يدمج أنماط التصميم، والمقايضات المعمارية، وأدوات التكرار المتباعد لمساعدة المستخدمين على الاحتفاظ بالمفاهيم المعقدة. ويؤكد على التحليل القائم على القيود، حيث يعلم المستخدمين كيفية تقييم المتطلبات المتنافسة مثل زمن الوصول (latency)، والاتساق، والتوافر عند صياغة التصاميم المعمارية. يغطي المحتوى طيفاً واسعاً من قدرات تصميم النظام، بما في ذلك استراتيجيات توسيع قواعد البيانات، وإدارة حركة المرور، وتحسين البنية التحتية. ويفصل تقنيات التوسع الأفقي، والتخزين المؤقت متعدد الطبقات، والتواصل غير المتزامن، واكتشاف الخدمات، مع توفير أطر عمل لإجراء تقديرات الموارد وتخطيط السعة. يتم تنظيم التوثيق كدليل دراسي، مما يوفر مساراً منهجياً عبر أساسيات هندسة الـ backend وتصميم الأنظمة واسعة النطاق.

    Details mechanisms for storing frequently accessed data in memory to reduce latency and backend processing requirements.

    Pythondesigndesign-patternsdesign-system
    عرض على GitHub↗353,387
  • vinta/awesome-pythonالصورة الرمزية لـ vinta

    vinta/awesome-python

    303,207عرض على GitHub↗

    هذا المشروع عبارة عن دليل شامل منسق من قبل المجتمع ينظم مشهداً واسعاً من مكتبات وأطر عمل وأدوات برمجيات Python. يعمل كقاعدة معرفية مركزية مصممة لتسهيل التنقل في النظام البيئي وتسريع اكتشاف المطورين عبر دورة حياة تطوير البرمجيات بأكملها. يتميز الدليل بتوفير فهرس منظم للموارد مصنف حسب المجال التقني، بدءاً من أدوات التطوير الأساسية وصولاً إلى المجالات الهندسية المتخصصة. ويغطي قدرات عالية المستوى بما في ذلك الذكاء الاصطناعي، وعلوم البيانات، وتطوير الويب، وإدارة البنية التحتية، مما يسمح للمطورين بتحديد حلول موثوقة لتحديات تقنية محددة. يشمل المشروع نطاقاً واسعاً من القدرات، بما في ذلك أدوات إدارة التبعيات، والتحليل الثابت للكود، والاختبار الآلي. كما يقوم بفهرسة موارد تخزين البيانات المستمرة، وأوركسترا البنية التحتية السحابية، وتطوير الواجهات، مما يوفر مرجعاً موحداً لبناء وصيانة الأنظمة البرمجية المعقدة.

    Boost system performance by memoizing frequently accessed data within memory-efficient storage structures.

    Pythonawesomecollectionspython
    عرض على GitHub↗303,207
  • langchain-ai/langchainالصورة الرمزية لـ langchain-ai

    langchain-ai/langchain

    139,458عرض على GitHub↗

    LangChain is an orchestration framework designed for building, managing, and deploying applications powered by large language models. It provides a unified integration layer that normalizes disparate model provider APIs into a consistent set of primitives, enabling developers to build complex, multi-step AI workflows that manage state, memory, and tool execution. The project distinguishes itself through a durable execution runtime that maintains persistent state across long-running processes by checkpointing progress to external storage. It models agent workflows as directed graphs, allowing

    Organize directory hierarchies to manage machine-specific state and persistent application data effectively.

    Pythonagentsaiai-agents
    عرض على GitHub↗139,458
  • chalarangelo/30-seconds-of-codeالصورة الرمزية لـ Chalarangelo

    Chalarangelo/30-seconds-of-code

    128,121عرض على GitHub↗

    30-seconds-of-code is a comprehensive knowledge base and programming snippet library designed to support software engineering education and professional development. It provides a curated collection of reusable code units and technical guides that help developers master core language mechanics, design patterns, and architectural philosophies. The project distinguishes itself by offering a wide-ranging library of algorithmic solutions and web development patterns that are organized into modular, independently testable units. It emphasizes functional programming paradigms and declarative logic,

    Provides tools for serializing and persisting data to the local file system.

    JavaScriptastroawesome-listcss
    عرض على GitHub↗128,121
  • excalidraw/excalidrawالصورة الرمزية لـ excalidraw

    excalidraw/excalidraw

    125,451عرض على GitHub↗

    This project is a virtual whiteboard component and vector graphics editor designed for creating diagrams with a hand-drawn aesthetic. It provides a canvas-based drawing engine that can be embedded directly into web applications, allowing users to manipulate shapes, upload images, and export visual data into standard formats like PNG, SVG, or JSON. The platform distinguishes itself through a real-time synchronization layer that supports multi-user collaboration across distributed environments. This engine utilizes end-to-end encryption to secure shared sessions and employs a local-first data p

    Leverages browser-based storage to maintain application state locally, ensuring data availability and persistence even during offline operation.

    TypeScriptcanvascollaborationdiagrams
    عرض على GitHub↗125,451
  • pytorch/pytorchالصورة الرمزية لـ pytorch

    pytorch/pytorch

    100,814عرض على GitHub↗

    PyTorch is a machine learning framework centered on a GPU-ready tensor library that supports multi-dimensional array operations across both CPU and accelerator hardware. It provides a foundational infrastructure for mathematical computation and dynamic neural network construction, utilizing a tape-based automatic differentiation system that allows for flexible, non-static graph execution. The framework is designed for deep integration with Python, enabling natural usage alongside standard scientific computing ecosystems. It distinguishes itself through a comprehensive distributed training sui

    Persists tensors and complex data structures to disk through native loading and saving mechanisms.

    Pythonautograddeep-learninggpu
    عرض على GitHub↗100,814
  • chatgptnextweb/nextchatالصورة الرمزية لـ ChatGPTNextWeb

    ChatGPTNextWeb/NextChat

    88,256عرض على GitHub↗

    NextChat is a self-hosted web application that provides a unified interface for interacting with multiple large language models. It functions as a conversational platform where users can manage and switch between diverse AI providers through configurable API backends, maintaining full control over their data and infrastructure. The platform features a persistent session layer designed to handle long-running dialogues by managing message history and context. It distinguishes itself through a structured prompt engineering environment that allows for the development and application of templates

    Utilizes browser-based storage to maintain chat logs and user preferences for offline access.

    TypeScriptcalclaudechatgptclaude
    عرض على GitHub↗88,256
  • firehol/netdataالصورة الرمزية لـ firehol

    firehol/netdata

    79,416عرض على GitHub↗

    Netdata is a real-time infrastructure monitoring tool and multi-node observability platform. It functions as a high-resolution monitoring agent, log and metric aggregator, and time-series database designed to provide full-stack visibility into server health. The system is distinguished by its per-second metric sampling and zero-configuration auto-discovery, which allows for immediate infrastructure tracking upon installation. It utilizes edge-based machine learning and unsupervised models to detect system anomalies and abnormal metric patterns locally on each node. For distributed environment

    Provides an efficient time-series database optimized for rapid retrieval and analysis of collected metrics.

    Go
    عرض على GitHub↗79,416
  • netdata/netdataالصورة الرمزية لـ netdata

    netdata/netdata

    79,176عرض على GitHub↗

    Netdata is a distributed observability platform designed for real-time infrastructure monitoring and performance tracking. It functions as a high-frequency agent that collects system, container, and application metrics with per-second precision, providing both local visualization and centralized aggregation across complex, multi-cloud environments. The platform distinguishes itself through edge-based intelligence, utilizing local machine learning models to automatically detect performance anomalies without requiring manual configuration or external query engines. Its architecture prioritizes

    Persists high-resolution telemetry data directly on the host filesystem to ensure continuous availability during network outages.

    Caialertingcncf
    عرض على GitHub↗79,176
  • doocs/advanced-javaالصورة الرمزية لـ doocs

    doocs/advanced-java

    78,987عرض على GitHub↗

    This project is a comprehensive Java backend engineering guide and technical reference focused on high-concurrency design, distributed systems, and microservices architecture. It provides detailed strategies for decomposing monolithic applications, managing service discovery, and implementing the architectural patterns required for scalable backend environments. The repository distinguishes itself through an extensive collection of big data algorithmic references and database scaling strategies. It covers memory-efficient techniques for analyzing massive datasets, such as Top-K element extrac

    The system stores large-scale data across a distributed cluster of nodes using a JSON-based document structure.

    Javaadvanced-javadistributed-search-enginedistributed-systems
    عرض على GitHub↗78,987
  • openhands/openhandsالصورة الرمزية لـ OpenHands

    OpenHands/OpenHands

    77,330عرض على GitHub↗

    OpenHands is an autonomous agent framework designed for software engineering workflows. It provides a modular platform for orchestrating AI agents that reason, plan, and execute tasks within isolated, containerized development environments. By integrating with standard version control and development tools, the system enables agents to autonomously navigate codebases, implement features, and resolve issues through iterative reasoning and tool execution. The platform distinguishes itself through a model-agnostic orchestrator that connects diverse language models to a unified tool registry. It

    Store conversation history in structured directory formats with sequentially indexed event files for granular data access.

    Pythonagentartificial-intelligencechatgpt
    عرض على GitHub↗77,330
  • elastic/elasticsearchالصورة الرمزية لـ elastic

    elastic/elasticsearch

    77,012عرض على GitHub↗

    Elasticsearch is a distributed search engine and document store designed for the high-performance indexing and retrieval of massive volumes of unstructured data. It functions as a centralized analytics platform, providing a schema-flexible architecture that organizes information into searchable indices while maintaining global cluster state through a distributed consensus mechanism. The platform distinguishes itself through its integrated approach to observability, security, and advanced analytics. It combines full-text, vector, and hybrid search capabilities with machine learning-driven insi

    Organizes schema-flexible data into searchable documents across distributed storage environments.

    Javaelasticsearchjavasearch-engine
    عرض على GitHub↗77,012
  • awesomedata/awesome-public-datasetsالصورة الرمزية لـ awesomedata

    awesomedata/awesome-public-datasets

    75,979عرض على GitHub↗

    This project is a community-maintained, open-access directory of high-quality public datasets. It serves as a centralized reference point for researchers, developers, and data scientists to locate reliable information sources across a wide spectrum of industries and scientific fields. By providing a structured index, the repository facilitates the discovery of data necessary for exploratory analysis, machine learning model training, and the development of data-intensive applications. The directory distinguishes itself through a lightweight, platform-agnostic approach to resource indexing that

    Presents datasets related to global transportation systems, including traffic, logistics, and transit data.

    aaron-swartzawesome-public-datasetsdatasets
    عرض على GitHub↗75,979
  • typicode/json-serverالصورة الرمزية لـ typicode

    typicode/json-server

    75,614عرض على GitHub↗

    json-server is a development toolset used to simulate a full REST API from a JSON file. It functions as a customizable mock API server that allows for the simulation of CRUD operations and resource relationships without the need to write backend code. The project enables rapid prototyping by generating a fake backend that persists data changes back to a local JSON file. It distinguishes itself by providing a static asset file server to deliver local documents, images, and stylesheets alongside the mock API endpoints. The server includes capabilities for data querying, such as parameter-based

    Persists application data as structured JSON files on the local filesystem.

    JavaScriptapifakefrontend
    عرض على GitHub↗75,614
  • redis/redisالصورة الرمزية لـ redis

    redis/redis

    74,906عرض على GitHub↗

    Redis is an in-memory, key-value database designed to provide sub-millisecond latency for read and write operations. It functions as a versatile data platform, serving as a distributed cache, a message broker, a NoSQL document store, and a vector database. The system utilizes an event-driven, single-threaded loop to process requests efficiently, while maintaining data durability through append-only persistence logs and asynchronous snapshotting mechanisms. What distinguishes Redis is its ability to handle complex data structures—including strings, hashes, lists, sets, and sorted sets—alongsid

    Guarantees data durability through automated replication, snapshotting, and multi-region clustering capabilities.

    Ccachecachingdatabase
    عرض على GitHub↗74,906
  • eugeny/tabbyالصورة الرمزية لـ Eugeny

    Eugeny/tabby

    72,154عرض على GitHub↗

    Tabby is a cross-platform terminal emulator and desktop application suite designed for managing command-line workflows and remote infrastructure. It provides a comprehensive environment for terminal session orchestration, allowing users to organize multiple active sessions through split panes and custom layouts. The application functions as a secure remote connection manager, supporting advanced authentication, port forwarding, and persistent network sessions via an asynchronous protocol layer. The project distinguishes itself through a modular plugin architecture that enables users to extend

    Persists user preferences and session data in local files to maintain consistent configurations across different machines.

    TypeScriptserialssh-clienttelnet-client
    عرض على GitHub↗72,154
  • prometheus/prometheusالصورة الرمزية لـ prometheus

    prometheus/prometheus

    64,569عرض على GitHub↗

    Prometheus is a comprehensive monitoring and alerting platform designed to track infrastructure health and application performance. It functions as a time series database that ingests, indexes, and queries high-frequency numerical data points. By utilizing a pull-based model, the system periodically collects multi-dimensional metrics from monitored targets, storing them in an optimized block storage format that supports high-throughput ingestion and efficient historical analysis. The platform distinguishes itself through a specialized query engine that enables real-time analysis of performanc

    Stores historical records of numerical performance data in a scalable format optimized for long-term trend analysis.

    Goalertinggraphinghacktoberfest
    عرض على GitHub↗64,569
  • localstack/localstackالصورة الرمزية لـ localstack

    localstack/localstack

    64,423عرض على GitHub↗

    LocalStack is an infrastructure development environment that provides a local simulation of cloud services. By leveraging container-orchestrated service lifecycles, it allows developers to build, test, and debug cloud-native applications on their local machines without requiring remote connectivity or incurring cloud provider costs. The platform distinguishes itself through sophisticated traffic redirection and request routing, which intercept cloud service calls at the network layer and redirect them to local handlers. This enables seamless integration with existing development workflows, al

    Persists resource states across sessions by configuring underlying storage backends to ensure data remains available after environment restarts.

    Pythonawscloudcontinuous-integration
    عرض على GitHub↗64,423
  • ffmpeg/ffmpegالصورة الرمزية لـ FFmpeg

    FFmpeg/FFmpeg

    61,176عرض على GitHub↗

    FFmpeg is a cross-platform multimedia framework designed for the recording, conversion, and streaming of audio and video content. It functions as a comprehensive toolkit that provides both a command-line utility for direct media manipulation and a collection of low-level libraries for integration into custom applications. At its core, the project utilizes a packet-based stream engine and a format-agnostic abstraction layer to handle diverse media standards, containers, and network protocols. The framework distinguishes itself through a modular, graph-based filter execution model that allows f

    Reads from or writes to local storage, supporting features like file truncation, seeking, and continuous tailing.

    Caudiocffmpeg
    عرض على GitHub↗61,176
  • solido/awesome-flutterالصورة الرمزية لـ Solido

    Solido/awesome-flutter

    60,327عرض على GitHub↗

    This project is a community-curated directory of resources, libraries, and tools designed to support developers working with the Flutter framework. It functions as a centralized knowledge base, organizing high-quality external references into a structured, human-readable format to assist in the discovery of technical materials for cross-platform application development. The directory distinguishes itself through a comprehensive index of the global Flutter ecosystem, including local user groups, meetups, and communication channels that connect developers to international support networks. It m

    Identifies reliable solutions for managing local data persistence, including secure storage and preference handling.

    Dartandroidawesomeawesome-list
    عرض على GitHub↗60,327
السابق123456…28التالي
  1. Home
  2. Data & Databases
  3. Data Engineering and Infrastructure
  4. Data Persistence and Storage
  5. Data Storage

استكشف الوسوم الفرعية

  • Application CachingMechanisms for storing frequently accessed data in memory.
  • Application State Containers1 وسم فرعيMaintains non-visual data for retrieval and modification by interface elements. **Distinct from Data Storage:** Distinct from Data Storage: focuses on in-memory application state management rather than persistent storage.
  • Cache Adapters1 وسم فرعيComponents that allow replacing default memory storage with external database solutions for improved performance.
  • Client-Side Persistence4 وسوم فرعيةMechanisms for managing data storage directly on user devices or within browser environments, distinct from server-side infrastructure.
  • Cross-Environment Storage Adapters1 وسم فرعيInterfaces that enable consistent data persistence across browser, mobile, and server-side runtimes. **Distinct from Data Storage:** Distinct from Data Storage: focuses on the cross-environment abstraction layer rather than general storage management.
  • Data Access Abstractions2 وسوم فرعيةMiddleware and interface layers that decouple application logic from specific underlying storage engines or physical backends.
  • Data Availability Layers3 وسوم فرعيةInfrastructure for ensuring transaction data remains accessible for independent verification. **Distinct from Data Storage:** Distinct from general data storage: focuses specifically on blockchain data availability and verification.
  • Data ForwardersComponents for streaming metrics to remote storage with replication and sharding support. **Distinct from Data Storage:** Distinct from Data Storage: focuses on the active forwarding/streaming of data rather than passive persistence.
  • Document-Based Storage3 وسوم فرعيةStorage mechanisms utilizing flexible document models to handle semi-structured data and diverse types. **Distinct from Data Storage:** Focuses on the document-based data model rather than general data storage utilities.
  • File-Based Storage Systems6 وسوم فرعيةPersistence strategies that utilize local or structured file systems for organizing state, logs, and configuration data.
  • Graph Database QueryingExecuting specialized query languages to interact with graph-structured data. **Distinct from Data Storage:** Distinct from Data Storage: focuses specifically on the execution of query languages like AQL for graph databases rather than general persistence.
  • High-Availability ConfigurationsAutomated replication and multi-region clustering for data durability.
  • Interaction State Storage1 وسم فرعيKey-value storage associated with specific user interactions to maintain conversational state. **Distinct from Data Storage:** Specifically manages state across a conversation rather than generic application data storage.
  • LinkedSystems designed to store and map semantic relationships between data points across web-scale datasets. **Distinct from Data Storage:** Focuses on semantic linked data (RDF-style) rather than general application data storage.
  • Metadata and State Management2 وسوم فرعيةSystems focused on the persistence of application configuration, relational metadata, and synchronized state logs.
  • Nested Columnar StorageStorage of hierarchical or nested data structures within a columnar format. **Distinct from Data Storage:** Distinct from general Data Storage: specifically addresses nested records and key-value maps within columnar layouts.
  • NoSQL WrappersDatabase wrappers that provide consistent non-relational data management across different platforms. **Distinct from Data Storage:** Distinct from general Data Storage: focuses specifically on the NoSQL wrapper abstraction for cross-platform consistency.
  • PluginAccesses declared storage collections at runtime to persist and retrieve operational data like submissions or logs. **Distinct from Data Storage:** Distinct from Data Storage: focuses on storage scoped to plugins, not general application data storage.
  • RealtimeAn improved storage engine that reduces connection and load times while supporting larger documents for realtime collaboration. **Distinct from Data Storage:** Distinct from Data Storage: optimized specifically for realtime collaborative workloads with CRDT conflict resolution.
  • Serialization UtilitiesTools for converting complex objects and tensor structures into persistent storage formats.
  • Session Storage Synchronization1 وسم فرعيHooks for synchronizing state with the browser's session-scoped storage. **Distinct from Storage Synchronization Services:** Specific to window.sessionStorage, unlike general storage synchronization services.
  • Specialized Database Engines2 وسوم فرعيةPurpose-built database systems optimized for specific data models like vectors, time-series, or document-oriented structures.
  • Storage Backend Configurators3 وسوم فرعيةTools for selecting storage backends and file formats for custom data types. **Distinct from Data Storage:** Distinct from Data Storage: focuses on the configuration of persistence backends rather than general storage utilities.
  • Storage Synchronization Services2 وسوم فرعيةAutomated processes for maintaining consistency between local and remote storage states. **Distinct from Data Storage:** Distinct from Data Storage: focuses on the synchronization of data states rather than general storage persistence.
  • Topic ManagementCreating and organizing named channels to distribute streaming data. **Distinct from Data Storage:** Distinct from general Data Storage: focuses specifically on the lifecycle of streaming topics.
  • Transportation Protocols1 وسم فرعيLibraries and tools for data movement, message queuing, and transport-layer communication.
  • Unformatted StorageStorage of raw data without applying structural formatting to minimize overhead. **Distinct from Data Storage:** Contrasts with general data storage by specifically avoiding formatting for efficiency.
  • Verifiable StorageStorage systems that provide cryptographic proofs of integrity and availability for stored datasets. **Distinct from Data Storage:** Focuses on the verifiability and tamper-evidence of stored data rather than general storage utilities.
  • Virtual Data SimulatorsUtilities for creating virtual tables that generate synthetic data or discard writes for testing. **Distinct from Data Storage:** Distinct from Data Storage: focuses on ephemeral, non-persistent simulation rather than durable storage.