# data-engineering-community/data-engineering-wiki **Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/data-engineering-community-data-engineering-wiki).** 1,985 stars · 241 forks · CSS · CC0-1.0 ## Links - GitHub: https://github.com/data-engineering-community/data-engineering-wiki - Homepage: https://dataengineering.wiki - awesome-repositories: https://awesome-repositories.com/repository/data-engineering-community-data-engineering-wiki.md ## Topics `data` `data-engineer` `data-engineering` `data-modeling` `data-pipelines` `database` `etl` `sql` ## Description The data engineering wiki is a crowdsourced knowledge base and reference guide assembled through collaborative contributions from practitioners. It functions as a structured repository of learning paths, architectural decision guides, and software evaluations for data systems, compiled from plain-text source markup files into a searchable static documentation site. The content is organized into strict conceptual hierarchies covering core engineering concepts, security and governance, and infrastructure tools. Contributors and readers can explore foundational architectural patterns, storage strategies, and processing techniques, alongside curated books, courses, and community resources. The knowledge base can be accessed online or downloaded for offline study by opening the repository as a local folder inside desktop markdown note-taking software. ## Tags ### Education & Learning Resources - [Community Knowledge Bases](https://awesome-repositories.com/f/education-learning-resources/community-knowledge-bases.md) — Functions as a crowdsourced collection of markdown documentation structured for offline reading and searchable web publishing. - [Curated Learning Resources](https://awesome-repositories.com/f/education-learning-resources/curated-learning-resources.md) — Collects community-recommended books and courses to support ongoing professional growth. ([source](https://github.com/data-engineering-community/data-engineering-wiki/blob/main/README.md)) - [Data Engineering Curricula](https://awesome-repositories.com/f/education-learning-resources/data-engineering-curricula.md) — Provides curated books, courses, and educational materials recommended by the community to build professional skills in data engineering. - [Language Concept Guides](https://awesome-repositories.com/f/education-learning-resources/educational-resources/languages-and-programming-concepts/programming-language-mastery-guides/language-concept-guides.md) — Examines core data engineering concepts and decision-making guides organized within a structured knowledge base. ([source](https://github.com/data-engineering-community/data-engineering-wiki#readme)) - [Community Curation Workflows](https://awesome-repositories.com/f/education-learning-resources/professional-development-career/career-development/community-operations-engagement/community-governance/community-curation-workflows.md) — Assembles structured knowledge through collaborative community contributions from practitioners. - [Data Engineering Resource Guides](https://awesome-repositories.com/f/education-learning-resources/reference-guides/data-quality-guides/data-engineering-resource-guides.md) — Offers a reference guide explaining foundational concepts, ingestion methods, storage strategies, and processing techniques for building data systems. - [Layered Taxonomies](https://awesome-repositories.com/f/education-learning-resources/professional-engineering-roadmaps/layered-taxonomies.md) — Structures technical resources into layered conceptual hierarchies to simplify navigation through complex domains. - [Data Science Concepts](https://awesome-repositories.com/f/education-learning-resources/technical-domain-education/computer-science-education/computer-science-concepts/data-science-concepts.md) — Investigates foundational ideas related to data architecture and processing pipelines. ([source](https://github.com/data-engineering-community/data-engineering-wiki/blob/main/Index.md)) ### Part of an Awesome List - [Core Concepts](https://awesome-repositories.com/f/awesome-lists/devtools/core-concepts.md) — Examines foundational architectural patterns, storage strategies, and processing techniques. ([source](https://github.com/data-engineering-community/data-engineering-wiki/tree/main/Concepts)) - [Data Engineering Tools](https://awesome-repositories.com/f/awesome-lists/devtools/data-engineering-tools.md) — Surveys and compares software, infrastructure options, and tools across the data engineering ecosystem to select the right solutions. ### Business & Productivity Software - [Offline Knowledge Management](https://awesome-repositories.com/f/business-productivity-software/offline-knowledge-management.md) — Runs documentation as a local vault inside desktop markdown applications for personal offline reference and study. - [Local-First Knowledge Bases](https://awesome-repositories.com/f/business-productivity-software/local-first-knowledge-bases.md) — Enables local-first personal knowledge management by opening documentation as an offline vault. ([source](https://github.com/data-engineering-community/data-engineering-wiki/blob/main/README.md)) ### Content Management & Publishing - [Markdown-Based Knowledge Bases](https://awesome-repositories.com/f/content-management-publishing/content-management-systems/content-architecture-modeling/markdown-ecosystem-tools/markdown-based-knowledge-bases.md) — Stores a collection of markdown files designed for offline reading and personal knowledge management inside desktop note-taking software. - [Curated Content Management](https://awesome-repositories.com/f/content-management-publishing/curated-content-management.md) — Organizes curated content and educational references for data engineering practitioners. - [Static Documentation Generation](https://awesome-repositories.com/f/content-management-publishing/static-site-document-generators/static-site-generators/static-documentation-generation.md) — Compiles source markup files into a searchable static documentation site. - [Repository Wikis](https://awesome-repositories.com/f/content-management-publishing/documentation-knowledge-management/documentation-hosting/repository-wikis.md) — Provides a curated repository of learning paths, architectural decision guides, and tool comparisons for data systems. - [Local Wiki Administration](https://awesome-repositories.com/f/content-management-publishing/local-wiki-administration.md) — Allows running the documentation repository locally as a wiki or vault. ([source](https://github.com/data-engineering-community/data-engineering-wiki#readme)) - [Static Site Generation](https://awesome-repositories.com/f/content-management-publishing/static-site-document-generators/static-site-generators/static-site-generation.md) — Generates a fast, lightweight static website from repository source files. ### Data & Databases - [Data Exploration](https://awesome-repositories.com/f/data-databases/data-analysis-visualization/analytical-platforms-engines/data-exploration.md) — Explores foundational terminology and concepts related to data engineering. ([source](https://github.com/data-engineering-community/data-engineering-wiki/blob/main/README.md)) ### Software Engineering & Architecture - [Architectural Decision Guides](https://awesome-repositories.com/f/software-engineering-architecture/architectural-decision-guides.md) — Navigates complex architectural choices, storage strategies, and processing trade-offs through structured community reference guides. - [Standardized Directory Taxonomies](https://awesome-repositories.com/f/software-engineering-architecture/project-management-governance/repository-maintenance/project-organization/standardized-directory-taxonomies.md) — Organizes content into strict conceptual directory hierarchies for tools, decision guides, and learning paths. - [Note Vault Abstractions](https://awesome-repositories.com/f/software-engineering-architecture/vault-standards/vault-management-delegations/vault-operations/note-vault-abstractions.md) — Allows opening the repository as a local folder inside desktop note-taking applications for offline study. ### Development Tools & Productivity - [Static Site Documentation](https://awesome-repositories.com/f/development-tools-productivity/documentation-generators/static-site-documentation.md) — Compiles static web sites from source markup files to provide lightweight reference across devices.