Awesome GitHub RepositoriesIntermediate Representations

Docling is a modular framework designed for document parsing, layout analysis, and structured data extraction. It transforms unstructured files and web content into a unified, hierarchical data model that preserves the spatial and semantic relationships between text, tables, images, and layout elements. By normalizing diverse input formats into a consistent internal representation, the library enables uniform processing across various document types. The project distinguishes itself through a schema-driven approach that maps document regions to strongly-typed objects, ensuring data accuracy t

This project is a diagram-as-code tool that transforms declarative text scripts into professional visual representations. It functions as a technical documentation generator, allowing users to define nodes, connections, and hierarchical relationships through a domain-specific modeling language that integrates directly into version-controlled developer workflows. The tool distinguishes itself through a highly modular architecture that decouples diagram definitions from spatial positioning. It features a pluggable layout engine that supports multiple arrangement algorithms, alongside a styling

DataX is a distributed data integration framework and plugin-based ETL tool designed for synchronizing large datasets between heterogeneous sources and destinations. It functions as a JDBC data migration engine and offline synchronization tool, enabling the movement of data between relational databases, NoSQL stores, and object storage. The system utilizes a plugin-based connector architecture that decouples reader and writer logic, allowing it to map and transform data types across different storage engines using a standardized internal representation. This design supports heterogeneous data

dbt-core is a command-line framework for transforming data within a warehouse using modular SQL and version control. It functions as a data transformation engine that enables users to define data structures and business logic through declarative configuration files, which the system then compiles into executable code. By managing complex data dependencies through a directed acyclic graph, it ensures that transformation tasks execute in the correct order while maintaining a manifest-driven state to track lineage and execution history. The project distinguishes itself through an adapter-based d

Clair is a container image vulnerability scanner and security analyzer. It performs static analysis of container images by matching package contents against vulnerability databases to identify security risks across different package formats and architectures. The project functions as both an image indexer and a vulnerability database manager. It processes container layers into intermediate representations to enable fast security lookups and synchronizes security metadata from multiple external sources to maintain a local registry. Capability areas include continuous security monitoring, whic

本项目是一个用 Rust 编写的分析工具，用于捕获、转换和可视化函数调用栈，以识别系统性能瓶颈。它作为一个采样分析器包装器，将原始分析数据转换为交互式火焰图，即资源消耗的层级映射。 该工具提供了与 Rust 构建系统的专门集成，以分析二进制文件和性能基准。它还允许自定义分析配置，使用户能够覆盖默认的系统分析工具或记录标志，以控制数据的收集方式。 该实用程序支持应用程序性能监控和二进制执行分析。它可以通过附加到活动进程 ID 来捕获性能数据，从而在无需重启的情况下分析正在运行的应用程序。

Poml is a prompt management framework and templating engine designed for authoring, versioning, and rendering structured prompts for large language models. It uses a semantic markup language to organize prompts into reusable templates, combining them with dynamic context and data to generate formatted inputs. The system distinguishes itself by decoupling core prompt logic from final presentation through a stylesheet-based approach. It provides a dedicated JSON schema output generator to enforce strict, machine-parsable model responses and a configuration interface for managing function tool s

Dokka 是一个可扩展的文档引擎，专为生成 Kotlin 项目的结构化 API 参考材料而设计。通过解析源代码和注释，它作为一个静态网站生成器，将代码库转换为可读文档。它直接集成到开发工作流中作为构建系统插件，允许在标准编译过程中自动创建参考材料。 该项目通过模块化、插件驱动的处理流水线脱颖而出，允许开发者修改生成工作流、自定义输出格式并调整视觉样式。它通过将来自多个子项目的文档聚合到单个统一输出中来支持复杂的项目结构。此外，它包括一个交叉引用引擎，可解析内部代码符号并链接到外部库文档，确保生成的材料保持连接和可导航。 该引擎提供对最终输出的广泛控制，包括过滤特定代码元素、嵌入实时使用示例以及直接链接到远程源代码存储库的能力。它支持多种输出格式（如 HTML、Markdown 和 Javadoc），并允许对模板和资产进行深度自定义以满足特定的品牌或文档要求。该工具旨在通过命令行接口或原生构建工具集成来调用，从而促进其在自动化部署流水线中的使用。

Fern is a toolset for managing API specifications, generating type-safe client libraries, and producing hosted developer documentation. It provides a utility for validating, transforming, and exporting API definitions into standardized OpenAPI formats, serving as a system to maintain a consistent source of truth for API designs. The project differentiates itself through an automated SDK distribution pipeline that publishes generated libraries to package managers such as npm, PyPI, Maven, and NuGet. It also includes an AI-powered search assistant trained on API and SDK specifications to answer