BI, dashboards and data viz

dc.js is a multi-dimensional analysis tool and visualization framework used to build interactive data dashboards. It functions as a charting library that renders diverse SVG visualizations powered by D3 and integrates natively with Crossfilter to enable coordinated filtering across large datasets. The project is distinguished by its linked-view coordination, where selecting a data range or category in one chart simultaneously updates all other connected views. This allows for dynamic data exploration through dimensional chart linking and coordinated brushing, transforming raw datasets into navigable interfaces for deep analysis. The suite covers a wide array of chart types, including sunbursts, choropleths, heat maps, and scatter plots, alongside numeric metrics and tabular data grids. It provides a comprehensive set of interaction components such as range brushes, checkbox menus, and text search fields to control data subsets. The library includes utilities for global color scheme management, chart group coordination, and accessibility enhancements for screen readers.

Umami is a self-hosted, privacy-focused web analytics platform designed to provide full control over infrastructure and user data. It captures website traffic and visitor behavior through anonymous tracking methods that avoid cookies, browser fingerprinting, and the storage of personally identifiable information. The platform distinguishes itself through a comprehensive suite of behavioral analysis tools, including session replays, heatmaps, and cohort-based retention reporting. It features a multi-tenant architecture that allows teams to manage multiple websites within a single, collaborative dashboard, supported by granular role-based access controls and the ability to share specific insights via public links. Beyond core traffic monitoring, the system includes a robust event tracking framework for capturing custom user interactions, conversion funnels, and marketing campaign attribution. It also provides diagnostic capabilities for web performance, allowing users to track core web vitals and troubleshoot data collection through detailed session logs and visitor activity searches. The software supports flexible deployment strategies, including containerized installations and source-code-based setups, and can be integrated into various environments via a standard API or pre-built plugins.

This project is a collection of specialized study guides and roadmaps centered on computer science, data engineering, and machine learning fundamentals. It provides a structured curriculum of technical competencies, tools, and skills required to transition into professional data engineering roles. The project features a data engineering skill map that visually organizes databases, processing architectures, and infrastructure tools. It also includes a machine learning learning path covering supervised and unsupervised learning techniques alongside model operations. The curriculum covers broad capability areas including machine learning operations, technical skill mapping, and computer science fundamentals. To ensure accessibility, the project provides text-based alternatives for its visual guides.

This project is a React-based framework for constructing interactive, node-based visual interfaces. It provides a platform for building canvases where users define, connect, and organize logical processes, data pipelines, or complex workflows through a graphical interface. By utilizing a modular component architecture, it enables the development of low-code environments, visual programming tools, and interactive diagramming applications. The framework distinguishes itself through a declarative approach where state changes automatically synchronize with the visual representation of nodes and edges. It employs a coordinate-aware container that renders elements as scalable vector graphics, ensuring consistent visual quality across zoom levels. Developers can leverage an integrated event-driven layer to manage user gestures, alongside automated layout algorithms that organize graph elements in real time to improve readability. The system includes comprehensive utilities for managing node properties, connection handles, and nested hierarchies. It supports a wide range of applications, from data exploration and automated graph visualization to specialized use cases like real-time audio synthesis. The project is distributed as a library of components designed to facilitate the creation of custom, interactive graph editors within web applications.

Lightdash is an open-source business intelligence platform that treats analytics logic as code. It centralizes metric and dimension definitions in a semantic layer, allowing data teams to define business metrics in YAML files version-controlled alongside data models. This approach ensures consistent, governed data access without requiring users to write SQL. Lightdash introduces CI/CD workflows for BI content, enabling teams to validate, test, and deploy analytics changes through automated pipelines and isolated preview environments. Its natural language query interface allows users to ask questions in plain English, translated into structured queries via AI agents. The platform also provides an embeddable analytics SDK for integrating dashboards into external applications, and enforces role-based access control with row-level security. Beyond these differentiators, Lightdash supports building interactive dashboards and data applications from the centralized semantic model, self-service metric exploration with filtering and drill-down, scheduled report delivery to Slack or email, and full data lineage tracking. It integrates deeply with dbt to synchronize models and metrics across the analytics stack.

Superset is a web-based business intelligence platform designed for data exploration, visualization, and interactive dashboarding. It functions as a query-driven analytics engine that connects to various SQL databases, allowing users to perform ad-hoc analysis, define virtual metrics, and build complex data visualizations through a centralized interface. The platform distinguishes itself through a robust semantic layer that transforms raw database schemas into calculated columns and virtual metrics, enabling consistent business logic across an organization. It features a plugin-based visualization architecture that supports modular chart components and custom geospatial maps, alongside granular role-based access control that enforces data security through row-level filters applied directly to generated SQL queries. Beyond its core analytics capabilities, the system provides comprehensive tools for enterprise data governance, including automated reporting, scheduled data snapshots, and secure content embedding. It supports high-performance operations through distributed caching, asynchronous query execution, and a standardized API for programmatic resource management. The project is designed for production-grade deployment, offering extensive configuration for containerized environments, metadata management, and secure network communication. It provides detailed documentation for installation, environment migration, and system hardening to ensure scalability and data integrity across distributed instances.

Kibana is a browser-based data exploration and visualization platform designed for interacting with information stored in distributed search engines. It serves as a centralized interface for analyzing structured and unstructured data, enabling users to build custom dashboards, generate interactive charts, and map complex datasets to uncover trends and actionable insights. Beyond visualization, the platform functions as a comprehensive management console for infrastructure operations. It provides tools for configuring security policies, managing data indices, and monitoring system health. The system also acts as a log analytics and application performance monitoring environment, allowing users to track real-time service metrics and identify operational bottlenecks across distributed systems. The platform supports extensive data lifecycle management, including the collection, normalization, and enrichment of information through processing pipelines. Its modular architecture allows for functional extensions, while a standardized interface enables programmatic control over cluster configurations and automation workflows.

ClickHouse is a high-performance, columnar analytical database designed for real-time query execution and large-scale data aggregation. It functions as a distributed data warehouse capable of processing petabytes of information, while also providing an embedded engine that integrates directly into applications for native query capabilities without external dependencies. The system is built to handle high-throughput ingestion and complex analytical workloads, delivering millisecond-level latency for interactive dashboards and operational monitoring. The platform distinguishes itself through advanced storage and execution techniques, including vectorized query processing and a merge tree storage engine that maintains performance during massive insertions. It features adaptive subcolumn mapping for semi-structured data and supports native vector search for machine learning and generative AI applications. To facilitate efficient data movement, the engine utilizes zero-copy shared memory buffers, minimizing overhead when interacting with external analytical tools or processing diverse file formats like Parquet, JSON, and Arrow. Beyond its core storage and processing capabilities, the project provides a comprehensive suite of tools for observability, security, and data integration. It includes built-in support for natural language querying, automated workflow orchestration for AI agents, and extensive diagnostic features for query plan inspection. The platform also offers robust cloud infrastructure management, including support for private networking, compliant deployment strategies, and integrated billing consolidation.

d2-admin is an admin dashboard framework used to build back-office management interfaces. It provides a set of pre-configured layouts and themeable components, including foldable sidebars and draggable grid systems, to facilitate system oversight and control. The framework is distinguished by its multi-tab administration interface, which allows users to switch between pages and reorder tabs via drag and drop. It also features a dynamic translation system for multi-language interface localization and a dedicated toolset for tabular data management, enabling the import and export of data via CSV and Excel formats. The project covers several broader capability areas, including interactive data visualization with charting libraries, modular application state management with persistence, and user authentication and session control. It also includes utilities for rich text and markdown editing, system health monitoring through error logging, and bundle performance optimization.

This project is a declarative data visualization library that provides a composable suite of user interface components for rendering interactive charts. It functions as an SVG-based charting engine, allowing developers to construct complex visualizations by nesting modular building blocks such as axes, grids, legends, and data series within a unified layout. The library distinguishes itself through a highly responsive architecture that automatically reconciles layout changes and maps data domains to pixel coordinates using mathematical scale functions. It prioritizes performance through memoized property diffing and component isolation, ensuring that high-frequency data updates remain smooth. Furthermore, it offers extensive customization hooks, enabling developers to inject unique shapes, custom styles, and specialized labels into individual chart elements. Beyond its core composition model, the framework includes comprehensive tools for managing user interactions, such as tooltips and coordinate-aware event handling. It supports a wide range of axis configurations for both continuous and categorical data, alongside built-in accessibility features that respect system-level motion preferences. The library is built with TypeScript, providing generic data support and strongly-typed wrappers to ensure consistency during development.

CrowdSec is a collaborative, distributed security engine designed for threat detection and infrastructure protection. It functions as an intrusion detection system that parses logs and network traffic to identify malicious patterns, utilizing a bucket-based threshold detection model to aggregate events and trigger alerts. The platform is built on a modular architecture that includes a centralized local API server for managing security signals and a relational database for persistent storage of remediation decisions. What distinguishes the project is its decoupled enforcement model, which offloads active blocking to lightweight external components known as bouncers. These bouncers query the central API to synchronize threat intelligence and apply real-time remediation across distributed environments. The system also features a hub-based configuration management framework, allowing users to download and deploy community-curated security scenarios, parsers, and collections to ensure consistent protection against evolving threats. The platform provides a comprehensive suite of tools for security operations, including automated log parsing pipelines, event-driven plugin systems for notification workflows, and extensive command-line utilities for infrastructure management. It supports flexible deployment patterns across standalone, containerized, and cloud-native environments, enabling centralized orchestration of security agents and fleet-wide monitoring of threat activity. The project includes a robust documentation and command-line interface that facilitates the lifecycle management of security components, from initial service discovery and configuration to the validation of detection logic and the auditing of active security policies.

Glances is a cross-platform system monitoring tool designed to track real-time resource usage and hardware health metrics across diverse computing environments. It functions as a command-line utility that provides a unified view of system performance, identifying bottlenecks and maintaining infrastructure stability through a consistent abstraction layer that translates kernel calls into actionable data. The project distinguishes itself through its distributed capabilities, offering a web-based interface that enables remote access to live performance metrics from any device without requiring direct terminal access. It also operates as a telemetry data exporter, utilizing an export-driven pipeline to stream collected statistics to external databases and monitoring tools for long-term historical analysis. The system supports a modular architecture that allows for extensible data collection through independent scripts. It facilitates remote monitoring by maintaining persistent network connections between lightweight data providers and centralized management interfaces.

This project is a community-curated directory of open-source software designed for deployment in private server environments and home labs. It serves as a comprehensive resource for discovering independent, self-hosted alternatives to mainstream cloud services, enabling users to maintain full data ownership and control over their digital infrastructure. The directory is structured through a hierarchical taxonomy that organizes a vast collection of applications into logical categories, ranging from media management and data analytics to private communication and team productivity tools. It distinguishes itself through a collaborative peer-review process, where community members validate the quality and relevance of each submission to ensure the directory remains accurate and reliable. The project covers a broad capability surface, including infrastructure automation, container-based service deployment, and declarative configuration management. These tools assist users in maintaining reproducible server environments and managing complex service dependencies across private hardware. The directory is maintained as a version-controlled repository, ensuring that all updates and community-driven changes are tracked and transparent.

NocoDB is a visual platform that transforms relational databases into collaborative, spreadsheet-style workspaces. By acting as a headless database backend, it provides a unified environment for designing database structures, managing record relationships, and interacting with data without requiring manual SQL queries. The platform normalizes interactions across various SQL and NoSQL data sources, allowing users to manage complex datasets through a centralized interface. The project distinguishes itself by automatically generating RESTful and GraphQL APIs from existing database schemas, enabling external applications to interact with data programmatically. It features a robust event-driven engine that monitors database state changes to trigger webhooks and execute custom logic within a sandboxed automation runtime. This allows for the creation of complex business workflows that synchronize information across third-party services based on real-time data updates. Beyond its core management capabilities, the platform offers a flexible view abstraction layer that renders data in multiple formats, including grids, kanban boards, galleries, forms, and calendars. It supports team collaboration through shared workspaces and provides tools for data visualization, schema design, and automated record manipulation. Comprehensive documentation is available to guide users through the API reference, script creation, and integration workflows.

This project is a plugin framework and agentic workflow library designed to connect large language models to professional toolstacks. It provides a system for integrating language models with external data warehouses, CRMs, and other enterprise software to retrieve and manipulate real-time business data. The framework enables the automation of specialized professional tasks through a file-based plugin definition system. It allows for the customization of domain expertise and plugin behavior to align with internal company processes, supported by an enterprise data connector that links models to BI tools, project trackers, and knowledge bases. The system covers a wide range of capability areas, including corporate knowledge management with unified enterprise search and cross-source data synthesis. It includes specialized toolsets for bioinformatics pipelines, financial operations automation, engineering lifecycle management, human resources administration, and sales intelligence. Additional capabilities span customer operations, legal contract review, product management, and data analysis. Project progress and workplace knowledge can be tracked via a local HTML dashboard and markdown-based task management.

This project is a self-hosted dashboard portal designed to centralize access to internal applications and infrastructure services. It functions as a configuration-driven platform that automatically discovers and organizes services from container runtimes and cluster management systems, presenting them within a unified, customizable web interface. The system distinguishes itself through a declarative widget framework that allows users to construct dashboard components by mapping raw API responses to visual elements. It includes a secure internal proxy layer that handles authentication, header injection, and request routing for external services, ensuring that data retrieval remains isolated and controlled. Developers can extend the platform by authoring custom widgets using standardized lifecycle hooks, which are supported by a comprehensive suite of unit and integration tests to ensure reliable data fetching and error handling. The platform covers a broad range of infrastructure monitoring and management capabilities, including real-time visualization of resource utilization for servers, containers, and virtual machines. Users can organize their dashboard through a hierarchical layout engine that supports nested service groups and flexible grid arrangements. The system also features a centralized localization layer to ensure consistent multi-language support across all interface elements and widgets. The application is managed through a centralized configuration file, which governs service discovery, global settings, and the behavior of various modular widgets.

DataV is a big screen visualization framework designed for high-impact data displays. It provides a collection of libraries for both Vue and React to build large-scale data dashboards featuring interactive charts and visual elements. The toolkit includes a specialized decoration kit of scalable vector graphics used to add borders and frames to professional data display screens. It focuses on complex data visualization, including the rendering of specialized charts such as water level and flight line maps. The framework covers a broad capability surface for data dashboard visualization, providing pre-made components to represent complex datasets and monitor performance indicators.

This project is a cross-platform desktop application designed for creating, editing, and managing structured diagrams and technical workflows. It provides a visual modeling environment that allows users to construct complex charts through a drag-and-drop interface, supporting the documentation of processes, software architectures, and system flows. The application distinguishes itself by utilizing a layered canvas composition that enables independent manipulation of diagram components, paired with a keyboard-driven workflow that minimizes mouse reliance. It employs scalable vector graphics for rendering, ensuring high-resolution output, while executing all graph processing and layout logic locally to provide immediate visual feedback. The software manages document structure through an XML-based serialization format, which supports version control and cross-platform compatibility. It also incorporates an event-driven command system to handle complex undo and redo operations throughout the editing lifecycle. The desktop shell integrates with the local file system, allowing for offline access and the ability to embed visual assets into external project management and documentation platforms.

Gradio is a Python library that enables the creation of interactive web applications by converting functions into browser-based interfaces. It functions as a declarative framework where developers define input and output components to automatically generate web forms, visualizations, and data-driven dashboards. By abstracting away manual web markup, the library allows for the rapid construction of interfaces for machine learning models, research demonstrations, and analytical workflows within a single environment. The platform distinguishes itself by automatically exposing internal application logic as web services, generating API endpoints and documentation at runtime. It includes a built-in client library that allows external scripts to interact with these hosted services, facilitating the integration of model outputs into larger software systems. This dual capability enables users to both build interactive front-ends and provide programmatic access to their data processing logic. The framework supports complex application requirements through an event-driven message bus that handles real-time data streaming and state synchronization. It manages long-running tasks via asynchronous job execution to maintain interface responsiveness and provides a dynamic layout engine for rendering visual structures. Developers can further extend the platform by creating custom components to implement specialized controls or unique interface elements beyond the standard library.

PlotNeuralNet is a programmatic tool designed to generate high-quality visual representations of neural network architectures. It functions as a declarative visualization framework that converts structural definitions into professional-grade graphical output, specifically tailored for technical documentation and academic research papers. The project distinguishes itself by utilizing a layer-centric procedural modeling approach, which applies standardized geometric templates to network components to ensure consistent visual styling. By leveraging a domain-specific macro language and a LaTeX-based engine, it translates high-level architectural descriptions into precise vector-based diagrams. This allows users to define complex network structures through a programming interface, automating the creation of schematics that accurately reflect model configurations. Beyond basic generation, the tool supports the prototyping of deep learning models by visualizing layer connections and data flow. It employs coordinate-based layout calculations and modular component templating to maintain alignment and spacing across diagrams, ensuring that visual records remain consistent as model designs evolve.