apache/zeppelin
Zeppelin
Apache Zeppelin is a web-based notebook platform for interactive data analytics that supports executing code in over 20 languages within a single notebook. It provides a plugin-based interpreter architecture that allows the notebook to be extended with new languages and data sources, and includes a JDBC connector abstraction for connecting to any JDBC-compliant database. The platform also features session-isolated interpreter contexts, enabling separate interpreter instances per notebook or user with support for dependency injection and user impersonation.
The platform distinguishes itself through its integration with Apache Spark clusters for distributed data processing, supporting YARN, Mesos, and standalone modes. It offers a Helium application framework for extending the notebook UI with custom visualizations and applications, and provides Shiro-based authentication and authorization for role-based access control and per-notebook permission management. Notebooks can be saved to external storage backends such as Git, S3, Azure, or MongoDB through a pluggable storage interface, and paragraph outputs can be embedded on external websites for sharing and reporting.
The platform supports collaborative data analytics through web-based notebooks with live results and embedded outputs, and includes dynamic input form creation for parameterizing queries and code execution. It renders output in multiple formats including text, HTML, tables, network graphs, and Angular widgets using simple display directives.
Features
- Notebook Code Execution - Executes code in over 20 languages within a web-based notebook, enabling interactive data exploration and analysis.
- Notebook-Based Data Collaboration - Shares and collaborates on data analysis through web-based notebooks with live results and embedded outputs.
- Apache Spark Analytics - A notebook environment that integrates with Spark clusters for distributed data processing and interactive analytics.
- Pluggable Storage Backends - Saves notebooks to Git, S3, Azure, GCS, or MongoDB through a pluggable storage backend interface.
- JDBC Abstraction Layers - Connects to any JDBC-compliant database by abstracting SQL execution behind a common driver interface.
- Notebook JDBC Querying - Connects to any JDBC-compliant database to run SQL queries directly from a notebook.
- Interpreter API Integrations - Adds support for new languages or data sources by writing a plugin that follows the interpreter API.
- Interpreter Session Management - Manages separate interpreter instances per notebook or user, supporting dependency injection and user impersonation.
- Plugin-Based Interpreter Frameworks - An interpreter framework that supports over 20 languages and data sources through a plugin-based architecture.
- Interpreter-Based Plugin Systems - Extends the notebook with new languages and data sources by loading plugins that implement a standard interpreter API at runtime.
- Multi-Format Notebook Outputs - Renders output as text, HTML, tables, network graphs, or Angular widgets using simple display directives.
- Notebook Output Renderers - Renders notebook outputs as HTML, tables, network graphs, and Angular widgets using simple display directives.
- Spark Cluster Connectivity - Runs distributed data processing on Spark clusters with support for YARN, Mesos, and standalone modes.
- Shared Notebooks - Shares paragraph outputs on external websites by embedding them outside the notebook interface.
- Custom Data Visualizations - Builds custom visualizations and display widgets to render data as tables, graphs, or interactive elements.
- Notebook Storage Backends - Saves notebooks to cloud or version-controlled storage backends such as Git, S3, Azure, or MongoDB.
- External Storage Integrations - Saves notebooks to Git, S3, Azure, or MongoDB for versioning, backup, and team collaboration.
- Shiro-Based Access Controls - Restricts notebook access using Apache Shiro for role-based authentication and per-notebook permission control.
- Per-Notebook Permission Controls - Controls read and write permissions per notebook to enforce data governance.
- Notebook UI Extensions - Extends the notebook UI with custom visualizations, spells, and applications through a plugin-based extension system.
- Dynamic Input Forms - Creates interactive form controls within a notebook paragraph to parameterize queries and code execution.
- Science and Data Analysis - Web-based notebook for interactive data analytics.
- Interactive Notebooks - Supports interactive analytics with multi-language notebook support.
