30 open-source projects similar to understandable-machine-intelligence-lab/quantus, ranked by shared indexed features. Tags may describe platforms or build tools rather than the same primary purpose. Check each project’s use case, license, and deployment requirements before treating it as a replacement.
Source code/webpage/demos for the What-If Tool
Captum is an open-source library for explaining model predictions by attributing them to input features, neurons, and layers using gradient-based and perturbation-based methods. It provides a modular framework for implementing, evaluating, and combining a range of explanation techniques, including gradient-based attribution, perturbation-based analysis, game-theoretic Shapley value approximation, and surrogate model explanations, with support for parallelization and noise stabilization. The library distinguishes itself through its breadth of attribution methods and its support for advanced in
A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.
Algorithms for explaining machine learning models
Interpret is an interpretable machine learning library and glassbox model framework. It provides toolkits for training inherently transparent models and applying post-hoc explanation techniques to make machine learning predictions human-understandable. The framework distinguishes itself by integrating differential privacy into the training of interpretable models to prevent sensitive data from leaking through explanations. It also features a visualization tool for rendering interactive decision paths and model behavior. The library covers model explainability through feature importance calcu
⬛ Python Individual Conditional Expectation Plot Toolbox
(a.k.a. Path-Integrated Gradients, a.k.a. Axiomatic Attribution for Deep Networks)
This repository contains a sample implementation of Gradient Feature Auditing (GFA) meant to be generalizable to most datasets. For more information on the repair process, see our paper on Certifying and Removing Disparate Impact. For information on the full auditing process, see our paper on…
Interpretable ML package 🔍 for concise, transparent, and accurate predictive modeling (sklearn-compatible).
Explainable outlier/anomaly detection based on smart decision tree grouping, similar in spirit to the GritBot software developed by RuleQuest research. Written in C++ with interfaces for R and Python (additional Ruby wrapper can be found here). Supports columns of types numeric, categorical,…
🦊 Xplique (pronounced \ɛks.plik\ ) is a Python toolkit dedicated to explainability. The goal of this library is to gather the state of the art of Explainable AI to help you understand your complex neural network models. Originally built for Tensorflow's model it also works for PyTorch models…
title: 'DIANNA: Deep Insight And Neural Network Analysis' tags: - Python - explainable AI - deep neural networks - ONNX - benchmark sets authors: - name: Elena Ranguelova^co-first author # note this makes a footnote saying 'co-first author' orcid: 0000-0002-9834-1756 affiliation: 1 - name:…
WeightWatcher (WW) is an open-source, diagnostic tool for analyzing Deep Neural Networks (DNN), without needing access to training or even test data. It is based on theoretical research into Why Deep Learning Works, based on our Theory of Heavy-Tailed Self-Regularization (HT-SR). It uses ideas…
Explain & debug any blackbox machine learning model with a single line of code.
XAI - An eXplainability toolbox for machine learning
A Python package to assess and improve fairness of machine learning models.
NeuroX provide all the necessary tooling to perform Interpretation and Analysis of (Deep) Neural Networks centered around Probing. Specifically, the toolkit provides:
effector an eXplainable AI package for tabular data. It:
Interpretability and explainability of data and machine learning models
This repo contains the code for our talk "Demystifying the neural network black box". Slides are available on Speaker Deck. This code has not been maintained for over a year. It's archived on 2024-12-18.
tensorflow implementation of Grad-CAM (CNN visualization)
The official implementation of "The Shapley Value of Classifiers in Ensemble Games" (CIKM 2021).
This repository is the official implementation of "Hyperdimensional Probe: Decoding LLM Representations via Vector Symbolic Architectures". This work combines symbolic representations and neural probing to introduce Hyperdimensional Probe, a new paradigm for decoding LLM vector space into…
A Tree based feature selection tool which combines both the Boruta feature selection algorithm with shapley values.