What are the main features of openai/moderation-api-release?

The main features of openai/moderation-api-release are: Moderation APIs, Guardrails and AI Safety.

Which projects share features with openai/moderation-api-release?

Projects with overlapping indexed features include: unitaryai/detoxify — Updated the multilingual model weights used by Detoxify with a model trained on the translated data from the 2nd… conversationai/perspectiveapi — Perspective is an API that uses machine learning models to score the perceived impact a comment might have on a… facebookresearch/crypten — A framework for Privacy Preserving Machine Learning. fairlearn/fairlearn — A Python package to assess and improve fairness of machine learning models. guardrails-ai/guardrails — Guardrails is a Python SDK that wraps calls to large language models with configurable validation pipelines,… centerforaisafety/harmbench — 📰 Latest News 📰 - 🗡️ What is HarmBench 🛡️ - 🌐 Overview 🌐 - ☕ Quick Start ☕ - ⚙️ Installation - 🛠️ Running the…

Moderation Api Release - evaluate LLM safety

Name: openai/moderation-api-release
Author: openai

The evaluation dataset data/samples-1680.jsonl.gz is the test set used in the following paper:

Features

Moderation APIs - Provides an endpoint for detecting undesired content in text.

unitaryai/detoxify

1,259View on GitHub

Updated the multilingual model weights used by Detoxify with a model trained on the translated data from the 2nd Jigsaw challenge (as well as the 1st). This model has also been trained to minimise bias and now returns the same categories as the unbiased model. New best AUC score on the test set:…

conversationai/perspectiveapi

925View on GitHub

Perspective is an API that uses machine learning models to score the perceived impact a comment might have on a conversation. See https://developers.perspectiveapi.com for more information.

facebookresearch/CrypTen

1,648View on GitHub

A framework for Privacy Preserving Machine Learning

centerforaisafety/HarmBench

991View on GitHub

📰 Latest News 📰 - 🗡️ What is HarmBench 🛡️ - 🌐 Overview 🌐 - ☕ Quick Start ☕ - ⚙️ Installation - 🛠️ Running the Evaluation Pipeline - ➕ Using your own models in HarmBench - ➕ Using your own red teaming methods in HarmBench - 🤗 Classifiers - ⚓ Documentation ⚓ - 🌱 HarmBench's Roadmap 🌱 -…

How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.