OpenNMT/CTranslate2

Features

• AI & Machine Learning - Fast inference engine for Transformer models
• Model Serving Engines - Fast C++ inference engine for transformer-based models.
• Inference Frameworks - C++ based inference engine for CPU and GPU acceleration.