# abkmystery/anee

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/abkmystery-anee).**

1 stars · 0 forks · Python · Apache-2.0

## Links

- GitHub: https://github.com/abkmystery/ANEE
- awesome-repositories: https://awesome-repositories.com/repository/abkmystery-anee.md

## Description

ANEE is an experimental dynamic inference wrapper for pretrained Transformer language models (currently GPT-2). Instead of always running all layers, ANEE exposes an energy_budget and performs early exit inside the model’s forward pass.

## Tags

### Part of an Awesome List

- [Neural Networks](https://awesome-repositories.com/f/awesome-lists/ai/neural-networks.md) — Sparse inference engine for transformer models.