# 66ring/critiprefill

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/66ring-critiprefill).**

17 stars · 1 forks · Python · GPL-3.0

## Links

- GitHub: https://github.com/66RING/CritiPrefill
- Homepage: https://arxiv.org/abs/2409.12490
- awesome-repositories: https://awesome-repositories.com/repository/66ring-critiprefill.md

## Description

Code repo for "CritiPrefill: A Segment-wise Criticality-based Approach for Prefilling Acceleration in LLMs".

## Tags

### Part of an Awesome List

- [Prompt Compression](https://awesome-repositories.com/f/awesome-lists/ai/prompt-compression.md) — Uses segment-wise criticality to speed up prefilling.