# uber/petastorm

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/uber-petastorm).**

1,889 stars · 283 forks · Python · Apache-2.0

## Links

- GitHub: https://github.com/uber/petastorm
- awesome-repositories: https://awesome-repositories.com/repository/uber-petastorm.md

## Description

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

## Tags

### Part of an Awesome List

- [Optimization Tools](https://awesome-repositories.com/f/awesome-lists/ai/optimization-tools.md) — Enables distributed training and evaluation of deep learning models.