NVIDIA/NeMo-Curator

Features

• Data Curation and Filtering - GPU-accelerated toolkit for large-scale data curation and heuristic filtering.
• LLM Development Tools - Framework for preparing and curating large-scale training datasets.
• Data Annotation and Synthesis - GPU-accelerated framework for large language model data curation.