2 dépôts
Fetching structured training datasets from remote web addresses via JSON.
Distinct from Language Modeling Data Loading: Specifically focuses on remote HTTP fetching of JSON corpora, whereas the parent is general text data loading.
Explore 2 awesome GitHub repositories matching artificial intelligence & ml · Remote JSON Corpus Loading. Refine with filters or upvote what's useful.
nlp.js is a JavaScript natural language processing library and development framework used to build natural language understanding engines. It provides a toolkit for creating local machine learning models for intent classification and acts as a multilingual text processor that detects languages and normalizes text across various dialects. The framework distinguishes itself by supporting local execution on both servers and mobile devices, enabling chatbot functionality without an internet connection. It features a specialized system for conversational slot filling to collect mandatory informati
Enables the initialization of model knowledge bases by fetching JSON corpora from remote URLs.
Torchtune is a PyTorch-native library for fine-tuning, aligning, and quantizing large language models. It provides a config-driven system for instantiating components, orchestrating distributed training, and managing parameter-efficient fine-tuning with quantization support, all through YAML-based configurations and command-line overrides. The library distinguishes itself through its comprehensive post-training workflow orchestration, combining supervised fine-tuning, preference optimization (DPO, PPO, GRPO), knowledge distillation, and quantization-aware training in a single configurable pip
Reads conversational data from local files or remote HTTPS URLs using the Hugging Face datasets loader.