16 مستودعات
Mechanisms for gathering explicit ratings or implicit behavioral data to inform recommendation models.
Distinct from User Feedback Systems: Distinct from general user feedback systems: focuses on data collection for model training rather than developer-facing issue reporting.
Explore 16 awesome GitHub repositories matching artificial intelligence & ml · User Feedback Collection. Refine with filters or upvote what's useful.
This project is an educational platform and research toolkit designed to teach deep learning through a combination of mathematical theory, visual diagrams, and executable code. It provides a comprehensive environment for building, training, and evaluating neural networks, grounding complex concepts in interactive computational notebooks that allow for hands-on experimentation. The framework distinguishes itself by interleaving theoretical foundations—including linear algebra, calculus, and probability—with practical implementations across multiple industry-standard libraries. It supports flex
Converts interaction records into explicit rating matrices or implicit feedback dictionaries for machine learning.
Deepagents is an LLM agent orchestration platform and stateful application server designed for deploying and managing AI agents built with computational graphs. It provides a containerized runtime environment that handles agent execution, state persistence, and the versioning of AI assistants. The platform distinguishes itself through deep integration with the Model Context Protocol, allowing agents to function as servers that expose tools and capabilities to external clients. It features a sophisticated observability suite for capturing execution traces, performing LLM-based evaluations agai
Generates pre-signed URLs to link external user feedback directly to specific execution traces.
SuperAGI is a comprehensive marketing automation platform and customer data system designed to orchestrate multi-channel engagement workflows. It functions as a no-code workflow orchestrator, allowing users to build complex, automated task sequences triggered by real-time user behavior, transactional data, or scheduled events. By centralizing customer profiles and interaction history, the platform enables businesses to manage end-to-end marketing operations from a single interface. The platform distinguishes itself through its deep integration with e-commerce storefronts and its ability to ex
Collects structured visitor data through interactive forms to inform and trigger autonomous workflows.
Ragas is an evaluation framework designed to measure the performance of retrieval-augmented generation pipelines and autonomous agent workflows. It provides a comprehensive suite of tools for benchmarking system outputs, utilizing language models as automated judges to score performance against defined rubrics and reference data. By standardizing inputs, retrieved contexts, and generated responses into a unified schema, the project enables consistent analysis across complex AI applications. The framework distinguishes itself through its ability to generate synthetic test datasets from existin
Identifies recurring signals within user feedback data to detect pipeline issues and inform iterative improvements.
Chainlit is a Python framework designed for building and deploying interactive, stateful conversational AI interfaces. It provides a backend-driven platform that connects language models and agent frameworks to a web-based chat frontend, managing the complexities of session state, message history, and real-time communication. The framework distinguishes itself by offering a component-based UI builder that allows developers to inject interactive widgets, rich media, and data visualizations directly into the chat stream. It supports the visualization of complex agent workflows, enabling users t
Captures explicit user ratings and feedback on messages to inform system improvement.
ParlAI is a conversational AI research framework designed for training, evaluating, and sharing dialogue models using a unified interface for datasets and agents. It functions as a PyTorch-based training platform and a dialogue data collection system, providing a centralized model zoo for the distribution of versioned pretrained agents. The project distinguishes itself through a knowledge-grounded retrieval system that combines dense and sparse indexing to ground responses in external information. It also provides a comprehensive infrastructure for gathering human-AI interaction data via inte
Implements self-feeding mechanisms that use real-time user textual feedback to improve chatbot capabilities.
Gorse is a personalized recommendation engine server and machine learning pipeline designed to suggest items to users based on their behavior and preferences. It operates as a distributed system that separates training, candidate generation, and serving nodes to support high-throughput workloads. The system utilizes a multi-stage recommendation pipeline to refine results through retrieval, scoring, and reranking. It generates personalized suggestions using collaborative filtering, matrix factorization, and item-to-item similarity models, while also providing non-personalized and fallback reco
Provides mechanisms for inserting and updating user interactions with items to inform underlying recommendation models.
OpenLLMetry is an OpenTelemetry-based observability framework and instrumentation library for generative AI applications. It provides toolsets for tracing and monitoring large language model workflows, capturing telemetry from model providers, agent frameworks, and vector databases using standardized semantic conventions. The project distinguishes itself by providing a specialized evaluation and experimentation suite that associates user feedback and prompt version hashes with specific execution traces. It includes a system for tracking model reasoning paths and enforcing security guardrails
Gathers explicit user ratings and associates them with specific execution traces to evaluate output quality.
Attaches short-lived feedback tokens to responses for client-side user rating submission.
Helicone is an AI gateway and observability platform designed to intercept, manage, and monitor interactions with large language models. By acting as a reverse-proxy, it provides a centralized layer for routing requests across multiple AI providers, allowing developers to maintain consistent application logic while gaining deep visibility into model performance, usage, and costs. The platform distinguishes itself through a robust suite of traffic management and prompt engineering tools. It enables policy-driven control, including automatic failover between providers, rate limiting, and edge-b
Captures positive or negative ratings on model responses to identify quality regressions and measure user satisfaction.
Marqo هي منصة لاكتشاف منتجات التجارة الإلكترونية، وقاعدة بيانات متجهة متعددة الوسائط، وأداة تسويق للبحث بالذكاء الاصطناعي. توفر البنية التحتية لتنفيذ البحث الدلالي والتوصيات، مما يسمح للمتسوقين بالعثور على المنتجات باستخدام اللغة الطبيعية والصور. تتميز المنصة بخط أنابيب ترتيب هجين يجمع بين درجات الدلالة العصبية وقواعد التعزيز والتثبيت المحددة تجارياً. تتميز بمحرك تجارة محادثة يستخدم نماذج لغوية كبيرة لمعالجة نية المستخدم وتوفر مجموعة تحليلات أداء البحث لقياس زيادة التحويل والإيرادات عبر اختبارات A/B. تغطي إمكانياتها الأوسع الفهرسة متعددة الوسائط لاسترجاع النصوص والصور الموحد، والتعلم السلوكي الآلي لتحسين الترتيب بناءً على بيانات تدفق النقرات، ومحركات التوصية الشخصية. يغطي النظام أيضاً مزامنة الكتالوج، وتجميع الأوجه القائم على السمات، وتوليد ملخصات التسوق عبر المحادثة.
Provides mechanisms for gathering user feedback on agent responses to refine search quality and accuracy.
TagSpaces is an offline-first file tagging and organization platform that lets you manage local files with portable metadata stored directly in filenames or sidecar JSON files, eliminating the need for a central database. It functions as a full-text file search engine, a Kanban board file organizer, a local AI file assistant, an S3-compatible cloud file manager, and a web clipper and bookmark manager, all within a single application. The project distinguishes itself through a local-first architecture where all file operations, indexing, and AI processing run entirely on the device, with cloud
Collects structured feedback from uninstalling users including reasons, platform, and usage duration.
Appirater هو مكتبة لمطالبات تقييم تطبيقات iOS وأداة لدمج الملاحظات. يوفر غلافاً مبسطاً لطلب مراجعات المستخدمين وتوجيههم إلى صفحة مراجعة App Store. تدير المكتبة وقت ظهور طلبات التقييم باستخدام نظام تشغيل يعتمد على السلوك. وهذا يسمح ببدء مطالبات الملاحظات بناءً على أنماط استخدام محددة، مثل عدد مرات تشغيل التطبيق أو عدد الأيام المنقضية منذ التثبيت. تتكامل الأداة مع تنبيهات النظام الأصلية وواجهات المتجر لعرض مطالبات التقييم. كما تتضمن قدرات لتخصيص النص والمظهر البصري لهذه الطلبات لتتماشى مع متطلبات العلامة التجارية.
Prompts users to rate the application based on usage patterns to increase storefront visibility.
Agenta is a Prompt Ops lifecycle manager and prompt management platform that decouples prompt engineering from application code. It serves as a centralized system for developing, versioning, and deploying prompt templates and model configurations across different environments. The platform functions as an AI agent orchestrator with a visual interface for building agent workflows and connecting models to external tools. It further acts as an evaluation framework and observability tool, utilizing OpenTelemetry to capture execution traces, monitor latency, and track token costs. The system cove
Captures explicit user ratings and comments linked to specific application traces to track quality.
Prompt-kit is a React-based toolkit and component library specialized for building conversational interfaces for large language models. It provides a framework of reusable UI elements designed to handle the specific requirements of generative AI, such as streaming text responses, rendering model reasoning, and managing complex model outputs. The toolkit distinguishes itself through specialized visualization capabilities, including the rendering of chain-of-thought reasoning traces and the display of external tool interactions. It also features an interactive preview system that renders genera
Provides mechanisms for gathering user ratings and reactions to evaluate and improve the quality of AI responses.
This project is a comprehensive framework for constructing, managing, and evaluating knowledge graphs through multi-agent reasoning and deep search capabilities. It provides an end-to-end pipeline that ingests multi-format documents, extracts entities and relationships based on configurable schemas, and maintains structured knowledge bases to support evidence-based retrieval. The system distinguishes itself through its multi-agent orchestration, which decomposes complex queries into parallel research steps and synthesizes long-form reports. It leverages advanced graph-based techniques, includ
Captures user evaluations of generated answers to refine future responses and optimize caching.