7 Repos
Collections of open datasets for data science and research.
Distinguishing note: Focuses on data availability.
Explore 7 awesome GitHub repositories matching data & databases · Public Datasets. Refine with filters or upvote what's useful.
This project is a comprehensive, community-driven knowledge repository that serves as a centralized hub for data science resources. It provides a structured index of educational materials, software packages, and professional development tools designed to support both students and practitioners in navigating the data science landscape. The repository distinguishes itself through a hierarchical taxonomy that organizes a vast collection of external links into a human-readable, markdown-based document. By relying on distributed contributions, the project maintains an up-to-date snapshot of the fi
Provides access to diverse datasets for training and analysis.
This project is a comprehensive, community-driven repository that serves as a centralized catalog for computer vision research and development. It functions as a structured index of academic papers, open-source software libraries, public datasets, and educational tutorials, providing a navigation point for the complex landscape of modern vision technology. The repository distinguishes itself through a taxonomy-based indexing system that maps the relationships between foundational research, influential academic figures, and their corresponding software implementations. By utilizing a lightweig
Provides access to public data collections and benchmarking suites for vision model training.
Easy-dataset is a comprehensive platform designed for the end-to-end management of machine learning datasets, specifically tailored for language and vision model fine-tuning. It functions as a centralized environment for the entire data lifecycle, encompassing the automated generation of synthetic training data, the structural organization of document collections, and the systematic annotation of individual data points. The platform distinguishes itself through its integrated evaluation and orchestration capabilities. It provides a dedicated suite for benchmarking models, featuring blind side
Supports searching and retrieving datasets from public platforms to jumpstart training workflows.
Datasette is a tool for publishing and sharing SQLite databases as public websites. It functions as a data publishing system that provides searchable interfaces and JSON APIs to expose the contents of SQLite files. The project enables both server-side and client-side execution. It can operate as an API server or as a database browser that runs entirely within a web browser using WebAssembly, allowing for serverless database access. The system supports a variety of deployment strategies, including containerized images for cloud hosting and a local development server for testing. It includes c
Enables the exposure of SQLite data over the web for public consumption and distribution.
hackerone-reports is a bug bounty dataset aggregator and vulnerability intelligence tool designed to scrape and parse public security reports from the HackerOne platform. It functions as a security report parser that transforms raw bug bounty feeds into structured datasets for analysis. The system automates the collection of public vulnerability reports to identify common security patterns and facilitate security research. It specializes in organizing these disclosures by bug type, payout amount, and target program to enable vulnerability trend analysis. The tool covers capabilities for scra
Aggregates diverse security disclosures from multiple public feeds into a single searchable dataset.
Dieses Projekt ist eine KI-gestützte Plattform zur Prüfung öffentlicher Ausgaben und zur sozialen Kontrolle, die darauf ausgelegt ist, die öffentliche Verwaltung zu überwachen und verdächtige Finanzaktivitäten zu kennzeichnen. Es fungiert als automatisiertes Betrugserkennungstool, das Mustererkennung nutzt, um Unregelmäßigkeiten in staatlichen Ausgabenaufzeichnungen zu identifizieren. Das System transformiert rohe Ausgabendateien durch eine Datenpipeline in strukturierte Datensätze und bildet dabei diverse Regierungsdatenformate auf ein standardisiertes relationales Modell ab. Es nutzt ein automatisiertes Kennzeichnungssystem, um die manuelle Prüfung durch Auditoren zu priorisieren, und generiert versionierte, Snapshot-basierte Datensatzexporte, um die Reproduzierbarkeit für unabhängige Überprüfungen zu gewährleisten. Die Plattform umfasst eine öffentliche Datenvisualisierungsoberfläche, die es Bürgern ermöglicht, detaillierte Ausgabenaufzeichnungen zu erkunden und zu validieren. Diese Funktion unterstützt die Rechenschaftspflicht im öffentlichen Sektor, indem sie die bei der automatisierten Analyse gefundenen Muster offenlegt.
Generates versioned data exports from public records to facilitate independent auditing and external analysis.
OSV is a distributed database and aggregator of open-source security advisories that uses a standardized vulnerability schema to track security flaws. It functions as a system for collecting and normalizing security data from diverse ecosystems into a single unified format, providing a web API for querying package vulnerabilities and submitting standardized records. The project distinguishes itself through a security advisory distribution service that supports bulk dataset exports via cloud storage buckets and incremental synchronization of security record updates. It also employs sandbox-bas
Exports the complete vulnerability database or ecosystem-specific subsets as compressed archives via a public cloud bucket.