22 Repos
Scripts or utilities that populate an environment with demonstration datasets for testing and exploration.
Explore 22 awesome GitHub repositories matching data & databases · Sample Data Loaders. Refine with filters or upvote what's useful.
Superset is a web-based business intelligence platform designed for data exploration, visualization, and interactive dashboarding. It functions as a query-driven analytics engine that connects to various SQL databases, allowing users to perform ad-hoc analysis, define virtual metrics, and build complex data visualizations through a centralized interface. The platform distinguishes itself through a robust semantic layer that transforms raw database schemas into calculated columns and virtual metrics, enabling consistent business logic across an organization. It features a plugin-based visualiz
Demonstration datasets and example dashboards are included to facilitate immediate exploration of core functionality upon initial installation.
This project is a comprehensive Chinese translation of a technical deep learning textbook, providing an educational resource on the theory and implementation of neural networks. It functions as a collaborative technical translation project designed to make complex academic AI literature accessible to non-English speakers. The project utilizes a community-driven translation model that integrates external suggestions and pull requests to refine linguistic accuracy and reduce bias. It employs standardized terminology mapping to ensure a uniform vocabulary throughout the translated content. To i
Covers constructing Markov chains by iteratively sampling variables given their neighbors in a graph.
This project is a computational statistics textbook and Bayesian data analysis course. It serves as a guide for performing statistical inference and quantifying uncertainty through a probabilistic programming workflow using Python. The resource employs a computation-first pedagogy, teaching Bayesian methods and parameter estimation through executable code and simulations instead of formal mathematical notation. It provides a practical approach to implementing Markov Chain Monte Carlo sampling to estimate posterior distributions. The content covers building probabilistic models, integrating e
Generates samples from a posterior distribution and provides tools to verify simulation convergence.
PyTorch Geometric is a library for building and training machine learning models on graph-structured data. It provides a framework for developing graph neural networks, including a specialized system for implementing node-to-node information exchange via customizable message passing, aggregation, and update functions. The library includes a sparse data processing toolkit that utilizes accelerated CPU and CUDA kernels to perform efficient reductions on large sparse datasets. It supports the creation of specialized architectures for structured data such as 3D meshes and point clouds. The proje
Extracts representative sub-sections of massive graphs to enable training on datasets that exceed system memory.
Vector is a high-performance observability data pipeline designed to collect, transform, and route logs, metrics, and traces across distributed infrastructure. It functions as a modular engine that decouples data ingestion from processing and transmission, utilizing a component-based architecture to connect diverse sources to multiple destinations. The project distinguishes itself through a focus on reliability and flow control. It implements backpressure-aware data movement to prevent data loss during traffic spikes and utilizes disk-backed event buffering to ensure durability during network
Discards invalid metric samples containing NaN values to maintain data quality.
Presto is a distributed SQL query engine designed for high-performance analytical processing across heterogeneous data sources. It functions as a data federation platform and massively parallel processing engine, allowing users to execute interactive queries against diverse storage systems without requiring data migration. By mapping remote metadata and structures to a unified relational namespace, it enables seamless cross-platform analysis through a standard SQL interface. The engine distinguishes itself through a pluggable connector architecture and a shared-nothing distributed processing
Retrieves a representative subset of data from a table using statistical or logical sampling methods.
DGL is a Python library for building and training graph neural networks. It functions as a graph message passing framework and a geometric deep learning tool, enabling the development of models that analyze graph-structured data. The library is designed for large-scale graph processing, utilizing distributed training and neighbor sampling to handle datasets with billions of edges. It provides specialized support for heterogeneous graph modeling, allowing for the representation of complex real-world entities with multiple node and edge types. Its capabilities cover a wide range of graph tasks
Extracts subsets of nodes and edges using neighbor or layer-wise sampling to enable training on large-scale graphs.
dbt-core is a command-line framework for transforming data within a warehouse using modular SQL and version control. It functions as a data transformation engine that enables users to define data structures and business logic through declarative configuration files, which the system then compiles into executable code. By managing complex data dependencies through a directed acyclic graph, it ensures that transformation tasks execute in the correct order while maintaining a manifest-driven state to track lineage and execution history. The project distinguishes itself through an adapter-based d
Allows filtering data during model execution using time ranges to speed up development cycles.
xsv is a suite of high-performance command-line utilities written in Rust for the analysis, manipulation, and statistical processing of large delimited datasets. It provides a toolkit for processing comma-separated value files through a command line interface. The project provides capabilities for statistical analysis, including the computation of column statistics, value frequencies, and descriptive metrics. It also includes data manipulation utilities for joining, slicing, sampling, and reformatting records. The toolkit covers a broad range of data operations including column selection, da
Implements reservoir sampling to extract random subsets of data while keeping memory usage constant.
This project is a machine learning implementation library featuring a collection of code examples that implement supervised, unsupervised, and reinforcement learning algorithms from scratch. It provides a comprehensive set of toolkits for core machine learning components, including a natural language processing toolkit, a reinforcement learning framework, and suites for data dimensionality reduction and pattern mining. The library includes specialized implementations for reinforcement learning, such as Q-Learning, Deep Q-Networks, and Actor-Critic agents. The natural language processing capab
Implements Markov Chain Monte Carlo algorithms to generate samples from complex posterior probability distributions.
RedisInsight is a graphical user interface and management tool for browsing, analyzing, and administering Redis databases. It provides a visual environment for exploring key-value data structures, managing database instances, and performing data analysis across different operating systems and deployments. The tool distinguishes itself by providing dedicated visual managers for complex operations, including a vector database manager for configuring embeddings and similarity searches, a query workbench for executing raw commands and Lua scripts, and a performance monitoring dashboard for tracki
Populates databases with predefined example datasets to facilitate testing and learning.
This project is a comprehensive collection of educational examples and reference implementations for building vision and language models using PyTorch. It serves as a deep learning tutorial covering the end-to-end process of developing neural networks, from initial architecture definition to final production deployment. The repository provides detailed guides on implementing a wide range of domain-specific models, including convolutional neural networks for object detection and segmentation, as well as transformer and recurrent architectures for natural language processing. It emphasizes gene
Defines the order and frequency of sample selection to manage class imbalances during training.
This project is a comprehensive collection of computer science implementations and an algorithm tutorial repository. It serves as a study guide and reference for competitive programming, providing executable code examples that demonstrate fundamental algorithmic problem solving and mathematical computation. The library covers a wide range of specialized domains, including cryptography and security primitives, lossless data compression techniques, and computational geometry for spatial analysis. It also features implementations of machine learning models, linear algebra operations, and formal
Implements reservoir sampling to select a random subset of items from a data stream in one pass.
imbalanced-learn is a dataset balancing framework and Python machine learning extension designed to resample training data and reduce the impact of class imbalance. It provides a toolkit of algorithms for adjusting class distributions to improve model performance on minority class prediction. As a scikit-learn resampling library, it extends the ecosystem with specialized tools for balancing datasets through over-sampling and under-sampling techniques. This allows for the correction of skewed class proportions to reduce model bias toward the majority class. The library implements the scikit-l
Applies sampling techniques to datasets with significant class differences to increase model accuracy.
pyprobml is a collection of notebook-based implementations of probabilistic machine learning models and algorithms. It uses scientific computing and data analysis libraries to execute mathematical concepts and theories for practical application and research. The project focuses on the programmatic generation of scientific figures and visualizations to recreate results from a technical text. It employs a system of branch-based asset storage to isolate these generated images from the source code. The repository covers a wide range of probabilistic modeling and machine learning tasks, including
Uses vectorized blocked Gibbs sampling to analyze phase transitions in Potts models.
ScottPlot is a cross-platform, high-performance charting library for .NET that renders interactive plots across desktop and web GUI frameworks including Windows Forms, WPF, MAUI, Avalonia, Blazor, and WinUI. It provides an optimized rendering engine capable of displaying millions of data points with interactive pan, zoom, and live data streaming, while also supporting image export to formats like PNG and SVG for file output, cloud applications, and notebooks. The library distinguishes itself through a comprehensive set of chart types including scatter, line, bar, pie, heatmap, financial, rada
Generates built-in sample datasets such as noisy sine waves for testing and demonstration.
PyTorch Metric Learning is an open-source library for training neural networks to produce similarity-preserving embedding spaces. It provides a modular framework where interchangeable loss functions, mining strategies, and evaluation tools can be composed to learn representations that map similar items to nearby points and dissimilar items to distant points in the embedding space. The library distinguishes itself through a highly configurable architecture that separates concerns across several interchangeable components. Users can assemble custom loss functions from pluggable distance metrics
Implements hierarchical sampling strategies that respect nested label structures during batch construction for metric learning.
The Blackbox Exporter is a Prometheus-compatible probe that checks the availability and response correctness of external services over HTTP, HTTPS, DNS, TCP, ICMP, and gRPC. It exposes probe results as Prometheus metrics, including a probe_success indicator for each endpoint checked, making it a dedicated tool for blackbox monitoring of network services. The exporter uses a probe-module configuration system where reusable settings such as protocol, method, and IP version are defined as named YAML modules. These modules are assigned to target groups through Prometheus relabeling rules, which m
Supports filtering metric samples via relabeling rules during the scraping process.
Dieses Projekt ist eine umfassende Lehrressource und ein Kurs zum Aufbau neuronaler Netze mit PyTorch. Es deckt die grundlegenden Bausteine des Deep Learning ab, einschließlich Tensor-Manipulation, automatischer Differenzierung und der Konstruktion modularer Komponenten für neuronale Netze. Das Repository dient als technischer Leitfaden für verschiedene spezialisierte Bereiche. Es bietet Implementierungsdetails für Computer-Vision-Aufgaben wie Bildklassifizierung, Objekterkennung und semantische Segmentierung sowie Workflows für die Verarbeitung natürlicher Sprache (NLP) mit Transformern, rekurrenten Netzen und generativen Modellen. Zudem enthält es eine Referenz für generative KI, mit Fokus auf die Synthese von Bildern mittels Diffusionsmodellen und adversarialen Netzwerken. Das Material erstreckt sich auf Modelloptimierung und Deployment-Pipelines. Es behandelt Techniken zur Reduzierung der Modellgröße und zur Erhöhung der Inferenzgeschwindigkeit durch Quantisierung und den Export von Modellen in Formate wie ONNX und TensorRT. Weitere Kompetenzbereiche umfassen Data Engineering für paralleles Laden, Modellevaluierung mittels benutzerdefinierter Metriken und das Deployment von Open-Source Large Language Models. Das Projekt wird primär als eine Reihe von Jupyter Notebooks bereitgestellt.
Implements sampling strategies that use assigned probabilities to handle class imbalances and ensure balanced representation.
quant-wiki is a comprehensive knowledge base and structured reference for quantitative finance, financial engineering, and algorithmic trading. It serves as a centralized library of documentation covering mathematical models, financial instruments, and systematic trading strategies. The project integrates AI-driven capabilities through a modular retrieval-augmented generation framework that extracts structured data from research papers and news. It features a multi-agent workflow engine designed to discover and validate predictive alpha factors, alongside tools for local large language model
Implements methods for selecting sample members using a random starting point and fixed periodic intervals.