13 Repos
Systems that organize, store, and provide queryable access to distributed data payloads and resource states.
Distinguishing note: Focuses on the infrastructure for indexing and retrieving data, distinct from general database management.
Explore 13 awesome GitHub repositories matching data & databases · Data Indexing Services. Refine with filters or upvote what's useful.
Elasticsearch is a distributed search engine and NoSQL document store designed for full-text search and real-time data retrieval. It functions as a RESTful data indexer and vector database, allowing for the storage and management of structured JSON documents across multiple nodes. The system distinguishes itself through its ability to serve as a log analytics platform for monitoring system health and security events. It incorporates vector search implementation using mathematical embeddings to support generative AI and augmented generation applications. The platform covers a broad range of c
Provides infrastructure for indexing and retrieving distributed data payloads via a RESTful interface.
Anoma is a distributed operating system designed to abstract the complexities of blockchain networks into a unified interface for cross-chain coordination. At its core, the platform utilizes a resource-based state machine and an intent-centric execution model, where user-defined goals are processed and settled by decentralized solvers rather than through direct, manual execution. This architecture enables the creation of applications that operate across heterogeneous distributed networks while maintaining a consistent developer and user experience. The platform distinguishes itself through a
Anoma retrieves stored data payloads, registers keys for routing, and verifies the health and configuration status of the indexing service to ensure reliable data access.
Kronos is a financial time-series forecasting framework and quantitative trading strategy simulator. It functions as a research environment designed to analyze historical market data, train predictive models, and evaluate the performance of automated trading signals. The platform distinguishes itself through its deep learning sequence predictors and probabilistic market modeling tools. By utilizing sequence-based architectures and statistical sampling, the system generates multiple potential price trajectories and volatility estimates to quantify uncertainty. It also supports transfer learnin
Calculates the likelihood that upcoming price fluctuations will exceed recent historical levels using probabilistic modeling.
Crystal is a statically typed, compiled programming language designed for high performance and memory safety. It leverages an LLVM-based compiler to translate source code into optimized machine-executable binaries, while its type-inference-based static analysis enforces strict safety rules during the build process. The language distinguishes itself through a fiber-based concurrent runtime that manages lightweight execution units for asynchronous input and output without blocking the main process. It also features a powerful compile-time macro system that allows for the inspection and transfor
Enables custom types to support bracket-based indexing for safe element retrieval and assignment.
This project is a Python library designed for the programmatic retrieval and analysis of diverse financial datasets. It functions as a comprehensive toolkit for quantitative research, providing a unified interface to fetch historical and real-time market data across asset classes including equities, futures, bonds, cryptocurrencies, and foreign exchange. By abstracting complex network requests into simple, parameter-driven functions, it enables users to integrate financial data into research workflows and automated trading systems. The library distinguishes itself through its scraper-based ag
Retrieves volatility index data to support market sentiment analysis.
Conductor is a distributed workflow manager and microservices orchestration engine. It coordinates long-running business processes across a network of services, using a stateful orchestration model to ensure consistent execution order and reliable state management. The system defines task sequences and conditional business logic using structured JSON configuration files. It manages the execution of complex operations across distributed systems with built-in persistence and failure recovery, tracking the progress of processes through a backend database. The platform provides capabilities for
Uses a searchable backend to organize and query workflow execution records based on metadata.
Chainlink is a decentralized oracle network that connects smart contracts to off-chain data, computation, and real-world systems. It provides a secure and reliable infrastructure for blockchain applications to access external information, execute automated workflows, and interact with other blockchains. The network is secured by a staking-based model where node operators lock LINK tokens as collateral, which can be slashed for poor performance, incentivizing honest and accurate data delivery. The platform distinguishes itself through a comprehensive set of capabilities that extend beyond basi
Delivers realized volatility data through oracle networks for configuring DeFi risk parameters.
Sui is a blockchain platform featuring an object-centric state model and resource-oriented smart contracts. It utilizes parallel transaction execution to increase network throughput and supports programmable transaction blocks that bundle multiple operations into single atomic units. The platform distinguishes itself with a capability-based access control system and zero-knowledge login mechanisms, enabling users to authenticate via identity providers without seed phrases. It also implements deterministic object addressing to allow predictable state lookups and supports the creation of soulbo
Provides infrastructure for storing processed blockchain data using PostgreSQL or custom interfaces.
This project is a quantitative finance library providing implementations of numerical methods for financial engineering. It focuses on derivative pricing, portfolio optimization, stochastic simulation, and volatility calibration. The library includes tools for calculating option values using Monte Carlo simulations, binomial trees, and Fourier inversion. It provides a framework for fitting volatility smiles to market data and a simulation engine for generating asset price paths via geometric Brownian motion and jump-diffusion models. The codebase covers broader numerical analysis capabilitie
Matches model parameters to market data by fitting volatility smiles through root-finding methods.
Apache Hudi is an open-source table format that brings ACID transactions, incremental processing, and multi-modal indexing to data lakes. It provides atomic commits with snapshot isolation, rollback, and optimistic concurrency control for reliable data lake operations, while supporting upserts, record-level updates, and deletions in large analytical datasets. The project distinguishes itself through a timeline-based architecture that coordinates all write operations, enabling features like time-travel querying, incremental change streaming, and multi-modal query views that include snapshot, i
Maintains scalable record-level and column-level indexes automatically during writes to speed up lookups.
Biopython ist eine Bioinformatik-Bibliothek für Python, die Werkzeuge zum Parsen, Manipulieren und Analysieren biologischer Sequenzen, molekularer Strukturen und phylogenetischer Bäume bereitstellt. Sie dient als Parser für biologische Sequenzen für genomische und proteomische Daten in verschiedenen Industriestandard-Formaten und fungiert als Schnittstelle zum Abfragen biologischer Daten und Zitate aus NCBI Entrez-Repositories. Das Projekt zeichnet sich durch spezialisierte Toolkits für die Analyse von Proteinstrukturen und die Konstruktion phylogenetischer Bäume aus. Es enthält einen Proteinstruktur-Analysator zur Verarbeitung von PDB- und mmCIF-Dateien zur Berechnung der Molekulargeometrie sowie ein Toolkit für phylogenetische Bäume zur Analyse evolutionärer Beziehungen zwischen Arten. Die Bibliothek deckt ein breites Spektrum bioinformatischer Funktionen ab, einschließlich der Analyse genomischer Sequenzen für Transkription und Translation, der Verwaltung von Sequenzalignments und populationsgenetischer Berechnungen. Sie bietet zudem Tools zur strukturellen Analyse für die Manipulation von 3D-Atomkoordinaten sowie Dienstprogramme zur Visualisierung genomischer Merkmale und zur Modellierung biogeografischer Daten. Das System integriert externe Bioinformatik-Binärdateien durch Tool-Wrapping und unterstützt die persistente Speicherung biologischer Datensätze durch SQL-basierte Sequenzspeicherung.
Creates mappings of sequence identifiers to file locations to enable fast random access within large datasets.
MiniOB is an open-source educational relational database kernel designed for learning the internals of database systems. It implements a dual-engine storage architecture combining B+ Tree and LSM-Tree, supports SQL parsing and query execution, and provides transactional processing with multi-version concurrency control. The system communicates with clients using the MySQL wire protocol and includes a vector database extension for storing and querying high-dimensional vectors. The project distinguishes itself through its comprehensive coverage of core database concepts in a single, learnable c
Build and maintain index structures to accelerate record retrieval by key values.
quant-wiki is a comprehensive knowledge base and structured reference for quantitative finance, financial engineering, and algorithmic trading. It serves as a centralized library of documentation covering mathematical models, financial instruments, and systematic trading strategies. The project integrates AI-driven capabilities through a modular retrieval-augmented generation framework that extracts structured data from research papers and news. It features a multi-agent workflow engine designed to discover and validate predictive alpha factors, alongside tools for local large language model
Implements portfolio protection against declines by purchasing put options during low volatility periods.