Awesome GitHub RepositoriesClient-Side Data Ingestion

EasyExcel is a Java processing library designed for reading and writing XLS, XLSX, and CSV files. It functions as a memory-efficient spreadsheet parser, an object-relational mapper that binds spreadsheet columns to Java class fields, and a stream-based exporter for handling high-volume data. The library distinguishes itself through a streaming model that processes large files row-by-row via listeners to prevent heap memory overflow. It also operates as a template engine, allowing the population of predefined spreadsheet files with dynamic data while preserving original layouts and styles. Br

ExcelJS is a Node.js spreadsheet engine and manipulation library used for reading, writing, and modifying XLSX and CSV files. It functions as a formatting tool and asynchronous streaming parser for generating complex workbooks containing formulas, rich text, and custom styles. The library is distinguished by its ability to process large datasets using asynchronous data streaming and incremental processing, which minimizes memory usage during data extraction and file generation. Its capability surface covers comprehensive data management, including structured tables, named ranges, and cell da

PapaParse is a delimited text processing library that converts CSV files into JSON objects or arrays. It provides a suite of tools for parsing delimited text and transforming structured data objects back into CSV formats through bidirectional serialization. The library is characterized by its ability to process massive datasets using incremental streaming and chunk-based processing to prevent memory overload. It includes an automatic delimiter detector to identify separator characters without manual configuration and utilizes web workers to offload parsing logic to background threads, keeping

PHPExcel is a PHP spreadsheet library used for programmatically reading and writing spreadsheet files in various formats. It utilizes an in-memory spreadsheet model that maps spreadsheet structures to a hierarchy of objects for programmatic manipulation. The library functions as an Office Open XML processor for generating and manipulating XLSX documents and serves as a reader for extracting data and structure from legacy binary XLS files. It also includes tools for CSV data integration and importing. The project provides capabilities for automated report generation and spreadsheet data extra

Chatlog is a local-first chat history viewer and indexing tool designed to organize and search personal messaging exports. It functions as a static web application that transforms unstructured chat data into a standardized format using schema-based parsing rules. The system operates entirely on the client side, building a searchable message index within the browser to enable fast retrieval of conversations. By storing data directly on the user device, the tool allows for private message analysis and archiving without the use of a central server. The application is delivered as a bundle of pr

Just the Docs is a Jekyll theme designed for building documentation sites that are hosted on GitHub Pages. It provides a responsive, mobile-friendly layout with built-in search, hierarchical navigation, and extensive customization through overridable SCSS variables, Liquid includes, and page layouts. The theme distinguishes itself through a file-based navigation hierarchy that automatically generates multi-level collapsible menus from directory structures and front matter, combined with client-side full-text search that indexes page content at build time. It includes automated deployment via

This project is a client-side data visualization tool and vector graphics generator that transforms tabular data into customizable SVG graphics. It functions as a browser-based visualization engine that processes datasets locally, ensuring that sensitive information is not transmitted to a server. The platform utilizes a modular layout engine to render diverse chart types, including hierarchical and temporal visualizations. It supports the definition and integration of custom layout extensions to expand the variety of available visualization types. The system provides capabilities for import

Kreuzberg is a document extraction engine that converts PDFs, Office files, images, and over 90 other formats into clean, structured text and metadata. It is built around a compiled Rust core that can be used as a native library, a command-line tool, a REST API server, or a WebAssembly module for browser-based processing. The system is designed to run entirely on self-hosted infrastructure, with no data leaving the user's environment. What distinguishes Kreuzberg is its breadth of integration surfaces and its pipeline architecture. It exposes extraction capabilities through native bindings fo

The 1BRC (One Billion Row Challenge) is a Java performance benchmarking exercise that processes one billion temperature records from a text file to compute the minimum, mean, and maximum temperature per weather station. At its core, it is a large-scale data aggregation challenge designed to test how efficiently a Java program can parse and aggregate structured data from a plain text file, serving as both a programming exercise and a benchmark for Java performance optimization. The project distinguishes itself through a collection of performance-oriented architectural patterns for high-through

Dawarich is a self-hosted location history manager and travel journaling platform. It functions as a personal travel archive that collects GPS coordinates and movement data, providing a private alternative to proprietary tracking services. The system utilizes a PostgreSQL geospatial database to store coordinates, visits, and custom geofence boundaries. The project distinguishes itself as a geospatial data converter and visualization tool, capable of transforming location history between formats such as GPX, KML, and GeoJSON. It allows users to organize GPS tracks and geotagged photos into nam

Genkit is an open-source framework for building AI-powered applications. It provides a unified interface for connecting to hundreds of generative AI models from multiple providers, enabling text, image, audio, and video generation through a single API. The framework structures multi-step AI interactions—including chat, retrieval-augmented generation, tool use, and agentic workflows—as composable, traceable flows with built-in streaming and state management. The framework distinguishes itself through a comprehensive developer toolkit that includes a command-line interface and a local developer

Apache Fesod is a lightweight Java library that wraps Apache POI to provide a streaming API for reading and writing large Excel files. Its core identity is a low-memory spreadsheet processor that prevents out-of-memory errors by handling data row by row, never loading an entire document into memory at once. The library distinguishes itself through a listener-driven event model that fires row-level events to user code as each row is parsed, enabling incremental processing. It also includes an object mapping layer that maps spreadsheet rows directly to Java objects using configurable column map

Cocoindex is an incremental data processing engine that builds and maintains live indexes for AI agents, with a core focus on codebase indexing and knowledge graph extraction. The engine uses a function-graph execution model where user-defined Python functions are composed into a directed acyclic graph, and it processes data incrementally so only changed source records or code paths are re-computed, avoiding full recomputation at any scale. It supports automatic schema inference from transformation pipeline type annotations and provides full data lineage tracing, tagging every output record wi

Zed is a terminal-based code editor built in Rust that provides a full-featured editing experience with familiar keybindings, mouse support, and multiple cursors. It runs entirely in the terminal while offering capabilities typically found in graphical editors, including split panes, a command palette, and integrated language server protocol support for real-time diagnostics, completions, go-to-definition, and code actions across multiple languages. The editor distinguishes itself through a plugin system that runs sandboxed TypeScript plugins in a QuickJS runtime, with an asynchronous bridge

هذا المشروع عبارة عن عميل PHP API و SDK لدمج خدمات OpenAI في تطبيقات PHP. يعمل كمكتبة تكامل وغلاف للتفاعل مع النماذج اللغوية الكبيرة لإنشاء نصوص، وصور، وصوت عبر استدعاءات REST API. توفر المكتبة تنسيقاً متخصصاً لمساعدي الذكاء الاصطناعي، وإدارة سلاسل المحادثات ومخازن المتجهات. كما تتضمن أدوات لضبط النموذج المخصص، وتنفيذ البحث الدلالي من خلال تضمينات النصوص، ومعالجة الصوت للنسخ والتركيب. يغطي سطح الإمكانات اعتدال المحتوى، وإدارة الملفات، والتعامل مع الدردشة وإكمال النصوص. ويدعم تسليم البيانات في الوقت الفعلي عبر بث أحداث مرسلة من الخادم، والمعالجة المجمعة غير المتزامنة، والتحقق من توقيعات webhook.

هذا المشروع عبارة عن ورقة غش لقواعد البيانات العلائقية ومرجع لـ SQL. يوفر مجموعة من أمثلة البنية وتوثيق الاستعلامات لإدارة قواعد البيانات العلائقية باستخدام لغة الاستعلام الهيكلية. تم تنفيذ الأداة كموقع ثابت مع توثيق قابل للبحث من جانب العميل، مما يسمح بالتصفية الفورية للمحتوى التقني من خلال فهرس يعتمد على المتصفح. يغطي المرجع إدارة قواعد البيانات العلائقية، بما في ذلك استرجاع البيانات، وإدارة مخطط قاعدة البيانات، وصيانة السجلات. كما يتضمن توجيهاً حول معالجة البيانات العلائقية من خلال ربط الجداول وتوليد التقارير الإجمالية.

This is a browser bookmarklet that scans Instagram follower and following lists to identify accounts that do not follow back. It runs entirely as client-side JavaScript injected into the Instagram web page, extracting relationship data from the DOM and comparing it locally without any server-side processing or external API calls. The tool includes adjustable timing controls to set custom delays between scanning actions, helping to avoid triggering Instagram's security rate limits during large list comparisons. It also provides a whitelist management system that stores excluded accounts as a J

Spout هي مكتبة معالجة ملفات جداول البيانات ومولد متعدد التنسيقات مصمم لقراءة وكتابة ملفات CSV وXLSX وODS. تعمل كمحلل قائم على التدفق يعالج ملفات جداول البيانات الكبيرة تدريجياً لتجنب تحميل المستندات بالكامل في الذاكرة. توفر المكتبة قدرات لإنشاء جداول البيانات برمجياً واستخراج البيانات. تدعم تنسيق المحتوى المخصص، مما يسمح بتطبيق الخطوط والخلفيات والحدود وتنسيقات الأرقام على خلايا أو أسطر فردية. بعيداً عن إدخال وإخراج الملفات الأساسي، يغطي المشروع معالجة المصنفات من خلال استخراج الأوراق الانتقائي وتعديل محتوى محدد داخل الملفات الموجودة. يستخدم استراتيجيات تحسين الذاكرة للتعامل مع معالجة جداول البيانات على نطاق واسع بغض النظر عن إجمالي حجم الملف.

Apollo Android هي مكتبة عميل GraphQL قوية النوع لتنفيذ الاستعلامات والطفرات عبر JVM و Android و Kotlin Multiplatform. تتضمن أداة توليد كود تنشئ فئات ومحللات غير قابلة للتغيير من مخططات GraphQL وملفات العمليات لضمان سلامة النوع في وقت التجميع. يتميز المشروع بذاكرة تخزين مؤقت طبيعية تقوم بتسوية الاستجابات في جدول بحث للحفاظ على مصدر واحد للحقيقة. كما يوفر عميلاً للاشتراكات لتحديثات البيانات من جانب الخادم في الوقت الفعلي عبر اتصالات WebSocket أو SSE وإطار عمل محاكاة لمحاكاة استجابات الخادم وتوليد بيانات وهمية آمنة من حيث النوع للاختبار. تغطي المكتبة مجموعة واسعة من القدرات بما في ذلك تحسين الشبكة من خلال تجميع الطلبات والاستعلامات المستمرة، بالإضافة إلى إدارة حالة البيانات المحلية مع التحديثات المتفائلة والترقيم. تدعم تكامل محركات HTTP المخصصة وتعيين أنواع القياس المخصصة إلى فئات اللغة الأصلية. تتكامل الأداة مع بيئات تطوير IDE لتوفير توليد الكود التلقائي والتنقل من المحرر إلى التعريفات.

This project is a PHP SQL REST API generator and database API wrapper that automatically transforms SQL database tables into a functional web interface. It serves as a lightweight layer that maps HTTP methods to SQL commands, allowing for the creation, reading, updating, and deletion of records without writing manual endpoint code. The tool distinguishes itself by providing a dedicated spatial data API gateway for querying and exporting geometry columns using GeoJSON and WKT standards. It also functions as a multi-tenant data API, capable of isolating records for different users through share