3 repositorios
Optimization techniques for reading and writing large datasets in chunks to reduce API calls.
Distinct from Array Processing: Focuses on reducing server requests in productivity apps rather than high-performance tensor computing
Explore 3 awesome GitHub repositories matching scientific & mathematical computing · Batch Data Processing. Refine with filters or upvote what's useful.
This repository is a comprehensive sample library providing reference implementations for automating tasks and extending functionality across Google Workspace applications. It serves as a collection of code examples and templates for building workspace automation scripts, custom add-ons, and integrated productivity tools. The project distinguishes itself by providing specialized examples for integrating large language models into productivity tools for content generation and data analysis. It also includes reference implementations for creating conversational chat apps, interactive cards, and
Minimizes server requests by using two-dimensional arrays for bulk data operations in spreadsheets.
Promptify is a suite of tools designed for model evaluation, prompt management, token cost tracking, structured extraction, and unified API gateway access. It provides a standardized interface to manage requests and responses across multiple large language model providers. The project features a prompt management platform for engineering and versioning prompts with structured output validation. It includes a dedicated evaluation framework to measure model performance using precision, recall, and f1 scores against labeled datasets, alongside a token cost tracker to monitor the financial expens
Supports high-volume workflows through asynchronous batch processing of multiple inputs to increase total throughput.
Este proyecto es una herramienta de análisis estático y linter para Ruby on Rails diseñada para identificar olores arquitectónicos y violaciones de mejores prácticas. Sirve como linter de calidad de código, auditor arquitectónico, escáner de seguridad y analizador de rendimiento para aplicaciones Rails. La herramienta evalúa la separación de responsabilidades entre controladores, modelos y plantillas de vista para reducir la deuda técnica. Identifica patrones de codificación subóptimos y aplica consistencia estilística, mientras escanea específicamente vulnerabilidades de seguridad como la asignación masiva (mass assignment) desprotegida en los modelos. La superficie de análisis cubre la detección de consultas a bases de datos ineficientes y patrones de recuperación de datos pesados en memoria. También audita el diseño de rutas, valida la persistencia de registros e identifica el manejo inadecuado de errores y configuraciones erróneas de zona horaria. Los usuarios pueden gestionar el análisis definiendo qué comprobaciones de código habilitar o deshabilitar a través de un archivo de configuración.
Processes large datasets in chunks to prevent memory exhaustion during data retrieval.