awesome-repositories.com
Blog
awesome-repositories.com

Descubre los mejores repositorios open-source con nuestra búsqueda potenciada por IA.

ExplorarBúsquedas curadasAlternativas open-sourceSoftware autohospedableBlogMapa del sitio
ProyectoAcerca deCómo clasificamosPrensaServidor MCP
Aviso legalPrivacidadTérminos
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·
microsoft avatar

microsoft/SynapseML

0
View on GitHub↗
5,230 estrellas·860 forks·Scala·MIT·5 vistasaka.ms/spark↗

SynapseML

SynapseML es una biblioteca de machine learning de Apache Spark diseñada para construir y escalar flujos de trabajo de machine learning y pipelines de datos a través de clústeres distribuidos. Sirve como framework de pipeline de machine learning distribuido y motor de inferencia distribuido para ejecutar predicciones aceleradas por hardware y tareas de deep learning en conjuntos de datos a gran escala.

El proyecto funciona como una capa de integración de IA en la nube, permitiendo a los usuarios aplicar servicios de inteligencia artificial preentrenados para texto, visión y voz dentro de pipelines distribuidos. También incluye un conjunto dedicado de herramientas para la detección de anomalías distribuida para identificar valores atípicos multivariados y de series temporales en datos de alta dimensión.

La biblioteca cubre una amplia gama de capacidades, incluyendo visión artificial distribuida para análisis de rostros e imágenes, procesamiento de lenguaje natural escalable para análisis de texto y traducción, y el entrenamiento de árboles de decisión potenciados por gradiente (gradient boosted decision trees). Proporciona herramientas para búsqueda de similitud mediante modelado de k-vecinos más cercanos, explicabilidad de modelos mediante atribución de características y la orquestación de flujos de trabajo de aprendizaje por refuerzo.

El sistema utiliza una arquitectura de pipeline componible y admite la inferencia de modelos basada en ONNX para compatibilidad multiplataforma.

Features

  • Distributed ML Pipeline Managers - Provides a composable framework for sequencing data featurization and model training across distributed compute clusters.
  • Distributed Machine Learning Integrators - Provides an interface for training and evaluating machine learning models on large-scale datasets using parallelized Spark structures.
  • Distributed Data Processing - Distributes machine learning workloads across a cluster of nodes using the Spark distributed data processing engine.
  • AI Service Integrations - Provides a layer to integrate and apply cloud-based AI services for sentiment and language analysis within distributed pipelines.
  • Anomaly Detection - Identifies multivariate outliers and unusual patterns in high-dimensional data and time series.
  • Cloud AI Integrations - Wraps external cloud AI services as pipeline steps by communicating over HTTP to process distributed data.
  • Computer Vision - Executes image recognition, face analysis, and object detection tasks across multi-node clusters.
  • Deep Learning Inference Engines - Executes pre-trained deep learning models on CPU or GPU hardware to generate predictions for large datasets.
  • Spark Cluster Connectivity - Establishes network connections to distributed Spark clusters to execute machine learning workflows across multiple nodes.
  • Distributed Inference Engines - Implements a distributed inference engine that splits and executes machine learning workloads across multiple cluster nodes.
  • Distributed Text Analytics - Performs sentiment analysis, entity extraction, and language translation on massive textual datasets using distributed processing.
  • Machine Learning Workflow Libraries - Provides a standardized framework for building and scaling machine learning pipelines across distributed Spark clusters.
  • Distributed Training - Scales the training and evaluation of machine learning models across multiple compute nodes.
  • Model Inference - Runs pretrained deep learning models across clusters to generate large-scale predictions using hardware acceleration.
  • Natural Language Processing Analysis - Executes linguistic analysis tasks including sentiment analysis, language detection, and entity extraction.
  • Scalable Anomaly Detection - Provides distributed implementations of anomaly detection to identify outliers in large-scale, high-dimensional datasets.
  • Text Analytics - Processes textual data at scale using distributed interfaces to extract insights and patterns.
  • Machine Learning Pipelines - Orchestrates composable workflows that integrate data featurization, model training, and external AI services.
  • Composable Architectures - Sequences data featurization and model training into unified workflows via a modular, composable interface.
  • Face Analysis - Detects human faces in images to perform verification, identification, grouping, and similarity matching.
  • Cybersecurity Machine Learning - Applies specialized machine learning models to detect and analyze cybersecurity threats.
  • Gradient Boosting - Implements distributed training for gradient boosted decision trees to process large-scale datasets.
  • Nonlinear Detection - Identifies anomalies in high-dimensional data using a distributed forest of isolation trees.
  • Image Content Analyzers - Provides tools for detecting objects and text within images to automate metadata extraction.
  • Machine Learning Pipelines - Embeds distributed machine learning models into pipelines to support batch, streaming, and serving workloads.
  • Distributed Execution - Runs vision-based machine learning models across distributed clusters to process large-scale image data.
  • ONNX Runtime Inference - Executes pre-trained models on CPU or GPU hardware using the cross-platform ONNX runtime for distributed inference.
  • Medical Relationship Extraction - Identifies medical entities and maps relationships within unstructured clinical documents and health records.
  • Multilingual Document Translation - Translates text and full documents across multiple languages while preserving original structural formatting.
  • Speech and Text Conversion - Provides integrated pipelines for transcribing audio to text and synthesizing text into neural audio.
  • Time Series Anomaly Detection - Generates models to identify irregularities and anomalous data points within temporal time series data.
  • Elastic Scaling - Executes model training and evaluation across compute environments that dynamically resize based on the workload.
  • Anomaly Detection Algorithms - Implements algorithms to identify outliers across multiple data streams by analyzing inter-correlations and dependencies.
  • Computation Serving - Exposes cluster-based computations as web services to deliver results with sub-millisecond response times.
  • Direct Memory Data Transfer - Optimizes data movement and memory usage between distributed partitions and native datasets using direct memory transfer.
  • Similarity Search - Identifies the nearest neighbors for a query across large datasets based on feature similarity.
  • Structured Data Extraction - Extracts key-value pairs and tables from business forms and IDs into structured formats.

Historial de estrellas

Gráfico del historial de estrellas de microsoft/synapsemlGráfico del historial de estrellas de microsoft/synapseml

Búsqueda con IA

Explora más repositorios increíbles

Describe lo que necesitas en lenguaje sencillo: la IA clasifica miles de proyectos open-source curados por relevancia.

Start searching with AI

Preguntas frecuentes

¿Qué hace microsoft/synapseml?

SynapseML es una biblioteca de machine learning de Apache Spark diseñada para construir y escalar flujos de trabajo de machine learning y pipelines de datos a través de clústeres distribuidos. Sirve como framework de pipeline de machine learning distribuido y motor de inferencia distribuido para ejecutar predicciones aceleradas por hardware y tareas de deep learning en conjuntos de datos a gran escala.

¿Cuáles son las características principales de microsoft/synapseml?

Las características principales de microsoft/synapseml son: Distributed ML Pipeline Managers, Distributed Machine Learning Integrators, Distributed Data Processing, AI Service Integrations, Anomaly Detection, Cloud AI Integrations, Computer Vision, Deep Learning Inference Engines.

¿Qué alternativas de código abierto existen para microsoft/synapseml?

Las alternativas de código abierto para microsoft/synapseml incluyen: azure/mmlspark — Mmlspark is a distributed framework for executing machine learning models, data transformations, and AI service… huggingface/transformers.js — This library is a web-native engine designed to execute pretrained machine learning models directly within the… dusty-nv/jetson-inference — jetson-inference is a set of libraries and tools for executing optimized deep learning models on embedded GPU… lyft/flyte — Flyte is a distributed machine learning pipeline manager and MLOps workflow engine. It functions as a… lyhue1991/eat_tensorflow2_in_30_days — This project is a structured learning curriculum and technical reference for mastering deep learning with TensorFlow.… wang-xinyu/tensorrtx — tensorrtx is a computer vision inference engine and model implementation library designed for graphics processor…

Alternativas open-source a SynapseML

Proyectos open-source similares, clasificados según cuántas características comparten con SynapseML.
  • azure/mmlsparkAvatar de Azure

    Azure/mmlspark

    5,228Ver en GitHub↗

    Mmlspark is a distributed framework for executing machine learning models, data transformations, and AI service integrations across Apache Spark clusters. It functions as a distributed machine learning library and pipeline orchestrator, allowing users to integrate pre-trained cognitive services and custom models into large-scale batch and streaming workflows. The project is distinguished by its ability to incorporate external AI services and web APIs directly into big data pipelines for text and vision analysis. It provides a scalable model training framework that coordinates gradient boostin

    Scala
    Ver en GitHub↗5,228
  • huggingface/transformers.jsAvatar de huggingface

    huggingface/transformers.js

    15,420Ver en GitHub↗

    This library is a web-native engine designed to execute pretrained machine learning models directly within the browser. It functions as a client-side inference framework, enabling developers to run complex neural networks for natural language processing, computer vision, and audio tasks without requiring a backend server or external API calls. The framework distinguishes itself by providing a unified pipeline-based abstraction that handles the entire lifecycle of model execution. It manages the dynamic retrieval of model weights and configurations from remote registries, while simultaneously

    JavaScriptbrowserjavascripttransformers
    Ver en GitHub↗15,420
  • dusty-nv/jetson-inferenceAvatar de dusty-nv

    dusty-nv/jetson-inference

    8,734Ver en GitHub↗

    jetson-inference is a set of libraries and tools for executing optimized deep learning models on embedded GPU hardware. Its primary purpose is to enable real-time computer vision and AI inference at the edge with low latency and high throughput. The project distinguishes itself through high-performance streaming analytics and the ability to execute concurrent AI pipelines on auto-grade silicon. It provides specialized support for multi-sensor stream processing, utilizing zero-copy data transport to load camera frames directly into GPU memory. The codebase covers a broad surface of capabiliti

    C++caffecomputer-visiondeep-learning
    Ver en GitHub↗8,734
  • lyft/flyteAvatar de lyft

    lyft/flyte

    7,095Ver en GitHub↗

    Flyte is a distributed machine learning pipeline manager and MLOps workflow engine. It functions as a Kubernetes-native orchestrator used to coordinate data, models, and compute resources for executing machine learning pipelines and autonomous agents at scale. The platform provides specialized infrastructure for the full machine learning lifecycle, including a dedicated model serving platform to deploy trained models as scalable production-ready inference services. It also enables the coordination and state management of autonomous AI agents. The system manages scalable pipeline execution th

    Go
    Ver en GitHub↗7,095
  • Ver las 30 alternativas a SynapseML→