Awesome GitHub RepositoriesMulti-Dimensional Parallelism

AISystem is a comprehensive AI full-stack infrastructure project covering the entire pipeline from AI chip architecture to high-level training frameworks. It encompasses the development of AI compiler frameworks, inference engines, and distributed training orchestrators designed to coordinate workloads across a heterogeneous compute stack of CPUs, GPUs, and NPUs. The project focuses on the deep integration of software and hardware, employing software-hardware co-design to align tensor layouts with physical memory structures. It provides specialized capabilities for accelerating Transformer mo

This repository provides a collection of reference implementations, toolkits, and orchestration tools for training and deploying large-scale AI models on Cloud TPU hardware. It serves as a framework for managing the lifecycle of accelerator clusters, including hardware orchestration and the provisioning of high-performance compute infrastructure for machine learning workloads. The project specifically enables the pre-training of foundation models, large language models, and complex reasoning architectures through distributed training toolkits and multi-host scaling recipes. It further provide

Cirq 是一个 Python 量子计算框架，用于在含噪声中等规模量子（NISQ）硬件上设计、模拟和执行量子电路。它既是一个量子电路模拟器和噪声建模器，也是实现量子算法的工具。 该框架为 NISQ 硬件提供了专门的接口，允许用户将逻辑量子电路映射到物理设备拓扑，同时验证硬件连接性和门约束。它通过集成噪声建模脱颖而出，应用去极化和阻尼通道来模拟真实量子处理器中发现的退相干和错误。 该项目涵盖了广泛的功能，包括量子电路设计、硬件集成和状态模拟。它包括用于门分解、硬件拓扑映射以及执行傅里叶变换和非结构化数据搜索等基本量子过程的工具。此外，它还提供了用于分子基态计算和硬件保真度基准测试的分析工具。