# infatoshi/cuda-course **Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/infatoshi-cuda-course).** 3,297 stars · 589 forks · Cuda ## Links - GitHub: https://github.com/Infatoshi/cuda-course - awesome-repositories: https://awesome-repositories.com/repository/infatoshi-cuda-course.md ## Description This project is a CUDA programming course and technical guide focused on writing and optimizing GPU kernels for hardware acceleration. It provides structured learning resources for using the CUDA platform to execute operations on silicon architectures. The material covers the optimization of linear algebra kernels and the analysis of machine learning deployment. It includes guidance on identifying acceleration tools, mapping the deep learning ecosystem, and evaluating the frameworks used to move models from research to production environments. The scope extends to GPU performance optimization and the tracking of machine learning experiments, including the recording of training metrics and model weights. ## Tags ### Education & Learning Resources - [GPU Programming Courses](https://awesome-repositories.com/f/education-learning-resources/gpu-programming-courses.md) — Provides a structured learning resource for writing, compiling, and executing GPU kernels using the CUDA platform. - [Programming Courses](https://awesome-repositories.com/f/education-learning-resources/educational-resources/courses-training-certifications/software-engineering-training-courses/programming-courses.md) — Offers a comprehensive structured course on programming and optimizing GPU kernels via CUDA. - [Hardware Acceleration Guides](https://awesome-repositories.com/f/education-learning-resources/hardware-acceleration-guides.md) — Provides a technical overview of low-level languages and compilers used to optimize performance on silicon architectures. - [Deep Learning Framework Comparisons](https://awesome-repositories.com/f/education-learning-resources/comparative-analyses/deep-learning-framework-comparisons.md) — Provides comparative analysis of research tools versus production libraries across different hardware backends. ([source](https://cdn.jsdelivr.net/gh/Infatoshi/cuda-course@master/01_Deep_Learning_Ecosystem/README.md#chapter-01-the-current-deep-learning-ecosystem)) ### Artificial Intelligence & ML - [Hardware Acceleration Backends](https://awesome-repositories.com/f/artificial-intelligence-ml/hardware-acceleration-backends.md) — Explains how high-level framework calls are mapped to low-level silicon instructions via hardware acceleration backends. ### Part of an Awesome List - [GPU Kernel Performance Tuning](https://awesome-repositories.com/f/awesome-lists/devtools/performance-and-optimization/gpu-kernel-performance-tuning.md) — Guides the improvement of execution speed by fusing linear algebra operations and generating optimized machine code. - [Deep Learning Ecosystems](https://awesome-repositories.com/f/awesome-lists/ai/deep-learning-ecosystems.md) — Organizes the frameworks and hardware architectures that constitute the modern deep learning ecosystem. ([source](https://cdn.jsdelivr.net/gh/Infatoshi/cuda-course@master/01_Deep_Learning_Ecosystem/README.md#chapter-01-the-current-deep-learning-ecosystem)) - [Production Machine Learning](https://awesome-repositories.com/f/awesome-lists/devops/production-machine-learning.md) — Evaluates the frameworks and formats required to move models from research into production environments. - [Deployment Analysis](https://awesome-repositories.com/f/awesome-lists/devops/production-machine-learning/deployment-analysis.md) — Analyzes different frameworks and toolkits used to move machine learning models from research environments into production hardware. ### Operating Systems & Systems Programming - [Tool Catalogs](https://awesome-repositories.com/f/operating-systems-systems-programming/hardware-interfacing-drivers/hardware-acceleration/gpu-acceleration/tool-catalogs.md) — Catalogs the low-level languages and compilers used to optimize performance across various silicon architectures. ([source](https://cdn.jsdelivr.net/gh/Infatoshi/cuda-course@master/01_Deep_Learning_Ecosystem/README.md#chapter-01-the-current-deep-learning-ecosystem)) - [Operation-to-Accelerator Mapping](https://awesome-repositories.com/f/operating-systems-systems-programming/hardware-interfacing-drivers/hardware-acceleration/operation-to-accelerator-mapping.md) — Explains the process of mapping software operations to specific GPU and CPU acceleration backends. ### Programming Languages & Runtimes - [CUDA Kernel Compilers](https://awesome-repositories.com/f/programming-languages-runtimes/compiler-interpreter-internals/compiler-infrastructure/jit-kernel-compilers/cuda-kernel-compilers.md) — Covers the use of NVCC to translate CUDA source code into PTX assembly and machine code. - [Kernel Fusion Operations](https://awesome-repositories.com/f/programming-languages-runtimes/runtime-execution-environments/runtime-environments/runtimes/graph-symbolic-execution-engines/operation-kernels/kernel-fusion-operations.md) — Teaches techniques for combining multiple mathematical operations into single kernels to reduce memory bandwidth overhead. - [Source Code Compilers](https://awesome-repositories.com/f/programming-languages-runtimes/source-code-compilers.md) — Provides practical instruction on transforming GPU source code into executable binaries. ([source](https://cdn.jsdelivr.net/gh/Infatoshi/cuda-course@master/01_Deep_Learning_Ecosystem/README.md#chapter-01-the-current-deep-learning-ecosystem)) - [Intermediate Representations](https://awesome-repositories.com/f/programming-languages-runtimes/compiler-interpreter-internals/compiler-infrastructure/intermediate-representations.md) — Describes the use of PTX as a virtual machine ISA for cross-generational GPU hardware portability. ### Scientific & Mathematical Computing - [GPU Linear Algebra Libraries](https://awesome-repositories.com/f/scientific-mathematical-computing/gpu-linear-algebra-libraries.md) — Teaches how to increase the execution speed of linear algebra operations through GPU-specific optimizations. ([source](https://cdn.jsdelivr.net/gh/Infatoshi/cuda-course@master/01_Deep_Learning_Ecosystem/README.md#chapter-01-the-current-deep-learning-ecosystem)) - [Kernel Optimizations](https://awesome-repositories.com/f/scientific-mathematical-computing/linear-algebra-libraries/kernel-optimizations.md) — Provides guidance on increasing execution speed by fusing operations into single GPU kernels for hardware acceleration. ### DevOps & Infrastructure - [Model Inference Deployment](https://awesome-repositories.com/f/devops-infrastructure/deployment-management/model-inference-deployment.md) — Guides the analysis of various tools and formats used to deploy models for production and edge computing. ([source](https://cdn.jsdelivr.net/gh/Infatoshi/cuda-course@master/01_Deep_Learning_Ecosystem/README.md#chapter-01-the-current-deep-learning-ecosystem))