This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, sgemv, sgemm, etc. The performance of these kernels is basically at or near the theoretical limit.
Multi-Threaded FP32 Matrix Multiplication on x86 CPUs
Accelerated General (FP32) Matrix Multiplication from scratch in CUDA
General Matrix Multiplication using NVIDIA Tensor Cores
The repository targets the OpenCL gemm function performance optimization. It compares several libraries clBLAS, clBLAST, MIOpenGemm, Intel MKL(CPU) and cuBLAS(CUDA) on different matrix sizes/vendor's hardwares/OS. Out-of-the-box easy as MSVC, MinGW, Linux(CentOS) x86_64 binary provided. 在不同矩阵大小/硬件/操作系统下比较几个BLAS库的sgemm函数性能，提供binary，开盒即用。
maxas Scott Grey's maxas assembler sgemm explaining the (for me) missing parts https://github.com/NervanaSystems/maxas
FastCuda is a handwritten CUDA operator library featuring progressive GEMM and Reduce kernels, cuBLAS benchmarking, and C/C++/Python interfaces for learning, profiling, and performance optimization.
A benchmark framework for POWER and x86_64
可验证的 CUDA 学习主线：SGEMM、通用 GPU 算子、性能优化与轻量推理组件
C++17 ONNX inference optimizer + CPU runtime for Apple Silicon. Operator fusion via IR passes, Accelerate AMX-backed sgemm; benched vs ONNX Runtime CPU EP on DistilBERT (1.26x baseline speedup, 6.99x ORT on raw MatMul).
A CPU benchmark suite that shows its work. Six workloads, calibrated measurement windows, barrier-synchronised threads, robust statistics, full machine provenance, and Ed25519-signed results.
Progressive CUDA SGEMM kernel(6) optimization (naive → vectorized) with cross-architecture profiling on RTX 3090 vs RTX 4050, benchmarked using Nsight Compute.
Perform the matrix-matrix operation `C = α*op(A)*op(B) + β*C` where `op(X)` is either `op(X) = X` or `op(X) = X^T`.
CUDA SGEMM optimization from scratch — six kernels reaching 6.37 TFLOP/s, 67.9× over naive CUDA, and 90% of NVIDIA cuBLAS performance.
To associate your repository with the sgemm topic, visit your repo's landing page and select "manage topics."