https://github.com/DefTruth/CUDA-Learn-Notes

🎉 Modern CUDA Learn Notes with PyTorch: fp32/tf32, fp16/bf16, fp8/int8, flash_attn, rope, sgemm, sgemv, warp/block reduce, dot, elementwise, softmax, layernorm, rmsnorm.

GPL-3.0 License

Stars
1.3K
View Code on GitHub Visit Website
Ecosystems: PyTorch, Cuda

No README available, please check again later.

Related Projects
cuda

Haskell FFI bindings to CUDA

16 Apr 2011 76
https://github.com/dancing-ui/uestc_vhm

使用yolov8、fast-reid、deepsort完成目标跟踪

10 Aug 2024 6
https://github.com/GT-ZhangAcer/QPT

[内测中]QPT - 致力于让开源项目更好通往互联网世界的Python to EXE工具（Python打包）。

03 May 2021 694
https://github.com/Bruce-Lee-LY/decoding_attention

Decoding Attention is specially optimized for multi head attention (MHA) using CUDA core for the ...

14 Aug 2024 14
cuda-learning

cuda编程学习入门

02 Feb 2022 28
https://github.com/finmath/finmath-lib-cuda-extensions

Classes enabling finmath-lib to run its Monte-Carlo models on Cuda GPUs

18 Jun 2017 8
awesome-gpgpu

A curated list of awesome GPGPU (CUDA/OpenCL/Vulkan) resources

20 Jun 2018 63
https://github.com/MrNeRF/gaussian-splatting-cuda

3D Gaussian Splatting, reimagined: Unleashing unmatched speed with C++ and CUDA from the ground up!

30 Jul 2023 862
cuda-design-patterns

Some CUDA design patterns and a bit of template magic for CUDA

16 Nov 2018 145
https://github.com/sony/nnabla-ext-cuda

A CUDA Extension of Neural Network Libraries

21 Jun 2017 92
cccl

CUDA C++ Core Libraries

17 Sep 2020 743
PyDyNet

NumPy实现类PyTorch的动态计算图和神经网络框架(MLP, CNN, RNN, Transformer)

06 May 2022 71
https://github.com/src-d/minhashcuda

Weighted MinHash implementation on CUDA (multi-gpu).

25 Oct 2016 114
https://github.com/TensorBFS/CuTropicalGEMM.jl

The fastest Tropical number matrix multiplication on GPU

29 Jun 2023 1
https://github.com/neoheartbeats/neoheartbeats-kernel

An architecture for LLMs' continual-learning and long-term memories

26 Jul 2024 4