Keywords
Languages
https://github.com/jamjamjon/usls
A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models
https://github.com/BrosnanYuen/RayBNN_Optimizer
Gradient Descent Optimizers and Genetic Algorithms using GPUs, CPUs, and FPGAs via CUDA, OpenCL, and oneAPI
https://github.com/NVIDIA/nvImageCodec
A nvImageCodec library of GPU- and CPU- accelerated codecs featuring a unified interface
ezlocalai
ezlocalai is an easy to set up local artificial intelligence server with OpenAI Style Endpoints
https://github.com/MrNeRF/gaussian-splatting-cuda
3D Gaussian Splatting, reimagined: Unleashing unmatched speed with C++ and CUDA from the ground up!
ScaleLLM
A high-performance inference system for large language models, designed for production environments
https://github.com/TensorBFS/CuTropicalGEMM.jl
The fastest Tropical number matrix multiplication on GPU
RadonKA.jl
A simple yet sufficiently fast (attenuated) Radon and backproject implementation using KernelAbstractions
https://github.com/mantasu/glasses-detector
Glasses detection, classification and segmentation
autoregressive-linear-attention-cuda
CUDA implementation of autoregressive linear attention, with all the latest research findings
willow-inference-server
Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS
PTXprofiler
A simple profiler to count Nvidia PTX assembly instructions of OpenCL/SYCL/CUDA kernels for roofline model analysis
https://github.com/DefTruth/CUDA-Learn-Notes
🎉 Modern CUDA Learn Notes with PyTorch: fp32/tf32, fp16/bf16, fp8/int8, flash_attn, rope, sgemm, sgemv, warp/block reduce, dot, elementwise, softmax, layernorm, rmsnorm
https://github.com/romnn/nvbit-rs
Rust bindings to the NVIDIA NVBIT binary instrumentation API
