github.devotd.
NewLLM infrastructure

nullmoth/nvidia-macos-driver v2.0.2 — a Metal driver for NVIDIA cards

Covers what the driver is made of and how far it has been verified: running NVIDIA GeForce cards through Metal on macOS 15 Sequoia.

Repositorynullmoth/nvidia-macos-driver ↗

Metal driver for NVIDIA GeForce cards on macOS Sequoia

stars
★ 3.3K
Forks
314
Language
Rust
License
NOASSERTION
Latest release
v2.3.3
Read original source ↗View on GitHub ↗

nullmoth/nvidia-macos-driver v2.0.2 is a driver that runs NVIDIA GeForce cards through Metal on macOS 15 Sequoia. The project is also an attempt to make local inference on a Mac possible without CUDA.

The repository bundles a kernel extension, a Metal plug-in, a shader translator, and a Mac app for installation. Commands from Metal apps pass through NVMTLDriver.bundle, get translated from Apple AIR to SPIR-V, then travel through the Mesa Vulkan-based NVK and the NAK compiler before reaching the kernel extension. The Vulkan backend is Mesa 17ca6174 with nvk-macos.patch applied. The kernel side uses the public NVIDIA GPU kernel module r610 unmodified, and the GSP firmware 610.57.04 is left untouched as well. In other words, it joins a newly written Metal front end with publicly available NVIDIA kernel components.

The targets are the post-Turing GTX 16, RTX 20, 30, 40 and 50 series, TITAN RTX, Quadro RTX, and the T series. Development and testing focused on the RTX 5060. It supports Metal 3 argument buffers tier 2, ray tracing, mesh shaders, MPS and MetalFX, with OpenGL provided through Apple's GL-on-Metal. That said, the license is listed as NOASSERTION and there are 142 open issues, so the distribution terms and the real-world stability are hard to judge from this information alone. The support list on its own does not establish that stability has been confirmed on other cards.