I made what I believe to be the fastest public Windows ML pipeline in existence. C++ DX11 -> TensorRT

Keyborg-Gadgets/ML-LookingGlass: A showcase of advance Windows architectures for Realtime object detection against DX11 Textures with RTdetr and TensorRT

The build system incorporates:
Keyborg-Gadgets/CUDA-Setup-Injector: A literal hack that causes cuda files to be pulled to a local directory in realtime. Once the ntdll calls are implemented all calls will be intercepted.

ML on windows sucks. It’s sucked for years and no one cares to make it better it seems. If you like any of these projects please leave me a star. More docs, readme, polish incoming across the board.