Start with Pytorch; if you removed CUDA support, all that's left is hacks honestly. Stuff like Olive and DirectML is equally as proprietary as CUDA while also less-developed, and Metal Performance Shaders are a hacked wrapper for GPU compute. See for yourself: https://pytorch.org/docs/stable/backends.html
There's also ONNX, a Pytorch alternative made by Microsoft that focuses on optimizing for as many targets as possible. It is very difficult to use though, and still under active development.
Generally, the issue is that our FAANG companies hate each other too much to do anything about Nvidia. AMD and Apple did have a working relationship (and even a GPGPU acceleration library), but now they are bitter enemies.
Start with Pytorch; if you removed CUDA support, all that's left is hacks honestly. Stuff like Olive and DirectML is equally as proprietary as CUDA while also less-developed, and Metal Performance Shaders are a hacked wrapper for GPU compute. See for yourself: https://pytorch.org/docs/stable/backends.html
There's also ONNX, a Pytorch alternative made by Microsoft that focuses on optimizing for as many targets as possible. It is very difficult to use though, and still under active development.
Generally, the issue is that our FAANG companies hate each other too much to do anything about Nvidia. AMD and Apple did have a working relationship (and even a GPGPU acceleration library), but now they are bitter enemies.