Deploy your PyTorch app on the Framework desktop with ROCm in a Docker container
Deploy your PyTorch app on the Framework desktop with ROCm in a Docker container We, the NOLAI Tech Team, have bought 4 framework desktops. They are great since they have such a large amount of (shared) RAM and a powerful AMD GPU. But that same AMD GPU is also a bit of a headache when it comes to running PyTorch models. The CUDA ecosystem is so dominant that most PyTorch images and packages assume you have an NVIDIA GPU. But luckily AMD has a solution: AMD gives you a Docker image with ROCm and a version of PyTorch that should work as a drop-in replacement for the CUDA build. The reality is …
