Support for a CUDA 12.5.x

[jasonsmithio]

🚀 The feature

I pushed the container and saw over 500 CVEs when I scanned the container. Many, if not all, would be addressed if we support Ubuntu 24.04. NVIDA has a docker image running 24.04 as it's base and it runs 12.5.1. I would like to update the build scripts to support this imae

Motivation, pitch

500+ CVEs related to the base image using 20.04

Alternatives

No response

Additional context

No response

[agunapal]

Hi @jasonsmithio You can build your custom image using this flag

https://github.com/pytorch/serve/blob/master/docker/build_image.sh#L29

Last time we tried, we didn't have a good experience with the ubuntu22.04 runners for CI/CD and hence didn't upgrade to 22.04. Will try again.