AWS Docker Issues with First GPU instnce usage

I have a built Docker image to run my Linux/arm64 EC2 instance. Recently I’ve decided to use GPUs (g5g especially), and I want to include CUDA and needed libs to be in my docker image to keep work with my running instance and include the newly added GPUs.
Is there anyone having ready images for Docker file or familiar with issues of first running GPU?

Appreciated in advance!