Hi,
There is no existing image without desktop. Would need to do customization based on sample rootfs.
Please refer to this topic:
Remove ubuntu-desktop and Install ubuntu-desktop
You may also consider to use light LXDE:
Save 1GB of Memory! Use LXDE on your Jetson - JetsonHacks