I followed this and confirmed that I still receive the error nvbuf_utils: dmabuf_fd -1 mapped entry NOT found when DISPLAY is NOT set (and no X-forwarding).
In that case, the warning No EGL Display. nvbufsurftransform: Could not get EGL display connection disappears. So I guess it should not be related.