How Do I use custom device tree files in the 6.2 OTA Tools?

It should be yes, but you have to customize the OTA tool to recognize your board config.

Please refer to the patch in How to generate OTA payload for custom baords - #7 by KevinFFF for the example how we added the OTA support for new board config.