Can YOLOv4 Be Trained with Polygon Annotations Instead of Rectangular Bounding Boxes?

If you are training only one class, you can try to use OCDNet. After training, it can generate polygon inference result.
Or, you can consider to use segmentation network. For example, segformer or Unet.