Repro clip, seen in version 2023.2.0 beta:
without saving to a USD - the camera mesh will persist through switching between viewports; turning off the camera type visibility will not remove the mesh either. but it will go away once USD is saved or upon a new file creation (shown in clip above).