Yes, I actually upgraded the tensorRT from version 3 to version 4 without flashing the jetson. I just used the 3.3 Jetpack, and did not select the item for reflashing the board.
Plus, I just checked the jetpack website, seems now jetpack 4.2 also supports jetson TX2.