Bear in mind, as long as the cooling requirements specified by Nvidia are met, the Tesla range of card are designed to be run at full load for most of their lives.
Comparing the T4 to the RTX2070 Super which uses the same GPU, the base/boost clock is 585/1590 vs 1605/1770 which is probably done with a view to longevity at load.
Later: The conservative clocks above may also have been chosen to keep the TDP at 70W, which is the limit for a PCIe slot with no auxiliary connector.
As a retired electronics tech, I’m a fan of cooling as much as possible and for cards that are being purchased to be used at full load for extended periods of time, believe watercooling is a worthwhile consideration. Not just from the reliability angle of lower temps, but in most cases the GPU will no longer be thermally throttled and so a significant performance boost results.
I have just added a waterblock to a GTX1080 in stock (not overclocked) form. Aircooled, running a task that can run for several hours, the clock is throttled down to 1609 within minutes. Water cooled it runs at 1911, a gain of 19%.
Admittedly there is extra cost and some maintenance involved, but once done, the cooling circuit can be applied to replacement cards. Now that some card manufacturers are offering solid watercooled options, the issue of voiding warranties or damaging a card by adding the block yourself is avoided and some are offering an extra year of warranty over aircooled models.
These are a nice example, if one looks past the flashing lights and lurid coolant colour: RTX3090-24G-EK｜Graphics Cards｜ASUS USA
As an aside, if you haven’t already seen them, here is a review on the T4: Analysis of Our NVIDIA Tesla T4 Review | ServeTheHome
an also an inferencing benchmark, showing relative performance between t4 and many other cards: NVIDIA GeForce RTX 3090 Review A Compute Powerhouse | Page 6 of 7