Color Format Conversion in Jetson

Hi Everyone,
I am currently using a Jetson Dev Kit running on Android 4.4.2 to evaluate my custom camera application with a USB 2.0 Camera. For my Camera App to work, I need to convert YUV422 frames coming from my camera into either YUV420P or YUV420SP. While performing software conversion, I am experiencing excess frame delays. Does this conversion can be done using CUDA?. Is any other HW component capable of performing this conversion? As I am new to Tegra Platform I am not able to reach a viable solution.