Online Decision Transformer

I want to try the Online Decision Transformer algorithm, but I have no idea how I will tackle it using Isaac Gym. Anybody have ideas as to how I can implement a transformer model with Isaac Gym?