I’ve made a small demo example that showcases TF-TRT optimization of a small toy model in Keras TF2. You can run it on JetPack 4.4 using three simple commands:
git clone https://github.com/pascal-hwky/tftrt-jetson.git cd tftrt-jetson ./arm.sh
Please find the repository here. Currently, I’m still receiving a strange error in the optimization stage:
Assertion Error in fromSymbolic: 0 (x must be build-time constant)
Unfortunately, this prevents the conversion of this segment to a fully optimized TRT engine operation. If anybody has seen this error before and knows what’s causing it, I would greatly appreciate any help!