关于推理速度上不去的问题

Robotics & Edge Computing Jetson Systems Jetson AGX Orin
, ,
1

请教一下，我们现在遇到一个问题：我们设计一块载板，放置2个JAO-64GB模组（命名为A B），上电均正常启动，然后跑推理测试demo，经过长期测试，发现有如下几种现象

1 A B同时跑推理测试，速率均可达到300M左右

2 A B同时跑推理测试，速率均达不到300M左右

  • 但是如果断开其中一个模组的电源，另一个速率肯定能达到300M左右

若现象1发生了，那这一天的测试结果均为现象1，不会出现现象2.

若现象2发生了，那这一天的测试结果均为现象2，不会出现现象1.

目前查的因素有：

  • 电源功率供给：在现象2发生的时候，使用示波器测试过HV电压（12V）波形，无明显掉电（掉电到大概11.9V）
  • 电源纹波：目前没有测试

请帮忙看看这个问题

2

*** Please note that this reply is generated by LLM automatically ***

The provided information appears to be a part number for a Jetson AGX Orin module.

Breaking down the part number:

  • 2JAO likely refers to the Jetson AGX Orin module series.
  • 64GB indicates that this module has 64GB of memory.
  • A is the manufacturing major revision, an upper case letter.
  • B is likely a version number or a code for a specific configuration.
  • demo might indicate that this is a demo or evaluation version of the module.
  • 1 could be a numeric code or a version number.
  • A and B are repeated, possibly indicating different configurations or versions.
  • B300M might refer to a specific thermal solution or a thermal design power (TDP) rating.
  • 2 could be a numeric code or a version number.
  • A and B are repeated again, possibly indicating different configurations or versions.
  • 300M might refer to a specific thermal solution or a thermal design power (TDP) rating.
  • 112 and 221 could be numeric codes or version numbers.
  • 2HV12V119V might refer to the module’s voltage rating or power requirements.

Comparing this to the provided context, we can see that the Jetson AGX Orin 64GB module is mentioned as a production module with a part number P3701-0005. However, the provided part number 2JAO64GBA Bdemo 1 A B300M 2 A B300M 300M 112 221 2HV12V119V does not match the format of the part numbers mentioned in the context.

It’s possible that this part number is a custom or OEM version of the Jetson AGX Orin 64GB module, or it might be a part number from a different manufacturer or product line. Without more information, it’s difficult to provide a more specific answer.

*** Please give the thumbs up if you get answers you like. Or provide feedback to help us improve the answer. ***

4

Hi,

Could you share how you measure the speed (300M)?
Is it the memory bandwidth or the performance reported from the TensorRT?

Thanks.

5

是推理速度。
麻烦了

6

Hi,

We don’t support dual module by default.
Based on your description, maybe you can check the stability of the power supply.

Thanks.

7

请教一下 电源不稳定会导致推理速度上不去么？ 具体不稳定的有哪些？ 例如纹波、 我一般需要排查电源哪些东西 麻烦了

8

Hi,

Unfortunately, we don’t support dual module.
Thanks.

9

抱歉 我可能没说明白，我现在使用同一个电源给2个相同的JAO载板+JAO模组供电，此时2个JAO模组内部各自跑官方推荐的压力测试，推理速度上不去（90左右），但是我只给一个JAO载板+JAO模组供电的情况下，推理速度可以上到300多。我不理解的是JAO推理速率上不去的原因是啥？ 是载板的电源纹波么？

（这里说一嘴，肯定不可能是提供的功率不够，JAO没有重启发送，示波器测试HV MV电压也没有明显掉电）

image

image

10

Hi,

Could you take a picture of your setup so we can know more about your setting?

Thanks.