Hello NVIDIA Community,
We are encountering significant power-related issues with our NVIDIA Jetson AGX Orin Developer Kit 64GB during robot testing. Below are the detailed observations and logs we’ve gathered to help diagnose the problem.
Hardware Details:
- Device: Jetson AGX Orin Developer Kit 64GB
- Backup Device: Another Jetson AGX Orin Developer Kit (Functioning Properly)
Issue Description:
While testing our robot, the primary Jetson AGX Orin suddenly shut down. Subsequent attempts to restart it have resulted in unreliable behavior. Initially, we powered the device using the jack port but faced the following issues:
-
USB-C Power Supply:
- Behavior: Pressing the power button causes the LED to turn on briefly and then go off.
- Current Draw: Not measurable as the device fails to stay powered.
-
Jack Port Power Supply:
- Behavior: The device only powers on reliably when supplied with exactly 12V.
- Current Draw:
- New (Functional) Orin: Approximately 2.8A to 9A in idle.
- Faulty Orin: Approximately 3.2A in idle, reducing to 0.9A post-boot.
Despite the faulty Orin drawing lower current after booting, it remains significantly higher compared to the new device, and the device shuts down randomly, especially under high current draw.
Debug Serial Log Findings:
We connected to the faulty Jetson AGX Orin via a debug serial connection and obtained the following log snippets:
tegra-i2c c240000.i2c: I2C transfer timed out
ina3221 1-0040: Unable to reset device
ina3221: probe of 1-0040 failed with error -110
tegra-i2c c240000.i2c: I2C transfer timed out
ina3221 1-0041: Unable to reset device
ina3221: probe of 1-0041 failed with error -110
ucsi_ccg 1-0008: i2c_transfer failed -110
ucsi_ccg 1-0008: ucsi_ccg_init failed with error -110
ucsi_ccg: probe of 1-0008 failed with error -110
Concerns & Questions:
-
I2C Transfer Timeouts and Device Probe Failures:
- Devices Affected: INA3221 Power Monitors and UCSI CCG (USB Type-C Controller).
- Error Code
-110: Indicates a timeout (ETIMEDOUT), suggesting communication failures on the I2C bus.
-
Impact on Power Functionality:
- INA3221 Failures: These power monitors are essential for accurate voltage and current measurements, ensuring stable power delivery. Failures here could lead to unreliable power management.
- UCSI CCG Failures: This controller manages USB Type-C power delivery. Its inability to initialize likely explains why the device cannot be powered via USB-C and faces issues with the jack port.
-
Current Draw Anomalies:
- The faulty Orin draws higher current at idle compared to the new unit and fails to maintain stable operation, especially under high load.
Troubleshooting Steps Taken:
-
Power Supply Verification:
- Confirmed that the power supply is stable and meets the required specifications.
-
Port Testing:
- Tested both USB-C and jack ports with various voltages. Only 12V via the jack port allows the device to power on, albeit unreliably.
-
Current Measurement:
- Compared the current draw of the faulty Orin with a new, functioning unit.
-
Serial Log Analysis:
- Connected via debug serial to capture and analyze log messages indicating I2C transfer timeouts and device probe failures.
Request for Assistance:
Given the above observations and log excerpts, we seek guidance on the following:
-
Interpretation of I2C Errors:
- Do the I2C transfer timeouts and probe failures for INA3221 and UCSI CCG indicate a hardware malfunction affecting power detection and management?
-
Potential Solutions:
- Hardware Inspection: Should we inspect or replace specific components related to the I2C bus or the affected devices?
- Firmware/Software Configuration: Are there known firmware issues or device tree configurations that might resolve these I2C communication problems?
- Alternative Diagnostics: What other diagnostic steps can we take to pinpoint and rectify the power instability?
-
Preventive Measures:
- Recommendations to prevent such issues in future deployments or during intensive testing phases.
Additional Information:
- Operating Conditions: The device was running in a robotic application environment, which may involve variable power demands and mechanical stresses.
- Recent Changes: No significant hardware or software changes were made prior to the sudden shutdown.
Thank you in advance for your support and expertise. We look forward to your guidance to resolve these issues and restore reliable operation to our Jetson AGX Orin Developer Kit.
Best Regards,
Orkun Acar
orkun-acar@outlook.com
OzU Rover
Attachments:
orin_log.pdf (452.8 KB)
( Sorry for uploading log as pdf :( permission issues)