Hello.systemctl suspend or it is instantly waking up. (I am not even losing the SSH connection)
This is what I see in dmesg
254.256064] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[ 254.259893] eth0: 0xffffff800a40c000, 48:b0:2d:e0:3c:8a, IRQ 406
[ 254.329441] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[ 254.331694] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[ 254.363772] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[ 254.365603] IPv6: ADDRCONF(NETDEV_UP): wlan0: link is not ready
[ 254.368160] iwlwifi 0000:01:00.0: L1 Enabled - LTR Enabled
[ 254.369268] iwlwifi 0000:01:00.0: L1 Enabled - LTR Enabled
[ 254.386890] r8152 1-3.1:1.0 eth1: carrier on
[ 254.486449] iwlwifi 0000:01:00.0: L1 Enabled - LTR Enabled
[ 254.486707] iwlwifi 0000:01:00.0: L1 Enabled - LTR Enabled
[ 254.545769] IPv6: ADDRCONF(NETDEV_UP): wlan0: link is not ready
[ 254.545826] IPv6: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
[ 254.644975] IPv6: ADDRCONF(NETDEV_UP): wlan0: link is not ready
Do you see what’s actually happening?
What are the pins that would wake the jetson up, that I have to double check? What are other reasons that the jetson might not go into standby or wakeup instantly?
Any help much appreciated!
You can try to use the uart console to check if any further log.
This is the output:
[ 6512.701209] pwm_fan_driver pwm-fan: pwm_fan_suspend:gpio request failed 39
[ 6512.708452] tegra_cec 70015000.tegra_cec: suspended
[ 6512.823056] IRQ10 no longer affine to CPU1
[ 6512.827544] CPU1: shutdown
[ 6512.859089] IRQ11 no longer affine to CPU2
[ 6512.863729] CPU2: shutdown
[ 6512.903003] IRQ12 no longer affine to CPU3
[ 6512.907578] CPU3: shutdown
ERROR: BPMP not powered on
WBD
[ 6512.917990] cache: parent cpu1 should not be sleeping
[ 6512.924078] cache: parent cpu2 should not be sleeping
[ 6512.930125] cache: parent cpu3 should not be sleeping
[ 6513.076136] tegra_cec 70015000.tegra_cec: Resuming
[ 6513.080997] tegra_cec 70015000.tegra_cec: tegra_cec_init started
[ 6513.183702] tegradc tegradc.1: dp: aux write got error (0x10000100)
[ 6513.189992] tegradc tegradc.1: dp: Failed to write DPCD data. CMD 0x600, Status 0x10000100
[ 6513.203246] tegradc tegradc.1: dp: aux write got error (0x10000100)
[ 6513.203250] tegradc tegradc.1: dp: Failed to write DPCD data. CMD 0x600, Status 0x10000100
[ 6513.208233] tegradc tegradc.1: dp: aux write got error (0x10000100)
[ 6513.208236] tegradc tegradc.1: dp: Failed to write DPCD data. CMD 0x600, Status 0x10000100
[ 6513.213218] tegradc tegradc.1: dp: aux write got error (0x10000100)
[ 6513.213221] tegradc tegradc.1: dp: Failed to write DPCD data. CMD 0x600, Status 0x10000100
[ 6513.213224] tegradc tegradc.1: dp: failed to exit panel power save mode (0xfffffff2)
[ 6513.213231] hpd: edid read prepare failed
[ 6513.286633] thermal thermal_zone6: failed to read out thermal zone (-5)
[ 6513.301619] tegradc tegradc.1: dp: aux read got error (0x10000100)
[ 6513.301624] tegradc tegradc.1: dp: Failed to read DPCD data. CMD 0x1, Status 0x10000100
[ 6513.301627] tegradc tegradc.1: dp: NV_DPCD_MAX_LINK_BANDWIDTH read failed
[ 6513.306364] tegradc tegradc.1: dp: aux read got error (0x10000100)
[ 6513.306368] tegradc tegradc.1: dp: Failed to read DPCD data. CMD 0x2, Status 0x10000100
[ 6513.306371] tegradc tegradc.1: dp: NV_DPCD_MAX_LANE_COUNT read failed
[ 6513.306375] tegradc tegradc.1: dp: Invalid link rate (0) or lane count (0)
[ 6514.119192] tegra_cec 70015000.tegra_cec: tegra_cec_init Done.
Hi,
Just to clarify one thing here…
Are you using Jetson nano or Orin nano…? this is Orin nano forum and your log looks like from jetson nano.
Nano and Orin nano are two different platforms…
Oh I am very sorry. I missclicked. I wanted to post in Jetson Nano Forum. Can you move my thread, or do I need to repost? Sorry!
Hi,
I just moved to nano forum.
Could you use the serial console to operate all the commands and record the log here?
I mean I want a log with your command to enter suspend and what thing got printed after that.
Thanks for moving.
sudo systemctl suspend
jetson@tegra-ubuntu:~$ sudo cat /sys/kernel/debug/wakeup_sources
name active_count event_count wakeup_count expire_count active_since total_time max_time last_change prevent_suspend_time
2-1 0 0 0 0 0 0 0 1333626 0
gpio-keys 4 4 0 0 0 0 0 7044284 0
7000e000.rtc 10 10 0 0 0 13 4 6739744 0
max77620-rtc 9 9 0 0 0 746 97 6739874 0
usb2 2 2 0 0 0 0 0 6512748 0
usb1 4 4 0 0 0 0 0 7044284 0
vbus-wakelock 0 0 0 0 0 0 0 1031 0
70090000.xusb 0 0 0 0 0 0 0 1026 0
0000:02:00.0 0 0 0 0 0 0 0 1020 0
1003000.pcie 0 0 0 0 0 0 0 973 0
fuse_wake_lock 0 0 0 0 0 0 0 939 0
70015000.tegra_cec 0 0 0 0 0 0 0 922 0
alarmtimer 0 0 0 0 0 0 0 854 0
extcon:extcon@1 0 0 0 0 0 0 0 480 0
extcon-suspend-lock 0 0 0 0 0 0 0 480 0
deleted 0 0 0 0 0 0 0 0 0
Hi,
Let’s do other trick here. Please run this before your suspend and it will enable more logs.
echo 8 > /proc/sys/kernel/printk;
echo N > /sys/module/printk/parameters/console_suspend
I don’t know whether that usb is the source of your wakeup or not. It is also possible.
jetson@tegra-ubuntu:~$ [ 7659.186967] PM: suspend entry 2023-10-20 14:36:36.735556446 UTC
[ 7659.192956] PM: Syncing filesystems ... done.
[ 7659.211616] PM: Preparing system for sleep (mem)
[ 7659.219058] tegra_dvfs: suspended
[ 7659.222537] Freezing user space processes ... (elapsed 0.001 seconds) done.
[ 7659.231045] Freezing remaining freezable tasks ... (elapsed 0.001 seconds) done.
[ 7659.239748] PM: Suspending system (mem)
[ 7659.249268] usb 1-2: usb_suspend_both: status 0
[ 7659.249853] usb usb2: usb_suspend_both: status 0
[ 7659.259215] tegra_cec 70015000.tegra_cec: suspended
[ 7659.266683] tegradc tegradc.1: suspend
[ 7659.266732] tegradc tegradc.0: suspend
[ 7659.274406] hpd: state 3 (Disabled), hpd 0, pending_hpd_evt 1
[ 7659.274452] extcon-disp-state extcon:disp-state: cable 47 state 0 already set.
[ 7659.274453] Extcon AUX1(HDMI) disable
[ 7659.280232] usb usb1: usb_suspend_both: status 0
[ 7659.295672] hpd: request suspend
[ 7659.298910] hpd: switching from state 3 (Disabled) to state 3 (Disabled)
[ 7659.325620] tegra-xusb 70090000.xusb: entering ELPG
[ 7659.331542] tegra-pmc: PMC tegra_pmc_utmi_phy_enable_sleepwalk : port 1, speed 2
[ 7659.339203] tegra-pmc: PMC tegra_pmc_utmi_phy_enable_sleepwalk : port 2, speed 0
[ 7659.348111] tegra-xusb-padctl 7009f000.xusb_padctl: power down UTMI pad 1
[ 7659.354959] tegra-xusb 70090000.xusb: entering ELPG done
[ 7659.360420] PM: suspend of devices complete after 111.322 msecs
[ 7659.368087] host1x 50000000.host1x: suspended
[ 7659.372648] PM: late suspend of devices complete after 6.298 msecs
[ 7659.400960] PM: noirq suspend of devices complete after 22.109 msecs
[ 7659.407349] Disabling non-boot CPUs ...
[ 7659.428386] IRQ10 no longer affine to CPU1
[ 7659.432919] CPU1: shutdown
[ 7659.435689] psci: CPU1 killed.
[ 7659.464318] IRQ11 no longer affine to CPU2
[ 7659.468862] CPU2: shutdown
[ 7659.471610] psci: CPU2 killed.
[ 7659.492268] IRQ12 no longer affine to CPU3
[ 7659.496808] CPU3: shutdown
[ 7659.499563] psci: CPU3 killed.
[ 7659.506596] tegra-pmc: PMC wake level = 0x178000010000
[ 7659.506596] tegra-pmc: PMC wake enable = 0x48178001010001
[ 7659.506596] Entered SC7
[ 7659.506596] Exited SC7
[ 7659.506596] tegra-pmc: PMC wake status = 0x0
[ 7659.506596] Suspended for 0.537 seconds
[ 7659.506693] Enabling non-boot CPUs ...
[ 7659.514663] CPU1: Booted secondary processor [411fd071]
[ 7659.520307] cache: parent cpu1 should not be sleeping
[ 7659.525777] CPU1 is up
[ 7659.528535] CPU2: Booted secondary processor [411fd071]
[ 7659.534042] cache: parent cpu2 should not be sleeping
[ 7659.539515] CPU2 is up
[ 7659.542200] CPU3: Booted secondary processor [411fd071]
[ 7659.547691] cache: parent cpu3 should not be sleeping
[ 7659.553377] CPU3 is up
[ 7659.557242] tegra-xusb 70090000.xusb: exiting ELPG
[ 7659.562551] tegra-xusb-padctl 7009f000.xusb_padctl: power on UTMI pads 1
[ 7659.571872] tegra-xusb 70090000.xusb: Firmware timestamp: 2019-10-17 15:58:59 UTC, Version: 50.25 release
[ 7659.581704] tegra-pmc: PMC tegra_pmc_utmi_phy_disable_sleepwalk : port 0
[ 7659.588438] tegra-pmc: PMC tegra_pmc_utmi_phy_disable_sleepwalk : port 1
[ 7659.595164] tegra-pmc: PMC tegra_pmc_utmi_phy_disable_sleepwalk : port 2
[ 7659.602370] tegra-xusb 70090000.xusb: exiting ELPG done
[ 7659.609989] tegra-pcie 1003000.pcie: probing port 0, using 1 lanes
[ 7659.618341] tegra-pcie 1003000.pcie: probing port 1, using 1 lanes
[ 7659.676134] PM: noirq resume of devices complete after 120.325 msecs
[ 7659.683724] host1x 50000000.host1x: resuming
[ 7659.689835] PM: early resume of devices complete after 6.511 msecs
[ 7659.696298] tegradc tegradc.1: resume
[ 7659.696608] tegradc tegradc.0: resume
[ 7659.705005] tegra-xudc-new 700d0000.xudc: exiting ELPG
[ 7659.707056] hpd: state 3 (Disabled), hpd 1, pending_hpd_evt 1
[ 7659.707058] hpd: switching from state 3 (Disabled) to state 0 (Reset)
[ 7659.722953] tegra-xudc-new 700d0000.xudc: exiting ELPG done
[ 7659.728541] tegra-xudc-new 700d0000.xudc: vbus state: 0
[ 7659.733813] tegra_soctherm 700e2000.soctherm: thermtrip: will shut down when cpu reaches 102500 mC
[ 7659.742790] tegra_soctherm 700e2000.soctherm: throttrip: will throttle when cpu reaches 100500 mC
[ 7659.751664] tegra_soctherm 700e2000.soctherm: thermtrip: will shut down when gpu reaches 103000 mC
[ 7659.760625] tegra_soctherm 700e2000.soctherm: throttrip: will throttle when gpu reaches 101000 mC
[ 7659.769498] tegra_soctherm 700e2000.soctherm: thermtrip: will shut down when pll reaches 127000 mC
[ 7659.778453] tegra_soctherm 700e2000.soctherm: throttrip: pll: missing hot temperature
[ 7659.786285] tegra_cec 70015000.tegra_cec: Resuming
[ 7659.791094] tegra_cec 70015000.tegra_cec: tegra_cec_init started
[ 7659.791900] extcon-gpio-states extcon:extcon@1: Cable state:0, cable id:0
[ 7659.807938] hpd: state 0 (Reset), hpd 1, pending_hpd_evt 0
[ 7659.813431] extcon-disp-state extcon:disp-state: cable 44 state 0 already set.
[ 7659.815657] tegradc tegradc.0: read_edid_into_buffer: extension_blocks = 0, max_ext_blocks = 3
[ 7659.815661] tegradc tegradc.0: hdmi_recheck_edid: read_edid_into_buffer() returned 128
[ 7659.815664] tegradc tegradc.0: old edid len = 128
[ 7659.815668] tegradc tegradc.0: hdmi: No EDID change. No userspace active. Using cached mode to initialize dc!
[ 7659.851780] Extcon DP: HPD disabled
[ 7659.851781] hpd: hpd_switch 0
[ 7659.851784] hpd: switching from state 0 (Reset) to state 1 (Check Plug)
[ 7659.851791] hpd: state 1 (Check Plug), hpd 1, pending_hpd_evt 0
[ 7659.851795] hpd: switching from state 1 (Check Plug) to state 2 (Check EDID)
[ 7659.851839] tegradc tegradc.0: blank - powerdown
[ 7659.851847] tegradc tegradc.0: unblank
[ 7659.855947] hpd: state 2 (Check EDID), hpd 1, pending_hpd_evt 0
[ 7659.856497] tegradc tegradc.0: nominal-pclk:162560000 parent:162558750 div:1.0 pclk:162558750 160934400~177190400
[ 7659.856526] tegradc tegradc.0: hdmi: tmds rate:162560K prod-setting:prod_c_hdmi_150m_300m
[ 7659.856596] tegradc tegradc.1: dp: aux write retry (0x10000100) -- 2
[ 7659.858037] tegradc tegradc.1: dp: aux write retry (0x10000100) -- 1
[ 7659.859479] tegradc tegradc.1: dp: aux write retry (0x10000100) -- 0
[ 7659.860922] tegradc tegradc.1: dp: aux write got error (0x10000100)
[ 7659.860926] tegradc tegradc.1: dp: Failed to write DPCD data. CMD 0x600, Status 0x10000100
[ 7659.861568] tegradc tegradc.1: dp: aux write retry (0x10000100) -- 2
[ 7659.863014] tegradc tegradc.1: dp: aux write retry (0x10000100) -- 1
[ 7659.864462] tegradc tegradc.1: dp: aux write retry (0x10000100) -- 0
[ 7659.865907] tegradc tegradc.1: dp: aux write got error (0x10000100)
[ 7659.865910] tegradc tegradc.1: dp: Failed to write DPCD data. CMD 0x600, Status 0x10000100
[ 7659.866552] tegradc tegradc.1: dp: aux write retry (0x10000100) -- 2
[ 7659.868000] tegradc tegradc.1: dp: aux write retry (0x10000100) -- 1
[ 7659.869446] tegradc tegradc.1: dp: aux write retry (0x10000100) -- 0
[ 7659.870893] tegradc tegradc.1: dp: aux write got error (0x10000100)
[ 7659.870896] tegradc tegradc.1: dp: Failed to write DPCD data. CMD 0x600, Status 0x10000100
[ 7659.871538] tegradc tegradc.1: dp: aux write retry (0x10000100) -- 2
[ 7659.872985] tegradc tegradc.1: dp: aux write retry (0x10000100) -- 1
[ 7659.874427] tegradc tegradc.1: dp: aux write retry (0x10000100) -- 0
[ 7659.875885] tegradc tegradc.1: dp: aux write got error (0x10000100)
[ 7659.875888] tegradc tegradc.1: dp: Failed to write DPCD data. CMD 0x600, Status 0x10000100
[ 7659.875890] tegradc tegradc.1: dp: failed to exit panel power save mode (0xfffffff2)
[ 7659.875897] hpd: edid read prepare failed
[ 7659.875897] extcon-disp-state extcon:disp-state: cable 44 state 0 already set.
[ 7659.875898] Extcon DP: HPD disabled
[ 7659.875900] hpd: hpd_switch 0
[ 7659.875902] hpd: switching from state 2 (Check EDID) to state 3 (Disabled)
[ 7659.880240] usb 1-2: reset full-speed USB device number 2 using tegra-xusb
[ 7660.108434] extcon-disp-state extcon:disp-state: cable 51 state 1 already set.
[ 7660.115657] Extcon HDMI: HPD enabled
[ 7660.119236] tegradc tegradc.0: hdmi: plugged
[ 7660.123621] PM: resume of devices complete after 427.537 msecs
[ 7660.132132] PM: Finishing wakeup.
[ 7660.135466] Restarting tasks ... [ 7660.138872] usb usb2: usb_suspend_both: status 0
[ 7660.139419] done.
[ 7660.139471] tegra_soctherm 700e2000.soctherm: soctherm: trip temperature -2147483647 forced to -127000
[ 7660.139494] tegra_soctherm 700e2000.soctherm: soctherm: trip temperature -2147483647 forced to -127000
[ 7660.139507] tegra_soctherm 700e2000.soctherm: soctherm: trip temperature -2147483647 forced to -127000
[ 7660.143583] thermal thermal_zone6: failed to read out thermal zone (-5)
[ 7660.182891] tegra-xudc-new 700d0000.xudc: entering ELPG
[ 7660.189560] tegra_dvfs: resumed
[ 7660.189800] tegra-xudc-new 700d0000.xudc: entering ELPG done
[ 7660.198485] PM: suspend exit 2023-10-20 14:36:38.284834255 UTC
[ 7660.199123] tegradc tegradc.1: dp: aux read retry (0x10000100) -- 2
[ 7660.200629] tegradc tegradc.1: dp: aux read retry (0x10000100) -- 1
[ 7660.202085] tegradc tegradc.1: dp: aux read retry (0x10000100) -- 0
[ 7660.203570] tegradc tegradc.1: dp: aux read got error (0x10000100)
[ 7660.203574] tegradc tegradc.1: dp: Failed to read DPCD data. CMD 0x1, Status 0x10000100
[ 7660.203578] tegradc tegradc.1: dp: NV_DPCD_MAX_LINK_BANDWIDTH read failed
[ 7660.204235] tegradc tegradc.1: dp: aux read retry (0x10000100) -- 2
[ 7660.205707] tegradc tegradc.1: dp: aux read retry (0x10000100) -- 1
[ 7660.207170] tegradc tegradc.1: dp: aux read retry (0x10000100) -- 0
[ 7660.208584] tegradc tegradc.1: dp: aux read got error (0x10000100)
[ 7660.208588] tegradc tegradc.1: dp: Failed to read DPCD data. CMD 0x2, Status 0x10000100
[ 7660.208591] tegradc tegradc.1: dp: NV_DPCD_MAX_LANE_COUNT read failed
[ 7660.208595] tegradc tegradc.1: dp: Invalid link rate (0) or lane count (0)
[ 7660.239534] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[ 7660.240472] eth0: 0xffffff800a40d000, 48:b0:2d:e0:3c:8a, IRQ 406
[ 7660.307799] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[ 7660.309971] IPv6: ADDRCONF(NETDEV_UP): wlan0: link is not ready
[ 7660.312217] iwlwifi 0000:01:00.0: L1 Enabled - LTR Enabled
[ 7660.312844] iwlwifi 0000:01:00.0: L1 Enabled - LTR Enabled
[ 7660.450834] iwlwifi 0000:01:00.0: L1 Enabled - LTR Enabled
[ 7660.456935] iwlwifi 0000:01:00.0: L1 Enabled - LTR Enabled
[ 7660.528929] IPv6: ADDRCONF(NETDEV_UP): wlan0: link is not ready
[ 7660.611847] IPv6: ADDRCONF(NETDEV_UP): wlan0: link is not ready
[ 7660.816690] tegra_cec 70015000.tegra_cec: tegra_cec_init Done.
Hi,
It is actually a little weird that the log didn’t tell the wake up reason from PMC.
For example, if this is from usb driver to wake up your device, then there should be such log printed.
[ 583.205644] tegra-pmc: Resume caused by PMC WAKE40, xhci-hcd:usb1
this post as example:
we just plug out/in hdmi, but the system enter suspend mode for an unknown reason, and out again the suspend, help to analyze the attached log file. why it enter this mode.
line 1519:
[ 581.029365] PM: suspend entry 2022-08-27 07:26:33.813719216 UTC
[ 581.029369] PM: Syncing filesystems … done.
[ 581.111130] PM: Preparing system for sleep (mem)
line 1662:
[ 583.105832] PM: suspend of devices complete after 1385.706 msecs
[ 583.108074] host1x 50000000.host1x: suspended
[ 583.108275…
Thus, I feel this is not from the usb but something else from board design.
Remove all usb devices from the board.
If there is already no usb device on the board, disable the xhci and xudc node in your device tree. Your usb will be disabled afterwards.
What does the
sudo cat /sys/kernel/debug/wakeup_sources
command actually tell me?
We are not really using usb. Can we disable gpio-keys wakeup?
Hi,
wakeup_sources is not jetson specific function. This is from upstream linux kernel.
If I understand correctly, the one that records a wake event is the “wakeup_count” but not the active acount.
Now we have different output:
[ 184.478946] tegra-pmc: PMC wake status = 0x10000000000
Does this give you more information on what do we need to disable?
yes, if there is really no usb there, as I already told, you need to disable xhci and xudc driver in your device tree.
This requires basic knowledge about device tree which I am uncertain if you have it or not.
If you know how that works, then please modify it first. If you don’t know, then please tell us which part you don’t understand.
BTW, disable xhci and xudc is just a workaround to bypass your current situation. If you want to support usb in future, then it is something else.
I have some, but not much knowledge about device tree. I mainly modified camera parameters.
But I do find
xudc@700d0000 {
phys = <&{/xusb_padctl@7009f000/pads/usb2/lanes/usb2-0}>;
phy-names = "usb2";
charger-detector = <&tegra_usb_cd>;
#extcon-cells = <1>;
status = "okay";
};
Should I put status = “disabled”?
This is in tegra210-porg-p3448-common.dtsi.
Also I find this where wakeup is defined. Should I also disable this?
xusb@70090000 {
phys = <&{/xusb_padctl@7009f000/pads/usb2/lanes/usb2-0}>,
<&{/xusb_padctl@7009f000/pads/usb2/lanes/usb2-1}>,
<&{/xusb_padctl@7009f000/pads/usb2/lanes/usb2-2}>,
<&{/xusb_padctl@7009f000/pads/pcie/lanes/pcie-6}>;
phy-names = "usb2-0", "usb2-1", "usb2-2", "usb3-0";
#extcon-cells = <1>;
nvidia,pmc-wakeup =
<&tegra_pmc
PMC_WAKE_TYPE_EVENT 39 PMC_TRIGGER_TYPE_HIGH>,
<&tegra_pmc
PMC_WAKE_TYPE_EVENT 40 PMC_TRIGGER_TYPE_HIGH>,
<&tegra_pmc
PMC_WAKE_TYPE_EVENT 41 PMC_TRIGGER_TYPE_HIGH>,
<&tegra_pmc
PMC_WAKE_TYPE_EVENT 42 PMC_TRIGGER_TYPE_HIGH>,
<&tegra_pmc
PMC_WAKE_TYPE_EVENT 44 PMC_TRIGGER_TYPE_HIGH>;
nvidia,boost_cpu_freq = <1200>;
status = "okay";
};
That worked! Actually, I was wrong, we are using USB! We have a touch monitor, which is connected directly in electronics, that is why I did not remember. I will talk to my electrical engineer and continue investigating.
Any chance we can only disable wakeup in device tree?
Thank you very much so far! Your support helped a lot!
If you remove that nvidia-pmc-wakeup things from the device tree, then it shall not trigger the wake up.
Thanks a lot, that worked!