PCIE export error

Autonomous Machines Jetson & Embedded Systems Jetson TX1
1

When our equipment operation after a period of time will have the error.And We have no insert any HDMI. Of course we are more concerned with is a PCIEexport mistake.What causes these mistakes?
Our equipment running outdoors Without adding any fan. These will have influence?

The logs is :

[   76.175920] nvmap_alloc_handle: PID 1837: ite_venc: WARNING: All NvMap Allocations must have a tag to identify the subsystem allocating memory.Plase pass the tag to the API call NvRmMemHanldeAllocAttr() or relevant. 
[   79.169794] nf_conntrack: automatic helper assignment is deprecated and it will be removed soon. Use the iptables CT target to attach helpers instead.
[   95.214928] tegra_mipi_cal 700e3000.mipical: Mipi cal timeout,val:1016ab0, lanes:3000000
[  609.763591] tegradc tegradc.1: blank - normal
[ 2359.260075] pcieport 0000:00:02.0: AER: Multiple Uncorrected (Non-Fatal) error received: id=0018
[ 2359.260095] pcieport 0000:00:02.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0010(Requester ID)
[ 2359.277333] pcieport 0000:00:02.0:   device [10de:0faf] error status/mask=00004000/00000000
[ 2359.295020] pcieport 0000:00:02.0:    [14] Completion Timeout     (First)
[ 2359.309512] pcieport 0000:00:02.0: broadcast error_detected message
[ 2359.309525] pcieport 0000:00:02.0: AER: Device recovery failed
[64471.232437] pcieport 0000:00:02.0: AER: Multiple Uncorrected (Non-Fatal) error received: id=0018
[64471.232460] pcieport 0000:00:02.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0010(Requester ID)
[64471.248591] pcieport 0000:00:02.0:   device [10de:0faf] error status/mask=00004000/00000000
[64471.267433] pcieport 0000:00:02.0:    [14] Completion Timeout     (First)
[64471.285069] pcieport 0000:00:02.0: broadcast error_detected message
[64471.285096] pcieport 0000:00:02.0: AER: Device recovery failed
[112419.229576] pcieport 0000:00:02.0: AER: Uncorrected (Non-Fatal) error received: id=0018
[112419.229592] pcieport 0000:00:02.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0010(Requester ID)
[112419.242311] pcieport 0000:00:02.0:   device [10de:0faf] error status/mask=00004000/00000000
[112419.251369] pcieport 0000:00:02.0:    [14] Completion Timeout     (First)
[112419.258683] pcieport 0000:00:02.0: broadcast error_detected message
[112419.258691] pcieport 0000:00:02.0: AER: Device recovery failed
[148417.740314] pcieport 0000:00:02.0: AER: Uncorrected (Non-Fatal) error received: id=0018
[148417.740331] pcieport 0000:00:02.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0010(Requester ID)
[148417.756474] pcieport 0000:00:02.0:   device [10de:0faf] error status/mask=00004000/00000000
[148417.783443] pcieport 0000:00:02.0:    [14] Completion Timeout     (First)
[148417.800159] pcieport 0000:00:02.0: broadcast error_detected message
[148417.800187] pcieport 0000:00:02.0: AER: Device recovery failed
[228471.899082] pcieport 0000:00:02.0: AER: Uncorrected (Non-Fatal) error received: id=0018
[228471.899138] pcieport 0000:00:02.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0010(Requester ID)
[228471.924582] pcieport 0000:00:02.0:   device [10de:0faf] error status/mask=00004000/00000000
[228471.963007] pcieport 0000:00:02.0:    [14] Completion Timeout     (First)
[228471.994876] pcieport 0000:00:02.0: broadcast error_detected message
[228471.994889] pcieport 0000:00:02.0: AER: Device recovery failed
[259332.211934] pcieport 0000:00:02.0: AER: Uncorrected (Non-Fatal) error received: id=0018
[259332.211952] pcieport 0000:00:02.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0010(Requester ID)
[259332.239915] pcieport 0000:00:02.0:   device [10de:0faf] error status/mask=00004000/00000000
[259332.283816] pcieport 0000:00:02.0:    [14] Completion Timeout     (First)
[259332.308887] pcieport 0000:00:02.0: broadcast error_detected message
[259332.308912] pcieport 0000:00:02.0: AER: Device recovery failed
[300293.459139] pcieport 0000:00:02.0: AER: Uncorrected (Non-Fatal) error received: id=0018
[300293.459202] pcieport 0000:00:02.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0010(Requester ID)
[300293.477361] pcieport 0000:00:02.0:   device [10de:0faf] error status/mask=00004000/00000000
[300293.491931] pcieport 0000:00:02.0:    [14] Completion Timeout     (First)
[300293.503101] pcieport 0000:00:02.0: broadcast error_detected message
[300293.503111] pcieport 0000:00:02.0: AER: Device recovery failed
[346082.358505] sdhci: ================== REGISTER DUMP (mmc1)==================
[346082.366995] sdhci: Sys addr[0x000]: 0x00000000 | Version[0x0fe]:  0x00000303
[346082.375375] sdhci: Blk size[0x004]: 0x00007080 | Blk cnt[0x006]:  0x00000000
[346082.383725] sdhci: Argument[0x008]: 0x12003e00 | Trn mode[0x00c]: 0x00000000
[346082.392054] sdhci: Present[0x024]:  0x01fb00f0 | Host ctl[0x028]: 0x00000013
[346082.400369] sdhci: Power[0x029]:    0x0000000d | Blk gap[0x02a]:  0x00000000
[346082.408682] sdhci: Wake-up[0x02b]:  0x00000000 | Clock[0x02c]:    0x00000007
[346082.416956] sdhci: Timeout[0x02e]:  0x0000000e | Int stat[0x030]: 0x00000000
[346082.425222] sdhci: Int enab[0x034]: 0x02ff000b | Sig enab[0x038]: 0x02fc000b
[346082.433457] sdhci: AC12 err[0x03c]: 0x00000000 | Slot int[0x0fc]: 0x00000000
[346082.441683] sdhci: Caps[0x040]:     0x376cd08c | Caps_1[0x044]:   0x10006f73
[346082.449900] sdhci: Cmd[0x00e]:      0x0000341a | Max curr[0x048]: 0x00000000
[346082.458092] sdhci: Host ctl2[0x03e]: 0x0000300b
[346082.463747] sdhci: ADMA Err[0x054]: 0x00000000 | ADMA Ptr[0x058]: 0xec100010
[346082.471927] mmc1: tuning_window[0]: 0x0
[346082.471937] mmc1: tuning_window[1]: 0x0
[346082.471946] mmc1: tuning_window[2]: 0x0
[346082.471955] mmc1: tuning_window[3]: 0x0
[346082.471964] mmc1: tuning_window[4]: 0x0
[346082.471973] mmc1: tuning_window[5]: 0x0
[346082.471982] mmc1: tuning_window[6]: 0x0
[346082.471991] mmc1: tuning_window[7]: 0x0
[346082.471996] sdhci: Tap value: 45 | Trim value: 8
[346082.472002] sdhci: SDMMC Interrupt status: 0x00040000
[346082.472005] sdhci: =========================================================
[346082.480187] mmc1: Command CRC error, intmask: 60001 Interface clock = 204000000Hz
[506996.049536] pcieport 0000:00:02.0: AER: Uncorrected (Non-Fatal) error received: id=0018
[506996.049552] pcieport 0000:00:02.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0010(Requester ID)
[506996.076589] pcieport 0000:00:02.0:   device [10de:0faf] error status/mask=00004000/00000000
[506996.106617] pcieport 0000:00:02.0:    [14] Completion Timeout     (First)
[506996.131175] pcieport 0000:00:02.0: broadcast error_detected message
[506996.131186] pcieport 0000:00:02.0: AER: Device recovery failed
[509972.547312] pcieport 0000:00:02.0: AER: Uncorrected (Non-Fatal) error received: id=0018
[509972.547329] pcieport 0000:00:02.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0010(Requester ID)
[509972.569227] pcieport 0000:00:02.0:   device [10de:0faf] error status/mask=00004000/00000000
[509972.592956] pcieport 0000:00:02.0:    [14] Completion Timeout     (First)
[509972.610782] pcieport 0000:00:02.0: broadcast error_detected message
[509972.610795] pcieport 0000:00:02.0: AER: Device recovery failed
[541916.448263] pcieport 0000:00:02.0: AER: Uncorrected (Non-Fatal) error received: id=0018
[541916.448279] pcieport 0000:00:02.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0010(Requester ID)
[541916.472851] pcieport 0000:00:02.0:   device [10de:0faf] error status/mask=00004000/00000000
[541916.490307] pcieport 0000:00:02.0:    [14] Completion Timeout     (First)
[541916.503008] pcieport 0000:00:02.0: broadcast error_detected message
[541916.503020] pcieport 0000:00:02.0: AER: Device recovery failed
[575114.371502] pcieport 0000:00:02.0: AER: Uncorrected (Non-Fatal) error received: id=0018
[575114.371522] pcieport 0000:00:02.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0010(Requester ID)
[575114.399241] pcieport 0000:00:02.0:   device [10de:0faf] error status/mask=00004000/00000000
[575114.413327] pcieport 0000:00:02.0:    [14] Completion Timeout     (First)
[575114.424731] pcieport 0000:00:02.0: broadcast error_detected message
[575114.424742] pcieport 0000:00:02.0: AER: Device recovery failed
[664363.656745] pcieport 0000:00:02.0: AER: Uncorrected (Non-Fatal) error received: id=0018
[664363.656760] pcieport 0000:00:02.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0010(Requester ID)
[664363.687104] pcieport 0000:00:02.0:   device [10de:0faf] error status/mask=00004000/00000000
[664363.721019] pcieport 0000:00:02.0:    [14] Completion Timeout     (First)
[664363.741403] pcieport 0000:00:02.0: broadcast error_detected message
[664363.741419] pcieport 0000:00:02.0: AER: Device recovery failed
[700654.600925] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700654.722083] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700654.775417] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700654.828584] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700654.836904] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700654.846982] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700654.885600] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700654.892100] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700654.942891] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700655.061764] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700655.180474] HDA: No HDMI device connected
[700655.181130] HDA: No HDMI device connected
[700655.181713] HDA: No HDMI device connected
[700988.985779] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700989.108378] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700989.172753] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700989.242904] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700989.259834] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700989.272305] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700989.330801] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700989.336155] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700989.400642] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700989.589553] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[700989.708033] HDA: No HDMI device connected
[701055.693702] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[701055.807784] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[701055.883551] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[701055.967859] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[701055.973930] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[701055.989353] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[701056.046724] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[701056.053387] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[701056.141646] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
[701056.349033] Setting clk_rate = 44100 Hz pll_a_out0 = 45158400 Hz clk_out = 11289600 Hz
2

You might want to give more information on what the PCIe card is. On that system, both before and after a PCIe error, you might want to also give a verbose lspci listing:

sudo lspci -vvv

Note that when you post a log you can highlight it with the mouse and then click on the “code” icon to keep it formatted and add scrollbars (the “</>” icon in the upper right of the reply text entry).

I doubt it matters, but you might also want to describe the power supply (e.g., trickle charged battery, pure power line, power that came with the dev kit, so on). If the error happens at some particular time of day (such as warmest hours or coldest hours) it might matter.

3

Our own PCIE equipment are our implementation of a video card equipment.Using hisi3519 chip as from equipment to make.
Pcie under normal circumstances of lspci -vvv is :

root@itarge-normal:/home/itarge# lspci -vvv
00:01.0 PCI bridge: NVIDIA Corporation Device 0fae (rev a1) (prog-if 00 [Normal decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Interrupt: pin A routed to IRQ 130
        Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
        I/O behind bridge: 0000f000-00000fff
        Memory behind bridge: 13000000-131fffff
        Prefetchable memory behind bridge: 0000000020000000-00000000207fffff
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity+ SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [40] Subsystem: NVIDIA Corporation Device 0000
        Capabilities: [48] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [50] MSI: Enable- Count=1/2 Maskable- 64bit+
                Address: 0000000000000000  Data: 0000
        Capabilities: [60] HyperTransport: MSI Mapping Enable- Fixed-
                Mapping Address Base: 00000000fee00000
        Capabilities: [80] Express (v2) Root Port (Slot+), MSI 00
                DevCap: MaxPayload 128 bytes, PhantFunc 0
                        ExtTag+ RBE+
                DevCtl: Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
                        RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
                LnkCap: Port #0, Speed 5GT/s, Width x4, ASPM L0s L1, Exit Latency L0s <512ns, L1 <4us
                        ClockPM- Surprise- LLActRep+ BwNot+ ASPMOptComp-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt+ ABWMgmt-
                SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
                        Slot #0, PowerLimit 0.000W; Interlock- NoCompl-
                SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                        Control: AttnInd Off, PwrInd On, Power- Interlock-
                SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
                        Changed: MRL- PresDet+ LinkState+
                RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-
                RootCap: CRSVisible-
                RootSta: PME ReqID 0000, PMEStatus- PMEPending-
                DevCap2: Completion Timeout: Range AB, TimeoutDis+, LTR+, OBFF Not Supported ARIFwd-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR+, OBFF Disabled ARIFwd-
                LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [100 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
        Capabilities: [140 v1] L1 PM Substates
                L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
                          PortCommonModeRestoreTime=30us PortTPowerOnTime=70us
        Kernel driver in use: pcieport
lspci: Unable to load libkmod resources: error -12

00:02.0 PCI bridge: NVIDIA Corporation Device 0faf (rev a1) (prog-if 00 [Normal decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Interrupt: pin A routed to IRQ 130
        Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
        I/O behind bridge: 0000f000-00000fff
        Memory behind bridge: 13200000-133fffff
        Prefetchable memory behind bridge: 0000000020800000-0000000020ffffff
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity+ SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [40] Subsystem: NVIDIA Corporation Device 0000
        Capabilities: [48] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [50] MSI: Enable- Count=1/2 Maskable- 64bit+
                Address: 0000000000000000  Data: 0000
        Capabilities: [60] HyperTransport: MSI Mapping Enable- Fixed-
                Mapping Address Base: 00000000fee00000
        Capabilities: [80] Express (v2) Root Port (Slot+), MSI 00
                DevCap: MaxPayload 128 bytes, PhantFunc 0
                        ExtTag+ RBE+
                DevCtl: Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
                        RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
                LnkCap: Port #1, Speed 5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <512ns, L1 <4us
                        ClockPM- Surprise- LLActRep+ BwNot+ ASPMOptComp-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt+ ABWMgmt-
                SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
                        Slot #0, PowerLimit 0.000W; Interlock- NoCompl-
                SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                        Control: AttnInd Off, PwrInd On, Power- Interlock-
                SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
                        Changed: MRL- PresDet+ LinkState+
                RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-
                RootCap: CRSVisible-
                RootSta: PME ReqID 0000, PMEStatus- PMEPending-
                DevCap2: Completion Timeout: Range AB, TimeoutDis+, LTR+, OBFF Not Supported ARIFwd-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR+, OBFF Disabled ARIFwd-
                LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [100 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
        Capabilities: [140 v1] L1 PM Substates
                L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
                          PortCommonModeRestoreTime=30us PortTPowerOnTime=70us
        Kernel driver in use: pcieport

01:00.0 Multimedia controller: Device 4954:3519 (rev 02)
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Interrupt: pin A routed to IRQ 547
        Region 0: Memory at 20000000 (32-bit, prefetchable) 
        Region 1: Memory at 13100000 (32-bit, non-prefetchable) 
        Region 2: Memory at 13000000 (32-bit, non-prefetchable) 
        Region 3: Memory at 13110000 (32-bit, non-prefetchable) 
        Region 4: Memory at 13120000 (32-bit, non-prefetchable) 
        Capabilities: [40] Power Management version 3
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=375mA PME(D0+,D1+,D2-,D3hot+,D3cold-)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
                Address: 000000017c93a000  Data: 0000
        Capabilities: [70] Express (v2) Endpoint, MSI 00
                DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s unlimited, L1 unlimited
                        ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
                LnkCap: Port #0, Speed 5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <1us, L1 <64us
                        ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR-, OBFF Not Supported
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
                LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [100 v2] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr+ BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
        Capabilities: [148 v1] L1 PM Substates
                L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2- ASPM_L1.1+ L1_PM_Substates+
                          PortCommonModeRestoreTime=10us PortTPowerOnTime=10us
        Kernel driver in use: itgcam

02:00.0 Multimedia controller: Device 4954:3519 (rev 02)
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Interrupt: pin A routed to IRQ 548
        Region 0: Memory at 20800000 (32-bit, prefetchable) 
        Region 1: Memory at 13300000 (32-bit, non-prefetchable) 
        Region 2: Memory at 13200000 (32-bit, non-prefetchable) 
        Region 3: Memory at 13310000 (32-bit, non-prefetchable) 
        Region 4: Memory at 13320000 (32-bit, non-prefetchable) 
        Capabilities: [40] Power Management version 3
                Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=375mA PME(D0+,D1+,D2-,D3hot+,D3cold-)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
                Address: 000000017c93a000  Data: 0001
        Capabilities: [70] Express (v2) Endpoint, MSI 00
                DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s unlimited, L1 unlimited
                        ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
                LnkCap: Port #0, Speed 5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <1us, L1 <64us
                        ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR-, OBFF Not Supported
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
                LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [100 v2] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr+ BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
        Capabilities: [148 v1] L1 PM Substates
                L1SubCap: P</li>

Is not normal because didn’t appear in the lab, also didn’t get to today.

4

I compared the pcie around the error information. used

sudo lspci -vvv

As shown below, the left is wrong after printing, the right to correct the information.
But what they represent?
https://screenshot.net/zh/lqxg3f5

5

It changes from having no uncorrectable errors to having some, and the first error pointer goes from NULL to an address. I can’t even guess what the cause is, I don’t know enough about your hardware. You might have some way of turning on verbose logging to get more details, but someone else will need to suggest how to increase logging.