Hi,
We are trying to access an FPGA via PCIe. We have used an FPGA image that provides access to he FPGA registers via PCIe while the another image declares an error. Is it possible from the following log to understand why the NVidia is not able to access the PCIe Endpoint:
[ 13.233010] PCIE: tegra_pcie_probe(4664)
[ 13.233013] PCIE: tegra_pcie_read_plat_data(3216)
[ 13.233085] PCIE: tegra_pcie_parse_dt(3304)
[ 13.233211] tegra-pcie 10003000.pcie-controller: 4x1, 1x1 configuration
[ 13.233237] PCIE: tegra_pcie_probe_complete(4536)
[ 13.233239] PCIE: tegra_pcie_init(2824)
[ 13.233241] PCIE: tegra_pcie_get_resources(1935)
[ 13.233242] PCIE: tegra_pcie_get_clocks(1338)
[ 13.233980] PCIE: tegra_pcie_enable_regulators(1564)
[ 13.233985] tegra-pcie 10003000.pcie-controller: PCIE: Enable power rails
[ 13.234102] PCIE: tegra_pcie_power_on(1820)
[ 13.234107] PCIE: tegra_pcie_module_power_ungate(1731)
[ 13.234109] PCIE: tegra_pcie_enable_regulators(1564)
[ 13.235183] PCIE: tegra_pcie_restore_device(1772)
[ 13.235185] PCIE: tegra_pcie_map_resources(1609)
[ 13.235230] PCIE: tegra_pcie_enable_pads(1453)
[ 13.235311] PCIE: tegra_pcie_enable_controller(1496)
[ 13.235344] PCIE: tegra_pcie_enable_msi(3042)
[ 13.235403] PCIE: tegra_pcie_check_ports(2487)
[ 13.235409] tegra-pcie 10003000.pcie-controller: probing port 0, using 4 lanes
[ 13.235411] PCIE: tegra_pcie_port_enable(2019)
[ 13.235414] PCIE: tegra_pcie_port_reset(1990)
[ 13.236840] PCIE: tegra_pcie_enable_rp_features(2358)
[ 13.236854] PCIE: tegra_pcie_enable_aer(1104)
[ 13.236862] PCIE: tegra_pcie_apply_sw_war(2200)
[ 13.236965] PCIE: tegra_pcie_prsnt_map_override(1162)
[ 13.236970] tegra-pcie 10003000.pcie-controller: probing port 2, using 1 lanes
[ 13.236972] PCIE: tegra_pcie_port_enable(2019)
[ 13.236975] PCIE: tegra_pcie_port_reset(1990)
[ 13.239003] PCIE: tegra_pcie_enable_rp_features(2358)
[ 13.239018] PCIE: tegra_pcie_enable_aer(1104)
[ 13.239025] PCIE: tegra_pcie_apply_sw_war(2200)
[ 13.239129] PCIE: tegra_pcie_prsnt_map_override(1162)
[ 13.258900] hi8435rada spi3.0: hi-8435 we are here. check the device
[ 13.259001] hi8435rada spi3.0: Add device: hi8435rada0
[ 13.260600] spi-tegra114 3240000.spi: Setting clk_src clk_m
[ 13.261536] spi-tegra114 3240000.spi: The def 0x40408000 and written 0x40600807
[ 13.261618] spi-tegra114 3240000.spi: The def 0x40408000 and written 0x40600807
[ 13.261691] spi-tegra114 3240000.spi: The def 0x40408000 and written 0x40600807
[ 13.261782] spi-tegra114 3240000.spi: The def 0x40408000 and written 0x40600807
[ 13.265183] xhci-tegra 3530000.xhci: cannot find firmware....retry after 1 second
[ 13.422915] dhd_module_init in
[ 13.422947] tegra_net_perf_init: cannot get wifi sclk
[ 13.423047] found wifi platform device bcmdhd_wlan
[ 13.433472] gpio tegra-gpio-aon wake69 for gpio=59(FF:3)
[ 13.433480] wifi_platform_get_country_code_map: could not get country_code_map
[ 13.433482] wifi_plat_dev_drv_probe:platform country code map is not available
[ 13.433494] Power-up adapter 'DHD generic adapter'
[ 13.433534] wifi_platform_set_power = 1
[ 13.636851] wifi_platform_bus_enumerate device present 1
[ 13.654892] wifi_platform_bus_enumerate device present 0
[ 13.655286] F1 signature read @0x18000000=0x17214354
[ 13.658829] F1 signature OK, socitype:0x1 chip:0x4354 rev:0x1 pkg:0x2
[ 13.659311] DHD: dongle ram size is set to 786432(orig 786432) at 0x180000
[ 13.659367] wifi_platform_prealloc: failed to alloc static mem section 7
[ 13.659378] wifi_platform_get_mac_addr
[ 13.661100] CFG80211-ERROR) wl_setup_wiphy : Registering Vendor80211
[ 13.661303] wl_create_event_handler(): thread:wl_event_handler:211 started
[ 13.661388] CFG80211-ERROR) wl_event_handler : tsk Enter, tsk = 0xffffffc1e1621a70
[ 13.662667] dhd_attach(): thread:dhd_watchdog_thread:212 started
[ 13.662736] dhd_attach(): thread:dhd_dpc:218 started
[ 13.662776] dhd_attach(): thread:dhd_rxf:21a started
[ 13.662781] dhd_deferred_work_init: work queue initialized
[ 13.662946] Dongle Host Driver, version 1.201.82 (r)
[ 13.662946] Compiled in drivers/net/wireless/bcmdhd on Sep 18 2017 at 11:57:40
[ 13.663217] tegra_sysfs_register
[ 13.663242] Register interface [wlan0] MAC: 00:04:4b:8c:85:00
[ 13.663242]
[ 13.663245] dhd_prot_ioctl : bus is down. we have nothing to do
[ 13.663405] sdhci-tegra 3440000.sdhci: Tuning already done, restoring the best tap value : 70
[ 13.664446] wifi_platform_set_power = 0
[ 13.672475] tegra-pcie 10003000.pcie-controller: link 2 down, retrying
[ 13.672482] PCIE: tegra_pcie_port_reset(1990)
[ 14.076872] tegra-pcie 10003000.pcie-controller: link 2 down, retrying
[ 14.076878] PCIE: tegra_pcie_port_reset(1990)
[ 14.266950] xhci-tegra 3530000.xhci: Firmware timestamp: 2017-03-31 06:21:56 UTC, Version: 55.07 release
[ 14.268843] xhci-tegra 3530000.xhci: xHCI Host Controller
[ 14.268858] xhci-tegra 3530000.xhci: new USB bus registered, assigned bus number 1
[ 14.269664] xhci-tegra 3530000.xhci: hcc params 0x0184fd25 hci version 0x100 quirks 0x00010810
[ 14.269689] xhci-tegra 3530000.xhci: irq 152, io mem 0x03530000
[ 14.269808] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[ 14.269811] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 14.269813] usb usb1: Product: xHCI Host Controller
[ 14.269814] usb usb1: Manufacturer: Linux 4.4.38-DTRE-v0.1 xhci-hcd
[ 14.269816] usb usb1: SerialNumber: 3530000.xhci
[ 14.270098] hub 1-0:1.0: USB hub found
[ 14.270119] hub 1-0:1.0: 4 ports detected
[ 14.292970] xhci-tegra 3530000.xhci: xHCI Host Controller
[ 14.292978] xhci-tegra 3530000.xhci: new USB bus registered, assigned bus number 2
[ 14.293117] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003
[ 14.293120] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 14.293122] usb usb2: Product: xHCI Host Controller
[ 14.293124] usb usb2: Manufacturer: Linux 4.4.38-DTRE-v0.1 xhci-hcd
[ 14.293125] usb usb2: SerialNumber: 3530000.xhci
[ 14.293405] hub 2-0:1.0: USB hub found
[ 14.293423] hub 2-0:1.0: 3 ports detected
[ 14.293708] tegra-xotg xotg: otg: host 3530000.xhci registered
[ 14.482137] tegra-pcie 10003000.pcie-controller: link 2 down, retrying
[ 14.482142] PCIE: tegra_pcie_port_reset(1990)
[ 14.484170] tegra-pcie 10003000.pcie-controller: link 2 down, ignoring
[ 14.484173] PCIE: tegra_pcie_port_disable(2050)
[ 14.484208] PCIE: tegra_pcie_conf_gpios(2539)
[ 14.484211] PCIE: tegra_pcie_enable_msi(3042)
[ 14.484524] PCIE: tegra_pcie_setup(777)
[ 14.484569] PCIE: tegra_pcie_scan_bus(831)
[ 14.484688] PCIE: tegra_pcie_add_bus(811)
[ 14.484692] tegra-pcie 10003000.pcie-controller: PCI host bridge to bus 0000:00
[ 14.484697] pci_bus 0000:00: root bus resource [mem 0x50100000-0x57ffffff]
[ 14.484700] pci_bus 0000:00: root bus resource [mem 0x58000000-0x7fffffff pref]
[ 14.484705] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 14.484708] pci_bus 0000:00: root bus resource [io 0x1000-0xffff]
[ 14.484712] pci_bus 0000:00: scanning bus
[ 14.484740] pci 0000:00:01.0: [10de:10e5] type 01 class 0x060400
[ 14.484807] pci 0000:00:01.0: calling pci_fixup_ide_bases+0x0/0x50
[ 14.484869] pci 0000:00:01.0: PME# supported from D0 D1 D2 D3hot D3cold
[ 14.484876] pci 0000:00:01.0: PME# disabled
[ 14.485049] iommu: Adding device 0000:00:01.0 to group 55
[ 14.485134] pci_bus 0000:00: fixups for bus
[ 14.485139] pci 0000:00:01.0: scanning [bus 00-00] behind bridge, pass 0
[ 14.485143] pci 0000:00:01.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[ 14.485155] pci 0000:00:01.0: scanning [bus 00-00] behind bridge, pass 1
[ 14.485266] PCIE: tegra_pcie_add_bus(811)
[ 14.485268] PCIE: tegra_pcie_bus_alloc(605)
[ 14.485323] pci_bus 0000:01: scanning bus
[ 14.485351] pci 0000:01:00.0: [10ee:7024] type 00 class 0x058000
[ 14.485395] pci 0000:01:00.0: reg 0x10: [mem 0x00000000-0x007fffff]
[ 14.485469] pci 0000:01:00.0: calling pci_fixup_ide_bases+0x0/0x50
[ 14.485519] pci 0000:01:00.0: PME# supported from D0 D1 D2 D3hot
[ 14.485526] pci 0000:01:00.0: PME# disabled
[ 14.485604] iommu: Adding device 0000:01:00.0 to group 56
[ 14.492861] pci_bus 0000:01: fixups for bus
[ 14.492864] pci_bus 0000:01: bus scan returning with max=01
[ 14.492869] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 01
[ 14.492877] pci_bus 0000:00: bus scan returning with max=01
[ 14.492880] PCIE: tegra_pcie_configure_aspm(965)
[ 14.492889] PCIE: tegra_pcie_config_l1ss_l12_thtime(867)
[ 14.492895] PCIE: tegra_pcie_enable_ltr_support(888)
[ 14.492904] pci 0000:00:01.0: fixup irq: got 422
[ 14.492907] pci 0000:00:01.0: assigning IRQ 422
[ 14.492914] pci 0000:01:00.0: fixup irq: got 0
[ 14.492916] pci 0000:01:00.0: assigning IRQ 00
[ 14.492936] pci 0000:00:01.0: BAR 8: assigned [mem 0x50800000-0x50ffffff]
[ 14.492941] pci 0000:01:00.0: BAR 0: assigned [mem 0x50800000-0x50ffffff]
[ 14.492948] pci 0000:00:01.0: PCI bridge to [bus 01]
[ 14.492956] pci 0000:00:01.0: bridge window [mem 0x50800000-0x50ffffff]
[ 14.493033] pcieport 0000:00:01.0: enabling device (0000 -> 0002)
[ 14.493053] pcieport 0000:00:01.0: enabling bus mastering
[ 14.493157] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[ 14.493159] pci 0000:01:00.0: Signaling PME through PCIe PME interrupt
[ 14.493166] pcie_pme 0000:00:01.0:pcie01: service driver pcie_pme loaded
[ 14.493250] aer 0000:00:01.0:pcie02: service driver aer loaded
[ 14.493354] PCIE: tegra_pcie_enable_features(2808)
[ 14.493356] PCIE: tegra_pcie_link_speed(2793)
[ 14.493359] PCIE: tegra_pcie_change_link_speed(2706)
[ 14.493360] PCIE: tegra_pcie_change_link_speed(2706)
[ 14.493372] tegra-pcie 10003000.pcie-controller: speed change : Gen-1 -> Gen-2
[ 14.494514] PCIE: tegra_pcie_scale_voltage(2642)
[ 14.494736] PCIE: tegra_pcie_apply_sw_war(2200)
[ 14.496258] mcdgdriver 0000:01:00.0: enabling device (0000 -> 0002)
[ 14.506462] PCIE: tegra_pcie_isr(1248)
[ 14.506478] PCIE: tegra_pcie_isr(1248)
[ 14.506480] mcdgdriver 0000:01:00.0: MCDG FPGA version - PD350064-Vffff 21/07/10345 04:15
[ 14.506481] PCIE: handle_sb_intr(1204)
[ 14.506496] pcieport 0000:00:01.0: AER: Uncorrected (Non-Fatal) error received: id=0020
[ 14.506510] pcieport 0000:00:01.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0008(Requester ID)
[ 14.506513] pcieport 0000:00:01.0: device [10de:10e5] error status/mask=00004000/00000000
[ 14.506516] pcieport 0000:00:01.0: [14] Completion Timeout (First)
[ 14.506522] pcieport 0000:00:01.0: broadcast error_detected message
[ 14.506916] mcdgdriver 0000:01:00.0: Add device: mcdgMUX0
[ 14.507071] mcdgdriver 0000:01:00.0: Add device: mcdgMUX1
[ 14.507199] mcdgdriver 0000:01:00.0: Add device: mcdgMUX2
[ 14.507325] mcdgdriver 0000:01:00.0: Add device: mcdgMUX3
[ 14.507400] mcdgdriver 0000:01:00.0: Add device: mcdgMISC
[ 14.507417] pcieport 0000:00:01.0: AER: Device recovery failed
[ 14.580826] usb 1-2: new high-speed USB device number 2 using xhci-tegra
[ 14.625294] usb 2-1: new SuperSpeed USB device number 2 using xhci-tegra
[ 14.643718] usb 2-1: feature bit otg_vbus_off set
[ 14.643723] usb 2-1: New USB device found, idVendor=05e3, idProduct=0617
[ 14.643727] usb 2-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[ 14.643730] usb 2-1: Product: USB3.0 Hub
[ 14.643733] usb 2-1: Manufacturer: GenesysLogic
[ 14.644274] xhci-tegra 3530000.xhci: tegra_xhci_mbox_work mailbox command 6
[ 14.646798] hub 2-1:1.0: USB hub found
[ 14.647100] hub 2-1:1.0: 4 ports detected
[ 14.717186] usb 1-2: feature bit otg_vbus_off set
[ 14.717191] usb 1-2: New USB device found, idVendor=05e3, idProduct=0610
[ 14.717193] usb 1-2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[ 14.717195] usb 1-2: Product: USB2.0 Hub
[ 14.717197] usb 1-2: Manufacturer: GenesysLogic
[ 14.718202] hub 1-2:1.0: USB hub found
[ 14.719184] hub 1-2:1.0: 4 ports detected
[ 15.008816] usb 1-2.3: new low-speed USB device number 3 using xhci-tegra
[ 15.104756] usb 1-2.3: New USB device found, idVendor=03f0, idProduct=134a
[ 15.104759] usb 1-2.3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[ 15.104761] usb 1-2.3: Product: HP USB Optical Mouse
[ 15.104762] usb 1-2.3: Manufacturer: PixArt
[ 15.104949] usb 1-2.3: ep 0x81 - rounding interval to 64 microframes, ep desc says 80 microframes
[ 15.107477] input: PixArt HP USB Optical Mouse as /devices/3530000.xhci/usb1/1-2/1-2.3/1-2.3:1.0/0003:03F0:134A.0001/input/input4
[ 15.107592] hid-generic 0003:03F0:134A.0001: input,hidraw0: USB HID v1.11 Mouse [PixArt HP USB Optical Mouse] on usb-3530000.xhci-2.3/input0
[ 15.176817] usb 1-2.4: new low-speed USB device number 4 using xhci-tegra
[ 15.285113] usb 1-2.4: New USB device found, idVendor=03f0, idProduct=0024
[ 15.285115] usb 1-2.4: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[ 15.285117] usb 1-2.4: Product: HP Basic USB Keyboard
[ 15.285119] usb 1-2.4: Manufacturer: CHICONY
[ 15.285264] usb 1-2.4: ep 0x81 - rounding interval to 64 microframes, ep desc says 80 microframes
[ 15.290694] input: CHICONY HP Basic USB Keyboard as /devices/3530000.xhci/usb1/1-2/1-2.4/1-2.4:1.0/0003:03F0:0024.0002/input/input5
[ 15.345022] hid-generic 0003:03F0:0024.0002: input,hidraw1: USB HID v1.10 Keyboard [CHICONY HP Basic USB Keyboard] on usb-3530000.xhci-2.4/input0
[ 16.396584] xhci-tegra 3530000.xhci: tegra_xhci_mbox_work mailbox command 5
[ 16.396588] xhci-tegra 3530000.xhci: tegra_xhci_mbox_work ignore firmware MBOX_CMD_DEC_SSPI_CLOCK request
[ 18.568481] PCIE: tegra_pcie_isr(1248)
[ 18.578522] PCIE: tegra_pcie_isr(1248)
[ 18.588522] PCIE: tegra_pcie_isr(1248)
[ 18.598666] PCIE: tegra_pcie_isr(1248)
[ 18.608679] PCIE: tegra_pcie_isr(1248)
[ 18.618733] PCIE: tegra_pcie_isr(1248)
[ 18.628740] PCIE: tegra_pcie_isr(1248)
[ 18.638779] PCIE: tegra_pcie_isr(1248)
[ 18.648786] PCIE: tegra_pcie_isr(1248)
[ 18.658831] PCIE: tegra_pcie_isr(1248)
[ 18.668839] PCIE: tegra_pcie_isr(1248)
[ 18.678874] PCIE: tegra_pcie_isr(1248)
Thanks,
Igal