[370.28] with kernel [4.8] on >=2015 machines: driver claims card not supported if nvidia is not primary card

EDIT: The issue is described and debugged in
https://devtalk.nvidia.com/default/topic/971733/linux/-370-28-with-kernel-4-8-on-gt-2015-machines-driver-claims-card-not-supported-if-nvidia-is-not-primary-card/post/4999717/#4999717

Here the old first post:


Hi,

I did not see this card removed from the supported ones, and the PCI-ID also still listed
in the list of supported cards in appendix A, but here’s what I get with 370.28:

[   44.227550] nvidia: loading out-of-tree module taints kernel.
[   44.227554] nvidia: module license 'NVIDIA' taints kernel.
[   44.691748] nvidia 0000:01:00.0: enabling device (0000 -> 0003)
[   44.691837] NVRM: The NVIDIA GPU 0000:01:00.0 (PCI ID: 10de:139b)
               NVRM: installed in this system is not supported by the 370.28
               NVRM: NVIDIA Linux driver release.  Please see 'Appendix
               NVRM: A - Supported NVIDIA GPU Products' in this release's
               NVRM: README, available on the Linux driver download page
               NVRM: at www.nvidia.com.
[   44.691874] nvidia: probe of 0000:01:00.0 failed with error -1
[   44.691904] nvidia-nvlink: Nvlink Core is being initialized, major device number 244
[   44.691919] NVRM: The NVIDIA probe routine failed for 1 device(s).
[   44.691919] NVRM: None of the NVIDIA graphics adapters were initialized!
[   44.691921] nvidia-nvlink: Unregistered the Nvlink Core, major device number 244
[   44.692032] NVRM: NVIDIA init module failed!

Has support for this card really be removed, is this some regression
or is there something else wrong with my system?

Cheers,
Oliver

This happens sometimes if another system component (usually bbswitch) cuts power to the GPU before the driver is loaded. Can you please check to see if something like that is happening?

Thanks a lot for your reply!
Indeed this is a system with bbswitch / bumblebee.
To make sure this is not causing the issue, I have now removed the bumblebee-service from my init-system,
and bbswitch is also never loaded, i.e. I get no output from:

$ dmesg | grep bbs
$ lsmod | grep bbs

same for nvidia (since I do not load the driver / nvidia-persistenced).

lspci says:

01:00.0 3D controller: NVIDIA Corporation GM107M [GeForce GTX 960M] (rev a2)
        Subsystem: CLEVO/KAPOK Computer GM107M [GeForce GTX 960M]
        Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Interrupt: pin A routed to IRQ 16
        Region 0: [virtual] Memory at f5000000 (32-bit, non-prefetchable) 
        Region 1: Memory at e0000000 (64-bit, prefetchable) 
        Region 3: Memory at f0000000 (64-bit, prefetchable) 
        Region 5: I/O ports at e000 
        [virtual] Expansion ROM at f6000000 [disabled] 
        Capabilities: [60] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
                Address: 0000000000000000  Data: 0000
        Capabilities: [78] Express (v2) Endpoint, MSI 00
                DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s unlimited, L1 <64us
                        ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset- SlotPowerLimit 0.000W
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
                LnkCap: Port #0, Speed 8GT/s, Width x16, ASPM L0s L1, Exit Latency L0s <1us, L1 <4us
                        ClockPM+ Surprise- LLActRep- BwNot- ASPMOptComp+
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 8GT/s, Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                DevCap2: Completion Timeout: Range AB, TimeoutDis+, LTR+, OBFF Via message
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
                LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete+, EqualizationPhase1+
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Kernel modules: nvidia_drm, nvidia

So the card is in D0 state.

Now:

$ modprobe nvidia
modprobe: ERROR: could not insert 'nvidia': No such device
$ dmesg
...
[  309.870280] nvidia 0000:01:00.0: enabling device (0000 -> 0003)
[  309.870408] NVRM: The NVIDIA GPU 0000:01:00.0 (PCI ID: 10de:139b)
               NVRM: installed in this system is not supported by the 370.28
               NVRM: NVIDIA Linux driver release.  Please see 'Appendix
               NVRM: A - Supported NVIDIA GPU Products' in this release's
               NVRM: README, available on the Linux driver download page
               NVRM: at www.nvidia.com.
[  309.870465] nvidia: probe of 0000:01:00.0 failed with error -1
[  309.870508] nvidia-nvlink: Nvlink Core is being initialized, major device number 244
[  309.870530] NVRM: The NVIDIA probe routine failed for 1 device(s).
[  309.870531] NVRM: None of the NVIDIA graphics adapters were initialized!
[  309.870533] nvidia-nvlink: Unregistered the Nvlink Core, major device number 244
[  309.870714] NVRM: NVIDIA init module failed!

Other ideas?

This is a Gentoo Linux with kernel 4.8.0, and some months ago (with older kernels and drivers) I know the bumblebee-setup worked once. Sadly I did not write down the exact versions with which it worked…

EDIT: Just to confirm, after loading bbswitch manually after that test (with -1 options, so it should not touch card power state), and retrying to load nvidia, I get:

[  300.875227] bbswitch: version 0.8
[  300.875231] bbswitch: Found integrated VGA device 0000:00:02.0: \_SB_.PCI0.GFX0
[  300.875235] bbswitch: Found discrete VGA device 0000:01:00.0: \_SB_.PCI0.PEG0.PEGP
[  300.875244] ACPI Warning: \_SB.PCI0.PEG0.PEGP._DSM: Argument #4 type mismatch - Found [Buffer], ACPI requires [Package] (20160422/nsarguments-95)
[  300.875322] bbswitch: detected an Optimus _DSM function
[  301.331999] pci 0000:01:00.0: enabling device (0000 -> 0003)
[  301.332040] bbswitch: Succesfully loaded. Discrete card 0000:01:00.0 is on
[  311.763633] NVRM: The NVIDIA GPU 0000:01:00.0 (PCI ID: 10de:139b)
               NVRM: installed in this system is not supported by the 370.28
               NVRM: NVIDIA Linux driver release.  Please see 'Appendix
               NVRM: A - Supported NVIDIA GPU Products' in this release's
               NVRM: README, available on the Linux driver download page
               NVRM: at www.nvidia.com.
[  311.763641] nvidia: probe of 0000:01:00.0 failed with error -1
[  311.763666] nvidia-nvlink: Nvlink Core is being initialized, major device number 244
[  311.763688] NVRM: The NVIDIA probe routine failed for 1 device(s).
[  311.763688] NVRM: None of the NVIDIA graphics adapters were initialized!
[  311.763690] nvidia-nvlink: Unregistered the Nvlink Core, major device number 244
[  311.763781] NVRM: NVIDIA init module failed!

Oh well, that’s funny - sorry for double-posting, but this is new information!

Using kernel 4.7.2, even with the 370.28 driver, on the same machine, ALL IS FINE.
The card is detected well, and also bumblebee is working.

So now the question is: Is this a known issue with 4.8 or did I just hit some magic corner case?

I also use 4.8, though, on a different machine with a GK104M, almost same kernel config, same nvidia driver version, and there all is well…

EDIT: I am now running a kernel bisect, which (due to the manual testing) will likely finish sometime tomorrow evening.
It seems, from the first bisect steps, that the culprit is “somewhere” in the 4.8 PCI changes.
I’ll let you know once I have the commit which caused it.

@aplattner:
Bisect done. By now I also found a colleague with the same issue on a different machine, also with kernel 4.8.

The bisect left me with this “bad” commit:
“PCI: Add runtime PM support for PCIe ports”
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/commit/?id=006d44e49a259b39947366728d65a873a19aadc0

Indeed, I also looked at the other related commits and found:
“PCI: Put PCIe ports into D3 during suspend”
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/commit/?id=9d26d3a8f1b0c442339a235f9508bdad8af91043

And indeed, I can confirm that for me the workaround to use:
pcie_port_pm=off
as kernel option with a vanilla 4.8 kernel also works around the issue.

I guess to fix things either nvidia driver needs to disallow d3cold or do some magic to check card state and somehow wake it up if necessary.

The affected users are thus right now, I think:
Anybody using Kernel >=4.8, with a system for which the nvidia card is not the primary output (otherwise it could never enter D3), and a BIOS released >=2015 (there’s an ugly date-comparison in the second commit I linked :-( ).

I’ll for now use “pcie_port_pm=off” to work around this issue (and tell my colleague).
Since this sadly disables port_pm for all PCIE bridges, it would of course be nicer to have a better workaround / fix in the nvidia driver.

Thanks in advance,
Oliver

Hi,

I’ve updated the thread title to reflect the real issue now finally described in #5 .

By now, I found I’m not alone: this also affects several Manjaro users:


and

Cheers,
Oliver

Hi olifre,
We are trying to reproduce this issue.

  • Can we get detail reproduction steps ?
  • ALso nvidia bug report of the system on which issue reproduce?
  • What is the model of the system in which issue reproduce ?
  • Is OS need to be installed in UEFI mode?
  • Is the issue reproduce on other distros like Ubuntu, Fedora etc, OR its specific to Gentoo?
  • Is the kernel built with any custom config?

Hi sandipt,

thanks for your reply!
I’ll try to produce an nvidia-bug-report as soon as I can, in the meantime, here the information I have collected up to now:

  • Can we get detail reproduction steps ?

You need a kernel >= 4.8, on a machine with a BIOS released >= 2015.
This can be checked e.g. with ‘dmidecode -t bios’ and looking at the reported ‘Release Date: 09/24/2015’.

Alternatively, if the BIOS is older, you must use the kernel option ‘pcie_port_pm=force’ to trigger the described behaviour.

The system needs to have a different graphics adapter driving the main display,
i.e. the nvidia card must be unused during boot. To be safe, any nvidia module(s) and nouveau modules
must be blacklisted and of course nvidia-persistenced must be disabled.
This setup is common for everybody using bumblebee or turning the nvidia card off completely
for powersaving.
Remember I also tried with bbswitch blacklisted - bumblebee itself is definitely not causing the issue.

Enable runtime power management, e.g. using the “runtime-pm” module for laptop-mode-tools,
or manually using Intel’s “powertop” utility.

In my case, my BIOS also activated PCIe_ASPM for all ports. I am not sure whether the problem is also reproducible without this.

Finally, try to:
modprobe nvidia
to observe the issue.

  • What is the model of the system in which issue reproduce ?
    In my case, it’s an “Schenker XMG A305” (which is also known as “Clevo W230SD”).

  • Is OS need to be installed in UEFI mode?
    In my case, it is, but since the nvidia card is not used at all for booting (see requirement (2)) I am 99% sure this does not matter.

  • Is the issue reproduce on other distros like Ubuntu, Fedora etc, OR its specific to Gentoo?
    There are many reports here:
    https://github.com/Bumblebee-Project/Bumblebee/issues/810
    from other users using Fedora 24, Manjaro and Gentoo. They all seem affected after updating to kernels >= 4.8.
    I personally did only test Gentoo on my affected machine.

  • Is the kernel built with any custom config?
    In my case, fully custom - but as you can see from the linked other issues, in other cases, no.

However, as I have shown in my last post, the issue can be fully traced back to the commits:
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/commit/?id=006d44e49a259b39947366728d65a873a19aadc0
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/commit/?id=9d26d3a8f1b0c442339a235f9508bdad8af91043
which are reverted by forcing pcie_port_pm off.

I’ll try to produce an nvidia-bugreport later today and attach it then.

Cheers and good luck,
Oliver
nvidia-bug-report.log.gz (62 KB)

Hi @sandipt,

since I am not sure whether you get a notification once I add an attachment, I’m adding this post:
I have now attached nvidia-bug-report.log.gz to my preceding post.

I took this report on the affected machine after:

  • Blacklisting bbswitch and disabling bumblebee.
  • Removing any pci-power-management-related options from my kernel commandline.
  • Trying to “modprobe nvidia”, which fails (as expected).

I may in about 1 week or so remove the attachment, since it contains some hardware serials which I would not like to have uploaded permanently in this public location.

Cheers and good luck,
Oliver

I’m having the same issue on Fedora. I have a Clevo P650SE laptop with a GTX 970m. Everything worked fine until I updated to the 4.8 series kernel. After that, the nvidia driver module refused to load. bumblebee-nivida --debug gave the following output:

-> Kernel module compilation complete.
ERROR: Unable to load the kernel module 'nvidia.ko'.  This happens most frequently when this kernel module was built against the wrong or improperly configured kernel sources, with a version of gcc that differs from the one used to build the target kernel, or if a driver such as rivafb, nvidiafb, or nouveau is present and prevents the NVIDIA kernel module from obtaining ownership of the NVIDIA graphics device(s), or no NVIDIA GPU installed in this system is supported by this NVIDIA Linux graphics driver release.

Please see the log entries 'Kernel module load error' and 'Kernel messages' at the end of the file '/var/log/nvidia-installer.log' for more information.
-> Kernel module load error: No such device
-> Kernel messages:
[   56.053077] Disabling lock debugging due to kernel taint
[   56.498841] NVRM: The NVIDIA GPU 0000:01:00.0 (PCI ID: 10de:13d8)
               NVRM: installed in this system is not supported by the 367.57
               NVRM: NVIDIA Linux driver release.  Please see 'Appendix
               NVRM: A - Supported NVIDIA GPU Products' in this release's
               NVRM: README, available on the Linux driver download page
               NVRM: at www.nvidia.com.
[   56.498848] nvidia: probe of 0000:01:00.0 failed with error -1
[   56.498867] nvidia-nvlink: Nvlink Core is being initialized, major device number 241
[   56.498879] NVRM: The NVIDIA probe routine failed for 1 device(s).
[   56.498880] NVRM: None of the NVIDIA graphics adapters were initialized!
[   56.498881] nvidia-nvlink: Unregistered the Nvlink Core, major device number 241
[   56.498958] NVRM: NVIDIA init module failed!
[  114.312529] NVRM: The NVIDIA GPU 0000:01:00.0 (PCI ID: 10de:13d8)
               NVRM: installed in this system is not supported by the 367.57
               NVRM: NVIDIA Linux driver release.  Please see 'Appendix
               NVRM: A - Supported NVIDIA GPU Products' in this release's
               NVRM: README, available on the Linux driver download page
               NVRM: at www.nvidia.com.
[  114.312537] nvidia: probe of 0000:01:00.0 failed with error -1
[  114.312564] nvidia-nvlink: Nvlink Core is being initialized, major device number 241
[  114.312579] NVRM: The NVIDIA probe routine failed for 1 device(s).
[  114.312579] NVRM: None of the NVIDIA graphics adapters were initialized!
[  114.312580] nvidia-nvlink: Unregistered the Nvlink Core, major device number 241
[  114.312675] NVRM: NVIDIA init module failed!
ERROR: Installation has failed.  Please see the file '/var/log/nvidia-installer.log' for details.  You may find suggestions on fixing installation problems in the README available on the Linux driver download page at www.nvidia.com.

As suggested on the bumbleee project page, I added “pcie_port_pm=off” to the kernel command line, and tried again. With that, the driver module would install, but I still can’t run any program with the GPU. Trying to run “primusrun glxgears” or “optirun glxgears” produces the following output:

[seeker@ ~]$ primusrun glxgears
primus: fatal: Bumblebee daemon reported: error: [XORG] (EE) /dev/dri/card0: failed to set DRM interface version 1.4: Permission denied

[seeker@ ~]$ optirun glxgears
[ 4327.047321] [ERROR]Cannot access secondary GPU - error: [XORG] (EE) /dev/dri/card0: failed to set DRM interface version 1.4: Permission denied

[ 4327.047350] [ERROR]Aborting because fallback start is disabled.

As before, my discreet graphics indicator LED turns on when I run primus or optirun, showing that the Nvidia GPU is being turned on, even though I can’t actually run anything using it. After I get the error, the GPU no longer automatically turns itself off as it should.

lspci shows

00:02.0 VGA compatible controller: Intel Corporation 4th Gen Core Processor Integrated Graphics Controller (rev 06) (prog-if 00 [VGA controller])
01:00.0 3D controller: NVIDIA Corporation GM204M [GeForce GTX 970M] (rev a1)

dmesg shows

[    9.988290] bbswitch: loading out-of-tree module taints kernel.
[    9.988322] bbswitch: module verification failed: signature and/or required key missing - tainting kernel
[    9.988540] bbswitch: version 0.8
[    9.988544] bbswitch: Found integrated VGA device 0000:00:02.0: \_SB_.PCI0.GFX0
[    9.988548] bbswitch: Found discrete VGA device 0000:01:00.0: \_SB_.PCI0.PEG0.PEGP
[    9.988639] bbswitch: detected an Optimus _DSM function
[    9.988699] bbswitch: Succesfully loaded. Discrete card 0000:01:00.0 is on
[   54.998554] nvidia: module license 'NVIDIA' taints kernel.
[   55.004630] nvidia-nvlink: Nvlink Core is being initialized, major device number 241
[   55.004639] NVRM: loading NVIDIA UNIX x86_64 Kernel Module  367.57  Mon Oct  3 20:37:01 PDT 2016
[   55.006422] nvidia-uvm: Loaded the UVM driver in 8 mode, major device number 240
[   55.007437] nvidia-modeset: Loading NVIDIA Kernel Mode Setting Driver for UNIX platforms  367.57  Mon Oct  3 20:32:57 PDT 2016
[   55.008422] [drm] [nvidia-drm] [GPU ID 0x00000100] Loading driver
[   55.010013] [drm] [nvidia-drm] [GPU ID 0x00000100] Unloading driver
[   55.024548] nvidia-modeset: Unloading
[   55.040621] nvidia-uvm: Unloaded the UVM driver in 8 mode
[   55.056355] nvidia-nvlink: Unregistered the Nvlink Core, major device number 241
[   61.895758] nvidia-nvlink: Nvlink Core is being initialized, major device number 241
[   61.895766] NVRM: loading NVIDIA UNIX x86_64 Kernel Module  367.57  Mon Oct  3 20:37:01 PDT 2016
[   61.896699] nvidia-modeset: Loading NVIDIA Kernel Mode Setting Driver for UNIX platforms  367.57  Mon Oct  3 20:32:57 PDT 2016
[   61.897212] [drm] [nvidia-drm] [GPU ID 0x00000100] Loading driver
[   62.029862] [drm] [nvidia-drm] [GPU ID 0x00000100] Unloading driver
[   62.047556] nvidia-modeset: Unloading
[   62.063461] nvidia-nvlink: Unregistered the Nvlink Core, major device number 241
[   62.080374] bbswitch: disabling discrete graphics
[   74.894502] bbswitch: enabling discrete graphics
[   75.239416] nvidia-nvlink: Nvlink Core is being initialized, major device number 241
[   75.239424] NVRM: loading NVIDIA UNIX x86_64 Kernel Module  367.57  Mon Oct  3 20:37:01 PDT 2016

I’ve tried this on Fedora 24 and 25, with kernels 4.8.5, .6, and .7. I’m booting with UEFI. I did not have any issues before with the kernel 4.5, 4.6, or 4.7 series.

Same here on Fedora 24 with 367.57, kernel 4.8.6-201 and bumblebee from https://www.linux.ncsu.edu/bumblebee/

Kernels 4.7.x work fine on the same system with the same packages.

Dell Precision 7510 (0M91XC) A00, BIOS 1.8.3

UPD: This problem goes away with pcie_port_pm=off on 4.8.6 kernel.

nvidia-installer log file '/var/log/nvidia-installer.log'
creation time: Tue Nov  8 12:29:49 2016
installer version: 367.57

PATH: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin

nvidia-installer command line:
    ./nvidia-installer
    --accept-license
    --silent
    --no-x-check
    --no-nouveau-check
    --no-recursion
    --opengl-libdir=lib64/nvidia-bumblebee
    --opengl-prefix=/usr
    --x-library-path=lib64/nvidia-bumblebee
    --x-prefix=/usr
    --x-module-path=/usr/lib64/nvidia-bumblebee/xorg/modules
    --no-symlink-check
    --no-runtime-check

Using built-in stream user interface
-> Detected 8 CPUs online; setting concurrency level to 8.
-> The file '/tmp/.X0-lock' exists and appears to contain the process ID '1192' of a runnning X server.
-> Continuing per the '--no-x-check' option.
-> License accepted by command line option.
-> Installing NVIDIA driver version 367.57.
-> There appears to already be a driver installed on your system (version: 367.57).  As part of installing this driver (version: 367.57), the existing driver will be uninstalled.  Are you sure you want to continue? (Answer: Continue installation)
-> Would you like to register the kernel module sources with DKMS? This will allow DKMS to automatically build a new module, if you install a different kernel later. (Answer: No)
-> Performing CC sanity check with CC="/usr/bin/cc".
-> Kernel source path: '/lib/modules/4.8.6-201.fc24.x86_64/source'
-> Kernel output path: '/lib/modules/4.8.6-201.fc24.x86_64/build'
-> Performing rivafb check.
-> Performing nvidiafb check.
-> Performing Xen check.
-> Performing PREEMPT_RT check.
-> Cleaning kernel module build directory.
   executing: 'cd ./kernel; /usr/bin/make -k -j8 clean NV_EXCLUDE_KERNEL_MODULES="" SYSSRC="/lib/modules/4.8.6-201.fc24.x86_64/source" SYSOUT="/lib/modules/4.8.6-201.fc24.x86_64/build"'...
   rm -f -r conftest
   /usr/bin/make "CC=cc" KBUILD_OUTPUT=/lib/modules/4.8.6-201.fc24.x86_64/build KBUILD_VERBOSE= -C /lib/modules/4.8.6-201.fc24.x86_64/source M=/tmp/NVIDIA-Linux-x86_64-367.57/kernel ARCH=x86_64 NV_KERNEL_SOURCES=/lib/modules/4.8.6-201.fc24.x86_64/source NV_KERNEL_OUTPUT=/lib/modules/4.8.6-201.fc24.x86_64/build NV_KERNEL_MODULES="nvidia nvidia-uvm nvidia-modeset nvidia-drm" INSTALL_MOD_DIR=kernel/drivers/video clean
   make[1]: Entering directory '/usr/src/kernels/4.8.6-201.fc24.x86_64'
   make[2]: Entering directory '/usr/src/kernels/4.8.6-201.fc24.x86_64'
   make[2]: Leaving directory '/usr/src/kernels/4.8.6-201.fc24.x86_64'
   make[1]: Leaving directory '/usr/src/kernels/4.8.6-201.fc24.x86_64'
-> Building kernel modules
   executing: 'cd ./kernel; /usr/bin/make -k -j8  NV_EXCLUDE_KERNEL_MODULES="" SYSSRC="/lib/modules/4.8.6-201.fc24.x86_64/source" SYSOUT="/lib/modules/4.8.6-201.fc24.x86_64/build"'...
   /usr/bin/make "CC=cc" KBUILD_OUTPUT=/lib/modules/4.8.6-201.fc24.x86_64/build KBUILD_VERBOSE= -C /lib/modules/4.8.6-201.fc24.x86_64/source M=/tmp/NVIDIA-Linux-x86_64-367.57/kernel ARCH=x86_64 NV_KERNEL_SOURCES=/lib/modules/4.8.6-201.fc24.x86_64/source NV_KERNEL_OUTPUT=/lib/modules/4.8.6-201.fc24.x86_64/build NV_KERNEL_MODULES="nvidia nvidia-uvm nvidia-modeset nvidia-drm" INSTALL_MOD_DIR=kernel/drivers/video modules
   make[1]: Entering directory '/usr/src/kernels/4.8.6-201.fc24.x86_64'
   make[2]: Entering directory '/usr/src/kernels/4.8.6-201.fc24.x86_64'
     SYMLINK /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-kernel.o
     SYMLINK /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-modeset/nv-modeset-kernel.o
    CONFTEST: INIT_WORK
    CONFTEST: remap_pfn_range
    CONFTEST: follow_pfn
    CONFTEST: set_memory_uc
    CONFTEST: vmap
    CONFTEST: set_pages_uc
    CONFTEST: change_page_attr
    CONFTEST: set_memory_array_uc
    CONFTEST: pci_get_class
    CONFTEST: pci_choose_state
    CONFTEST: vm_insert_page
    CONFTEST: acpi_device_id
    CONFTEST: acquire_console_sem
    CONFTEST: console_lock
    CONFTEST: kmem_cache_create
    CONFTEST: on_each_cpu
    CONFTEST: smp_call_function
    CONFTEST: acpi_evaluate_integer
    CONFTEST: ioremap_cache
    CONFTEST: ioremap_wc
    CONFTEST: acpi_walk_namespace
    CONFTEST: pci_domain_nr
    CONFTEST: pci_dma_mapping_error
    CONFTEST: sg_alloc_table
    CONFTEST: sg_init_table
    CONFTEST: pci_get_domain_bus_and_slot
    CONFTEST: get_num_physpages
    CONFTEST: efi_enabled
    CONFTEST: proc_create_data
    CONFTEST: pde_data
    CONFTEST: proc_remove
    CONFTEST: pm_vt_switch_required
    CONFTEST: drm_driver_has_set_busid
    CONFTEST: xen_ioemu_inject_msi
    CONFTEST: phys_to_dma
    CONFTEST: get_dma_ops
    CONFTEST: write_cr4
    CONFTEST: of_parse_phandle
    CONFTEST: for_each_online_node
    CONFTEST: node_end_pfn
    CONFTEST: pci_bus_address
    CONFTEST: request_threaded_irq
    CONFTEST: remap_page_range
    CONFTEST: address_space_init_once
    CONFTEST: kbasename
    CONFTEST: fatal_signal_pending
    CONFTEST: list_cut_position
    CONFTEST: vzalloc
    CONFTEST: wait_on_bit_lock_argument_count
    CONFTEST: bitmap_clear
    CONFTEST: usleep_range
    CONFTEST: radix_tree_empty
    CONFTEST: drm_dev_unref
    CONFTEST: drm_atomic_set_mode_for_crtc
    CONFTEST: drm_reinit_primary_mode_group
    CONFTEST: drm_atomic_clean_old_fb
    CONFTEST: get_user_pages_remote
    CONFTEST: drm_gem_object_lookup
    CONFTEST: i2c_adapter
    CONFTEST: pm_message_t
    CONFTEST: irq_handler_t
    CONFTEST: acpi_device_ops
    CONFTEST: acpi_op_remove
    CONFTEST: outer_flush_all
    CONFTEST: proc_dir_entry
    CONFTEST: scatterlist
    CONFTEST: sg_table
    CONFTEST: file_operations
    CONFTEST: vm_operations_struct
    CONFTEST: atomic_long_type
    CONFTEST: pci_save_state
    CONFTEST: file_inode
    CONFTEST: task_struct
    CONFTEST: kuid_t
    CONFTEST: dma_ops
    CONFTEST: dma_map_ops
    CONFTEST: noncoherent_swiotlb_dma_ops
    CONFTEST: fault_flags
    CONFTEST: atomic64_type
    CONFTEST: address_space
    CONFTEST: backing_dev_info
    CONFTEST: kernel_write
    CONFTEST: strnstr
    CONFTEST: iterate_dir
    CONFTEST: kstrtoull
    CONFTEST: drm_bus_present
    CONFTEST: mm_context_t
    CONFTEST: drm_bus_has_bus_type
    CONFTEST: drm_bus_has_get_irq
    CONFTEST: drm_bus_has_get_name
    CONFTEST: drm_driver_has_legacy_dev_list
    CONFTEST: drm_crtc_state_has_connectors_changed
    CONFTEST: drm_init_functions_have_name_arg
    CONFTEST: drm_mode_connector_list_update_has_merge_type_bits_arg
    CONFTEST: drm_helper_mode_fill_fb_struct_has_const_mode_cmd_arg
    CONFTEST: dom0_kernel_present
    CONFTEST: drm_available
    CONFTEST: nvidia_grid_build
    CONFTEST: drm_atomic_available
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-frontend.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-instance.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-acpi.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-chrdev.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-cray.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-dma.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-gvi.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-i2c.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-mempool.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-mmap.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-p2p.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-pat.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-procfs.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-usermap.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-vm.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-vtophys.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/os-interface.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/os-mlock.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/os-pci.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/os-registry.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/os-usermap.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-modeset-interface.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-pci-table.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv_uvm_interface.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nvlink_linux.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nvlink_pci.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/ebridge_linux.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/ibmnpu_linux.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_utils.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_common.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_linux.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_page_migration.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_page_migration_stubs.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_page_migration_kepler.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_page_migration_maxwell.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_page_migration_pascal.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_channel_mgmt.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/nvstatus.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/nv-kthread-q.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/nv-kthread-q-selftest.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_common_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_channel_directed_tests.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_channel_basic_sanity_tests.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_kernel_events.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_kernel_counters.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_debug_session.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_gpu_ops_tests.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_lite.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_page_cache.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_lite_api.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_lite_prefetch.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_lite_region_tracking.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_mmu_mgmt_pascal.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_mmu_mgmt.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_mmu_mgmt_stubs.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_full_fault_buffer.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm_full_fault_buffer_pascal.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/mmu_fmt.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/gmmu_fmt.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_tools.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_global.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_gpu.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_procfs.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_va_space.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_gpu_semaphore.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_mem.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_rm_mem.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_channel.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_lock.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_hal.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_range_tree.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_range_allocator.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_va_range.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_va_block.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_range_group.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_gpu_page_fault.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_perf_events.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_perf_module.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_mmu.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_pte_batch.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_tlb_batch.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_push.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_pushbuffer.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_thread_context.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_tracker.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_kepler.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_kepler_ce.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_kepler_host.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_kepler_mmu.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_maxwell.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_maxwell_host.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_pascal.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_pascal_ce.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_pascal_host.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_pascal_mmu.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_pascal_fault_buffer.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_policy.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_perf_utils.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_kvmalloc.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_pmm_gpu.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_migrate.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_map_external.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_user_channel.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_hmm.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_perf_heuristics.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_perf_thrashing.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_perf_prefetch.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_test_rng.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_range_tree_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_range_allocator_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_gpu_semaphore_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_mem_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_rm_mem_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_page_tree_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_tracker_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_push_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_channel_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_ce_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_lock_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_perf_utils_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_kvmalloc_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_pmm_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_perf_events_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_perf_module_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_get_rm_ptes_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_fault_buffer_flush_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_mmu_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_peer_identity_mappings_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_va_block_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm/uvm8_range_group_tree_test.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-modeset/nvidia-modeset-linux.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-drm/nvidia-drm.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-drm/nvidia-drm-drv.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-drm/nvidia-drm-utils.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-drm/nvidia-drm-crtc.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-drm/nvidia-drm-encoder.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-drm/nvidia-drm-connector.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-drm/nvidia-drm-gem.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-drm/nvidia-drm-fb.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-drm/nvidia-drm-modeset.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-drm/nvidia-drm-mmap.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-drm/nvidia-drm-linux.o
     CC [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-drm/nv-pci-table.o
   ld -r -o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-interface.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-frontend.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-instance.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-acpi.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-chrdev.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-cray.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-dma.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-gvi.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-i2c.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-mempool.o /t
   mp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-mmap.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-p2p.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-pat.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-procfs.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-usermap.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-vm.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-vtophys.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/os-interface.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/os-mlock.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/os-pci.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/os-registry.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/os-usermap.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-modeset-interface.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv-pci-table.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nv_uvm_interface.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nvlink_linux.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/nvlink_pci.o /tmp/NVIDIA-Linux-x86_6
   4-367.57/kernel/nvidia/ebridge_linux.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia/ibmnpu_linux.o
   ld -r -o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-modeset/nv-modeset-interface.o /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-modeset/nvidia-modeset-linux.o
     LD [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia.o
     LD [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-modeset.o
     LD [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-drm.o
     LD [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm.o
     Building modules, stage 2.
     MODPOST 4 modules
     CC      /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-drm.mod.o
     CC      /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-modeset.mod.o
     CC      /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm.mod.o
     CC      /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia.mod.o
     LD [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-drm.ko
     LD [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia.ko
     LD [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-uvm.ko
     LD [M]  /tmp/NVIDIA-Linux-x86_64-367.57/kernel/nvidia-modeset.ko
   make[2]: Leaving directory '/usr/src/kernels/4.8.6-201.fc24.x86_64'
   make[1]: Leaving directory '/usr/src/kernels/4.8.6-201.fc24.x86_64'
-> done.
-> Kernel module compilation complete.
ERROR: Unable to load the kernel module 'nvidia.ko'.  This happens most frequently when this kernel module was built against the wrong or improperly configured kernel sources, with a version of gcc that differs from the one used to build the target kernel, or if a driver such as rivafb, nvidiafb, or nouveau is present and prevents the NVIDIA kernel module from obtaining ownership of the NVIDIA graphics device(s), or no NVIDIA GPU installed in this system is supported by this NVIDIA Linux graphics driver release.

Please see the log entries 'Kernel module load error' and 'Kernel messages' at the end of the file '/var/log/nvidia-installer.log' for more information.
-> Kernel module load error: No such device
-> Kernel messages:
[   73.757880] NVRM: The NVIDIA GPU 0000:01:00.0 (PCI ID: 10de:13b0)
               NVRM: installed in this system is not supported by the 367.57
               NVRM: NVIDIA Linux driver release.  Please see 'Appendix
               NVRM: A - Supported NVIDIA GPU Products' in this release's
               NVRM: README, available on the Linux driver download page
               NVRM: at www.nvidia.com.
[   73.757885] nvidia: probe of 0000:01:00.0 failed with error -1
[   73.757897] nvidia-nvlink: Nvlink Core is being initialized, major device number 238
[   73.757906] NVRM: The NVIDIA probe routine failed for 1 device(s).
[   73.757906] NVRM: None of the NVIDIA graphics adapters were initialized!
[   73.757907] nvidia-nvlink: Unregistered the Nvlink Core, major device number 238
[   73.757964] NVRM: NVIDIA init module failed!
[  180.055104] vgaarb: device changed decodes: PCI:0000:01:00.0,olddecodes=none,decodes=none:owns=none
[  180.055158] NVRM: The NVIDIA GPU 0000:01:00.0 (PCI ID: 10de:13b0)
               NVRM: installed in this system is not supported by the 367.57
               NVRM: NVIDIA Linux driver release.  Please see 'Appendix
               NVRM: A - Supported NVIDIA GPU Products' in this release's
               NVRM: README, available on the Linux driver download page
               NVRM: at www.nvidia.com.
[  180.055166] nvidia: probe of 0000:01:00.0 failed with error -1
[  180.055194] nvidia-nvlink: Nvlink Core is being initialized, major device number 238
[  180.055211] NVRM: The NVIDIA probe routine failed for 1 device(s).
[  180.055212] NVRM: None of the NVIDIA graphics adapters were initialized!
[  180.055213] nvidia-nvlink: Unregistered the Nvlink Core, major device number 238
[  180.055325] NVRM: NVIDIA init module failed!
ERROR: Installation has failed.  Please see the file '/var/log/nvidia-installer.log' for details.  You may find suggestions on fixing installation problems in the README available on the Linux driver download page at www.nvidia.com.

Olá, existe alguma incompatibilidade com o kernel 4.8 e o driver para a GTX 1070?
No UBUNTU 14.4.5 quando instalo o driver ele não faz login.

I am having the same problem i guess.
details about the problems posted at the arch forums

https://bbs.archlinux.org/viewtopic.php?id=219617

This issue was fixed for me with the 375.20 drivers.

Edit: to clarify, primus/optirun now works. I still require the pcie_port_pm=off workaround on the kernel command line.

I may have had two separate issues occur concurrently. The pcie pm issue with kernel 4.8, and incompatibility of xorg 1.19 with pre-375.20 version of the driver. At least it works now, but it’d be great if they could fix the drivers and/or bbswitch to work without disabling pcie power management.

We are tracking this issue under : 1835588

Hi Sandip,

any news here?

I’m still having this problem with 4.9 and 375.26 on openSUSE Tumbleweed. If I’m forcing the kernel to switch back the PM method the laptop starts up into rl3 and freezes before I can login.

The Laptop is a DELL Inspiron 15 Series 7000 (7559) with a GTX960M.

Thanks
Ale

Hi Anolting, Could you please explain your problem in detail? Also please share nvidia bug report when issue reproduced.

Hi everyone,

I came over this thread because I expierenced the same problem. My system consists of two gtx1080 and after I put pcie_port_pm=off in the kernel parameters one of the gpus seems to work just fine, but the other one still has the same problem.I know that both gpus are working in principal because after a reboot they sometimes switched places. I tried the driver versions 378.09-1 and 375.26-1 with the same error.

After loading the nvidia kernel module I get the following output on my dmesg:

[ 4387.022034] vgaarb: device changed decodes: PCI:0000:02:00.0,olddecodes=none,decodes=none:owns=none
[ 4387.022587] vgaarb: device changed decodes: PCI:0000:83:00.0,olddecodes=none,decodes=none:owns=none
[ 4387.022656] NVRM: The NVIDIA GPU 0000:83:00.0 (PCI ID: 10de:1b80)
NVRM: installed in this system is not supported by the 375.26
NVRM: NVIDIA Linux driver release. Please see ‘Appendix
NVRM: A - Supported NVIDIA GPU Products’ in this release’s
NVRM: README, available on the Linux driver download page
NVRM: at www.nvidia.com.
[ 4387.022817] nvidia: probe of 0000:83:00.0 failed with error -1
[ 4387.022876] nvidia-nvlink: Nvlink Core is being initialized, major device number 242
[ 4387.022930] NVRM: The NVIDIA probe routine failed for 1 device(s).
[ 4387.022935] NVRM: loading NVIDIA UNIX x86_64 Kernel Module 375.26 Thu Dec 8 18:36:43 PST 2016 (using threaded interrupts)

Kernel is the stock Archlinux Kernel: Linux gpu0 4.8.13-1-ARCH #1 SMP PREEMPT Fri Dec 9 07:24:34 CET 2016 x86_64 GNU/Linux

My system is a gpu server (Supermicro X9DRG-HF) running with Xeon E5-2690 v2 with a Bios from 10/22/2014. It runs in legacy mode.

I can provide more information if needed

dump.zip (61.7 KB)
nvidia-bug-report.log.gz (106 KB)

Hi All, Is this issue still reproduce with 375.39 and 378.13 driver? If yes, can someone provide simplified reproduction steps? As of now we are not able to repro this issue. Is the issue repro without bumblebee setup, without bumblebee modules? If you did some custom kernel config please share? Is this the issue repro with generic kernel also where no custom config? How we can check pcie_port_pm is on and active on OS? Please make sure to attach nvidia bug report.