5 GTX 1070 cards only 4 showing up as useable

Like the topic says I have 5 GTX 1070 graphics cards currently in my rig. When I execute

lspci |grep VGA
01:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1070] (rev a1)
02:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1070] (rev a1)
04:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1070] (rev a1)
06:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1070] (rev a1)
07:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1070] (rev a1)

5 Graphics cards show up like that but when I issue

nvidia-smi
Thu Mar 21 13:01:47 2019
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 418.56       Driver Version: 418.56       CUDA Version: 10.1     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  GeForce GTX 1070    Off  | 00000000:01:00.0 Off |                  N/A |
|  0%   48C    P0    31W / 151W |      0MiB /  8116MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+
|   1  GeForce GTX 1070    Off  | 00000000:02:00.0 Off |                  N/A |
|  0%   44C    P5     7W / 151W |      0MiB /  8119MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+
|   2  GeForce GTX 1070    Off  | 00000000:04:00.0 Off |                  N/A |
|  0%   47C    P5     9W / 151W |      0MiB /  8119MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+
|   3  GeForce GTX 1070    Off  | 00000000:06:00.0 Off |                  N/A |
|  0%   48C    P5     7W / 151W |      0MiB /  8119MiB |      5%      Default |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+

So I think I have tracked down the error but I am not 100% how I go about fixing it.

[ 1988.976244] NVRM: This PCI I/O region assigned to your NVIDIA device is invalid:
               NVRM: BAR1 is 0M @ 0x0 (PCI:0000:07:00.0)
[ 1988.976245] NVRM: The system BIOS may have misconfigured your GPU.
[ 1988.976248] nvidia: probe of 0000:07:00.0 failed with error -1
[ 1988.976259] NVRM: The NVIDIA probe routine failed for 1 device(s).

I have disabled the nouveau from both Grub and modprobe.d/blacklist.conf. My current specs on this computer is

MSI 170A Celeron i5 2.93Ghz
8GB of RAM
3TB Drive.

Any help is greatly appreciated if anyone has any pointers on where I can look. Thanks

This is outside my area of expertise, maybe another forum participant can provide deeper insights.

BAR stands base address register. It is used to specify a memory region for communication with peripheral devices, such as GPUs. As I recall (barely, vaguely) BAR0 is for memory mapped IO, and I think each GTX1070 requires 256MB of that, while BAR1 is for the video memory aperture.

This system may simply provide less BAR memory aperture than is required to support five GPUs. That wouldn’t surprise me given that it seems to be a low-end platform. You could check the system BIOS settings related to BAR usage, in case there are configurable items there.

This is a motherboard compatibility issue. The PnP BIOS in your motherboard has assigned 0 to the BAR in question. That is illegal/invalid, and is not something you can sort out via software. This is not a GPU or NVIDIA issue.

  1. Seek help from MSI
  2. Use a different motherboard
  3. Investigate your BIOS settings to see if anything affects this.

Thanks for the help it was a BIOS setting that I overlooked enabling the extra memory needed for more GPUs. Thanks

Can you tell me what version of the bios you are running and what setting you changed to solve this issue.