Two NVIDIA cards Base Mosaic / MultiGPU error "GPU PCI IDs do not match"

I tried to use two NVIDIA cards for lot monitors, but I got error.

Cards are Quadro2000 and GeForce GTX750Ti. Use nvidia driver on Linux 4.6.2-1 x86_64.
Distribution is Manjaro Linux stable latest.

I was going to use Base Mosaic, but I understood they don’t support NVIDIA Mosaic.
I use Xinerama with three screens now. It’s very unstable but work.
But I got same error when enabled Base Mosaic or MultiGPU.

[    24.048] (EE) NVIDIA(GPU-0): GPUs:
[    24.048] (EE) NVIDIA(GPU-0):     1) NVIDIA GPU at PCI:15:0:0
[    24.048] (EE) NVIDIA(GPU-0):     2) NVIDIA GPU at PCI:40:0:0
[    24.048] (EE) NVIDIA(GPU-0): Errors:
[    24.048] (EE) NVIDIA(GPU-0):     - GPU PCI IDs do not match

This is log when simply enabled MultiGPU.

[    21.864] 
X.Org X Server 1.17.4
Release Date: 2015-10-28
[    21.864] X Protocol Version 11, Revision 0
[    21.864] Build Operating System: Linux 4.2.5-1-ARCH x86_64 
[    21.864] Current Operating System: Linux mint 4.6.2-1-MANJARO #1 SMP PREEMPT Wed Jun 8 11:00:08 UTC 2016 x86_64
[    21.864] Kernel command line: BOOT_IMAGE=/vmlinuz-4.6-x86_64 root=/dev/mapper/ManjaroVG-ManjaroRoot rw cryptdevice=/dev/disk/by-uuid/8621f425-b092-44b7-8fdc-79f05108c25a:cryptManjaro resume=UUID=57a79e64-4586-4345-905f-e5ef72c5b8de quiet splash nomodeset nokmsboot
[    21.864] Build Date: 01 November 2015  10:36:50AM
[    21.864]  
[    21.864] Current version of pixman: 0.34.0
[    21.864] 	Before reporting problems, check http://wiki.x.org
	to make sure that you have the latest version.
[    21.864] Markers: (--) probed, (**) from config file, (==) default setting,
	(++) from command line, (!!) notice, (II) informational,
	(WW) warning, (EE) error, (NI) not implemented, (??) unknown.
[    21.864] (==) Log file: "/var/log/Xorg.0.log", Time: Mon Jul 18 20:17:09 2016
[    21.868] (==) Using config directory: "/etc/X11/xorg.conf.d"
[    21.868] (==) Using system config directory "/usr/share/X11/xorg.conf.d"
[    21.871] (==) ServerLayout "Layout0"
[    21.871] (**) |-->Screen "Screen0" (0)
[    21.871] (**) |   |-->Monitor "Monitor0"
[    21.874] (**) |   |-->Device "Device0"
[    21.874] (**) |-->Input Device "Keyboard0"
[    21.874] (**) |-->Input Device "Mouse0"
[    21.874] (==) Automatically adding devices
[    21.874] (==) Automatically enabling devices
[    21.874] (==) Automatically adding GPU devices
[    21.876] (WW) `fonts.dir' not found (or not valid) in "/usr/share/fonts/100dpi/".
[    21.876] 	Entry deleted from font path.
[    21.876] 	(Run 'mkfontdir' on "/usr/share/fonts/100dpi/").
[    21.876] (WW) `fonts.dir' not found (or not valid) in "/usr/share/fonts/75dpi/".
[    21.876] 	Entry deleted from font path.
[    21.876] 	(Run 'mkfontdir' on "/usr/share/fonts/75dpi/").
[    21.876] (==) FontPath set to:
	/usr/share/fonts/misc/,
	/usr/share/fonts/TTF/,
	/usr/share/fonts/OTF/,
	/usr/share/fonts/Type1/
[    21.876] (==) ModulePath set to "/usr/lib/xorg/modules"
[    21.876] (**) Extension "Composite" is enabled
[    21.876] (WW) Hotplugging is on, devices using drivers 'kbd', 'mouse' or 'vmmouse' will be disabled.
[    21.876] (WW) Disabling Keyboard0
[    21.876] (WW) Disabling Mouse0
[    21.877] (II) Loader magic: 0x817d60
[    21.877] (II) Module ABI versions:
[    21.877] 	X.Org ANSI C Emulation: 0.4
[    21.877] 	X.Org Video Driver: 19.0
[    21.877] 	X.Org XInput driver : 21.1
[    21.877] 	X.Org Server Extension : 9.0
[    21.878] (EE) systemd-logind: failed to get session: PID 965 does not belong to any known session
[    21.880] (--) PCI:*(0:15:0:0) 10de:0dd8:103c:084a rev 161, Mem @ 0xe2000000/33554432, 0xc8000000/134217728, 0xc4000000/67108864, I/O @ 0x0000d000/128, BIOS @ 0x????????/131072
[    21.880] (--) PCI: (0:40:0:0) 10de:1380:19da:1346 rev 162, Mem @ 0xe5000000/16777216, 0xd0000000/268435456, 0xe0000000/33554432, I/O @ 0x0000e000/128, BIOS @ 0x????????/524288
[    21.880] (WW) Open ACPI failed (/var/run/acpid.socket) (No such file or directory)
[    21.881] (II) LoadModule: "glx"
[    21.889] (II) Loading /usr/lib/xorg/modules/extensions/libglx.so
[    22.048] (II) Module glx: vendor="NVIDIA Corporation"
[    22.048] 	compiled for 4.0.2, module version = 1.0.0
[    22.048] 	Module class: X.Org Server Extension
[    22.050] (II) NVIDIA GLX Module  364.19  Tue Apr 19 14:10:52 PDT 2016
[    22.052] (II) LoadModule: "nvidia"
[    22.052] (II) Loading /usr/lib/xorg/modules/drivers/nvidia_drv.so
[    22.070] (II) Module nvidia: vendor="NVIDIA Corporation"
[    22.070] 	compiled for 4.0.2, module version = 1.0.0
[    22.070] 	Module class: X.Org Video Driver
[    22.072] (II) NVIDIA dlloader X Driver  364.19  Tue Apr 19 13:48:55 PDT 2016
[    22.072] (II) NVIDIA Unified Driver for all Supported NVIDIA GPUs
[    22.073] (++) using VT number 7

[    22.277] (II) Loading sub module "fb"
[    22.277] (II) LoadModule: "fb"
[    22.279] (II) Loading /usr/lib/xorg/modules/libfb.so
[    22.283] (II) Module fb: vendor="X.Org Foundation"
[    22.283] 	compiled for 1.17.4, module version = 1.0.0
[    22.283] 	ABI class: X.Org ANSI C Emulation, version 0.4
[    22.283] (II) Loading sub module "wfb"
[    22.283] (II) LoadModule: "wfb"
[    22.283] (II) Loading /usr/lib/xorg/modules/libwfb.so
[    22.288] (II) Module wfb: vendor="X.Org Foundation"
[    22.288] 	compiled for 1.17.4, module version = 1.0.0
[    22.288] 	ABI class: X.Org ANSI C Emulation, version 0.4
[    22.288] (II) Loading sub module "ramdac"
[    22.288] (II) LoadModule: "ramdac"
[    22.288] (II) Module "ramdac" already built-in
[    22.295] (**) NVIDIA(0): Depth 24, (--) framebuffer bpp 32
[    22.295] (==) NVIDIA(0): RGB weight 888
[    22.295] (==) NVIDIA(0): Default visual is TrueColor
[    22.295] (==) NVIDIA(0): Using gamma correction (1.0, 1.0, 1.0)
[    22.297] (**) NVIDIA(0): Option "NoLogo" "1"
[    22.297] (**) NVIDIA(0): Option "MultiGPU" "on"
[    22.297] (**) NVIDIA(0): NVIDIA Multi-GPU auto-select rendering option.
[    22.298] (**) NVIDIA(0): Enabling 2D acceleration
[    24.048] (EE) NVIDIA(GPU-0): Failed to find a valid Multi-GPU configuration.
[    24.048] (EE) NVIDIA(GPU-0): Invalid Multi-GPU configuration 1 of 1:
[    24.048] (EE) NVIDIA(GPU-0): GPUs:
[    24.048] (EE) NVIDIA(GPU-0):     1) NVIDIA GPU at PCI:15:0:0
[    24.048] (EE) NVIDIA(GPU-0):     2) NVIDIA GPU at PCI:40:0:0
[    24.048] (EE) NVIDIA(GPU-0): Errors:
[    24.048] (EE) NVIDIA(GPU-0):     - GPU PCI IDs do not match
[    24.048] (WW) NVIDIA(GPU-0): Failed to find a valid Multi-GPU configuration for the NVIDIA
[    24.048] (WW) NVIDIA(GPU-0):     graphics device PCI:15:0:0. Please see Chapter 28:
[    24.048] (WW) NVIDIA(GPU-0):     Configuring SLI and Multi-GPU FrameRendering in the README
[    24.048] (WW) NVIDIA(GPU-0):     for troubleshooting suggestions.

and one when enabled Base Mosaic with nvidia-settings.

[    20.386] 
X.Org X Server 1.17.4
Release Date: 2015-10-28
[    20.386] X Protocol Version 11, Revision 0
[    20.386] Build Operating System: Linux 4.2.5-1-ARCH x86_64 
[    20.386] Current Operating System: Linux mint 4.6.2-1-MANJARO #1 SMP PREEMPT Wed Jun 8 11:00:08 UTC 2016 x86_64
[    20.386] Kernel command line: BOOT_IMAGE=/vmlinuz-4.6-x86_64 root=/dev/mapper/ManjaroVG-ManjaroRoot rw cryptdevice=/dev/disk/by-uuid/8621f425-b092-44b7-8fdc-79f05108c25a:cryptManjaro resume=UUID=57a79e64-4586-4345-905f-e5ef72c5b8de quiet splash nomodeset nokmsboot
[    20.386] Build Date: 01 November 2015  10:36:50AM
[    20.386]  
[    20.386] Current version of pixman: 0.34.0
[    20.386] 	Before reporting problems, check http://wiki.x.org
	to make sure that you have the latest version.
[    20.386] Markers: (--) probed, (**) from config file, (==) default setting,
	(++) from command line, (!!) notice, (II) informational,
	(WW) warning, (EE) error, (NI) not implemented, (??) unknown.
[    20.386] (==) Log file: "/var/log/Xorg.0.log", Time: Sat Jul 16 12:02:14 2016
[    20.390] (==) Using config directory: "/etc/X11/xorg.conf.d"
[    20.390] (==) Using system config directory "/usr/share/X11/xorg.conf.d"
[    20.393] (==) ServerLayout "Layout0"
[    20.393] (**) |-->Screen "Screen0" (0)
[    20.393] (**) |   |-->Monitor "Monitor0"
[    20.396] (**) |   |-->Device "Device0"
[    20.396] (**) |-->Input Device "Keyboard0"
[    20.396] (**) |-->Input Device "Mouse0"
[    20.396] (**) Option "Xinerama" "0"
[    20.396] (==) Automatically adding devices
[    20.396] (==) Automatically enabling devices
[    20.396] (==) Automatically adding GPU devices
[    20.401] (WW) `fonts.dir' not found (or not valid) in "/usr/share/fonts/100dpi/".
[    20.401] 	Entry deleted from font path.
[    20.401] 	(Run 'mkfontdir' on "/usr/share/fonts/100dpi/").
[    20.402] (WW) `fonts.dir' not found (or not valid) in "/usr/share/fonts/75dpi/".
[    20.402] 	Entry deleted from font path.
[    20.402] 	(Run 'mkfontdir' on "/usr/share/fonts/75dpi/").
[    20.402] (==) FontPath set to:
	/usr/share/fonts/misc/,
	/usr/share/fonts/TTF/,
	/usr/share/fonts/OTF/,
	/usr/share/fonts/Type1/
[    20.402] (==) ModulePath set to "/usr/lib/xorg/modules"
[    20.402] (WW) Hotplugging is on, devices using drivers 'kbd', 'mouse' or 'vmmouse' will be disabled.
[    20.402] (WW) Disabling Keyboard0
[    20.402] (WW) Disabling Mouse0
[    20.402] (II) Loader magic: 0x817d60
[    20.402] (II) Module ABI versions:
[    20.402] 	X.Org ANSI C Emulation: 0.4
[    20.402] 	X.Org Video Driver: 19.0
[    20.402] 	X.Org XInput driver : 21.1
[    20.402] 	X.Org Server Extension : 9.0
[    20.403] (EE) systemd-logind: failed to get session: PID 851 does not belong to any known session
[    20.405] (--) PCI:*(0:15:0:0) 10de:0dd8:103c:084a rev 161, Mem @ 0xe2000000/33554432, 0xc8000000/134217728, 0xc4000000/67108864, I/O @ 0x0000d000/128, BIOS @ 0x????????/131072
[    20.405] (--) PCI: (0:40:0:0) 10de:1380:19da:1346 rev 162, Mem @ 0xe5000000/16777216, 0xd0000000/268435456, 0xe0000000/33554432, I/O @ 0x0000e000/128, BIOS @ 0x????????/524288
[    20.405] (WW) Open ACPI failed (/var/run/acpid.socket) (No such file or directory)
[    20.406] (II) LoadModule: "glx"
[    20.413] (II) Loading /usr/lib/xorg/modules/extensions/libglx.so
[    20.557] (II) Module glx: vendor="NVIDIA Corporation"
[    20.557] 	compiled for 4.0.2, module version = 1.0.0
[    20.557] 	Module class: X.Org Server Extension
[    20.559] (II) NVIDIA GLX Module  364.19  Tue Apr 19 14:10:52 PDT 2016
[    20.570] (II) LoadModule: "nvidia"
[    20.571] (II) Loading /usr/lib/xorg/modules/drivers/nvidia_drv.so
[    20.588] (II) Module nvidia: vendor="NVIDIA Corporation"
[    20.588] 	compiled for 4.0.2, module version = 1.0.0
[    20.588] 	Module class: X.Org Video Driver
[    20.590] (II) NVIDIA dlloader X Driver  364.19  Tue Apr 19 13:48:55 PDT 2016
[    20.590] (II) NVIDIA Unified Driver for all Supported NVIDIA GPUs
[    20.591] (++) using VT number 7

[    20.795] (II) Loading sub module "fb"
[    20.795] (II) LoadModule: "fb"
[    20.797] (II) Loading /usr/lib/xorg/modules/libfb.so
[    20.800] (II) Module fb: vendor="X.Org Foundation"
[    20.800] 	compiled for 1.17.4, module version = 1.0.0
[    20.800] 	ABI class: X.Org ANSI C Emulation, version 0.4
[    20.800] (II) Loading sub module "wfb"
[    20.800] (II) LoadModule: "wfb"
[    20.801] (II) Loading /usr/lib/xorg/modules/libwfb.so
[    20.805] (II) Module wfb: vendor="X.Org Foundation"
[    20.805] 	compiled for 1.17.4, module version = 1.0.0
[    20.805] 	ABI class: X.Org ANSI C Emulation, version 0.4
[    20.805] (II) Loading sub module "ramdac"
[    20.805] (II) LoadModule: "ramdac"
[    20.805] (II) Module "ramdac" already built-in
[    20.812] (**) NVIDIA(0): Depth 24, (--) framebuffer bpp 32
[    20.812] (==) NVIDIA(0): RGB weight 888
[    20.812] (==) NVIDIA(0): Default visual is TrueColor
[    20.812] (==) NVIDIA(0): Using gamma correction (1.0, 1.0, 1.0)
[    20.814] (**) NVIDIA(0): Option "Stereo" "0"
[    20.814] (**) NVIDIA(0): Option "nvidiaXineramaInfoOrder" "DFP-0"
[    20.814] (**) NVIDIA(0): Option "SLI" "off"
[    20.814] (**) NVIDIA(0): Option "MultiGPU" "Off"
[    20.814] (**) NVIDIA(0): Option "BaseMosaic" "on"
[    20.814] (**) NVIDIA(0): Stereo disabled by request
[    20.815] (**) NVIDIA(0): NVIDIA SLI disabled.
[    20.815] (**) NVIDIA(0): NVIDIA Multi-GPU disabled.
[    20.815] (**) NVIDIA(0): Option "MetaModes" "GPU-e85b6d81-cd8a-863c-9de4-f02b26aefc6e.DVI-I-1: nvidia-auto-select +0+0, GPU-e85b6d81-cd8a-863c-9de4-f02b26aefc6e.DP-0: nvidia-auto-select +1920+0, GPU-a26d8e50-e07f-4980-899e-201371772a1d.HDMI-0: nvidia-auto-select +3840+0"
[    20.815] (**) NVIDIA(0): Enabling 2D acceleration
[    22.573] (EE) NVIDIA(GPU-0): Failed to find a valid Base Mosaic configuration.
[    22.573] (EE) NVIDIA(GPU-0): Invalid Base Mosaic configuration 1 of 1:
[    22.573] (EE) NVIDIA(GPU-0): GPUs:
[    22.573] (EE) NVIDIA(GPU-0):     1) NVIDIA GPU at PCI:15:0:0
[    22.573] (EE) NVIDIA(GPU-0):     2) NVIDIA GPU at PCI:40:0:0
[    22.573] (EE) NVIDIA(GPU-0): Errors:
[    22.573] (EE) NVIDIA(GPU-0):     - GPU PCI IDs do not match
[    22.573] (WW) NVIDIA(GPU-0): Failed to find a valid Base Mosaic configuration for the
[    22.573] (WW) NVIDIA(GPU-0):     NVIDIA graphics device PCI:15:0:0. Please see Chapter 28:
[    22.573] (WW) NVIDIA(GPU-0):     Configuring SLI and Multi-GPU FrameRendering in the README
[    22.573] (WW) NVIDIA(GPU-0):     for troubleshooting suggestions.

Logs says

[    22.573] (EE) NVIDIA(GPU-0):     1) NVIDIA GPU at PCI:15:0:0
[    22.573] (EE) NVIDIA(GPU-0):     2) NVIDIA GPU at PCI:40:0:0

but lspci says different thing.

$ lspci | grep VGA
0f:00.0 VGA compatible controller: NVIDIA Corporation GF106GL [Quadro 2000] (rev a1)
28:00.0 VGA compatible controller: NVIDIA Corporation GM107 [GeForce GTX 750 Ti] (rev a2)

If write 0f:00:0 or 28:00:0 to BusID, didn’t start X.

[    56.257] 
X.Org X Server 1.17.4
Release Date: 2015-10-28
[    56.257] X Protocol Version 11, Revision 0
[    56.257] Build Operating System: Linux 4.2.5-1-ARCH x86_64 
[    56.257] Current Operating System: Linux mint 4.6.2-1-MANJARO #1 SMP PREEMPT Wed Jun 8 11:00:08 UTC 2016 x86_64
[    56.257] Kernel command line: BOOT_IMAGE=/vmlinuz-4.6-x86_64 root=/dev/mapper/ManjaroVG-ManjaroRoot rw cryptdevice=/dev/disk/by-uuid/8621f425-b092-44b7-8fdc-79f05108c25a:cryptManjaro resume=UUID=57a79e64-4586-4345-905f-e5ef72c5b8de quiet splash nomodeset nokmsboot
[    56.257] Build Date: 01 November 2015  10:36:50AM
[    56.257]  
[    56.257] Current version of pixman: 0.34.0
[    56.257] 	Before reporting problems, check http://wiki.x.org
	to make sure that you have the latest version.
[    56.257] Markers: (--) probed, (**) from config file, (==) default setting,
	(++) from command line, (!!) notice, (II) informational,
	(WW) warning, (EE) error, (NI) not implemented, (??) unknown.
[    56.258] (==) Log file: "/var/log/Xorg.0.log", Time: Sat Jul 16 12:06:17 2016
[    56.258] (==) Using config directory: "/etc/X11/xorg.conf.d"
[    56.258] (==) Using system config directory "/usr/share/X11/xorg.conf.d"
[    56.258] (==) ServerLayout "Layout0"
[    56.258] (**) |-->Screen "Screen0" (0)
[    56.258] (**) |   |-->Monitor "Monitor0"
[    56.258] (**) |   |-->Device "Device0"
[    56.258] (**) |-->Input Device "Keyboard0"
[    56.258] (**) |-->Input Device "Mouse0"
[    56.258] (**) Option "Xinerama" "0"
[    56.258] (==) Automatically adding devices
[    56.258] (==) Automatically enabling devices
[    56.258] (==) Automatically adding GPU devices
[    56.258] (WW) `fonts.dir' not found (or not valid) in "/usr/share/fonts/100dpi/".
[    56.258] 	Entry deleted from font path.
[    56.258] 	(Run 'mkfontdir' on "/usr/share/fonts/100dpi/").
[    56.258] (WW) `fonts.dir' not found (or not valid) in "/usr/share/fonts/75dpi/".
[    56.258] 	Entry deleted from font path.
[    56.258] 	(Run 'mkfontdir' on "/usr/share/fonts/75dpi/").
[    56.258] (==) FontPath set to:
	/usr/share/fonts/misc/,
	/usr/share/fonts/TTF/,
	/usr/share/fonts/OTF/,
	/usr/share/fonts/Type1/
[    56.258] (==) ModulePath set to "/usr/lib/xorg/modules"
[    56.258] (WW) Hotplugging is on, devices using drivers 'kbd', 'mouse' or 'vmmouse' will be disabled.
[    56.258] (WW) Disabling Keyboard0
[    56.258] (WW) Disabling Mouse0
[    56.258] (II) Loader magic: 0x817d60
[    56.258] (II) Module ABI versions:
[    56.258] 	X.Org ANSI C Emulation: 0.4
[    56.258] 	X.Org Video Driver: 19.0
[    56.258] 	X.Org XInput driver : 21.1
[    56.258] 	X.Org Server Extension : 9.0
[    56.260] (EE) systemd-logind: failed to get session: PID 1001 does not belong to any known session
[    56.262] (--) PCI:*(0:15:0:0) 10de:0dd8:103c:084a rev 161, Mem @ 0xe2000000/33554432, 0xc8000000/134217728, 0xc4000000/67108864, I/O @ 0x0000d000/128, BIOS @ 0x????????/131072
[    56.262] (--) PCI: (0:40:0:0) 10de:1380:19da:1346 rev 162, Mem @ 0xe5000000/16777216, 0xd0000000/268435456, 0xe0000000/33554432, I/O @ 0x0000e000/128, BIOS @ 0x????????/524288
[    56.262] (WW) Open ACPI failed (/var/run/acpid.socket) (No such file or directory)
[    56.262] (II) LoadModule: "glx"
[    56.263] (II) Loading /usr/lib/xorg/modules/extensions/libglx.so
[    56.267] (II) Module glx: vendor="NVIDIA Corporation"
[    56.267] 	compiled for 4.0.2, module version = 1.0.0
[    56.267] 	Module class: X.Org Server Extension
[    56.267] (II) NVIDIA GLX Module  364.19  Tue Apr 19 14:10:52 PDT 2016
[    56.267] (II) LoadModule: "nvidia"
[    56.267] (II) Loading /usr/lib/xorg/modules/drivers/nvidia_drv.so
[    56.268] (II) Module nvidia: vendor="NVIDIA Corporation"
[    56.268] 	compiled for 4.0.2, module version = 1.0.0
[    56.268] 	Module class: X.Org Video Driver
[    56.268] (II) NVIDIA dlloader X Driver  364.19  Tue Apr 19 13:48:55 PDT 2016
[    56.268] (II) NVIDIA Unified Driver for all Supported NVIDIA GPUs
[    56.268] (++) using VT number 7

[    56.268] (EE) No devices detected.
[    56.268] (EE) 
Fatal server error:
[    56.268] (EE) no screens found(EE) 
[    56.268] (EE) 
Please consult the The X.Org Foundation support 
	 at http://wiki.x.org
 for help. 
[    56.268] (EE) Please also check the log file at "/var/log/Xorg.0.log" for additional information.
[    56.268] (EE)

What’s wrong and how to fix it?

Thanks in advance.

The GPUs need to be identical for BaseMosaic to work. You can’t just throw two completely different boards together. When it says “PCI IDs” it’s referring to the product ID, not the bus location.

The 0f/15 and 28/40 thing is just the Xorg and lspci disagreeing about whether PCI bus numbers should be printed in decimal or hexadecimal.

Thank you for the easy to understand explanation.

Does MultiGPU have same limitation?

Yes.

Thank you very much.