xorg.conf file problem

Accelerated Computing CUDA CUDA Programming and Performance
1

I have a Red Hat Enterprise 5.3 I have a Tyan S7025 Motherboard, with two Quad-Core Xeon E5520 (2.26 GHz), 24GB DDR 1333MHz ECC Registered w/Parity and 4 Tesla C1060s. I am having trouble getting the operating system to recognize the Teslas. I have the latest drivers installed and the most recent version of cuda installed, but when I run the nvidia-xconfig but after that when i reboot the machine it doesn’t recognize the Teslas. I open the xorg.conf file open and this is what i see (pasted below). The problem is in the device section for the four Tesla cards is in the driver section it says “nv” which I’ve read is supposed to say Nvidia, but when I try i get a blank screen and I have to restore to the original config file. Then under BoardName it says “Unkown Board”.

If anyone has a similar setup with the Tyan Mobo and at least 1 Tesla. If you could post your xorg.conf so i can get a reference point it would be greatly appreciated.

Section “ServerLayout”
Identifier “X.org Configured”
Screen 0 “Screen0” 0 0
Screen 1 “Screen1” RightOf “Screen0”
Screen 2 “Screen2” RightOf “Screen1”
Screen 3 “Screen3” RightOf “Screen2”
Screen 4 “Screen4” RightOf “Screen3”
InputDevice “Mouse0” “CorePointer”
InputDevice “Keyboard0” “CoreKeyboard”
EndSection

Section “Files”
RgbPath “/usr/share/X11/rgb”
ModulePath “/usr/lib64/xorg/modules”
FontPath “unix/:7100”
FontPath “built-ins”
EndSection

Section “Module”
Load “dri”
Load “glx”
Load “vnc”
Load “xtrap”
Load “dbe”
Load “record”
Load “extmod”
EndSection

Section “InputDevice”
Identifier “Keyboard0”
Driver “kbd”
EndSection

Section “InputDevice”
Identifier “Mouse0”
Driver “mouse”
Option “Protocol” “auto”
Option “Device” “/dev/input/mice”
Option “ZAxisMapping” “4 5 6 7”
EndSection

Section “Monitor”
Identifier “Monitor0”
VendorName “Monitor Vendor”
ModelName “Monitor Model”
EndSection

Section “Monitor”
Identifier “Monitor1”
VendorName “Monitor Vendor”
ModelName “Monitor Model”
EndSection

Section “Monitor”
Identifier “Monitor2”
VendorName “Monitor Vendor”
ModelName “Monitor Model”
EndSection

Section “Monitor”
Identifier “Monitor3”
VendorName “Monitor Vendor”
ModelName “Monitor Model”
EndSection

Section “Monitor”
Identifier “Monitor4”
VendorName “Monitor Vendor”
ModelName “Monitor Model”
EndSection

Section “Device”
### Available Driver options are:-
### Values: : integer, : float, : “True”/“False”,
### : “String”, : “ Hz/kHz/MHz”
### [arg]: arg optional
#Option “ShadowFB” # []
#Option “DefaultRefresh” # []
#Option “ModeSetClearScreen” # []
Identifier “Card0”
Driver “vesa”
VendorName “Unknown Vendor”
BoardName “Unknown Board”
BusID “PCI:1:0:0”
EndSection

Section “Device”
### Available Driver options are:-
### Values: : integer, : float, : “True”/“False”,
### : “String”, : “ Hz/kHz/MHz”
### [arg]: arg optional
#Option “SWcursor” # []
#Option “HWcursor” # []
#Option “NoAccel” # []
#Option “ShadowFB” # []
#Option “UseFBDev” # []
#Option “Rotate” # []
#Option “VideoKey” #
#Option “FlatPanel” # []
#Option “FPDither” # []
#Option “CrtcNumber” #
#Option “FPScale” # []
#Option “FPTweak” #
#Option “DualHead” # []
Identifier “Card1”
Driver “nv”
VendorName “nVidia Corporation”
BoardName “Unknown Board”
BusID “PCI:8:0:0”
EndSection

Section “Device”
### Available Driver options are:-
### Values: : integer, : float, : “True”/“False”,
### : “String”, : “ Hz/kHz/MHz”
### [arg]: arg optional
#Option “SWcursor” # []
#Option “HWcursor” # []
#Option “NoAccel” # []
#Option “ShadowFB” # []
#Option “UseFBDev” # []
#Option “Rotate” # []
#Option “VideoKey” #
#Option “FlatPanel” # []
#Option “FPDither” # []
#Option “CrtcNumber” #
#Option “FPScale” # []
#Option “FPTweak” #
#Option “DualHead” # []
Identifier “Card2”
Driver “nv”
VendorName “nVidia Corporation”
BoardName “Unknown Board”
BusID “PCI:12:0:0”
EndSection

Section “Device”
### Available Driver options are:-
### Values: : integer, : float, : “True”/“False”,
### : “String”, : “ Hz/kHz/MHz”
### [arg]: arg optional
#Option “SWcursor” # []
#Option “HWcursor” # []
#Option “NoAccel” # []
#Option “ShadowFB” # []
#Option “UseFBDev” # []
#Option “Rotate” # []
#Option “VideoKey” #
#Option “FlatPanel” # []
#Option “FPDither” # []
#Option “CrtcNumber” #
#Option “FPScale” # []
#Option “FPTweak” #
#Option “DualHead” # []
Identifier “Card3”
Driver “nv”
VendorName “nVidia Corporation”
BoardName “Unknown Board”
BusID “PCI:132:0:0”
EndSection

Section “Device”
### Available Driver options are:-
### Values: : integer, : float, : “True”/“False”,
### : “String”, : “ Hz/kHz/MHz”
### [arg]: arg optional
#Option “SWcursor” # []
#Option “HWcursor” # []
#Option “NoAccel” # []
#Option “ShadowFB” # []
#Option “UseFBDev” # []
#Option “Rotate” # []
#Option “VideoKey” #
#Option “FlatPanel” # []
#Option “FPDither” # []
#Option “CrtcNumber” #
#Option “FPScale” # []
#Option “FPTweak” #
#Option “DualHead” # []
Identifier “Card4”
Driver “nv”
VendorName “nVidia Corporation”
BoardName “Unknown Board”
BusID “PCI:136:0:0”
EndSection

Section “Screen”
Identifier “Screen0”
Device “Card0”
Monitor “Monitor0”
SubSection “Display”
Viewport 0 0
Depth 1
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 4
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 8
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 15
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 16
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 24
EndSubSection
EndSection

Section “Screen”
Identifier “Screen1”
Device “Card1”
Monitor “Monitor1”
SubSection “Display”
Viewport 0 0
Depth 1
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 4
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 8
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 15
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 16
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 24
EndSubSection
EndSection

Section “Screen”
Identifier “Screen2”
Device “Card2”
Monitor “Monitor2”
SubSection “Display”
Viewport 0 0
Depth 1
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 4
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 8
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 15
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 16
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 24
EndSubSection
EndSection

Section “Screen”
Identifier “Screen3”
Device “Card3”
Monitor “Monitor3”
SubSection “Display”
Viewport 0 0
Depth 1
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 4
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 8
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 15
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 16
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 24
EndSubSection
EndSection

Section “Screen”
Identifier “Screen4”
Device “Card4”
Monitor “Monitor4”
SubSection “Display”
Viewport 0 0
Depth 1
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 4
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 8
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 15
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 16
EndSubSection
SubSection “Display”
Viewport 0 0
Depth 24
EndSubSection
EndSection

2

Use the script in the release notes to load the driver and create the /dev/nv* entries.

3

Where can I find the release notes?

4

[url=“http://developer.download.nvidia.com/compute/cuda/2_3/sdk/docs/cudasdk_release_notes_linux.txt”]http://developer.download.nvidia.com/compu...notes_linux.txt[/url]

5

I read the release notes but unfortunately I am very new to linux and I’m having a hard time understanding what to do to make these teslas register so i can access the via cuda.

6

Honestly, I can’t find anything about /dev/nv* in the release notes either. This page might be more helpful:

http://acceleratedcomputing.blogspot.com/2…060-on-mac.html

It says ‘Mac’ but is really about linux (on a Mac)

[codebox]#!/bin/bash

Startup/shutdown script for nVidia CUDA

chkconfig: 345 80 20

description: Startup/shutdown script for nVidia CUDA

Source function library.

. /etc/init.d/functions

DRIVER=nvidia

RETVAL=0

Create /dev nodes for nvidia devices

function createnodes() {

Count the number of NVIDIA controllers found.

N3D=/sbin/lspci | grep -i NVIDIA | grep "3D controller" | wc -l

NVGA=/sbin/lspci | grep -i NVIDIA | grep "VGA compatible controller" | wc -l

N=expr $N3D + $NVGA - 1

for i in seq 0 $N; do

   mknod -m 666 /dev/nvidia$i c 195 $i

  RETVAL=$?

  [ "$RETVAL" = 0 ] || exit $RETVAL

done

mknod -m 666 /dev/nvidiactl c 195 255

RETVAL=$?

[ “$RETVAL” = 0 ] || exit $RETVAL

}

Remove /dev nodes for nvidia devices

function removenodes() {

rm -f /dev/nvidia*

}

Start daemon

function start() {

echo -n $"Loading $DRIVER kernel module: "

modprobe $DRIVER && success || failure

RETVAL=$?

echo

[ “$RETVAL” = 0 ] || exit $RETVAL

echo -n $"Initializing CUDA /dev entries: "

createnodes && success || failure

RETVAL=$?

echo

[ “$RETVAL” = 0 ] || exit $RETVAL

}

Stop daemon

function stop() {

echo -n $"Unloading $DRIVER kernel module: "

rmmod -f $DRIVER && success || failure

RETVAL=$?

echo

[ “$RETVAL” = 0 ] || exit $RETVAL

echo -n $"Removing CUDA /dev entries: "

removenodes && success || failure

RETVAL=$?

echo

[ “$RETVAL” = 0 ] || exit $RETVAL

}

See how we were called

case “$1” in

start)

   start

  ;;

stop)

   stop

  ;;

restart)

   stop

  start

  ;;

*)

   echo $"Usage: $0 {start|stop|restart}"

  RETVAL=1

esac

exit $RETVAL

[/codebox]

EDIT: Did you (manually) install the Nvidia drivers? Because the installation will at the end ask you if you want it to rewrite the xorg.conf to use the new driver, which I’m ready to bet on is what most people want. That should you rid of the ‘nv’ entries supplied by the distribution.

7

I have a SuperMicro SuperServer with (1) Quad-Core Xeon E5520 (2.26 GHz), 12GB DDR 1333MHz, (1) Quadro FX 370LP and (2) Tesla C1060s.

To get mine working, I had to use the “Xorg -configure” command, then manually edit the entries. I had to disable the onboard display and run my additional Quadro FX card to render my display in three dimensions. You should see the “#” where I disabled my onboard Matrox display.

Here is my xorg.conf file:

[codebox]# nvidia-xconfig: X configuration file generated by nvidia-xconfig

nvidia-xconfig: version 1.0 (buildmeister@builder62) Wed Jul 22 16:45:17 PDT 2009

Section “ServerLayout”

Identifier     "X.org Configured"

Screen         "Screen0"

InputDevice    "Mouse0" "CorePointer"

InputDevice    "Keyboard0" "CoreKeyboard"

EndSection

Section “Files”

ModulePath   "/usr/lib/xorg/modules"

FontPath     "/usr/share/fonts/X11/misc"

FontPath     "/usr/share/fonts/X11/cyrillic"

FontPath     "/usr/share/fonts/X11/100dpi/:unscaled"

FontPath     "/usr/share/fonts/X11/75dpi/:unscaled"

FontPath     "/usr/share/fonts/X11/Type1"

FontPath     "/usr/share/fonts/X11/100dpi"

FontPath     "/usr/share/fonts/X11/75dpi"

FontPath     "/var/lib/defoma/x-ttcidfont-conf.d/dirs/TrueType"

EndSection

Section “Module”

Load  "extmod"

Load  "dri"

Load  "dbe"

Load  "glx"

Load  "record"

Load  "type1"

Load  "freetype"

Load  "dri2"

Load  "vbe"

Load  "ddc"

EndSection

Section “InputDevice”

Identifier  "Keyboard0"

Driver      "kbd"

EndSection

Section “InputDevice”

Identifier  "Mouse0"

Driver      "mouse"

Option	    "Protocol" "auto"

Option	    "Device" "/dev/input/mice"

Option	    "ZAxisMapping" "4 5 6 7"

EndSection

Section “Monitor”

#DisplaySize	  380   300	# mm

Identifier   "Monitor0"

VendorName   "SAM"

ModelName    "SyncMaster"

HorizSync    30.0 - 81.0

VertRefresh  56.0 - 75.0

Option	    "DPMS"

EndSection

Section “Device”

    ### Available Driver options are:-

    ### Values: <i>: integer, <f>: float, <bool>: "True"/"False",

    ### <string>: "String", <freq>: "<f> Hz/kHz/MHz"

    ### [arg]: arg optional

    #Option     "SWcursor"           	# [<bool>]

    #Option     "HWcursor"           	# [<bool>]

    #Option     "PciRetry"           	# [<bool>]

    #Option     "SyncOnGreen"        	# [<bool>]

    #Option     "NoAccel"            	"False"

    #Option     "ShowCache"          	# [<bool>]

    #Option     "Overlay"            	# [<str>]

    #Option     "MGASDRAM"           	"True"

    #Option     "ShadowFB"           	# [<bool>]

    #Option     "UseFBDev"           	# [<bool>]

    #Option     "ColorKey"           	# <i>

    #Option     "SetMclk"            	# <freq>

    #Option     "OverclockMem"       	"True"

    #Option     "VideoKey"           	# <i>

    #Option     "Rotate"             	# [<str>]

    #Option     "TexturedVideo"      	# [<bool>]

    #Option     "Crtc2Half"          	# [<bool>]

    #Option     "Crtc2Ram"           	# <i>

    #Option     "Int10"              	# [<bool>]

    #Option     "AGPMode"            	# <i>

    #Option     "AGPSize"            	# <i>

    #Option     "DigitalScreen1"     	# [<bool>]

    #Option     "DigitalScreen2"     	# [<bool>]

    #Option     "TV"                 	# [<bool>]

    #Option     "TVStandard"         	# [<str>]

    #Option     "CableType"          	# [<str>]

    #Option     "NoHal"              	# [<bool>]

    #Option     "SwappedHead"        	# [<bool>]

    #Option     "DRI"                	# [<bool>]

    #Option     "MergedFB"           	# [<bool>]

    #Option     "Monitor2HSync"      	# [<str>]

    #Option     "Monitor2VRefresh"   	# [<str>]

    #Option     "Monitor2Position"   	# [<str>]

    #Option     "MetaModes"          	# [<str>]

    #Option     "OldDmaInit"         	# [<bool>]

    #Option     "ForcePciDma"        	# [<bool>]

    #Option     "AccelMethod"        	# [<str>]

    #Option     "KVM"                	# [<bool>]

Identifier  "Device0"

Driver      "mga"

VendorName  "Matrox Graphics, Inc."

BoardName   "MGA G200eW WPCM450"

BusID       "PCI:5:1:0"

EndSection

Section “Device”

Identifier  "Device1"

Driver      "nvidia"

VendorName  "nVidia Corporation"

BoardName   "nVidia Corporation Quadro FX 370 LP"

BusID       "PCI:1:0:0"

EndSection

Section “Device”

Identifier  "Device2"

Driver      "nvidia"

VendorName  "nVidia Corporation"

BoardName   "GT200 [Tesla C1060 / Tesla S1070]"

BusID       "PCI:2:0:0"

EndSection

Section “Device”

Identifier  "Device3"

Driver      "nvidia"

VendorName  "nVidia Corporation"

BoardName   "GT200 [Tesla C1060 / Tesla S1070]"

BusID       "PCI:3:0:0"

EndSection

Section “Screen”

Identifier "Screen0"

Device     "Device1"

Monitor    "Monitor0"

SubSection "Display"

	Viewport   0 0

	Depth     1

EndSubSection

SubSection "Display"

	Viewport   0 0

	Depth     4

EndSubSection

SubSection "Display"

	Viewport   0 0

	Depth     8

EndSubSection

SubSection "Display"

	Viewport   0 0

	Depth     15

EndSubSection

SubSection "Display"

	Viewport   0 0

	Depth     16

EndSubSection

SubSection "Display"

	Viewport   0 0

	Depth     24

EndSubSection

EndSection

[/codebox]

Here is my lspci readout

[codebox]00:00.0 Host bridge: Intel Corporation X58 I/O Hub to ESI Port (rev 13)

00:01.0 PCI bridge: Intel Corporation X58 I/O Hub PCI Express Root Port 1 (rev 13)

00:03.0 PCI bridge: Intel Corporation X58 I/O Hub PCI Express Root Port 3 (rev 13)

00:07.0 PCI bridge: Intel Corporation X58 I/O Hub PCI Express Root Port 7 (rev 13)

00:0e.0 Host bridge: Intel Corporation Device 341c (rev 13)

00:0e.1 Host bridge: Intel Corporation Device 341d (rev 13)

00:0e.2 Host bridge: Intel Corporation Device 341e (rev 13)

00:13.0 PIC: Intel Corporation X58 I/O Hub I/OxAPIC Interrupt Controller (rev 13)

00:14.0 PIC: Intel Corporation X58 I/O Hub System Management Registers (rev 13)

00:14.1 PIC: Intel Corporation X58 I/O Hub GPIO and Scratch Pad Registers (rev 13)

00:14.2 PIC: Intel Corporation X58 I/O Hub Control Status and RAS Registers (rev 13)

00:14.3 PIC: Intel Corporation X58 I/O Hub Throttle Registers (rev 13)

00:16.0 System peripheral: Intel Corporation X58 Chipset QuickData Technology Device (rev 13)

00:16.1 System peripheral: Intel Corporation X58 Chipset QuickData Technology Device (rev 13)

00:16.2 System peripheral: Intel Corporation X58 Chipset QuickData Technology Device (rev 13)

00:16.3 System peripheral: Intel Corporation X58 Chipset QuickData Technology Device (rev 13)

00:16.4 System peripheral: Intel Corporation X58 Chipset QuickData Technology Device (rev 13)

00:16.5 System peripheral: Intel Corporation X58 Chipset QuickData Technology Device (rev 13)

00:16.6 System peripheral: Intel Corporation X58 Chipset QuickData Technology Device (rev 13)

00:16.7 System peripheral: Intel Corporation DMA Engine (rev 13)

00:1a.0 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #4

00:1a.1 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #5

00:1a.2 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #6

00:1a.7 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #2

00:1c.0 PCI bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Port 1

00:1d.0 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #1

00:1d.1 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #2

00:1d.2 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #3

00:1d.7 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #1

00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev 90)

00:1f.0 ISA bridge: Intel Corporation 82801JIR (ICH10R) LPC Interface Controller

00:1f.2 IDE interface: Intel Corporation 82801JI (ICH10 Family) 4 port SATA IDE Controller

00:1f.3 SMBus: Intel Corporation 82801JI (ICH10 Family) SMBus Controller

00:1f.5 IDE interface: Intel Corporation 82801JI (ICH10 Family) 2 port SATA IDE Controller

01:00.0 VGA compatible controller: nVidia Corporation Quadro FX 370 LP (rev a1)

02:00.0 3D controller: nVidia Corporation GT200 [Tesla C1060 / Tesla S1070] (rev a1)

03:00.0 3D controller: nVidia Corporation GT200 [Tesla C1060 / Tesla S1070] (rev a1)

04:00.0 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)

04:00.1 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)

05:01.0 VGA compatible controller: Matrox Graphics, Inc. MGA G200eW WPCM450 (rev 0a)[/codebox]

I see several problems with your xorg.conf file. There are 5 screens listed in “ServerLayout”. Since you are running Teslas, they should all be run without trying to port the graphics to a display. Delete all these entries besides “Screen0”.

#1- Have you tried using the nvidia-xconfig command?

#2 - If #2 doesn’t work, you may have to manually configure your xorg.conf file according to the data from the “lspci” command. Simply copy the data from the lspci readout to your xorg.conf file.

8

I have a SuperMicro SuperServer with (1) Quad-Core Xeon E5520 (2.26 GHz), 12GB DDR 1333MHz, (1) Quadro FX 370LP and (2) Tesla C1060s.

To get mine working, I had to use the “Xorg -configure” command, then manually edit the entries. I had to circumvent using the onboard display and run my additional Quadro FX card to render my display in three dimensions. You can see this in the “Screen0” section - I use “device1” instead of the normal “device0”.

Here is my xorg.conf file:

[codebox]# nvidia-xconfig: X configuration file generated by nvidia-xconfig

nvidia-xconfig: version 1.0 (buildmeister@builder62) Wed Jul 22 16:45:17 PDT 2009

Section “ServerLayout”

Identifier     "X.org Configured"

Screen         "Screen0"

InputDevice    "Mouse0" "CorePointer"

InputDevice    "Keyboard0" "CoreKeyboard"

EndSection

Section “Files”

ModulePath   "/usr/lib/xorg/modules"

FontPath     "/usr/share/fonts/X11/misc"

FontPath     "/usr/share/fonts/X11/cyrillic"

FontPath     "/usr/share/fonts/X11/100dpi/:unscaled"

FontPath     "/usr/share/fonts/X11/75dpi/:unscaled"

FontPath     "/usr/share/fonts/X11/Type1"

FontPath     "/usr/share/fonts/X11/100dpi"

FontPath     "/usr/share/fonts/X11/75dpi"

FontPath     "/var/lib/defoma/x-ttcidfont-conf.d/dirs/TrueType"

EndSection

Section “Module”

Load  "extmod"

Load  "dri"

Load  "dbe"

Load  "glx"

Load  "record"

Load  "type1"

Load  "freetype"

Load  "dri2"

Load  "vbe"

Load  "ddc"

EndSection

Section “InputDevice”

Identifier  "Keyboard0"

Driver      "kbd"

EndSection

Section “InputDevice”

Identifier  "Mouse0"

Driver      "mouse"

Option	    "Protocol" "auto"

Option	    "Device" "/dev/input/mice"

Option	    "ZAxisMapping" "4 5 6 7"

EndSection

Section “Monitor”

#DisplaySize	  380   300	# mm

Identifier   "Monitor0"

VendorName   "SAM"

ModelName    "SyncMaster"

HorizSync    30.0 - 81.0

VertRefresh  56.0 - 75.0

Option	    "DPMS"

EndSection

Section “Device”

    ### Available Driver options are:-

    ### Values: <i>: integer, <f>: float, <bool>: "True"/"False",

    ### <string>: "String", <freq>: "<f> Hz/kHz/MHz"

    ### [arg]: arg optional

    #Option     "SWcursor"           	# [<bool>]

    #Option     "HWcursor"           	# [<bool>]

    #Option     "PciRetry"           	# [<bool>]

    #Option     "SyncOnGreen"        	# [<bool>]

    #Option     "NoAccel"            	"False"

    #Option     "ShowCache"          	# [<bool>]

    #Option     "Overlay"            	# [<str>]

    #Option     "MGASDRAM"           	"True"

    #Option     "ShadowFB"           	# [<bool>]

    #Option     "UseFBDev"           	# [<bool>]

    #Option     "ColorKey"           	# <i>

    #Option     "SetMclk"            	# <freq>

    #Option     "OverclockMem"       	"True"

    #Option     "VideoKey"           	# <i>

    #Option     "Rotate"             	# [<str>]

    #Option     "TexturedVideo"      	# [<bool>]

    #Option     "Crtc2Half"          	# [<bool>]

    #Option     "Crtc2Ram"           	# <i>

    #Option     "Int10"              	# [<bool>]

    #Option     "AGPMode"            	# <i>

    #Option     "AGPSize"            	# <i>

    #Option     "DigitalScreen1"     	# [<bool>]

    #Option     "DigitalScreen2"     	# [<bool>]

    #Option     "TV"                 	# [<bool>]

    #Option     "TVStandard"         	# [<str>]

    #Option     "CableType"          	# [<str>]

    #Option     "NoHal"              	# [<bool>]

    #Option     "SwappedHead"        	# [<bool>]

    #Option     "DRI"                	# [<bool>]

    #Option     "MergedFB"           	# [<bool>]

    #Option     "Monitor2HSync"      	# [<str>]

    #Option     "Monitor2VRefresh"   	# [<str>]

    #Option     "Monitor2Position"   	# [<str>]

    #Option     "MetaModes"          	# [<str>]

    #Option     "OldDmaInit"         	# [<bool>]

    #Option     "ForcePciDma"        	# [<bool>]

    #Option     "AccelMethod"        	# [<str>]

    #Option     "KVM"                	# [<bool>]

Identifier  "Device0"

Driver      "mga"

VendorName  "Matrox Graphics, Inc."

BoardName   "MGA G200eW WPCM450"

BusID       "PCI:5:1:0"

EndSection

Section “Device”

Identifier  "Device1"

Driver      "nvidia"

VendorName  "nVidia Corporation"

BoardName   "nVidia Corporation Quadro FX 370 LP"

BusID       "PCI:1:0:0"

EndSection

Section “Device”

Identifier  "Device2"

Driver      "nvidia"

VendorName  "nVidia Corporation"

BoardName   "GT200 [Tesla C1060 / Tesla S1070]"

BusID       "PCI:2:0:0"

EndSection

Section “Device”

Identifier  "Device3"

Driver      "nvidia"

VendorName  "nVidia Corporation"

BoardName   "GT200 [Tesla C1060 / Tesla S1070]"

BusID       "PCI:3:0:0"

EndSection

Section “Screen”

Identifier "Screen0"

Device     "Device1"

Monitor    "Monitor0"

SubSection "Display"

	Viewport   0 0

	Depth     1

EndSubSection

SubSection "Display"

	Viewport   0 0

	Depth     4

EndSubSection

SubSection "Display"

	Viewport   0 0

	Depth     8

EndSubSection

SubSection "Display"

	Viewport   0 0

	Depth     15

EndSubSection

SubSection "Display"

	Viewport   0 0

	Depth     16

EndSubSection

SubSection "Display"

	Viewport   0 0

	Depth     24

EndSubSection

EndSection

[/codebox]

Here is my lspci readout

[codebox]00:00.0 Host bridge: Intel Corporation X58 I/O Hub to ESI Port (rev 13)

00:01.0 PCI bridge: Intel Corporation X58 I/O Hub PCI Express Root Port 1 (rev 13)

00:03.0 PCI bridge: Intel Corporation X58 I/O Hub PCI Express Root Port 3 (rev 13)

00:07.0 PCI bridge: Intel Corporation X58 I/O Hub PCI Express Root Port 7 (rev 13)

00:0e.0 Host bridge: Intel Corporation Device 341c (rev 13)

00:0e.1 Host bridge: Intel Corporation Device 341d (rev 13)

00:0e.2 Host bridge: Intel Corporation Device 341e (rev 13)

00:13.0 PIC: Intel Corporation X58 I/O Hub I/OxAPIC Interrupt Controller (rev 13)

00:14.0 PIC: Intel Corporation X58 I/O Hub System Management Registers (rev 13)

00:14.1 PIC: Intel Corporation X58 I/O Hub GPIO and Scratch Pad Registers (rev 13)

00:14.2 PIC: Intel Corporation X58 I/O Hub Control Status and RAS Registers (rev 13)

00:14.3 PIC: Intel Corporation X58 I/O Hub Throttle Registers (rev 13)

00:16.0 System peripheral: Intel Corporation X58 Chipset QuickData Technology Device (rev 13)

00:16.1 System peripheral: Intel Corporation X58 Chipset QuickData Technology Device (rev 13)

00:16.2 System peripheral: Intel Corporation X58 Chipset QuickData Technology Device (rev 13)

00:16.3 System peripheral: Intel Corporation X58 Chipset QuickData Technology Device (rev 13)

00:16.4 System peripheral: Intel Corporation X58 Chipset QuickData Technology Device (rev 13)

00:16.5 System peripheral: Intel Corporation X58 Chipset QuickData Technology Device (rev 13)

00:16.6 System peripheral: Intel Corporation X58 Chipset QuickData Technology Device (rev 13)

00:16.7 System peripheral: Intel Corporation DMA Engine (rev 13)

00:1a.0 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #4

00:1a.1 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #5

00:1a.2 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #6

00:1a.7 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #2

00:1c.0 PCI bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Port 1

00:1d.0 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #1

00:1d.1 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #2

00:1d.2 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #3

00:1d.7 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #1

00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev 90)

00:1f.0 ISA bridge: Intel Corporation 82801JIR (ICH10R) LPC Interface Controller

00:1f.2 IDE interface: Intel Corporation 82801JI (ICH10 Family) 4 port SATA IDE Controller

00:1f.3 SMBus: Intel Corporation 82801JI (ICH10 Family) SMBus Controller

00:1f.5 IDE interface: Intel Corporation 82801JI (ICH10 Family) 2 port SATA IDE Controller

01:00.0 VGA compatible controller: nVidia Corporation Quadro FX 370 LP (rev a1)

02:00.0 3D controller: nVidia Corporation GT200 [Tesla C1060 / Tesla S1070] (rev a1)

03:00.0 3D controller: nVidia Corporation GT200 [Tesla C1060 / Tesla S1070] (rev a1)

04:00.0 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)

04:00.1 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)

05:01.0 VGA compatible controller: Matrox Graphics, Inc. MGA G200eW WPCM450 (rev 0a)[/codebox]

I see several problems with your xorg.conf file. There are 5 screens listed in “ServerLayout”. Since you are running Teslas, they should all be run without trying to port the graphics to a display. Delete all these entries besides “Screen0”.

Your “nv” entry should read “nvidia” - you can change that manually.

Last - a couple of ending comments/questions:

#1- Have you tried using the nvidia-xconfig command?

#2 - If #1 doesn’t work, you may have to manually configure your xorg.conf file according to the data from the “lspci” command. Simply copy the data from the lspci readout to your xorg.conf file.

9

Lastly… a comment on your setup.

As I write this today, there is no motherboard which can fully use 4 Tesla C1060 cards. The PCI-E pipeline traffic maxes out with 2 Tesla cards. Hence, there is no reason to have more than 2 Tesla cards in a 1U unit - you can’t use them… It would be wiser to put those in a 2 slot, 1U unit, connect the two 1U units with a 20GB Infiniband connection - then cluster them with Rocks or MOSIX.

I talked with Nvidia before building my configuration - they said that there are systems which use 4 cards (specifically the S1070 setups), but these are simply C1060s which are rate-locked at 1/2 speed - effectively 2 C1060s at full speed.

Whoever sold you that system was hankering for a commission. =D

10

  1. For your Tesla card to be recognized on a RHEL 5.x system, you have to install the Nvidia drivers and also use a startup script for the /dev/nv* to appear.

  2. http://acceleratedcomputing.blogspot.com/2…060-on-mac.html This link actually describes the procedure for a Tesla C1060 installation on a Mac Pro running CentOS.

  3. Also make sure the drivers you have are for the same kernel you have on your system, else update your kernel to match the driver specified kernel.