I followed blog instructions here: CUDA 6.5 on AWS GPU instance running Ubuntu 14.04 - Seven Story Rabbit Hole, however my instance won’t boot properly post install.
This is the script I am using:
!/bin/bash
#
# requirements for nvidia installer
#
apt-get -y update
apt-get -y install build-essential
#
# from legacy archive: http://www.nvidia.com/object/linux-amd64-display-archive.html
#
wget http://us.download.nvidia.com/XFree86/Linux-x86_64/367.57/NVIDIA-Linux-x86_64-367.57.run
chmod u+x ./NVIDIA-Linux-x86_64-367.57.run
./NVIDIA-Linux-x86_64-367.57.run --silent
# there will be an error message like the following, see blog: http://tleyden.github.io/blog/2014/10/25/cuda-6-dot-5-on-aws-gpu-instance-running-ubuntu-14-dot-04/
#
# Unable to load the kernel module 'nvidia.ko'. This happens most frequently when this kernel module was built against the wrong or
# improperly configured kernel sources, with a version of gcc that differs from the one used to build the target kernel, or if a driver
# such as rivafb, nvidiafb, or nouveau is present and prevents the NVIDIA kernel module from obtaining ownership of the NVIDIA graphics
# device(s), or no NVIDIA GPU installed in this system is supported by this NVIDIA Linux graphics driver release.
#
# Please see the log entries 'Kernel module load error' and 'Kernel messages' at the end of the file '/var/log/nvidia-installer.log'
# for more information.
apt-get -y install linux-image-extra-virtual
reboot
After reboot, the instance won’t pass status checks and the console log shows:
5.753398] md: raid6 personality registered for level 6
[ 5.757346] md: raid5 personality registered for level 5
[ 5.761201] md: raid4 personality registered for level 4
[ 5.778796] md: raid10 personality registered for level 10
done.
Begin: Running /scripts/init-premount ... done.
Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done.
Begin: Running /scripts/local-premount ... [ 5.820909] Btrfs loaded
Scanning for Btrfs filesystems
[ 32.264063] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [btrfs:558]
[ 32.264063] Modules linked in: btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear nouveau mxm_wmi wmi crct10dif_pclmul video crc32_pclmul cirrus i2c_algo_bit ghash_clmulni_intel ttm aesni_intel drm_kms_helper aes_x86_64 lrw syscopyarea gf128mul sysfillrect glue_helper sysimgblt ablk_helper fb_sys_fops cryptd drm psmouse pata_acpi floppy fjes
[ 32.264063] CPU: 0 PID: 558 Comm: btrfs Not tainted 4.4.0-51-generic #72-Ubuntu
[ 32.264063] Hardware name: Xen HVM domU, BIOS 4.2.amazon 11/11/2016
[ 32.264063] task: ffff880f1c678dc0 ti: ffff880f17b40000 task.ti: ffff880f17b40000
[ 32.264063] RIP: 0010:[<ffffffff81085c8e>] [<ffffffff81085c8e>] __do_softirq+0x7e/0x290
[ 32.264063] RSP: 0000:ffff88079e003f28 EFLAGS: 00000206
[ 32.264063] RAX: ffff880f17b44000 RBX: 0000000000000000 RCX: 0000000000000004
[ 32.264063] RDX: fffffffffffffff7 RSI: 0000000000404000 RDI: ffff88079e003f30
[ 32.264063] RBP: ffff88079e003f80 R08: 0000000000000000 R09: ffff88079d800000
[ 32.264063] R10: 0000000000000000 R11: 0000000000007ffe R12: 00007f880a2ed1c0
[ 32.264063] R13: 00007ffcaa9b9830 R14: 0000000000000000 R15: 00007f880a2ed260
[ 32.264063] FS: 00007f880a7128c0(0000) GS:ffff88079e000000(0000) knlGS:0000000000000000
[ 32.264063] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 32.264063] CR2: 0000000001e4f2b8 CR3: 0000000f1767b000 CR4: 00000000000406f0
[ 32.264063] Stack:
[ 32.264063] 0040400000000008 ffff880f17b44000 00000000fffee11c ffffffff81f36a00
[ 32.264063] 000000000000000a 0000020200000000 0000000000000000 00007f880a2ed1c0
[ 32.264063] 00007ffcaa9b9830 0000000000000000 00007f880a2ed260 ffff88079e003f90
[ 32.264063] Call Trace:
[ 32.264063] <IRQ>
[ 32.264063] [<ffffffff81086013>] irq_exit+0xa3/0xb0
[ 32.264063] [<ffffffff814d6bc5>] xen_evtchn_do_upcall+0x35/0x40
[ 32.264063] [<ffffffff81837ef2>] xen_hvm_callback_vector+0x82/0x90
[ 32.264063] <EOI>
[ 32.264063] Code: c1 c1 98 00 c7 45 c8 0a 00 00 00 48 89 45 c0 65 48 8b 04 25 04 42 01 00 48 89 45 b0 65 c7 05 b6 e4 f8 7e 00 00 00 00 fb 66 66 90 <66> 66 90 b8 ff ff ff ff 49 c7 c4 c0 90 e0 81 0f bc 45 d4 83 c0
[ 60.264055] NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [btrfs:558]
[ 60.264055] Modules linked in: btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear nouveau mxm_wmi wmi crct10dif_pclmul video crc32_pclmul cirrus i2c_algo_bit ghash_clmulni_intel ttm aesni_intel drm_kms_helper aes_x86_64 lrw syscopyarea gf128mul sysfillrect glue_helper sysimgblt ablk_helper fb_sys_fops cryptd drm psmouse pata_acpi floppy fjes
[ 60.264055] CPU: 0 PID: 558 Comm: btrfs Tainted: G L 4.4.0-51-generic #72-Ubuntu
[ 60.264055] Hardware name: Xen HVM domU, BIOS 4.2.amazon 11/11/2016
[ 60.264055] task: ffff880f1c678dc0 ti: ffff880f17b40000 task.ti: ffff880f17b40000
[ 60.264055] RIP: 0010:[<ffffffff81085c8e>] [<ffffffff81085c8e>] __do_softirq+0x7e/0x290
[ 60.264055] RSP: 0000:ffff88079e003f28 EFLAGS: 00000206
[ 60.264055] RAX: ffff880f17b44000 RBX: 0000000000000000 RCX: 0000000000000004
[ 60.264055] RDX: fffffffffffffff7 RSI: 0000000000404000 RDI: ffff88079e003f30
[ 60.264055] RBP: ffff88079e003f80 R08: 0000000000000000 R09: ffff88079d800000
[ 60.264055] R10: 0000000000000000 R11: 0000000000007ffe R12: 00007f880a2ed1c0
[ 60.264055] R13: 00007ffcaa9b9830 R14: 0000000000000000 R15: 00007f880a2ed260
[ 60.264055] FS: 00007f880a7128c0(0000) GS:ffff88079e000000(0000) knlGS:0000000000000000
[ 60.264055] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 60.264055] CR2: 0000000001e4f2b8 CR3: 0000000f1767b000 CR4: 00000000000406f0
[ 60.264055] Stack:
Am I performing the correct steps?