Deep Learning Workstations
From Robin
(Difference between revisions)
(→Setup SSH Server) |
(Added PPA link) |
||
Line 63: | Line 63: | ||
* Remove graphics cards | * Remove graphics cards | ||
* Install Ubuntu following [https://medium.com/@FloodSung/tutorial-how-to-install-ubuntu-16-04-windows10-on-alienware-15-r3-91cd1dc7eb3c these instructions] | * Install Ubuntu following [https://medium.com/@FloodSung/tutorial-how-to-install-ubuntu-16-04-windows10-on-alienware-15-r3-91cd1dc7eb3c these instructions] | ||
- | * Install Nvidia graphics driver from PPA repository. | + | * Install Nvidia graphics driver from [https://launchpad.net/~graphics-drivers/+archive/ubuntu/ppa PPA repository]. |
* Put graphics cards back in. | * Put graphics cards back in. | ||
* verify that you can boot into Windows and Ubuntu | * verify that you can boot into Windows and Ubuntu |
Revision as of 14:39, 23 January 2018
Contents |
Deep Learning Workstations
We have shared workstations for projects needing serious GPU and CPU power while retaining physical access to a computer.
Most interesting are the four Dell Alienware computers from January 2018, here are their details and responsible staff for ongoing record keeping:
- Aurora R7 - Intel i7 8700K (6-core), 2x Nvidia GTX1080ti (UiO: 113616). Justas/Zia/Weria
- hostname:
- URL:
- WLAN: D8:9E:F3:7A:84:B7
- ETH: 9C:30:5B:13:AF:33
- Aurora R7 - Intel i7 8700K (6-core), 2x Nvidia GTX1080ti (UiO: 113615). Charles/Kai/Tønnes
- hostname: dasher
- URL: dasher-robin.duckdns.org
- WLAN: D8:9E:F3:7A:7E:D1
- ETH: 9C:30:5B:13:C5:69
- Aurora R7 - Intel i7 8700K (6-core), 2x Nvidia GTX1070ti (UiO: 113617). Vegard/Masterstudenter
- hostname:
- URL:
- WLAN: D8:9E:F3:7A:46:08
- ETH: 9E:30:5B:13:C5:8B
- Area 51 R3 - AMD Threadripper 1950x (16-core), 1x Nvidia GTX1070ti (UiO: 113614). Jørgen etc.
- hostname:
- URL:
- WLAN: 9C:30:5B:13:C5:71
- ETH1: 30:9C:23:2A:EB:39
- ETH2: 30:9C:23:2A:EB:38
We also have older workstations:
- Deep Thinker: Intel..., 2x Nvidia GXT1080. Charles/Justas/Masterstudenter
- hostname: deepthinker
- url: deepthinker.onthewifi.com
Setting up the workstations
As a rule, shared systems should be able to dual-boot between Windows 10 and Ubuntu.
- For the Dell systems, first shrink the main NTFS partition to allow an Ubuntu system partition.
- The shared (spinning) disk can stay as NTFS.
- Ubuntu 17.10 is ok for Deep Learning / how about for robotics applications?
Tensorflow
- Install tensorflow-gpu to use GPUs.
- Tensorflow requires specific versions of CUDA and CUDnn
- For Tensorflow 1.4 (current release as of 9/1/2018): Need CUDA 8, CUDnn 6
- For Tensorflow 1.5 (prerelease as of 9/1/2018) - works with CUDA 9, CUDnn 7 (latest).
Ubuntu 16.04 Setup
Install Ubuntu 16.04, do not turn Secure Boot off.
- Shrink Windows NTFS volume in Disk Management
- Remove graphics cards
- Install Ubuntu following these instructions
- Install Nvidia graphics driver from PPA repository.
- Put graphics cards back in.
- verify that you can boot into Windows and Ubuntu
- Ubuntu sometimes freezes on shutdown due to an I2C driver, which can be blacklisted
- If Ubuntu doesn't login and graphics are weird, probably using unsigned Nvidia driver, use this script to sign kernel modules. - if this path is taken, modules need to be signed against any new future kernels.
- Install CUDA 8.0 and CUDnn 6.0 for Tensorflow 1.4
Setup SSH Server
- The SSH server config (/etc/ssh/sshd_config) should be hardened to prevent brute force password attacks.
- Broadly, follow these instructions to disable password access. Maybe a good idea to use fail2ban or deny hosts, but just disabling password access should be a good start.
- Regular users should copy their public key to the machine in person and add it to ~/.ssh/authorized_keys
- ssh-copy-id won't work if password access is turned off :-\
Setup Dynamic DNS
- Good to have a fixed URL for each machine as the IP address from Eduroam can change.
- Dynamic DNS services allow the computer to update it's own IP address on the DNS server.
- (Even with public URL, still need to be on UiO network or VPN to login via SSH)
- Get a URL from no-ip.com or DuckDNS
- Install ddclient on Ubuntu to configure dynDNS -- need to install back ported v3.8.3 to support duckdns https://launchpad.net/~rhansen/+archive/ubuntu/ddclient
- Configure /etc/ddclient.conf as follows: https://sourceforge.net/p/ddclient/wiki/protocols/#duckdns
protocol=duckdns password=token-from-duck-dns chosen-host-url.duckdns.org run_daemon="true"
- start service: sudo service ddclient start
- show status: sudo service ddclient status
Remote Connections
- Ports on Eduroam-connected systems are generally not opened externally
- You can access them by connecting to the University VPN and then connecting.
- Instructions here for setting up VPN on your client system.