Documentation: document lava-docker

Ths patch documenent lava-docker and add a boards.yaml.example

2 files changed, 332 insertions, 54 deletions

diff --git a/README.md b/README.md
index e0fb466..14913e5 100644
--- a/README.md
+++ b/README.md
@@ -1,105 +1,317 @@
 # Linaro's Automated Validation Architecture (LAVA) Docker Container
-Preinstalls and preconfigures the latest LAVA server release.
 
-## Prerequisite
-The package docker-compose is necessary
+## Introduction
 
-## Name Conventions
-Each board must be named by their device-type as "device-type-XX" where XX is a number
-Each tty will have a name /dev/boardname (via the udev rules)
-Each conmux config file will be named boardname.cf
-Each slave must be named lab-slave-XX
+The goal of lava-docker is to simplify the install and maintenance of
+a LAVA lab in order to participate in distributed test efforts such as
+kernelCI.org.
 
-## Know limitation
-The current lava-docker provide support for only one slave
+With lava-docker, you describe the devices under test (DUT) in a
+simple YAML file, and then a custom script will generate the necessary
+LAVA configuration files automatically.
+
+Similarly, LAVA users and authentication tokens are described in
+a(nother) YAML file, and the LAVA configurations are automatically generated.
+
+This enables the setup of a LAVA lab with minimal knowledge of the
+underlying LAVA configuration steps necessary.
+
+## Prerequisites
+lava-docker has currently been tested primarily on Debian stable (stretch).
+The following packages are necessary on the host machine:
+* docker
+* docker-compose
+
+## Quickstart
+Example to use lava-docker with only one QEMU device:
+
+* Checkout the lava-docker repository
+* You will obtain the following boards.yaml
+```
+lab-slave-0:
+  boardlist:
+    qemu-01:
+      type: qemu
+```
+* Generate configuration files for LAVA, udev, serial ports, etc. from boards.yaml via
+```
+./lavalab-gen.py
+```
+* Build docker images via
+```
+docker-compose build
+```
+* Start all images via
+```
+docker-compose up -d
+```
+
+* Once launched, you can access the LAVA web interface via http://localhost:10080/.
+With the default users, you can login with admin:admin.
+
+* By default, a LAVA healthcheck job will be run on the qemu device.
+You will see it in the "All Jobs" list: http://localhost:10080/scheduler/alljobs
+
+* You can also see full job output by clicking the blue eye icon ("View job details") (or via http://localhost:10080/scheduler/job/1 since it is the first job ran)
+
+* For more details, see https://validation.linaro.org/static/docs/v2/first-job.html
+
+### Adding your first board:
+#### device-type
+To add a board you need to find its device-type, standard naming is to use the same as the official kernel DT name.
+(But a very few DUT differ from that)
+
+You could check in https://github.com/Linaro/lava-server/tree/release/lava_scheduler_app/tests/device-types if you find yours.
+
+Example:
+For a beagleboneblack, the device-type is beaglebone-black (Even if official DT name is am335x-boneblack)
+So you have now:
+```
+    beagleboneblack-01:
+      type: beaglebone-black
+```
+
+#### UART
+Next step is to gather information on UART wired on DUT.<br>
+If you have a FTDI, simply get its serial (visible in lsusb -v or for major distribution in dmesg)<br>
+<br>
+For other UART type (or for old FTDI without serial number) you need to get the devpath attribute via:
+```
+udevadm info -a -n /dev/ttyUSBx |grep ATTR|grep devpath | head -n1
+```
+Example with a FTDI UART:
+```
+[    6.616707] usb 4-1.4.2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
+[    6.704305] usb 4-1.4.2: SerialNumber: AK04TU1X
+The serial is AK04TU1X
+```
+So you have now:
+```
+    beagleboneblack-01:
+      type: beaglebone-black
+      uart:
+        idvendor: "0403"
+	idproduct: 6001
+	serial: AK04TU1X
+```
+
+Example with a FTDI without serial:
+```
+[2428401.256860] ftdi_sio 1-1.4:1.0: FTDI USB Serial Device converter detected
+[2428401.256916] usb 1-1.4: Detected FT232BM
+[2428401.257752] usb 1-1.4: FTDI USB Serial Device converter now attached to ttyUSB1
+udevadm info -a -n /dev/ttyUSB1 |grep devpath | head -n1
+    ATTRS{devpath}=="1.5"
+```
+So you have now:
+```
+    beagleboneblack-01:
+      type: beaglebone-black
+      uart:
+        idvendor: "0403"
+	idproduct: 6001
+	devpath: "1.5"
+```
+
+#### PDU (Power Distribution Unit)
+Final step is to manage the powering of the board.<br>
+Many PDU switchs could be handled by a command line tool which control the PDU.<br>
+You need to fill boards.yaml with the command line to be ran.<br>
+
+Example with an ACME board:
+If the beagleboneblack is wired to port 3 and the ACME board have IP 192.168.66.2:
+```
+      pdu_generic:
+        hard_reset_command: /usr/local/bin/acme-cli -s 192.168.66.2 reset 3
+        power_off_command: /usr/local/bin/acme-cli -s 192.168.66.2 power_off 3
+        power_on_command: /usr/local/bin/acme-cli -s 192.168.66.2 power_on 3
+```
+
+#### Example:
+beagleboneblack, with FTDI (serial 1234567), connected to port 5 of an ACME
+```
+    beagleboneblack-01:
+      type: beaglebone-black
+      pdu_generic:
+        hard_reset_command: /usr/local/bin/acme-cli -s 192.168.66.2 reset 5
+        power_off_command: /usr/local/bin/acme-cli -s 192.168.66.2 power_off 5
+        power_on_command: /usr/local/bin/acme-cli -s 192.168.66.2 power_on 5
+      uart:
+        idvendor: "0403"
+	idproduct: 6001
+	serial: 1234567
+```
+
+## Known limitations
+The current lava-docker provides support for generating only one LAVA slave.
 
 ## Architecture
-The host must have a dedicated LAN. (192.168.66.0/24)
-The host must have IP set to 192.168.66.1 on this LAN.
-A sample dhcpd config file is available in the dhcpd directory
+The setup is composed of a host which runs the following docker images and DUT to be tested.<br/>
+* lava-master: run lava-server along with the web interface
+* lava-slave: run lava-dispatcher, the compoment which sends jobs to DUTs
+* squid: an HTTP proxy for caching downloaded contents (kernel/dtb/rootfs)
+
+The host and DUTs must share a common LAN.<br/>
+The host IP on this LAN must be set as dispatcher_ip in boards.yaml.<br/>
+
+Since most DUTs are booted using TFTP, they need DHCP for gaining network connectivity.<br/>
+So, on the LAN shared with DUTs, a running DHCPD is necessary. (See DHCPD below)<br/>
+
+![lava-docker diagram](doc/lava-docker.png)
+
+### Power supply
+You need to have a PDU for powering your DUT.
+Managing PDUs is done via pdu_generic
+
+### Network ports
+The following ports are used by lava-docker and are proxyfied on the host:
+- 69/UDP	proxyfied to the slave for TFTP
+- 80		proxyfied to the slave for TODO (transfer overlay)
+- 5500		proxyfied to the slave for Notification
+- 5555		proxyfied to the master (LAVA logger)
+- 5556		proxyfied to the master (LAVA master)
+- 10080		proxyfied to the master (Web interface)
+- 55950-56000	proxyfied to the slave for NBD
+
+### DHCPD
+A DHCPD service is necessary for giving network access to DUT.
+
+The DHCPD server could be anywhere with the condition that it is accessible of DUTs. (Could be on host, in a docker in the host, or is the ISP box on the same LAN.<br/>
+
+### Examples
+#### Example 1: Basic LAB with home router
+Router: 192.168.1.1 which handle DHCP for 192.168.1.10-192.168.1.254<br>
+Lab: 192.168.1.2<br>
+
+So the dispatcher_ip is set to 192.168.1.2
+
+#### Example 2: Basic LAB without home router
+Lab: 192.168.1.2 which handle DHCP for 192.168.1.10-192.168.1.254<br>
+
+So the dispatcher_ip is set to 192.168.1.2
+
+#### Example 3: LAB with dedicated LAN for DUTs
+A dedicated LAN is used for DUTs. (192.168.66.0/24)
+The host have two NIC:
+- eth0: (192.168.1.0/24) on home LAN. (The address could be static or via DHCP)
+- eth1: (192.168.66.0/24) with address set to 192.168.66.1
+
+On the host, a DHCPD give address in range of 192.168.66.3-192.168.66.200
+
+So the dispatcher_ip is set to 192.168.66.1
+
+#### DHCPD examples:
+##### isc-dhcpd-server
+A sample isc-dhcpd-server DHCPD config file is available in the dhcpd directory.<br/>
+##### dnsmasq
+Simply set interface=interfacename where interfacename is your shared LAN interface
 
 ## Generating files
+
+### Helper script
+You can use the lavalab-gen.sh helper script which will do all the above actions for you.
+
 ### boards.yaml
-This file describe how are setuped your boards, and how they are connected and powered.
-```
-lab-slave-XX:
-	dispatcher_ip: the IP where the slave could be contacted. In lava-docker it is the host IP since docker proxify TFTP from host to the slave.
-	boardlist:
-		devicename:
-			type: the devicetype of this device
-			pdu:
-				daemon: The hostname running the PDU daemon (always localhost)
-				host: The host name of the PDU as named in lavapdu.conf
-				port: portnumber (The port number of the PDU where the device is connected)
-			uart:
-				type:
-				serial: The serial number in case of FTDI uart
-```
-Notes:
-uart FTDI only need serial
-
-Examples: see boards.yaml
+This file describe how the DUTs are connected and powered.
+```
+lab-slave-XX:		The name of the slave (where XX is a number)
+  dispatcher_ip: the IP where the slave could be contacted. In lava-docker it is the host IP since docker proxify TFTP from host to the slave.
+  boardlist:
+    devicename:	Each board must be named by their device-type as "device-type-XX" (where XX is a number)
+      type: the LAVA device-type of this device
+      macaddr: (Optional) the MAC address to set in uboot
+# One of uart or connection_command must be choosen
+      uart:
+	idvendor: The VID of the UART
+	idproduct: the PID of the UART
+        serial: The serial number in case of FTDI uart
+        devpath: the UDEV devpath to this uart for UART without serial number
+      connection_command: A command to be ran for getting a serial console
+      pdu_generic:
+        hard_reset_command: commandline to reset the board
+	power_off_command: commandline to power off the board
+	power_on_command: commandline to power on the board
+```
+Notes on UART:
+* Only one of devpath/serial is necessary.
+* For finding the right devpath, you could use
+```
+udevadm info -a -n /dev/ttyUSBx |grep devpath | head -n1
+```
+* VID and PID could be found in lsusb. If a leading zero is present, the value must be given between double-quotes (and leading zero must be kept)
+Example:
+```
+Bus 001 Device 054: ID 0403:6001 Future Technology Devices International, Ltd FT232 Serial (UART) IC
+```
+This device must use "0403" for idvendor and 6001 for idproduct.
+
+Note on connection_command: connection_command is for people which want to use other way than conmux to handle the console. (ser2net).
+
+Examples: see [boards.yaml.example](boards.yaml.example)
 
 ### tokens.yaml
-The tokens format have two section, one for user generation, the other for callback tokens
+The tokens format has two sections, one for LAVA users, the other for callback tokens
 ```
 lava_server_users:
-	- name: LAVA username
-	  token: The token of this use
-	  password: Password the this user (generated if not provided)
-	  superuser: yes/no (default no)
-	  staff: yes/no (default no)
+  - name: LAVA username
+    token: The token of this user
+    password: Password the this user (generated if not provided)
+    superuser: yes/no (default no)
+    staff: yes/no (default no)
 callback_tokens:
   - filename: The filename for storing the informations below, the name should be unique along other callback tokens
     username: The LAVA user owning the token below. (This user should be created via lava_server_users:)
     token: The token for this callback
     description: The description of this token. This string could be used with LAVA-CI.
 ```
-Example: see tokens.yaml
+Example: see [tokens.yaml](tokens.yaml)
 
 ### Generate
 ```
 lavalab-gen.py
 ```
 
-this scripts will generate all necessary files in the following location:
+this script will generate all necessary files in the following locations:
 ```
 conmux/		All files needed by conmux
 tokens/		This is where the callback tokens will be generated
 users/		This is where the users will be generated
-devices/	All LAVA devices files (note that an extra qemu device is also created for the master)
+devices/	All LAVA devices files
 slaves/		Contain the dispatcher_ip to give to slave node
 udev-rules for host
 docker-compose.yml	Generated from docker-compose.template
 ```
 
-All thoses files (except for udev-rules) will be handled by docker.
-The udev-rules is for generating the right /dev/xxx TTY names.
+All thoses file (except for udev-rules) will be handled by docker.
 
-You can still hack after generated files.
+You can still hack after all generated files.
 
-## Building
-To build an image locally, execute the following from the directory you cloned the repo:
+#### udev rules
+Note that the udev-rules are generated for the host, they must be placed in /etc/udev/rules.d/
+They are used for giving a proper /dev/xxx name to tty devices. (where xxx is the board name)
+(lavalab-gen.sh will do it for you)
+
+### Building
+To build all docker images, execute the following from the directory you cloned the repo:
 
 ```
 docker-compose build
 ```
 
-## Running
+### Running
+For running all images, simply run:
 ```
-docker-compose up
+docker-compose up -d
 ```
 
-## Process wrapper
-You can use the lavalab-gen.sh wrapper which will do all the above actions
-
 ## Proxy cache
-A squid docker is provided for caching all LAVA downloads (image, dtb, rootfs, etc...)
-You have to uncomment a line in lava-master/Dockerfile to enable it
+A squid docker is provided for caching all LAVA downloads (image, dtb, rootfs, etc...)<br/>
+You have to uncomment a line in lava-master/Dockerfile to enable it.<br/>
+Note that the squid proxy is always built and run.
 
 ## Security
 Note that this container provides defaults which are unsecure. If you plan on deploying this in a production enviroment please consider the following items:
 
-  * Changing the default admin password
+  * Changing the default admin password (in tokens.taml)
   * Using HTTPS
   * Re-enable CSRF cookie (disabled in lava-master/Dockerfile)
diff --git a/boards.yaml.example b/boards.yaml.example
new file mode 100644
index 0000000..e989af9
--- /dev/null
+++ b/boards.yaml.example
@@ -0,0 +1,66 @@
+lab-slave-0:
+  dispatcher_ip: 192.168.66.1
+  boardlist:
+    qemu-01:
+      type: qemu
+    bcm2837-rpi-3-b-01:
+      type: bcm2837-rpi-3-b
+      pdu_generic:
+        hard_reset_command: /usr/local/bin/acme-cli -s 192.168.66.2 reset 1
+        power_off_command: /usr/local/bin/acme-cli -s 192.168.66.2 switch_off 1
+        power_on_command: /usr/local/bin/acme-cli -s 192.168.66.2 switch_on 1
+      uart:
+        idvendor: "0403"
+        idproduct: 6001
+        serial: FT9QQZTA
+    am335x-boneblack-01:
+      type: beaglebone-black
+      pdu_generic:
+        hard_reset_command: /usr/local/bin/acme-cli -s 192.168.66.2 reset 2
+        power_off_command: /usr/local/bin/acme-cli -s 192.168.66.2 switch_off 2
+        power_on_command: /usr/local/bin/acme-cli -s 192.168.66.2 switch_on 2
+      uart:
+        idvendor: "0403"
+        idproduct: 6001
+        serial: FT9QR1A9
+    meson-gxl-s905x-libretech-cc-01:
+      type: meson-gxl-s905x-libretech-cc
+      pdu_generic:
+        hard_reset_command: /usr/local/bin/acme-cli -s 192.168.66.2 reset 3
+        power_off_command: /usr/local/bin/acme-cli -s 192.168.66.2 switch_off 3
+        power_on_command: /usr/local/bin/acme-cli -s 192.168.66.2 switch_on 3
+      uart:
+        idvendor: 067b
+        idproduct: 2303
+        devpath: 1.1.4
+      macaddr: "00:FA:E0:DE:AD:78"
+    dragonboard-410c-01:
+      type: dragonboard-410c
+      pdu_generic:
+        hard_reset_command: /usr/local/bin/acme-cli -s 192.168.66.2 reset 4
+        power_off_command: /usr/local/bin/acme-cli -s 192.168.66.2 switch_off 4
+        power_on_command: /usr/local/bin/acme-cli -s 192.168.66.2 switch_on 4
+      uart:
+        idvendor: "0403"
+        idproduct: 6001
+        serial: FT9R7VDB
+    r8a7796-m3ulcb-01:
+      type: r8a7796-m3ulcb
+      pdu_generic:
+        hard_reset_command: /usr/local/bin/acme-cli -s 192.168.66.2 reset 5
+        power_off_command: /usr/local/bin/acme-cli -s 192.168.66.2 switch_off 5
+        power_on_command: /usr/local/bin/acme-cli -s 192.168.66.2 switch_on 5
+      uart:
+        idvendor: "0403"
+        idproduct: 6001
+        serial: AK04WW0Q
+    imx6q-sabrelite-01:
+      type: imx6q-sabrelite
+      pdu_generic:
+        hard_reset_command: /usr/local/bin/acme-cli -s 192.168.66.2 reset 6
+        power_off_command: /usr/local/bin/acme-cli -s 192.168.66.2 switch_off 6
+        power_on_command: /usr/local/bin/acme-cli -s 192.168.66.2 switch_on 6
+      uart:
+        idvendor: "0403"
+        idproduct: 6015
+        serial: DAZ0KEUH