Adding a board
- 1. Make sure you can access the target via ssh, serial or some other connection
- 2. Decide whether to use an existing user account, or to create a user account specifically for testing
- 3. create a test directory on the target
- 4. create a board file (on the host)
- 5. add your board as a node in the Jenkins interface
The most common way to do this is to use 'ssh' access over a network connection. The target board needs to run an ssh server, and the host machine connects to it using the 'ssh' client.
The method of setting an ssh server up on a board varies from system to system, but sample instructions for setting up an ssh server on a raspberry pi are located here: Raspberry Pi Fuego Setup
Another method that can work is to use a serial connection between the host and the board's serial console. Setting this up is outside the scope of this current documentation, but Fuego uses the "serio" package to accomplish this. I
The user account used by Fuego is determined by your board file, which you will configure manually in step 4. You need to decide which account to use. There are three options:
- use the root account
- use an existing account
- use a new account, dedicated to testing
There are pros and cons to each approach.
My personal preference is to use the root account. Several tests in Fuego require root privileges. If you are working with a test board, that you can re-install easily, using the 'root' account will allow you to run the greatest number of tests. However, this should not be used to test machines that are in production. A Fuego test can run all kinds of commands, and you should not trust that tests will not destroy your machine (either accidentally or via some malicious intent).
If you don't use 'root', then you can either use an existing account, or create a new account. In most circumstances it is worthwhile to create a new account dedicated to testing. However, you may not have sufficient privileges on your board to do this.
In any event, at this point, decide which account you will use for testing with Fuego, and note it to include in the board file, described later.
For target with network connectivity :
For target with Serial connectivity :
Use minicom or any other serial terminal tool. Login to the target by giving username and password. Create the directory 'fuego' as below:
The easiest way to create a board file is to copy an existing one, and edit the variables to match those of your board. The following instructions are for a board called 'myboard', that has networking access, an ssh daemon running on target, and the ARM architecture.
Do the following:
Note: you can use your own editor in place of 'vi'
- TRANSPORT - this specifies the transport to use with the target
- there are three transport types currently supported: 'ssh', 'serial', 'ttc'
- Most boards will use the 'ssh' or 'serial' transport type
- ex: TRANSPORT="ssh"
Most targets require the following:
- LOGIN - specifies the user account to use for Fuego operations
- PASSWORD - specifies the password for that account (if any)
There are some parameters that are specific to individual transports.
For targets using ssh:
IPADDR is the network address of your board. SSH_PORT is the port where the ssh daemon is listening for connections. By default this is 22, but you should set this to whatever your target board uses. SSH_KEY is the absolute path where an SSH key file may be found (to allow password-less access to a target machine). An example would be:
SSH_PORT and SSH_KEY are optional.
For targets using serial:
SERIAL is serial port name used to access the target from the host. This is the name of the serial device node on the host (or in the container). this is specified without the /dev/ prefix. Some examples are:
BAUD is the baud-rate used for the serial communication, for eg. "115200".
IO_TIME_SERIAL is the time required to catch the command's response from the target. This is specified as a decimal fraction of a second, and is usually very short. A time that usually works is "0.1" seconds.
- ex: IO_TIME_SERIAL="0.1"
This value directly impacts the speed of operations over the serial port, so it should be adjusted with caution. However, if you find that some operations are not working over the serial port, try increasing this value (in small increments - 0.15, 0.2, etc.)
Note: In the case of TRANSPORT="serial", Please make sure that docker container and Fuego have sufficient permissions to access the specified serial port. You may need to modify docker-create-usb-privileged-container.sh prior to making your docker image, in order to make sure the container can access the ports. Also, if check that the host filesystem permissions on the device node (e.g /dev/ttyACM0 allows access. From inside the container you can try using the sersh or sercp commands directly, to test access to the target.
For targets using ttc:
TTC_TARGET is the name of the target used with the 'ttc' command.
The BOARD_TESTDIR directory is an absolute path in the filesystem on the target board where the Fuego tests are run. Normally this is set to something like "/home/fuego", but you can set it to anything. The user you specify for LOGIN should have access rights to this directory.
The ARCHITECTURE is a string describing the architecture used by toolchains to build the tests for the target.
The TOOLCHAIN variable indicates the toolchain to use to build the tests for the target. If you are using an ARM target, set this to "qemu-armv7hf". This is a default ARM toolchain installed in the docker container, and should work for most ARM boards.
If you are not using ARM, or for some reason the pre-installed arm toolchains don't work for the Linux distribution installed on your board, then you will need to install your own SDK or toolchain. In this case, follow the steps in Adding a toolchain, then come back to this step and set the TOOLCHAIN variable to the name you used for that operation.
For other variables in the board file, see the section below.
The DISTRIB variable specifies attributes of the Linux distribution running on the board, that are used by Fuego. Currently, this is mainly used to tell Fuego what kind of system logger the operating system on the board has. Here are some options that are available:
- base.dist - a "standard" distribution that implements syslogd-style system logging. It should have the commands: logread, logger, and /var/log/messages
- nologread.dist - a distribution that has no 'logread' command, but does have /var/log/messages
- nosyslogd.dist - a distribution that does not have syslogd-style system logging.
If DISTRIB is not specified, Fuego will default to using "nosyslogd.dist".
The BOARD_CONTROL variable specifies the name of the system used to control board hardware operations. When Fuego is used in conjunction with board control hardware, it can automate more testing functionality. Specifically, it can reboot the board, or re-provision the board, as needed for testing. As of the 1.3 release, Fuego only supports the 'ttc' board control system. Other board control systems will be introduced and supported over time.
In the Jenkins interface, boards are referred to as "Nodes".
You can see a list of the boards that Fuego knows about using:
- $ ftc list-boards When you run this command, you should see the name of the board you just created.
You can see the nodes that have already been installed in Jenkins with:
- $ ftc list-nodes
To actually add the board as a node in jenkins, inside the docker container, run the following command at a shell prompt:
- $ ftc add-nodes -b <board_name>
See Variables for the definition and usage of these variables.
To prepare to run a test on a filesystem on a sata device, define the SATA device and mountpoint variables for your board.
For example, if you had a SATA device with a mountable filesystem accessible on device /dev/sdb1, and you have a directory on your target of /mnt/sata that can be used to mount this device at, you could declare the following variables in your board file.
You can define variables with similar names (USB_DEV and USB_MP, or MMC_DEV and MMC_MP) for USB-based filesystems or MMC-based filesystems.
You can control whether the LTP posix test succeeds by indicating the number of positive and negative results you expect for your board. These numbers are indicated in test variables in the board file:
You should run the LTP test yourself once, to see what your baseline values should be, then set these to the correct values for your board (configuration and setup).
Then, Fuego will report any deviation from your accepted numbers, for LTP tests on your board.
LTP may also use these other test variables defined in the board file:
- FUNCTIONAL_LTP_HOMEDIR - If this variable is set, it indicates where a pre-installed version of LTP resides in the board's filesystem. This can be used to avoid a lengthy deploy phase on each execution of LTP.
- FUNCTIONAL_LTP_BOARD_SKIPLIST - This variable has a list of individual LTP test programs to skip.
See Functional.LTP for more information about the LTP test, and test variables used by it.