Release 1.3 testing - 2018-05-01

Here are some notes on testing the 1.3 release (using the 412-container):

flat problem list [edit section]

Resolution key:

Bugs seen:

Here are testplan_lts failures for 2018-05-01

min1 [edit section]

ren1 [edit section]

bbb [edit section]

rpi3-1 [edit section]

NOTES on test duration [edit section]

Overview [edit section]

  root@tlinux:/# ftc list-runs --where "start_time>yesterday,status!=PASS" | sort -k 3
Runs on this host:
where start_time value is '1.5250788e+12'
  Test                        Started                host:board                     Status
  --------------------------- ---------------------- ------------------------------ ------
  Functional.LTP              2018-05-01_01:18:20    fuegohost:bbb                  ERROR
  Functional.aiostress        2018-05-01_01:55:25    fuegohost:bbb                  ERROR
  Functional.crashme          2018-05-01_02:25:11    fuegohost:bbb                  ERROR
  Functional.ft2demos         2018-05-01_02:43:04    fuegohost:bbb                  ERROR
  Functional.glib             2018-05-01_02:54:57    fuegohost:bbb                  ERROR
  Functional.kernel_build     2018-05-01_00:44:46    fuegohost:bbb                  ERROR
  Functional.linus_stress     2018-05-01_03:24:50    fuegohost:bbb                  ERROR
  Functional.netperf          2018-05-01_03:36:43    fuegohost:bbb                  ERROR
  Functional.rmaptest         2018-05-01_03:48:36    fuegohost:bbb                  ERROR
  Functional.synctest         2018-05-01_04:00:29    fuegohost:bbb                  ERROR
  Functional.LTP              2018-05-01_00:43:58    fuegohost:min1                 FAIL
  Functional.aiostress        2018-05-01_01:34:38    fuegohost:min1                 FAIL
  Functional.glib             2018-05-01_01:37:38    fuegohost:min1                 FAIL
  Functional.kernel_build     2018-05-01_01:39:42    fuegohost:min1                 ERROR
  Functional.LTP              2018-05-01_01:01:23    fuegohost:ren1                 FAIL
  Functional.aiostress        2018-05-01_00:54:12    fuegohost:ren1                 ERROR
  Functional.crashme          2018-05-01_00:56:46    fuegohost:ren1                 FAIL
  Functional.ft2demos         2018-05-01_00:55:07    fuegohost:ren1                 ERROR
  Functional.glib             2018-05-01_00:49:26    fuegohost:ren1                 FAIL
  Functional.kernel_build     2018-05-01_00:47:49    fuegohost:ren1                 ERROR
  Benchmark.ffsb              2018-05-01_00:59:25    fuegohost:rpi3-1               SKIP
  Functional.LTP              2018-05-01_01:02:42    fuegohost:rpi3-1               FAIL
  Functional.aiostress        2018-05-01_00:44:39    fuegohost:rpi3-1               FAIL
  Functional.bc               2018-05-01_02:35:33    fuegohost:rpi3-1               ERROR
  Functional.ft2demos         2018-05-01_00:45:07    fuegohost:rpi3-1               ERROR
  Functional.glib             2018-05-01_02:38:14    fuegohost:rpi3-1               ERROR
  Functional.kernel_build     2018-05-01_01:01:38    fuegohost:rpi3-1               ERROR
  --------------------------- ---------------------- ------------------------------ ------

Details [edit section]

min1 LTP testcase problems [edit section]

root@tlinux:/# ftc gen-report --where "board=min1,test=LTP,start_time>yesterday,tguid:result!=PASS"
where start_time value is '1.5250788e+12'
======================================================================
           **** Fuego Test Report ****
  test                : LTP
  board               : min1
  kernel              : 4.13.0-39-generic
  timestamp           : 2018-05-01_00:43:58
  report_date         : 2018-05-01_17:55:27
======================================================================
--------------------------------------------------------------------------------------------------------------------------------
  test_name            spec                 board                timestamp            tguid                tguid:result
--------------------------------------------------------------------------------------------------------------------------------
  Functional.LTP       default              min1                 2018-05-01_00:43:58  syscalls             FAIL
  Functional.LTP       default              min1                 2018-05-01_00:43:58  syscalls.io_getevents01 FAIL
  Functional.LTP       default              min1                 2018-05-01_00:43:58  syscalls.fanotify06  FAIL
  Functional.LTP       default              min1                 2018-05-01_00:43:58  syscalls.io_submit01 FAIL
  Functional.LTP       default              min1                 2018-05-01_00:43:58  syscalls.io_cancel01 FAIL
  Functional.LTP       default              min1                 2018-05-01_00:43:58  syscalls.msgctl11    FAIL
  Functional.LTP       default              min1                 2018-05-01_00:43:58  syscalls.eventfd01   FAIL
  Functional.LTP       default              min1                 2018-05-01_00:43:58  syscalls.io_setup01  FAIL
  Functional.LTP       default              min1                 2018-05-01_00:43:58  syscalls.io_destroy01 FAIL
  Functional.LTP       default              min1                 2018-05-01_00:43:58  sem_init.sem_init_7-1 SKIP
--------------------------------------------------------------------------------------------------------------------------------

ren1 LTP testcase problems [edit section]

35 fails or skips

root@tlinux:/# ftc gen-report --where "board=ren1,test=LTP,start_time>yesterday,tguid:result!=PASS" --fields timestamp,build_number,kernel,tguid,tguid:result
where start_time value is '1.5250788e+12'
======================================================================
           **** Fuego Test Report ****
  test                : LTP
  board               : ren1
  kernel              : 4.9.0-yocto-standard
  timestamp           : 2018-05-01_01:01:23
  report_date         : 2018-05-01_18:45:22
======================================================================
-----------------------------------------------------------------------------------------------------------
  timestamp            build_number         kernel               tguid                tguid:result
-----------------------------------------------------------------------------------------------------------
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls             FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.cve-2017-6951 FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.prot_hsymlinks FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.renameat202 FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.add_key04   FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.keyctl08    FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.keyctl03    FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.keyctl02    FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.keyctl05    FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.keyctl04    FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.keyctl07    FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.keyctl06    FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.msgctl09    FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.msgctl08    FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.fanotify08  FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.fanotify07  FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.fanotify06  FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.utime02     FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.perf_event_open02 FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.abort01     FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.recvmsg01   FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.kill11      FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.msgctl10    FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.msgctl11    FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.request_key02 FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.open10      FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.renameat201 FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.add_key03   FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.setsockopt02 FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.cve-2017-5669 FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.sendmsg01   FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.request_key01 FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.request_key03 FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.setpriority01 FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard syscalls.utime01     FAIL
  2018-05-01_01:01:23  3                    4.9.0-yocto-standard sem_init.sem_init_7-1 SKIP
-----------------------------------------------------------------------------------------------------------

bbb.default.Functional.glib build error details [edit section]

libtool: compile:  arm-linux-gnueabihf-gcc -DHAVE_CONFIG_H -I. -I.. -I.. \
   -DG_LOG_DOMAIN=\"GLib\" -DG_DISABLE_CAST_CHECKS -DG_DISABLE_DEPRECATED \
   -DGLIB_COMPILATION -DPCRE_STATIC -DG_DISABLE_SINGLE_INCLUDES -pthread \
   -g -O2 -Wall -MT gatomic.lo -MD -MP -MF .deps/gatomic.Tpo -c gatomic.c \
   -fPIC -DPIC -o .libs/gatomic.o
/tmp/ccSPOtNr.s: Assembler messages:
/tmp/ccSPOtNr.s:65: Error: selected processor does not support `swp r3,r5,[r4]' in Thumb mode
/tmp/ccSPOtNr.s:85: Error: selected processor does not support `swp r3,r5,[r4]' in Thumb mode
/tmp/ccSPOtNr.s:188: Error: selected processor does not support `swp r3,r5,[r4]' in Thumb mode
/tmp/ccSPOtNr.s:208: Error: selected processor does not support `swp r3,r5,[r4]' in Thumb mode
/tmp/ccSPOtNr.s:310: Error: selected processor does not support `swp r3,r5,[r4]' in Thumb mode
/tmp/ccSPOtNr.s:330: Error: selected processor does not support `swp r3,r5,[r4]' in Thumb mode
/tmp/ccSPOtNr.s:432: Error: selected processor does not support `swp r3,r5,[r4]' in Thumb mode
/tmp/ccSPOtNr.s:452: Error: selected processor does not support `swp r3,r5,[r4]' in Thumb mode
Makefile:994: recipe for target 'gatomic.lo' failed

rpi3-11 LTP testcase problems [edit section]

root@tlinux:/# ftc gen-report --where "board=rpi3-1,test=LTP,tguid:result!=PASS,start_time>2 days ago"
where start_time value is '1.525060103e+12'
======================================================================
           **** Fuego Test Report ****
  test                : LTP
  board               : rpi3-1
  kernel              : 4.9.41-v7+
  timestamp           : 2018-05-01_01:02:42
  report_date         : 2018-05-02_03:48:23
======================================================================
--------------------------------------------------------------------------------------------------------------------------------
  test_name            spec                 board                timestamp            tguid                tguid:result
--------------------------------------------------------------------------------------------------------------------------------
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls             FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls.add_key04   FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls.keyctl03    FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls.keyctl02    FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls.keyctl05    FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls.keyctl04    FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls.keyctl07    FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls.keyctl06    FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls.io_getevents01 FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls.io_submit01 FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls.fcntl36     FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls.io_cancel01 FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls.msgctl11    FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls.eventfd01   FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls.request_key02 FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls.io_setup01  FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls.io_destroy01 FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls.add_key03   FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls.request_key01 FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  syscalls.request_key03 FAIL
  Functional.LTP       default              rpi3-1               2018-05-01_01:02:42  sem_init.sem_init_7-1 SKIP
--------------------------------------------------------------------------------------------------------------------------------

General Bugs [edit section]

table of current test status [edit section]

If a test is not listed here, it passes on all 4 platforms (bbb, ren1, min1, docker)

test  ^ bbb  ^ ren1  ^ min1  ^ rpi3-1  ^ docker  ^ notes  ^ disposition  ^
Benchmark.OpenSSL missing zconf.h . . . . . <empty cell>
Functional.aiostress missing libaio.o on target missing libaio.h missing libaio.so.1 on target . . . ?
Functional.crashme ok expected 3000, got 507 ok . . . ?
Functional.ft2demos missing libXau and libXmcdp missing libscb.la ok . . . ?
Functional.glib processor does not support Thumb mode program returns 143 exit code program returns 143 exit code . . . (high priority)
Functional.kernel_build . only builds in docker only builds in docker . . . needs review
Functional.LTP . . . . . default timeout is 40m (too short for some boards, when build is included) ?
Query