Hi Linus, Please pull the following Kselftest update for 4.18-rc1 This Kselftest update for 4.18-rc1 consists of: - Work to restructure timers test suite to move PIE out of rtctest from Alexandre Belloni. - Several minor spelling and bug fixes. - New cgroup tests from Roman Gushchin and Mike Rapoport. - Kselftest framework changes to handle and report skipped tests correctly. Prior to these changes, framework treated all non-zero return codes from tests as failures. When tests are skipped with non-zero return code, due to unmet dependencies and/or unsupported configuration, reporting them as failed lead to false negatives on the tests that couldn't be run. - Fixes to test Makefiles to remove unnecessary RUN_TESTS and EMIT_TESTS overrides and use common defines from lib.mk. - Fixes to several tests to return correct Kselftest skip code. - Changes to improve test output. diff is attached. thanks, -- Shuah ----------------------------------------------------------------------------------- The following changes since commit b04e217704b7f879c6b91222b066983a44a7a09f: Linux 4.17-rc7 (2018-05-27 13:01:47 -0700) are available in the git repository at: git://git.kernel.org/pub/scm/linux/kernel/git/shuah/linux-kselftest tags/linux-kselftest-4.18-rc1 for you to fetch changes up to fa32156921daa5c175228e2cac7679d50efd6c52: selftests: lib: fix prime_numbers module search and skip logic (2018-05-30 21:32:55 -0600) ---------------------------------------------------------------- linux-kselftest-4.18-rc1 This Kselftest update for 4.18-rc1 consists of: - Work to restructure timers test suite to move PIE out of rtctest from Alexandre Belloni. - Several minor spelling and bug fixes. - New cgroup tests from Roman Gushchin and Mike Rapoport. - Kselftest framework changes to handle and report skipped tests correctly. Prior to these changes, framework treated all non-zero return codes from tests as failures. When tests are skipped with non-zero return code, due to unmet dependencies and/or unsupported configuration, reporting them as failed lead to false negatives on the tests that couldn't be run. - Fixes to test Makefiles to remove unnecessary RUN_TESTS and EMIT_TESTS overrides and use common defines from lib.mk. - Fixes to several tests to return correct Kselftest skip code. - Changes to improve test output. ---------------------------------------------------------------- Alexandre Belloni (4): selftests: timers: move PIE tests out of rtctest selftests: timers: rtcpie: restore previous PIE rate selftests: move RTC tests to rtc subfolder selftests: rtc: rework rtctest Anders Roxell (3): selftests: kvm: add .gitignore for generated files selftests: kvm: update .gitignore with missing file selftests/filesystems: devpts_pts included wrong header Colin Ian King (2): selftests: media_tests: fix spelling mistake: "iternations" -> "iterations" selftests: filesystems: fix spelling mistake: "desciptor" -> "descriptor" Daniel Díaz (2): selftests/intel_pstate: Improve test, minor fixes selftests/intel_pstate: Enhance table printing Florian Weimer (1): selftests/x86: Detect -no-pie availability Jeffrin Jose T (2): selftest: intel_pstate: debug support message from aperf.c and return value selftests: intel_pstate: notification about privilege required to run intel_pstate testing script Mike Rapoport (2): selftests: cgroup/memcontrol: add basic test for swap controls selftests: cgroup/memcontrol: add basic test for socket accounting Roman Gushchin (2): selftests: cgroup: add memory controller self-tests kselftest/cgroup: fix variable dereferenced before check warning Shuah Khan (Samsung OSG) (37): selftests: lib.mk: cleanup RUN_TESTS define and make it readable selftests: lib.mk: add SKIP handling to RUN_TESTS define selftests: lib.mk: move running and printing result to a new function selftests: lib.mk: Include test suite name in the RUN_TESTS output selftests: lib.mk: add SKIP handling and test suite name to EMIT_TESTS selftests: lib.mk: add test execute bit check to EMIT_TESTS selftests: kselftest: change KSFT_SKIP=4 instead of KSFT_PASS selftests: android: delete RUN_TESTS and EMIT_TESTS overrides selftests: futex: delete RUN_TESTS and EMIT_TESTS overrides selftests: mount: delete RUN_TESTS and EMIT_TESTS overrides selftests: mqueue: delete RUN_TESTS and EMIT_TESTS overrides selftests: memory-hotplug: delete RUN_TESTS and EMIT_TESTS overrides selftests: android: ion: return Kselftest Skip code for skipped tests selftests: breakpoints: return Kselftest Skip code for skipped tests selftests: cpu-hotplug: return Kselftest Skip code for skipped tests selftests: cpufreq: return Kselftest Skip code for skipped tests selftests: efivarfs: return Kselftest Skip code for skipped tests selftests: exec: return Kselftest Skip code for skipped tests selftests: filesystems: return Kselftest Skip code for skipped tests selftests: firmware: return Kselftest Skip code for skipped tests selftests: gpio: return Kselftest Skip code for skipped tests selftests: intel_pstate: return Kselftest Skip code for skipped tests selftests: ipc: return Kselftest Skip code for skipped tests selftests: kmod: return Kselftest Skip code for skipped tests selftests: kvm: return Kselftest Skip code for skipped tests selftests: lib: add prime_numbers.sh test to Makefile selftests: lib: return Kselftest Skip code for skipped tests selftests: locking: add Makefile for locking test selftests: locking: return Kselftest Skip code for skipped tests selftests: media_tests: return Kselftest Skip code for skipped tests selftests: membarrier: return Kselftest Skip code for skipped tests selftests: memfd: return Kselftest Skip code for skipped tests selftests: memory-hotplug: return Kselftest Skip code for skipped tests selftests: mqueue: return Kselftest Skip code for skipped tests selftests: net: return Kselftest Skip code for skipped tests selftests: memfd: split regular and hugetlbfs tests selftests: lib: fix prime_numbers module search and skip logic MAINTAINERS | 2 +- tools/testing/selftests/Makefile | 5 +- tools/testing/selftests/android/Makefile | 8 - tools/testing/selftests/android/ion/ion_test.sh | 7 +- .../breakpoints/step_after_suspend_test.c | 6 +- tools/testing/selftests/cgroup/Makefile | 10 + tools/testing/selftests/cgroup/cgroup_util.c | 331 +++++++ tools/testing/selftests/cgroup/cgroup_util.h | 41 + tools/testing/selftests/cgroup/test_memcontrol.c | 1015 ++++++++++++++++++++ .../selftests/cpu-hotplug/cpu-on-off-test.sh | 14 +- tools/testing/selftests/cpufreq/main.sh | 5 +- tools/testing/selftests/efivarfs/efivarfs.sh | 7 +- tools/testing/selftests/exec/execveat.c | 6 +- tools/testing/selftests/filesystems/Makefile | 1 + tools/testing/selftests/filesystems/devpts_pts.c | 15 +- tools/testing/selftests/firmware/fw_fallback.sh | 4 +- tools/testing/selftests/firmware/fw_filesystem.sh | 4 +- tools/testing/selftests/firmware/fw_lib.sh | 7 +- tools/testing/selftests/futex/Makefile | 12 - tools/testing/selftests/gpio/gpio-mockup.sh | 12 +- tools/testing/selftests/intel_pstate/aperf.c | 6 +- tools/testing/selftests/intel_pstate/run.sh | 47 +- tools/testing/selftests/ipc/msgque.c | 7 +- tools/testing/selftests/kmod/kmod.sh | 13 +- tools/testing/selftests/kselftest.h | 2 +- tools/testing/selftests/kvm/.gitignore | 3 + tools/testing/selftests/kvm/lib/assert.c | 9 +- tools/testing/selftests/kvm/vmx_tsc_adjust_test.c | 2 + tools/testing/selftests/lib.mk | 55 +- tools/testing/selftests/lib/Makefile | 2 +- tools/testing/selftests/lib/bitmap.sh | 8 +- tools/testing/selftests/lib/prime_numbers.sh | 9 +- tools/testing/selftests/lib/printf.sh | 8 +- tools/testing/selftests/locking/Makefile | 10 + tools/testing/selftests/locking/ww_mutex.sh | 8 + tools/testing/selftests/media_tests/Makefile | 3 +- .../selftests/media_tests/media_device_open.c | 8 +- .../selftests/media_tests/media_device_test.c | 10 +- .../testing/selftests/membarrier/membarrier_test.c | 7 +- tools/testing/selftests/memfd/Makefile | 6 +- .../memfd/{run_tests.sh => run_hugetlbfs_test.sh} | 18 +- tools/testing/selftests/memory-hotplug/Makefile | 5 +- .../selftests/memory-hotplug/mem-on-off-test.sh | 14 +- tools/testing/selftests/mount/Makefile | 12 +- tools/testing/selftests/mount/run_tests.sh | 12 + tools/testing/selftests/mqueue/Makefile | 12 +- tools/testing/selftests/mqueue/mq_open_tests.c | 37 +- tools/testing/selftests/mqueue/mq_perf_tests.c | 8 +- tools/testing/selftests/net/fib_tests.sh | 8 +- tools/testing/selftests/net/netdevice.sh | 16 +- tools/testing/selftests/net/pmtu.sh | 5 +- tools/testing/selftests/net/psock_tpacket.c | 4 +- tools/testing/selftests/net/rtnetlink.sh | 31 +- tools/testing/selftests/rtc/.gitignore | 2 + tools/testing/selftests/rtc/Makefile | 9 + tools/testing/selftests/rtc/rtctest.c | 238 +++++ .../{timers/rtctest_setdate.c => rtc/setdate.c} | 0 tools/testing/selftests/timers/.gitignore | 3 +- tools/testing/selftests/timers/Makefile | 4 +- tools/testing/selftests/timers/rtcpie.c | 134 +++ tools/testing/selftests/timers/rtctest.c | 403 -------- tools/testing/selftests/x86/Makefile | 8 +- tools/testing/selftests/x86/trivial_program.c | 10 + 63 files changed, 2113 insertions(+), 615 deletions(-) create mode 100644 tools/testing/selftests/cgroup/Makefile create mode 100644 tools/testing/selftests/cgroup/cgroup_util.c create mode 100644 tools/testing/selftests/cgroup/cgroup_util.h create mode 100644 tools/testing/selftests/cgroup/test_memcontrol.c create mode 100644 tools/testing/selftests/kvm/.gitignore create mode 100644 tools/testing/selftests/locking/Makefile mode change 100644 => 100755 tools/testing/selftests/locking/ww_mutex.sh rename tools/testing/selftests/memfd/{run_tests.sh => run_hugetlbfs_test.sh} (88%) create mode 100755 tools/testing/selftests/mount/run_tests.sh create mode 100644 tools/testing/selftests/rtc/.gitignore create mode 100644 tools/testing/selftests/rtc/Makefile create mode 100644 tools/testing/selftests/rtc/rtctest.c rename tools/testing/selftests/{timers/rtctest_setdate.c => rtc/setdate.c} (100%) create mode 100644 tools/testing/selftests/timers/rtcpie.c delete mode 100644 tools/testing/selftests/timers/rtctest.c create mode 100644 tools/testing/selftests/x86/trivial_program.c -----------------------------------------------------------------------------------