mbox

[PULL,00/45] testing updates (fixes, upgrades, caching)

Message ID 20190910084349.28817-1-alex.bennee@linaro.org (mailing list archive)
State New, archived
Headers show

Pull-request

https://github.com/stsquad/qemu.git tags/pull-testing-next-100919-1

Message

Alex Bennée Sept. 10, 2019, 8:43 a.m. UTC 
The following changes since commit 89ea03a7dc83ca36b670ba7f787802791fcb04b1:

  Merge remote-tracking branch 'remotes/huth-gitlab/tags/m68k-pull-2019-09-07' into staging (2019-09-09 09:48:34 +0100)

are available in the Git repository at:

  https://github.com/stsquad/qemu.git tags/pull-testing-next-100919-1

for you to fetch changes up to 4cf22bac5b22a36adf23dc9ec4628c66bbc6f209:

  travis.yml: Install libcap-dev for testing virito-9p (2019-09-10 09:39:09 +0100)

----------------------------------------------------------------
Testing fixes:

  - podman cleanups
  - docker.py python3 fixes (encode)
  - DEF_TARGET_LIST applied to cross build images
  - move a bunch to Buster based images
  - enable Travis caching
  - more common objs for faster builds
  - stable URLs for acceptance tests
  - additional travis dependencies

----------------------------------------------------------------
Alex Bennée (28):
      configure: clean-up container cross compile detect
      tests/docker: fix "cc" command to work with podman
      tests/docker: handle missing encoding keyword for subprocess.check_output
      tests/docker: fix final missing .encode when parsing solibs
      tests/tcg: add .gitignore for in source builds
      tests/docker: move DEF_TARGET_LIST setting to common.rc
      tests/docker: set DEF_TARGET_LIST for some containers
      tests/docker: add Buster to DOCKER_PARTIAL_IMAGES
      tests/docker: move our arm64 cross compile to Buster
      tests/docker: move our powerpc cross compile to Buster
      tests/docker: move our Alpha cross compile to Buster
      tests/docker: move our HPPA cross compile to Buster
      tests/docker: move our m68k cross compile to Buster
      tests/docker: move our sparc64 cross compile to Buster
      tests/docker: move our sh4 cross compile to Buster
      tests/docker: move our mips64 cross compile to Buster
      tests/docker: move our riscv64 cross compile to Buster
      tests/docker: move our ppc64 cross compile to Buster
      tests/docker: update Debian Sid image
      tests/docker: pin powerpc-user-cross to a snapshot
      tests/docker: add debian-xtensa-cross to DEBIAN_PARTIAL_IMAGES
      tests/docker: add debian9-mxe to DEBIAN_PARTIAL_IMAGES
      tests/docker: avoid $SHELL invoke bash directly
      tests/docker: add debian-amd64-cross for non-x86 hosts
      tests/docker: use --arch-only for installing deps
      tests/docker: add more images to PARTIAL_IMAGES when not on x86_64
      tests/docker: --disable-libssh on ubuntu1804 builds
      configure: check if --no-pie is supported first

Cleber Rosa (1):
      Fedora images: use URLs from stable "archives.fedoraproject.org"

John Snow (1):
      tests/docker: Use --userns=keep-id for podman

Paolo Bonzini (3):
      tests/tcg: use EXTRA_CFLAGS everywhere
      tests/tcg: cleanup Makefile inclusions
      tests/tcg: move configuration to a sub-shell script

Philippe Mathieu-Daudé (10):
      .travis.yml: Enable multiple caching features
      .travis.yml: Increase cache timeout from 3min to 20min
      .travis.yml: Cache Python PIP packages
      .travis.yml: Cache Avocado cache
      .travis.yml: Improve ccache use
      .travis.yml: Enable ccache on OSX
      .travis.yml: Document how the build matrix use caches
      .travis.yml: Cache Linux/GCC 'debug profile' jobs together
      .travis.yml: Cache Linux/GCC 'non-debug profile' jobs together
      .travis.yml: Cache Linux/Clang jobs together

Thomas Huth (2):
      hw/misc: Mark most objects as "common" code to speed up compilation a litte bit
      travis.yml: Install libcap-dev for testing virito-9p

 .shippable.yml                                     |   2 +
 .travis.yml                                        |  40 +++-
 Makefile                                           |   1 +
 Makefile.target                                    |   3 -
 configure                                          | 168 ++-------------
 hw/misc/Makefile.objs                              |  90 ++++----
 qemu-doc.texi                                      |   6 +-
 tests/Makefile.include                             |  25 ++-
 tests/acceptance/boot_linux_console.py             |  25 ++-
 tests/acceptance/linux_initrd.py                   |   5 +-
 tests/docker/Makefile.include                      |  58 +++--
 tests/docker/common.rc                             |   4 +
 tests/docker/docker.py                             |  51 +++--
 tests/docker/dockerfiles/debian-alpha-cross.docker |   7 +-
 tests/docker/dockerfiles/debian-amd64-cross.docker |  22 ++
 tests/docker/dockerfiles/debian-arm64-cross.docker |   7 +-
 tests/docker/dockerfiles/debian-armel-cross.docker |   3 +-
 tests/docker/dockerfiles/debian-armhf-cross.docker |   3 +-
 .../dockerfiles/debian-buster-arm64-cross.docker   |  16 --
 tests/docker/dockerfiles/debian-hppa-cross.docker  |   5 +-
 tests/docker/dockerfiles/debian-m68k-cross.docker  |   5 +-
 tests/docker/dockerfiles/debian-mips-cross.docker  |   7 +-
 .../docker/dockerfiles/debian-mips64-cross.docker  |   5 +-
 .../dockerfiles/debian-mips64el-cross.docker       |   3 +-
 .../docker/dockerfiles/debian-mipsel-cross.docker  |   2 +-
 .../docker/dockerfiles/debian-powerpc-cross.docker |   8 +-
 .../dockerfiles/debian-powerpc-user-cross.docker   |   8 +-
 tests/docker/dockerfiles/debian-ppc64-cross.docker |   7 +-
 .../docker/dockerfiles/debian-ppc64el-cross.docker |   3 +-
 .../docker/dockerfiles/debian-riscv64-cross.docker |   5 +-
 tests/docker/dockerfiles/debian-s390x-cross.docker |   3 +-
 tests/docker/dockerfiles/debian-sh4-cross.docker   |   5 +-
 tests/docker/dockerfiles/debian-sid.docker         |  24 +--
 .../docker/dockerfiles/debian-sparc64-cross.docker |   5 +-
 tests/docker/dockerfiles/ubuntu1804.docker         |   3 +
 tests/docker/run                                   |   4 +-
 tests/docker/test-build                            |   1 -
 tests/docker/test-mingw                            |   1 -
 tests/docker/test-quick                            |   1 -
 tests/tcg/.gitignore                               |   5 +
 tests/tcg/Makefile.include                         |  88 --------
 tests/tcg/Makefile.prereqs                         |  18 ++
 tests/tcg/Makefile.probe                           |  31 ---
 tests/tcg/Makefile.qemu                            |  95 +++++++++
 tests/tcg/{Makefile => Makefile.target}            |  15 +-
 tests/tcg/aarch64/Makefile.include                 |   8 -
 tests/tcg/aarch64/Makefile.softmmu-target          |   4 +-
 tests/tcg/aarch64/Makefile.target                  |  12 +-
 tests/tcg/alpha/Makefile.include                   |   2 -
 tests/tcg/alpha/Makefile.softmmu-target            |   4 +-
 tests/tcg/arm/Makefile.include                     |   8 -
 tests/tcg/arm/Makefile.softmmu-target              |   6 +-
 tests/tcg/configure.sh                             | 234 +++++++++++++++++++++
 tests/tcg/cris/Makefile.include                    |   6 -
 tests/tcg/hppa/Makefile.include                    |   2 -
 tests/tcg/i386/Makefile.include                    |   9 -
 tests/tcg/i386/Makefile.softmmu-target             |  12 +-
 tests/tcg/i386/Makefile.target                     |  13 +-
 tests/tcg/m68k/Makefile.include                    |   2 -
 tests/tcg/minilib/Makefile.target                  |   2 +-
 tests/tcg/mips/Makefile.include                    |  20 --
 tests/tcg/ppc/Makefile.include                     |  10 -
 tests/tcg/riscv/Makefile.include                   |  10 -
 tests/tcg/s390x/Makefile.include                   |   2 -
 tests/tcg/sh4/Makefile.include                     |   4 -
 tests/tcg/sparc64/Makefile.include                 |   2 -
 tests/tcg/x86_64/Makefile.softmmu-target           |  36 ++++
 tests/tcg/x86_64/Makefile.target                   |   7 +-
 tests/tcg/xtensa/Makefile.include                  |  11 -
 tests/tcg/xtensa/Makefile.softmmu-target           |   4 +-
 tests/vm/fedora                                    |   2 +-
 71 files changed, 715 insertions(+), 610 deletions(-)
 create mode 100644 tests/docker/dockerfiles/debian-amd64-cross.docker
 delete mode 100644 tests/docker/dockerfiles/debian-buster-arm64-cross.docker
 create mode 100644 tests/tcg/.gitignore
 delete mode 100644 tests/tcg/Makefile.include
 create mode 100644 tests/tcg/Makefile.prereqs
 delete mode 100644 tests/tcg/Makefile.probe
 create mode 100644 tests/tcg/Makefile.qemu
 rename tests/tcg/{Makefile => Makefile.target} (90%)
 delete mode 100644 tests/tcg/aarch64/Makefile.include
 delete mode 100644 tests/tcg/alpha/Makefile.include
 delete mode 100644 tests/tcg/arm/Makefile.include
 create mode 100755 tests/tcg/configure.sh
 delete mode 100644 tests/tcg/cris/Makefile.include
 delete mode 100644 tests/tcg/hppa/Makefile.include
 delete mode 100644 tests/tcg/i386/Makefile.include
 delete mode 100644 tests/tcg/m68k/Makefile.include
 delete mode 100644 tests/tcg/mips/Makefile.include
 delete mode 100644 tests/tcg/ppc/Makefile.include
 delete mode 100644 tests/tcg/riscv/Makefile.include
 delete mode 100644 tests/tcg/s390x/Makefile.include
 delete mode 100644 tests/tcg/sh4/Makefile.include
 delete mode 100644 tests/tcg/sparc64/Makefile.include
 create mode 100644 tests/tcg/x86_64/Makefile.softmmu-target
 delete mode 100644 tests/tcg/xtensa/Makefile.include

--
2.20.1

Comments

Peter Maydell Sept. 10, 2019, 9:58 a.m. UTC | #1 
On Tue, 10 Sep 2019 at 09:43, Alex Bennée <alex.bennee@linaro.org> wrote:
>
> The following changes since commit 89ea03a7dc83ca36b670ba7f787802791fcb04b1:
>
>   Merge remote-tracking branch 'remotes/huth-gitlab/tags/m68k-pull-2019-09-07' into staging (2019-09-09 09:48:34 +0100)
>
> are available in the Git repository at:
>
>   https://github.com/stsquad/qemu.git tags/pull-testing-next-100919-1
>
> for you to fetch changes up to 4cf22bac5b22a36adf23dc9ec4628c66bbc6f209:
>
>   travis.yml: Install libcap-dev for testing virito-9p (2019-09-10 09:39:09 +0100)
>
> ----------------------------------------------------------------
> Testing fixes:
>
>   - podman cleanups
>   - docker.py python3 fixes (encode)
>   - DEF_TARGET_LIST applied to cross build images
>   - move a bunch to Buster based images
>   - enable Travis caching
>   - more common objs for faster builds
>   - stable URLs for acceptance tests
>   - additional travis dependencies

Hi; this seems to break 'check-tcg' (for a linux-user static config):

[...]
  CHECK   debian-ppc64-cross
  BUILD   ppc64-linux-user guest-tests with docker qemu:debian-ppc64-cross
  RUN     tests for ppc64
  TEST    test-mmap (default) on ppc64
  TEST    sha1 on ppc64
  TEST    linux-test on ppc64
  TEST    testthread on ppc64
  BUILD   TCG tests for ppc64abi32-linux-user
  BUILD   ppc64abi32-linux-user guest-tests with powerpc-linux-gnu-gcc
  RUN     TCG tests for ppc64abi32-linux-user
  BUILD   ppc64abi32-linux-user guest-tests with powerpc-linux-gnu-gcc
  RUN     tests for ppc64abi32
  TEST    test-mmap (default) on ppc64abi32
  TEST    sha1 on ppc64abi32
  TEST    linux-test on ppc64abi32
qemu: uncaught target signal 11 (Segmentation fault) - core dumped
timeout: the monitored command dumped core
Segmentation fault
../Makefile.target:116: recipe for target 'run-linux-test' failed


thanks
-- PMM
Alex Bennée Sept. 10, 2019, 11:27 a.m. UTC | #2 
Peter Maydell <peter.maydell@linaro.org> writes:

> On Tue, 10 Sep 2019 at 09:43, Alex Bennée <alex.bennee@linaro.org> wrote:
>>
>> The following changes since commit 89ea03a7dc83ca36b670ba7f787802791fcb04b1:
>>
>>   Merge remote-tracking branch 'remotes/huth-gitlab/tags/m68k-pull-2019-09-07' into staging (2019-09-09 09:48:34 +0100)
>>
>> are available in the Git repository at:
>>
>>   https://github.com/stsquad/qemu.git tags/pull-testing-next-100919-1
>>
>> for you to fetch changes up to 4cf22bac5b22a36adf23dc9ec4628c66bbc6f209:
>>
>>   travis.yml: Install libcap-dev for testing virito-9p (2019-09-10 09:39:09 +0100)
>>
>> ----------------------------------------------------------------
>> Testing fixes:
>>
>>   - podman cleanups
>>   - docker.py python3 fixes (encode)
>>   - DEF_TARGET_LIST applied to cross build images
>>   - move a bunch to Buster based images
>>   - enable Travis caching
>>   - more common objs for faster builds
>>   - stable URLs for acceptance tests
>>   - additional travis dependencies
>
> Hi; this seems to break 'check-tcg' (for a linux-user static config):
>
> [...]
>   CHECK   debian-ppc64-cross
>   BUILD   ppc64-linux-user guest-tests with docker qemu:debian-ppc64-cross
>   RUN     tests for ppc64
>   TEST    test-mmap (default) on ppc64
>   TEST    sha1 on ppc64
>   TEST    linux-test on ppc64
>   TEST    testthread on ppc64
>   BUILD   TCG tests for ppc64abi32-linux-user
>   BUILD   ppc64abi32-linux-user guest-tests with powerpc-linux-gnu-gcc
>   RUN     TCG tests for ppc64abi32-linux-user
>   BUILD   ppc64abi32-linux-user guest-tests with powerpc-linux-gnu-gcc
>   RUN     tests for ppc64abi32
>   TEST    test-mmap (default) on ppc64abi32
>   TEST    sha1 on ppc64abi32
>   TEST    linux-test on ppc64abi32
> qemu: uncaught target signal 11 (Segmentation fault) - core dumped
> timeout: the monitored command dumped core
> Segmentation fault
> ../Makefile.target:116: recipe for target 'run-linux-test' failed

What host are you running on? Mine doesn't run because it has no way of
building those tests.

>
>
> thanks
> -- PMM


--
Alex Bennée
Peter Maydell Sept. 10, 2019, 11:30 a.m. UTC | #3 
On Tue, 10 Sep 2019 at 12:28, Alex Bennée <alex.bennee@linaro.org> wrote:
> Peter Maydell <peter.maydell@linaro.org> writes:
> > Hi; this seems to break 'check-tcg' (for a linux-user static config):
> >
> > [...]
> >   CHECK   debian-ppc64-cross
> >   BUILD   ppc64-linux-user guest-tests with docker qemu:debian-ppc64-cross
> >   RUN     tests for ppc64
> >   TEST    test-mmap (default) on ppc64
> >   TEST    sha1 on ppc64
> >   TEST    linux-test on ppc64
> >   TEST    testthread on ppc64
> >   BUILD   TCG tests for ppc64abi32-linux-user
> >   BUILD   ppc64abi32-linux-user guest-tests with powerpc-linux-gnu-gcc
> >   RUN     TCG tests for ppc64abi32-linux-user
> >   BUILD   ppc64abi32-linux-user guest-tests with powerpc-linux-gnu-gcc
> >   RUN     tests for ppc64abi32
> >   TEST    test-mmap (default) on ppc64abi32
> >   TEST    sha1 on ppc64abi32
> >   TEST    linux-test on ppc64abi32
> > qemu: uncaught target signal 11 (Segmentation fault) - core dumped
> > timeout: the monitored command dumped core
> > Segmentation fault
> > ../Makefile.target:116: recipe for target 'run-linux-test' failed
>
> What host are you running on? Mine doesn't run because it has no way of
> building those tests.

x86-64 Ubuntu 18.04.3 LTS (bionic).

thanks
-- PMM