ci: Add environment files for all settings #16623

This moves all environment settings from travis to files in the ci folder. Now, it is possible to easily run each travis configuration with a single command.

This approach pollutes the calling bash environment. Should work without export?

Concept ACK.

<!--e57a25ab6845829454e8d69fc972939a-->

The following sections might be updated with supplementary metadata relevant to reviewers and maintainers.

<!--174a7506f384e20aa4161008e828411d-->

Conflicts

Reviewers, this pull request conflicts with the following ones:

• #16392 (WIP build: macOS toolchain update by fanquake)
• #16161 (util: Fix compilation errors in support/lockedpool.cpp by jkczyz)
• #15584 (build: disable BIP70 support by default by fanquake)
• #12134 (Build previous releases and run functional tests by Sjors)

If you consider this pull request important, please also help to review the conflicting pull requests. Ideally, start with the one that should be merged first.

Concept ACK

I'll run through each of the different ENV builds locally. Have done amd64_asan and amd64_qt5 so far.

For a future change / discussion, it'd be handy if the Docker containers were named. amd64_qt is more useful than peaceful_rubin once there are a bunch floating around.

Also, maybe we could stop (although not destroy) containers automatically after successful completion of the tests?

This approach pollutes the calling bash environment.

Can you explain what command exactly does that? I can't find any.

It will potentially pollute your ccache dir and the git repo with build artifacts, but that has nothing to do with bash.

Good suggestions @fanquake. I'll probably leave those as follow-up features that can be added.

ACK. I would find it easier if the new files were numbered the same as its equivalent Travis machine.

Recipe to verify the move:

1. delete export from ci/test/00_setup_env_*
2. git commit -a --amend
3. git show --color-moved=dimmed-zebra --color-moved-ws=allow-indentation-change

I tried (cloned in /home/travis/bitcoin):

cd bitcoin
FILE_ENV="./ci/test/00_setup_env_amd64_qt5.sh" ./ci/test_run_all.sh

This fails at the configure step:

travis_fold:start:configure
configure: loading site script /home/travis/bitcoin/depends/x86_64-unknown-linux-gnu/share/config.site
configure: loading cache config.cache
configure: error: `CXXFLAGS' was not set in the previous run
configure: error: `CFLAGS' was not set in the previous run
configure: error: in `/home/travis/bitcoin/build':
configure: error: changes in the environment can compromise the build
configure: error: run `make distclean' and/or `rm config.cache' and start over
...
configure:2987: loading cache config.cache
configure:3014: error: `CXXFLAGS' was not set in the previous run
configure:3014: error: `CFLAGS' was not set in the previous run
configure:3051: error: in `/home/travis/bitcoin/build':
configure:3053: error: changes in the environment can compromise the build
configure:3055: error: run `make distclean' and/or `rm config.cache' and start over
...
configure: exit 1

It may have gotten poluted from a previous run, so I tried purging docker instances and nuking the git repository:

docker stop $(docker ps -a -q)
docker container prune
git clean -dfx

Now it runs. Because Docker has root privileges, things very quickly turn into permission hell if you try to run more than one instance.

As a followup, it would be nice if you can run all configurations with a single command (stopping if any fails).

Now it runs. Because Docker has root privileges, things very quickly turn into permission hell if you try to run more than one instance.

You can't run more than one ci instance on the repo at the same time.

As a followup, it would be nice if you can run all configurations with a single command (stopping if any fails).

I'll leave this as follow-up ;)

You can't run more than one ci instance on the repo at the same time.

I was running them in sequence.

That should work as long as you run sudo git clean -dffx (at your own risk, obviously)