make: CI Win64 build

kiminuo commented at 7:54 am on September 1, 2021: contributor

Hi,

I executed the following command:

0MAKEJOBS="-j15" FILE_ENV="./ci/test/00_setup_env_win64.sh" ./ci/test_run_all.sh

and I got:

 0[...]
 1/usr/bin/x86_64-w64-mingw32-ar cr leveldb/libmemenv.a leveldb/helpers/memenv/libmemenv_a-memenv.o 
 2/usr/bin/x86_64-w64-mingw32-ranlib leveldb/libmemenv.a
 3make  -C secp256k1 libsecp256k1.la
 4make[3]: Entering directory '/home/user/bitcoin/bitcoin/ci/scratch/build/bitcoin-x86_64-w64-mingw32/src/secp256k1'
 5x86_64-w64-mingw32-gcc -O2  -std=c89 -pedantic -Wno-long-long -Wnested-externs -Wshadow -Wstrict-prototypes -Wundef -Wno-overlength-strings -Wall -Wno-unused-function -Wextra -Wcast-align -Wcast-align=strict -fvisibility=hidden  -pipe -O2  -L/home/user/bitcoin/bitcoin/depends/x86_64-w64-mingw32/lib  gen_context.o -o gen_context
 6./gen_context
 7/bin/bash: ./gen_context: No such file or directory
 8make[3]: Leaving directory '/home/user/bitcoin/bitcoin/ci/scratch/build/bitcoin-x86_64-w64-mingw32/src/secp256k1'
 9make[3]: *** [Makefile:1785: src/ecmult_static_context.h] Error 127
10make[2]: *** [Makefile:18108: secp256k1/libsecp256k1.la] Error 2
11make[2]: Leaving directory '/home/user/bitcoin/bitcoin/ci/scratch/build/bitcoin-x86_64-w64-mingw32/src'
12make[1]: *** [Makefile:16271: all-recursive] Error 1
13make[1]: Leaving directory '/home/user/bitcoin/bitcoin/ci/scratch/build/bitcoin-x86_64-w64-mingw32/src'
14make: *** [Makefile:823: all-recursive] Error 1

Am I doing something wrong or is something broken? Note the /bin/bash: ./gen_context: No such file or directory error.

For debugging purposes I did list the following directory:

 0ci/scratch/build/bitcoin-x86_64-w64-mingw32/src/secp256k1# ls -l
 1total 1732
 2-rw-rw-r-- 1 1000 1000   1057 Aug 28 07:26 COPYING
 3-rw-r--r-- 1 root root  74645 Aug 31 14:01 Makefile
 4-rw-rw-r-- 1 1000 1000   5426 Aug 28 07:26 Makefile.am
 5-rw-r--r-- 1 root root  79831 Aug 31 14:00 Makefile.in
 6-rw-r--r-- 1 root root  53198 Aug 31 14:00 aclocal.m4
 7-rwxrwxr-x 1 1000 1000     47 Aug 28 07:26 autogen.sh
 8drwxr-xr-x 3 root root   4096 Aug 31 14:01 build-aux
 9-rw-r--r-- 1 root root  66027 Aug 31 14:01 config.log
10-rwxr-xr-x 1 root root  63237 Aug 31 14:01 config.status
11-rwxr-xr-x 1 root root 531431 Aug 31 14:00 configure
12-rw-rw-r-- 1 1000 1000  20668 Aug 28 07:26 configure.ac
13drwxr-xr-x 2 root root   4096 Aug 31 14:01 contrib
14-rwxr-xr-x 1 root root 397219 Aug 31 14:10 gen_context.exe
15-rw-r--r-- 1 root root  82253 Aug 31 14:02 gen_context.o
16drwxr-xr-x 2 root root   4096 Aug 31 14:01 include
17-rw-r--r-- 1 root root    414 Aug 31 14:01 libsecp256k1.pc
18-rw-rw-r-- 1 1000 1000    327 Aug 28 07:26 libsecp256k1.pc.in
19-rwxr-xr-x 1 root root 343214 Aug 31 14:01 libtool
20drwxr-xr-x 5 root root   4096 Aug 31 14:02 src

And one can see that gen_context.exe exists but not gen_context, so that makes me think that maybe there is some issue with $(BUILD_EXEEXT).

Do you encounter the same error? Any idea how to fix it?

Environment:

Ubuntu 20.04
git commit: 33707a2a

kiminuo added the label Bug on Sep 1, 2021

kiminuo renamed this:
~~CI Win64 build~~
make: CI Win64 build
on Sep 1, 2021

fanquake commented at 7:58 am on September 1, 2021: member

This is a known issue with libsecp256k1: https://github.com/bitcoin-core/secp256k1/issues/923#issuecomment-870162411.

fanquake added the label Windows on Sep 1, 2021

MarcoFalke commented at 3:14 pm on September 1, 2021: member

Does this happen in a clean git dir? Focal is also used in the CI, but it hasn’t hit this error yet, so I wonder what the difference here is.

MarcoFalke removed the label Bug on Sep 1, 2021

MarcoFalke added the label Tests on Sep 1, 2021

kiminuo commented at 4:37 pm on September 1, 2021: contributor

@MarcoFalke Yes, I did try git clean -xdf and it did not help me.

Focal is also used in the CI, but it hasn’t hit this error yet, so I wonder what the difference here is.

Same here. That’s why I’m interested whether others see the error too or whether it’s just me.

hebasto commented at 4:05 pm on September 25, 2021: member

Tested the recent master (16ccb3a1cd9125eb24a5b45a98099ff98660767a) on Linux Mint 20.2 (x86_64, Ubuntu 20.04 codebase):

0$ make distclean
1$ MAKEJOBS="-j9" FILE_ENV="./ci/test/00_setup_env_win64.sh" ./ci/test_run_all.sh

No errors.

Did another test with the clean repo. No errors.

kiminuo commented at 8:11 pm on September 25, 2021: contributor

I have tried again without any luck (16ccb3a1). Ubuntu 21.04

kiminuo closed this on Sep 25, 2021

kiminuo reopened this on Sep 25, 2021

fanquake commented at 3:16 am on October 1, 2021: member

The cause of this issue is having a machine with binfmt_misc enabled, and also have wine-binfmt installed. When we build configure gets confused, and thinks it isn’t cross-compiling, when it is. It takes a path where $(EXEEXT) doesn’t end up set, and thus tries to run gen_context when the executable is actually gen_context.exe. This is still an issue with latest upstream, however there are some PRs open that may fixup this problem.

For the moment, you could work around by disabling binfmt_misc, or uninstalling wine-binfmt.

hebasto commented at 2:52 am on December 9, 2021: member

@kiminuo

Would you mind testing #23722?

kiminuo commented at 7:52 am on December 9, 2021: contributor

@hebasto

Running MAKEJOBS="-j15" FILE_ENV="./ci/test/00_setup_env_win64.sh" ./ci/test_run_all.sh on Ubuntu 21.10 leads to the following compilation:

23722.log

Unfortunately, it fails to build for me.

(I can test more if you like.)

fanquake commented at 7:54 am on December 9, 2021: member

Unfortunately, it fails to build for me.

x86_64-w64-mingw32-g++: fatal error: Killed signal terminated program cc1plus compilation terminated.

That just looks like you’ve run out of memory.

kiminuo commented at 8:39 am on December 9, 2021: contributor

That just looks like you’ve run out of memory.

Weird, but it seems so.

New log: 23722.log

hebasto commented at 8:46 am on December 9, 2021: member

That just looks like you’ve run out of memory.

Weird, but it seems so.

New log: 23722.log

hmm,

0checking for QWindowsIntegrationPlugin (-lqwindows)... no
1configure: WARNING: QWindowsIntegrationPlugin not found.; bitcoin-qt frontend will not be built

hebasto commented at 9:05 am on December 9, 2021: member

@kiminuo

New log: 23722.log

Have you config.log available?

kiminuo commented at 12:53 pm on December 9, 2021: contributor

bitcoin-x86_64-w64-mingw32_config.log bitcoin-x86_64-w64-mingw32_src_secp256k1_config.log build_config.log src_secp256k1_config.log

real-or-random referenced this in commit 0559fc6e41 on Dec 15, 2021

fanquake closed this on Dec 16, 2021

fanquake referenced this in commit c06cda3e48 on Dec 18, 2021

DrahtBot locked this on Dec 16, 2022

make: CI Win64 build #22854