build: multiprocess link issues on fedora aarch64 #26943

issue fanquake openend this issue on January 22, 2023
  1. fanquake commented at 3:41 pm on January 22, 2023: member

    master @ ad09b762757a293ff970113c15bd9dee3057e556

     0make -C depends/ -j5 NO_QT=1 NO_WALLET=1 NO_ZMQ=1 NO_NATPMP=1 NO_UPNP=1 MULTIPROCESS=1
 1./autogen.sh
 2CONFIG_SITE=/home/fedora/bitcoin/depends/aarch64-unknown-linux-gnu/share/config.site ./configure
 3make
 4...
 5  CXXLD    bitcoin-node
 6  CXXLD    test/test_bitcoin
 7/usr/bin/ld: /home/fedora/bitcoin/depends/aarch64-unknown-linux-gnu/lib/libmultiprocess.a(proxy.cpp.o): relocation R_AARCH64_ADR_PREL_PG_HI21 against symbol `_ZN2kj1_5Debug11minSeverityE' which may bind externally can not be used when making a shared object; recompile with -fPIC
 8/usr/bin/ld: /home/fedora/bitcoin/depends/aarch64-unknown-linux-gnu/lib/libmultiprocess.a(proxy.cpp.o)(.text+0xa34): unresolvable R_AARCH64_ADR_PREL_PG_HI21 relocation against symbol `_ZN2kj1_5Debug11minSeverityE'
 9/usr/bin/ld: final link failed: bad value
10collect2: error: ld returned 1 exit status
  2. fanquake added the label Build system on Jan 22, 2023
  3. hebasto commented at 9:37 am on January 25, 2023: member

    FWIW, there are no issues on Ubuntu 22.04:

    0# cat /etc/os-release | grep VERSION
1VERSION_ID="22.04"
2VERSION="22.04.1 LTS (Jammy Jellyfish)"
3VERSION_CODENAME=jammy
4# uname -m    
5aarch64
  4. hebasto commented at 10:28 am on January 25, 2023: member
    Confirming the bug on Fedora 37.
  5. maflcko commented at 10:33 am on January 25, 2023: member
    Does it also happen on Kinetic or Lunar? Or with clang?
  6. hebasto commented at 10:56 am on January 25, 2023: member

    Does it also happen on Kinetic or Lunar? Or with clang?

    It happens with clang-15 which is the default on Fedora 37.

  7. hebasto commented at 11:23 am on January 25, 2023: member
    And it compiles with #25797 :)
  8. maflcko commented at 8:56 pm on January 25, 2023: member

    It happens with clang-15 which is the default on Fedora 37.

    No? clang is not default for Fedora. g++ is picked, at least on my system.

    The bug doesn’t happen on Lunar. On Fedora it happens with both g++ and clang++:

     0# make V=1
 1Making all in src
 2make[1]: Entering directory '/bitcoin-core/src'
 3make[2]: Entering directory '/bitcoin-core/src'
 4make[3]: Entering directory '/bitcoin-core'
 5make[3]: Leaving directory '/bitcoin-core'
 6/bin/sh ../libtool  --tag=CXX --preserve-dup-deps  --mode=link /usr/bin/ccache g++ -std=c++17 -fdebug-prefix-map=/bitcoin-core=. -fstack-reuse=none -Wstack-protector -fstack-protector-all -fstack-clash-protection       -fno-extended-identifiers -fPIE -pipe -std=c++17 -O2    -Wl,-z,relro -Wl,-z,now -Wl,-z,separate-code -pie      -pthread -lpthread -L/bitcoin-core/depends/aarch64-unknown-linux-gnu/lib  -o bitcoin-node bitcoin_node-bitcoind.o  init/bitcoin_node-bitcoin-node.o libbitcoin_node.a  libbitcoin_common.a libbitcoin_util.a libunivalue.la  libbitcoin_consensus.a crypto/libbitcoin_crypto_base.la    crypto/libbitcoin_crypto_arm_shani.la leveldb/libleveldb.la crc32c/libcrc32c.la   leveldb/libmemenv.la secp256k1/libsecp256k1.la    -L/bitcoin-core/depends/aarch64-unknown-linux-gnu/lib -levent_pthreads -levent  -L/bitcoin-core/depends/aarch64-unknown-linux-gnu/lib -levent    libbitcoin_ipc.a -L/bitcoin-core/depends/aarch64-unknown-linux-gnu/lib -lmultiprocess -lcapnp-rpc -lcapnp -lkj-async -lkj -pthread -lpthread  
 7libtool: link: /usr/bin/ccache g++ -std=c++17 -fdebug-prefix-map=/bitcoin-core=. -fstack-reuse=none -Wstack-protector -fstack-protector-all -fstack-clash-protection -fno-extended-identifiers -fPIE -pipe -std=c++17 -O2 -Wl,-z -Wl,relro -Wl,-z -Wl,now -Wl,-z -Wl,separate-code -pie -o bitcoin-node bitcoin_node-bitcoind.o init/bitcoin_node-bitcoin-node.o  -lpthread -L/bitcoin-core/depends/aarch64-unknown-linux-gnu/lib libbitcoin_node.a libbitcoin_common.a libbitcoin_util.a ./.libs/libunivalue.a libbitcoin_consensus.a crypto/.libs/libbitcoin_crypto_base.a crypto/.libs/libbitcoin_crypto_arm_shani.a leveldb/.libs/libleveldb.a crc32c/.libs/libcrc32c.a leveldb/.libs/libmemenv.a secp256k1/.libs/libsecp256k1.a -levent_pthreads -levent -levent libbitcoin_ipc.a -lmultiprocess /bitcoin-core/depends/aarch64-unknown-linux-gnu/lib/libcapnp-rpc.so /bitcoin-core/depends/aarch64-unknown-linux-gnu/lib/libcapnp.so /bitcoin-core/depends/aarch64-unknown-linux-gnu/lib/libkj-async.so /bitcoin-core/depends/aarch64-unknown-linux-gnu/lib/libkj.so -lpthread -pthread -Wl,-rpath -Wl,/bitcoin-core/depends/aarch64-unknown-linux-gnu/lib -Wl,-rpath -Wl,/bitcoin-core/depends/aarch64-unknown-linux-gnu/lib
 8/usr/bin/ld: /bitcoin-core/depends/aarch64-unknown-linux-gnu/lib/libmultiprocess.a(proxy.cpp.o): relocation R_AARCH64_ADR_PREL_PG_HI21 against symbol `_ZN2kj1_5Debug11minSeverityE' which may bind externally can not be used when making a shared object; recompile with -fPIC
 9/usr/bin/ld: /bitcoin-core/depends/aarch64-unknown-linux-gnu/lib/libmultiprocess.a(proxy.cpp.o)(.text+0xa34): unresolvable R_AARCH64_ADR_PREL_PG_HI21 relocation against symbol `_ZN2kj1_5Debug11minSeverityE'
10/usr/bin/ld: final link failed: bad value
11collect2: error: ld returned 1 exit status
12make[2]: *** [Makefile:7114: bitcoin-node] Error 1
13make[2]: Leaving directory '/bitcoin-core/src'
14make[1]: *** [Makefile:19201: all-recursive] Error 1
15make[1]: Leaving directory '/bitcoin-core/src'
16make: *** [Makefile:817: all-recursive] Error 1

     0# make V=1
 1Making all in src
 2make[1]: Entering directory '/bitcoin-core/src'
 3make[2]: Entering directory '/bitcoin-core/src'
 4make[3]: Entering directory '/bitcoin-core'
 5make[3]: Leaving directory '/bitcoin-core'
 6/bin/sh ../libtool  --tag=CXX --preserve-dup-deps  --mode=link /usr/bin/ccache clang++ -std=c++17 -fdebug-prefix-map=/bitcoin-core=. -Wstack-protector -fstack-protector-all        -fPIE -pipe -std=c++17 -O2    -Wl,-z,relro -Wl,-z,now -Wl,-z,separate-code -pie      -pthread -lpthread -L/bitcoin-core/depends/aarch64-unknown-linux-gnu/lib  -o bitcoin-node bitcoin_node-bitcoind.o  init/bitcoin_node-bitcoin-node.o libbitcoin_node.a  libbitcoin_common.a libbitcoin_util.a libunivalue.la  libbitcoin_consensus.a crypto/libbitcoin_crypto_base.la    crypto/libbitcoin_crypto_arm_shani.la leveldb/libleveldb.la crc32c/libcrc32c.la  crc32c/libcrc32c_arm_crc.la leveldb/libmemenv.la secp256k1/libsecp256k1.la    -L/bitcoin-core/depends/aarch64-unknown-linux-gnu/lib -levent_pthreads -levent  -L/bitcoin-core/depends/aarch64-unknown-linux-gnu/lib -levent    libbitcoin_ipc.a -L/bitcoin-core/depends/aarch64-unknown-linux-gnu/lib -lmultiprocess -lcapnp-rpc -lcapnp -lkj-async -lkj -pthread -lpthread  
 7libtool: link: /usr/bin/ccache clang++ -std=c++17 -fdebug-prefix-map=/bitcoin-core=. -Wstack-protector -fstack-protector-all -fPIE -pipe -std=c++17 -O2 -Wl,-z -Wl,relro -Wl,-z -Wl,now -Wl,-z -Wl,separate-code -pie -o bitcoin-node bitcoin_node-bitcoind.o init/bitcoin_node-bitcoin-node.o  -lpthread -L/bitcoin-core/depends/aarch64-unknown-linux-gnu/lib libbitcoin_node.a libbitcoin_common.a libbitcoin_util.a ./.libs/libunivalue.a libbitcoin_consensus.a crypto/.libs/libbitcoin_crypto_base.a crypto/.libs/libbitcoin_crypto_arm_shani.a leveldb/.libs/libleveldb.a crc32c/.libs/libcrc32c.a crc32c/.libs/libcrc32c_arm_crc.a leveldb/.libs/libmemenv.a secp256k1/.libs/libsecp256k1.a -levent_pthreads -levent -levent libbitcoin_ipc.a -lmultiprocess /bitcoin-core/depends/aarch64-unknown-linux-gnu/lib/libcapnp-rpc.so /bitcoin-core/depends/aarch64-unknown-linux-gnu/lib/libcapnp.so /bitcoin-core/depends/aarch64-unknown-linux-gnu/lib/libkj-async.so /bitcoin-core/depends/aarch64-unknown-linux-gnu/lib/libkj.so -lpthread -pthread -Wl,-rpath -Wl,/bitcoin-core/depends/aarch64-unknown-linux-gnu/lib -Wl,-rpath -Wl,/bitcoin-core/depends/aarch64-unknown-linux-gnu/lib
 8/usr/bin/ld: /bitcoin-core/depends/aarch64-unknown-linux-gnu/lib/libmultiprocess.a(proxy.cpp.o): relocation R_AARCH64_ADR_PREL_PG_HI21 against symbol `_ZN2kj1_5Debug11minSeverityE' which may bind externally can not be used when making a shared object; recompile with -fPIC
 9/usr/bin/ld: /bitcoin-core/depends/aarch64-unknown-linux-gnu/lib/libmultiprocess.a(proxy.cpp.o)(.text+0x10): unresolvable R_AARCH64_ADR_PREL_PG_HI21 relocation against symbol `_ZN2kj1_5Debug11minSeverityE'
10/usr/bin/ld: final link failed: bad value
11clang-15: error: linker command failed with exit code 1 (use -v to see invocation)
12make[2]: *** [Makefile:7114: bitcoin-node] Error 1
13make[2]: Leaving directory '/bitcoin-core/src'
14make[1]: *** [Makefile:19201: all-recursive] Error 1
15make[1]: Leaving directory '/bitcoin-core/src'
16make: *** [Makefile:817: all-recursive] Error 1
  9. hebasto commented at 9:56 pm on January 25, 2023: member

    It happens with clang-15 which is the default on Fedora 37.

    No? clang is not default for Fedora. g++ is picked, at least on my system.

    I meant version “15” is default for package “clang” :)

    Sorry for messing things up…

  10. maflcko commented at 9:15 am on January 26, 2023: member

    No worries.

    Checked that Fedora 38 rawhide is also affected. Fedora 36 works (tested g++).

  11. jonatack commented at 8:43 pm on January 30, 2023: member
    Unsure if related: https://cirrus-ci.com/task/5963593934438400?logs=ci#L1092
  12. maflcko renamed this:
    build: multiprocess link issues on aarch64
    build: multiprocess link issues on fedora aarch64
    on Jan 31, 2023
  13. ryanofsky commented at 8:00 pm on February 15, 2023: contributor

    I don’t understand why this would happen only for one platform, but based on the error message maybe the following change would fix it:

    0--- a/depends/packages/capnp.mk
1+++ b/depends/packages/capnp.mk
2@@ -11,6 +11,7 @@ $(package)_config_opts := --with-external-capnp
3 $(package)_config_opts += CAPNP="$$(native_capnp_prefixbin)/capnp"
4 $(package)_config_opts += CAPNP_CXX="$$(native_capnp_prefixbin)/capnp-c++"
5 $(package)_config_opts_android := --disable-shared
6+$(package)_cxxflags += -fPIC
7 endef
8 
9 define $(package)_config_cmds

    The error is link error linking the bitcoin-node executable:

    /usr/bin/ld: /bitcoin-core/depends/aarch64-unknown-linux-gnu/lib/libmultiprocess.a(proxy.cpp.o): relocation R_AARCH64_ADR_PREL_PG_HI21 against symbol `_ZN2kj1_5Debug11minSeverityE’ which may bind externally can not be used when making a shared object; recompile with -fPIC

    The decoded symbol name is kj::_::Debug::minSeverity which is a symbol in the libkj.a library

    re: #26943 (comment)

    Unsure if related: https://cirrus-ci.com/task/5963593934438400?logs=ci#L1092

    This looks like a different issue. Maybe caused by the change a few weeks ago https://github.com/community/community/discussions/46034 affecting github download checksums

  14. hebasto commented at 10:38 am on February 26, 2023: member

    The decoded symbol name is kj::_::Debug::minSeverity which is a symbol in the libkj.a library

    If we expect that the static libkj.a library is used rather than the shared libkj.so one, maybe it makes sense to configure with --disable-shared for all platforms, not just for Android?

  15. fanquake referenced this in commit c3a962be10 on Nov 10, 2023
  16. fanquake commented at 1:47 pm on December 5, 2023: member
    Going to close, as this issue specifically should be fixed, but building on aarch64 is still broken until atleast #28846.
  17. fanquake closed this on Dec 5, 2023
  18. fanquake referenced this in commit 965d38d0ab on Dec 6, 2023
  19. fanquake referenced this in commit bde8d63b17 on Dec 12, 2023
  20. bitcoin locked this on Dec 5, 2024


fanquake hebasto maflcko jonatack ryanofsky

Labels
Build system

github-metadata-mirror

This is a metadata mirror of the GitHub repository bitcoin/bitcoin. This site is not affiliated with GitHub. Content is generated from a GitHub metadata backup.
generated: 2024-12-23 12:12 UTC
This site is hosted by @0xB10C
More mirrored repositories can be found on mirror.b10c.me