build: target Windows 7 when building libevent and fix ipv6 usage #19375

pull fanquake wants to merge 2 commits into bitcoin:master from fanquake:libevent_target_0x0601 changing 2 files +21 −0
  1. fanquake commented at 3:21 am on June 25, 2020: member

    TLDR: This poaches a commit from #18287 and adds one more to adjust the Windows version targeted when building libevent. These changes combined should fully fix ipv6 usage with the RPC server on Windows.


    Binding the RPC server to a ipv6 address does not currently work on Windows. We currently try and bind to 127.0.0.1 and ::1 by default.

    On Windows you’ll see lines like this in debug.log:

    02020-06-24T01:49:04Z libevent: getaddrinfo: nodename nor servname provided, or not known
    12020-06-24T01:49:04Z Binding RPC on address ::1 port 8332 failed
    

    This issue was bought up in, and supposedly fixed by #18287, however the two people that tested it, both said that it didn’t fix the problem. I think I now understand why that change alone is incomplete.

    Our call into libevent starts with evhttp_bind_socket_with_handle():

     0evhttp_bind_socket_with_handle()
     1	bind_socket()
     2		make_addrinfo()
     3			evutil_getaddrinfo()
     4				if #USE_NATIVE_GETADDRINFO
     5					#ifndef AI_ADDRCONFIG
     6						evutil_adjust_hints_for_addrconfig_()
     7							evutil_check_interfaces()
     8								evutil_check_ifaddrs()
     9									evutil_found_ifaddr()
    10										// miss identifies ipv6 as ipv4?
    11					#endif
    12					evutil_getaddrinfo_common_()
    

    The problem is falling into "#ifndef AI_ADDRCONFIG":

    0#ifndef AI_ADDRCONFIG
    1	/* Not every system has AI_ADDRCONFIG, so fake it. */
    2	if (hints.ai_family == PF_UNSPEC &&
    3	    (hints.ai_flags & EVUTIL_AI_ADDRCONFIG)) {
    4		evutil_adjust_hints_for_addrconfig_(&hints);
    5	}
    6#endif
    

    When this occurs, hints end up being adjusted, and it seems that ipv6 addresses end up being mis-identified as ipv4?

    However this shouldn’t happen, as these AI_ definitions are available on Windows. The issue is that in evutil.c, _WIN32_WINNT is set to 0x501 (XP).

    This obviously predates Vista (0x0600), which is when the AI_ADDRCONFIG definition (and others) became available.

    The change here will override libevents internal D_WIN32_WINNT defines. This should be ok, because it’s only making “more” of the Windows API available. It’s also aligned with what we do in our own configure, we pass D_WIN32_WINNT=0x0601. We also now use linker flags to restrict our binary from running on a Windows version earlier than Windows 7.

    The combined fixes can be tested by running:

    bitcoind -rpcbind=::1 rpcallowip='0.0.0.0/0' -debug=http

    and then querying it using:

    bitcoin-cli -rpcconnect=::1 getblockchaininfo

    TODO:

  2. depends: Patch libevent build to fix IPv6 -rpcbind on Windows
    libevent uses getaddrinfo when available, and falls back to gethostbyname
    Windows has both, but gethostbyname only supports IPv4
    libevent fails to detect Windows's getaddrinfo due to not including the right headers
    This patches libevent's configure script to check it correctly
    03e056edcd
  3. fanquake added the label Build system on Jun 25, 2020
  4. fanquake added the label Needs gitian build on Jun 25, 2020
  5. fanquake added the label Needs Guix build on Jun 25, 2020
  6. fanquake requested review from sipsorcery on Jun 25, 2020
  7. in depends/packages/libevent.mk:22 in b440aca96a outdated
    15@@ -14,6 +16,7 @@ define $(package)_set_vars
    16   $(package)_config_opts_release=--disable-debug-mode
    17   $(package)_config_opts_linux=--with-pic
    18   $(package)_config_opts_android=--with-pic
    19+  $(package)_cppflags_mingw32=-D_WIN32_WINNT=0x0601
    


    luke-jr commented at 3:47 am on June 25, 2020:
    I don’t see how this can work… evutil.c #undef _WIN32_WINNT

    fanquake commented at 3:55 am on June 25, 2020:

    It’s only undef’d after the inclusion of ws2tcpip.h which is where the AI_* definitions are.

    In the ws2tcpip.h header on my machine I’ve got:

     0#define AI_PASSIVE                  0x00000001
     1#define AI_CANONNAME                0x00000002
     2#define AI_NUMERICHOST              0x00000004
     3#if (_WIN32_WINNT >= 0x0600)
     4#define AI_NUMERICSERV              0x00000008
     5#define AI_ALL                      0x00000100
     6#define AI_ADDRCONFIG               0x00000400
     7#define AI_V4MAPPED                 0x00000800
     8#define AI_NON_AUTHORITATIVE        0x00004000
     9#define AI_SECURE                   0x00008000
    10#define AI_RETURN_PREFERRED_NAMES   0x00010000
    11#endif
    

    luke-jr commented at 4:14 am on June 25, 2020:
    Oh, weird. That seems like it’s probably a bug, but not our problem.

    laanwj commented at 5:14 pm on June 25, 2020:
    You might want to add a comment here in the makefile about why this is defined, and why it works.

    fanquake commented at 5:29 am on June 30, 2020:
    @laanwj I’ve added a comment here. These kinds of details probably deserve a separate document in depends (we could also add some of the macOS stuff there as well). I can follow up by writing up some more extensive docs.
  8. fanquake deleted a comment on Jun 25, 2020
  9. luke-jr approved
  10. luke-jr commented at 4:14 am on June 25, 2020: member
    utACK
  11. fanquake added the label RPC/REST/ZMQ on Jun 25, 2020
  12. fanquake added the label Windows on Jun 25, 2020
  13. sipsorcery commented at 10:26 am on June 25, 2020: member

    tACK b440aca96a338f16ca664065821b980c4b0537ae.

    Adjusted test commands:

    0bitcoind -regtest -rpcbind=::1 -rpcallowip=0.0.0.0/0 -debug=http
    1bitcoin-cli -regtest -rpcconnect=::1 getblockchaininfo
    

    Relevant parts of bitcoind console messages:

     0....
     12020-06-25T10:21:59Z Command-line arg: debug="http"
     22020-06-25T10:21:59Z Command-line arg: regtest=""
     32020-06-25T10:21:59Z Command-line arg: rpcallowip="0.0.0.0/0"
     42020-06-25T10:21:59Z Command-line arg: rpcbind=****
     52020-06-25T10:21:59Z Using at most 125 automatic connections (2048 file descriptors available)
     62020-06-25T10:21:59Z Using 16 MiB out of 32/2 requested for signature cache, able to store 524288 elements
     72020-06-25T10:21:59Z Using 16 MiB out of 32/2 requested for script execution cache, able to store 524288 elements
     82020-06-25T10:21:59Z Script verification uses 7 additional threads
     92020-06-25T10:21:59Z Allowing HTTP connections from: 127.0.0.0/8 ::1/128 0.0.0.0/0
    102020-06-25T10:21:59Z scheduler thread start
    112020-06-25T10:21:59Z Binding RPC on address ::1 port 18443
    122020-06-25T10:21:59Z Initialized HTTP server
    13....
    142020-06-25T10:23:07Z Received a POST request for / from [::1]:52391
    
  14. sipsorcery approved
  15. fanquake commented at 11:26 am on June 25, 2020: member

    Just a clarification to “how” this is working, and follow up to the comments above. By default, the mingw32 compiler, (on my machine, x86_64-w64-mingw32-g++ (GCC) 9.3.0) will set _WIN32_WINNT to 0x0502 (Windows Server 2003).

    So the fix here isn’t just that we are overriding libevents internal _WIN32_WINNT defines, it’s because we are actually settings a value for _WIN32_WINNT, which overrides the default set by the compiler, and, is high enough that the definitions are available.

    The seconds point is header include order. Because the ws2tcpip.h header, which contains the AI_* definitions:

     0#define AI_PASSIVE                  0x00000001
     1#define AI_CANONNAME                0x00000002
     2#define AI_NUMERICHOST              0x00000004
     3#if (_WIN32_WINNT >= 0x0600)
     4#define AI_NUMERICSERV              0x00000008
     5#define AI_ALL                      0x00000100
     6#define AI_ADDRCONFIG               0x00000400
     7#define AI_V4MAPPED                 0x00000800
     8#define AI_NON_AUTHORITATIVE        0x00004000
     9#define AI_SECURE                   0x00008000
    10#define AI_RETURN_PREFERRED_NAMES   0x00010000
    11#endif
    

    is included before libevent #undefs _WIN32_WINNT and sets it to 0x0501, AI_ADDRCONFIG et al will be defined, because at that point, _WIN32_WINNT is set to the value we have passed (0x0601).

  16. DrahtBot commented at 7:16 pm on June 25, 2020: member

    Guix builds

    File commit 67881de0e3b1cef1d0f978582765a8aeeb09c21a(master) commit 63cf27e54c96aed84025b00932d9a316a01105b6(master and this pull)
    *-aarch64-linux-gnu-debug.tar.gz 49113bc3ed7f1815... 318a738f9cdc2f48...
    *-aarch64-linux-gnu.tar.gz 999ddbe4a7be7ba8... 573434b6feee7979...
    *-arm-linux-gnueabihf-debug.tar.gz bbac7bfb9860b5d6... 2c363eb44989f880...
    *-arm-linux-gnueabihf.tar.gz cf1a95295ee77021... 13ef283a7fb408e9...
    *-riscv64-linux-gnu-debug.tar.gz 3fdf07215f80dfe3... 79c1a3e4e4a83698...
    *-riscv64-linux-gnu.tar.gz 6224201d5937fcc4... 2aa3153560373b17...
    *-win-unsigned.tar.gz e0d22d0c535d9308... cd45622e543e2ec3...
    *-win64-debug.zip a955e7f4d71b592e... 2831352a23310256...
    *-win64-setup-unsigned.exe 4bf65e9ff53ccdf1... b414e067c7035563...
    *-win64.zip 156debb0703a96df... 0a6f4a96e9145d75...
    *-x86_64-linux-gnu-debug.tar.gz 9f9195121960d3d3... b1fc12491789faf9...
    *-x86_64-linux-gnu.tar.gz b8daebe585cc3061... 97fac4377623dafa...
    *.tar.gz a8caa4ce5c4f6179... a0caef0b3a80fa5a...
    guix_build.log 9e7212d4ac88ed34... 34f033d46ef9d45f...
    guix_build.log.diff 464e4312d8f44626...
  17. DrahtBot removed the label Needs Guix build on Jun 25, 2020
  18. DrahtBot commented at 9:38 am on June 26, 2020: member

    Gitian builds

    File commit f32f7e907a5eb73e880c567c699569081608ed7a(master) commit 7b0e5ab7cdd87dab8e8223929b3c748e23a95daf(master and this pull)
    bitcoin-core-linux-0.21-res.yml 0c3497a54c3bc7ba... dffd10f16f22f162...
    bitcoin-core-win-0.21-res.yml 0c96eabe3c4b7001... bf5a8c1d6705aed5...
    *-aarch64-linux-gnu-debug.tar.gz e6e6eb3eb520abd8... 4f460ea874312118...
    *-aarch64-linux-gnu.tar.gz 8e59a3b4af364dad... 114e69c66600410c...
    *-arm-linux-gnueabihf-debug.tar.gz 2aed896e8c43a57d... 486d46b41f3a4765...
    *-arm-linux-gnueabihf.tar.gz 63293d04b4ec7207... 0036110dd4373afb...
    *-riscv64-linux-gnu-debug.tar.gz 1839d68fe79d7f13... 59e354dab7ae4e1e...
    *-riscv64-linux-gnu.tar.gz 3cc74c73b47e7d01... 00718c78f1125dbf...
    *-win64-debug.zip 57c9d758ab0df9b4... 56c12243d2341f26...
    *-win64-setup-unsigned.exe dc5ae19748a68fd9... eb4c7f14642f5173...
    *-win64.zip 65f0e902c07f6c21... fe85fd08913f2199...
    *-x86_64-linux-gnu-debug.tar.gz 10559cc3035c6d9d... 323088e38537ccc6...
    *-x86_64-linux-gnu.tar.gz c3566a5163bd0f91... 733f72a67a79c595...
    *.tar.gz 1d0feaaf4c030a20... 5e1138a8e28fe411...
    linux-build.log 7fd8dac8d8b12baa... adf44e5c9b5151a0...
    osx-build.log 985b22ed7d303197... 7804e935f79659a6...
    win-build.log cf06ae72cd7f8cdf... 08cd72c27b79b2af...
    bitcoin-core-linux-0.21-res.yml.diff 1407cec4e401ae77...
    bitcoin-core-win-0.21-res.yml.diff ec8ff30e1a5276cf...
    linux-build.log.diff b9aff065c681ff8c...
    osx-build.log.diff 3f019019e3bb75f9...
    win-build.log.diff 7f5879c8074def9f...
  19. DrahtBot removed the label Needs gitian build on Jun 26, 2020
  20. build: pass _WIN32_WINNT=0x0601 when building libevent for Windows
    This enables of the use of AI_* definitions in the Windows headers,
    specifically AI_ADDRCONFIG, which fixes an issue with libevent and
    ipv6 on Windows.
    
    It also aligns with what we define in configure when building Core.
    eb6b73540d
  21. fanquake force-pushed on Jun 30, 2020
  22. laanwj commented at 12:56 pm on July 1, 2020: member
    ACK eb6b73540d1ee7ff5a6874dd0e35f9b30b68e3b8
  23. laanwj merged this on Jul 1, 2020
  24. laanwj closed this on Jul 1, 2020

  25. fanquake deleted the branch on Jul 1, 2020
  26. theuni commented at 11:50 pm on July 1, 2020: member
    Post-merge ACK eb6b73540d1ee7ff5a6874dd0e35f9b30b68e3b8 .
  27. luke-jr referenced this in commit d4674b82c5 on Aug 15, 2020
  28. jasonbcox referenced this in commit 7415376aa5 on Oct 2, 2020
  29. zkbot referenced this in commit 372f695d4d on Jun 5, 2021
  30. DrahtBot locked this on Feb 15, 2022

github-metadata-mirror

This is a metadata mirror of the GitHub repository bitcoin/bitcoin. This site is not affiliated with GitHub. Content is generated from a GitHub metadata backup.
generated: 2024-11-21 21:12 UTC

This site is hosted by @0xB10C
More mirrored repositories can be found on mirror.b10c.me