Shutdown hangs a bit in IBD #15657

issue promag openend this issue on March 24, 2019

promag commented at 11:05 am on March 24, 2019: member

~~Looks like it’s related to disconnecting current nodes (?).~~ Some logs:

02019-03-24T10:59:42Z opencon thread exit
12019-03-24T11:00:01Z dnsseed thread exit

02019-03-24T11:01:06Z net thread exit
12019-03-24T11:01:10Z opencon thread exit

promag commented at 2:23 pm on March 24, 2019: member

Full log with -debug:

  02019-03-24T14:21:42Z Bitcoin Core version v0.18.99.0-4e748752d (release build)
  12019-03-24T14:21:42Z Assuming ancestors of block 0000000000000000000f1c54590ee18d15ec70e68c8cd4cfbadb1b4f11697eee have valid signatures.
  22019-03-24T14:21:42Z Setting nMinimumChainWork=0000000000000000000000000000000000000000051dc8b82f450202ecb3d471
  32019-03-24T14:21:42Z Using the 'sse4(1way),sse41(4way),avx2(8way)' SHA256 implementation
  42019-03-24T14:21:42Z Using RdSeed as additional entropy source
  52019-03-24T14:21:42Z Using RdRand as an additional entropy source
  62019-03-24T14:21:42Z Default data directory /Users/joao/Library/Application Support/Bitcoin
  72019-03-24T14:21:42Z Using data directory /Users/joao/Library/Application Support/Bitcoin
  82019-03-24T14:21:42Z Config file: /Users/joao/Library/Application Support/Bitcoin/bitcoin.conf (not found, skipping)
  92019-03-24T14:21:42Z Using at most 125 automatic connections (4864 file descriptors available)
 102019-03-24T14:21:42Z Using 16 MiB out of 32/2 requested for signature cache, able to store 524288 elements
 112019-03-24T14:21:42Z Using 16 MiB out of 32/2 requested for script execution cache, able to store 524288 elements
 122019-03-24T14:21:42Z Using 12 threads for script verification
 132019-03-24T14:21:42Z scheduler thread start
 142019-03-24T14:21:42Z Allowing HTTP connections from: 127.0.0.0/8 ::1/128
 152019-03-24T14:21:42Z Binding RPC on address ::1 port 8332
 162019-03-24T14:21:42Z Binding RPC on address 127.0.0.1 port 8332
 172019-03-24T14:21:42Z Initialized HTTP server
 182019-03-24T14:21:42Z HTTP: creating work queue of depth 16
 192019-03-24T14:21:42Z Starting RPC
 202019-03-24T14:21:42Z Starting HTTP RPC server
 212019-03-24T14:21:42Z No rpcpassword set - using random cookie authentication.
 222019-03-24T14:21:42Z Generated RPC authentication cookie /Users/joao/Library/Application Support/Bitcoin/.cookie
 232019-03-24T14:21:42Z Registering HTTP handler for / (exactmatch 1)
 242019-03-24T14:21:42Z Registering HTTP handler for /wallet/ (exactmatch 0)
 252019-03-24T14:21:42Z Starting HTTP server
 262019-03-24T14:21:42Z HTTP: starting 4 worker threads
 272019-03-24T14:21:42Z Entering http event loop
 282019-03-24T14:21:42Z Using wallet directory /Users/joao/Library/Application Support/Bitcoin/wallets
 292019-03-24T14:21:42Z init message: Verifying wallet(s)...
 302019-03-24T14:21:42Z Using BerkeleyDB version Berkeley DB 4.8.30: (April  9, 2010)
 312019-03-24T14:21:42Z Using wallet /Users/joao/Library/Application Support/Bitcoin/wallets
 322019-03-24T14:21:42Z BerkeleyEnvironment::Open: LogDir=/Users/joao/Library/Application Support/Bitcoin/wallets/database ErrorFile=/Users/joao/Library/Application Support/Bitcoin/wallets/db.log
 332019-03-24T14:21:42Z init message: Loading banlist...
 342019-03-24T14:21:42Z ERROR: DeserializeFileDB: Failed to open file /Users/joao/Library/Application Support/Bitcoin/banlist.dat
 352019-03-24T14:21:42Z Invalid or missing banlist.dat; recreating
 362019-03-24T14:21:42Z Flushed 0 banned node ips/subnets to banlist.dat  6ms
 372019-03-24T14:21:42Z net: setting try another outbound peer=false
 382019-03-24T14:21:42Z Cache configuration:
 392019-03-24T14:21:42Z * Using 2.0 MiB for block index database
 402019-03-24T14:21:42Z * Using 8.0 MiB for chain state database
 412019-03-24T14:21:42Z * Using 440.0 MiB for in-memory UTXO set (plus up to 286.1 MiB of unused mempool space)
 422019-03-24T14:21:42Z init message: Loading block index...
 432019-03-24T14:21:42Z LevelDB using max_open_files=1000 (default=1000)
 442019-03-24T14:21:42Z Opening LevelDB in /Users/joao/Library/Application Support/Bitcoin/blocks/index
 452019-03-24T14:21:42Z leveldb: Delete type=3 [#1](/bitcoin-bitcoin/1/)
 462019-03-24T14:21:42Z Opened LevelDB successfully
 472019-03-24T14:21:42Z Using obfuscation key for /Users/joao/Library/Application Support/Bitcoin/blocks/index: 0000000000000000
 482019-03-24T14:21:42Z LoadBlockIndexDB: last block file = 0
 492019-03-24T14:21:42Z LoadBlockIndexDB: last block file info: CBlockFileInfo(blocks=0, size=0, heights=0...0, time=1970-01-01...1970-01-01)
 502019-03-24T14:21:42Z Checking all blk files are present...
 512019-03-24T14:21:42Z Initializing databases...
 522019-03-24T14:21:42Z Pre-allocating up to position 0x1000000 in blk00000.dat
 532019-03-24T14:21:42Z LevelDB using max_open_files=1000 (default=1000)
 542019-03-24T14:21:42Z Opening LevelDB in /Users/joao/Library/Application Support/Bitcoin/chainstate
 552019-03-24T14:21:42Z leveldb: Delete type=3 [#1](/bitcoin-bitcoin/1/)
 562019-03-24T14:21:42Z Opened LevelDB successfully
 572019-03-24T14:21:42Z WriteBatch memory usage: db=chainstate, before=0.0MiB, after=0.0MiB
 582019-03-24T14:21:42Z Wrote new obfuscate key for /Users/joao/Library/Application Support/Bitcoin/chainstate: eab08ccd0c57ca88
 592019-03-24T14:21:42Z Using obfuscation key for /Users/joao/Library/Application Support/Bitcoin/chainstate: eab08ccd0c57ca88
 602019-03-24T14:21:42Z init message: Rewinding blocks...
 612019-03-24T14:21:42Z  block index              55ms
 622019-03-24T14:21:42Z init message: Loading wallet...
 632019-03-24T14:21:42Z BerkeleyEnvironment::Open: LogDir=/Users/joao/Library/Application Support/Bitcoin/wallets/database ErrorFile=/Users/joao/Library/Application Support/Bitcoin/wallets/db.log
 642019-03-24T14:21:42Z [default wallet] nFileVersion = 189900
 652019-03-24T14:21:42Z [default wallet] Keys: 0 plaintext, 0 encrypted, 0 w/ metadata, 0 total. Unknown wallet records: 0
 662019-03-24T14:21:42Z [default wallet] Performing wallet upgrade to 169900
 672019-03-24T14:21:43Z [default wallet] keypool added 2000 keys (1000 internal), size=2000 (1000 internal)
 682019-03-24T14:21:43Z [default wallet] Wallet completed loading in             989ms
 692019-03-24T14:21:43Z [default wallet] setKeyPool.size() = 2000
 702019-03-24T14:21:43Z [default wallet] mapWallet.size() = 0
 712019-03-24T14:21:43Z [default wallet] mapAddressBook.size() = 0
 722019-03-24T14:21:43Z   - Load block from disk: 0.09ms [0.00s]
 732019-03-24T14:21:43Z   - Connect total: 0.07ms [0.00s (infms/blk)]
 742019-03-24T14:21:43Z   - Flush: 0.03ms [0.00s (infms/blk)]
 752019-03-24T14:21:43Z   - Writing chainstate: 0.02ms [0.00s (infms/blk)]
 762019-03-24T14:21:43Z UpdateTip: new best=000000000019d6689c085ae165831e934ff763ae46a2a6c172b3f1b60a8ce26f height=0 version=0x00000001 log2_work=32.000022 tx=1 date='2009-01-03T18:15:05Z' progress=0.000000 cache=0.0MiB(0txo)
 772019-03-24T14:21:43Z   - Connect postprocess: 0.08ms [0.00s (infms/blk)]
 782019-03-24T14:21:43Z - Connect block: 0.28ms [0.00s (infms/blk)]
 792019-03-24T14:21:43Z mapBlockIndex.size() = 1
 802019-03-24T14:21:43Z Failed to open mempool file from disk. Continuing anyway.
 812019-03-24T14:21:43Z nBestHeight = 0
 822019-03-24T14:21:43Z torcontrol thread start
 832019-03-24T14:21:43Z Bound to [::]:8333
 842019-03-24T14:21:43Z Bound to 0.0.0.0:8333
 852019-03-24T14:21:43Z init message: Loading P2P addresses...
 862019-03-24T14:21:43Z ERROR: DeserializeFileDB: Failed to open file /Users/joao/Library/Application Support/Bitcoin/peers.dat
 872019-03-24T14:21:43Z Invalid or missing peers.dat; recreating
 882019-03-24T14:21:43Z tor: Error connecting to Tor control socket
 892019-03-24T14:21:43Z tor: Not connected to Tor control port 127.0.0.1:9051, trying to reconnect
 902019-03-24T14:21:43Z Flushed 0 addresses to peers.dat  6ms
 912019-03-24T14:21:43Z init message: Starting network threads...
 922019-03-24T14:21:43Z dnsseed thread start
 932019-03-24T14:21:43Z net thread start
 942019-03-24T14:21:43Z opencon thread start
 952019-03-24T14:21:43Z msghand thread start
 962019-03-24T14:21:43Z init message: Done loading
 972019-03-24T14:21:43Z Loading addresses from DNS seeds (could take a while)
 982019-03-24T14:21:43Z addcon thread start
 992019-03-24T14:21:43Z Added 25 addresses from sxa35bqgjufzajdt.internal: 0 tried, 25 new
1002019-03-24T14:21:43Z Added 21 addresses from 3ruqazlhqrx4izs4.internal: 0 tried, 46 new
1012019-03-24T14:21:44Z trying connection 73.96.30.69:8333 lastseen=140.3hrs
102^C2019-03-24T14:21:44Z Interrupting HTTP server
1032019-03-24T14:21:44Z Interrupting HTTP RPC server
1042019-03-24T14:21:44Z Interrupting RPC
1052019-03-24T14:21:44Z tor: Thread interrupt
1062019-03-24T14:21:44Z Shutdown: In progress...
1072019-03-24T14:21:44Z torcontrol thread exit
1082019-03-24T14:21:44Z addcon thread exit
1092019-03-24T14:21:44Z Stopping HTTP RPC server
1102019-03-24T14:21:44Z Unregistering HTTP handler for / (exactmatch 1)
1112019-03-24T14:21:44Z Unregistering HTTP handler for /wallet/ (exactmatch 0)
1122019-03-24T14:21:44Z Stopping RPC
1132019-03-24T14:21:44Z RPC stopped.
1142019-03-24T14:21:44Z Stopping HTTP server
1152019-03-24T14:21:44Z Waiting for HTTP worker threads to exit
1162019-03-24T14:21:44Z Waiting for HTTP event thread to exit
1172019-03-24T14:21:44Z Exited http event loop
1182019-03-24T14:21:44Z Stopped HTTP server
1192019-03-24T14:21:44Z BerkeleyEnvironment::Flush: [/Users/joao/Library/Application Support/Bitcoin/wallets] Flush(false)
1202019-03-24T14:21:44Z BerkeleyEnvironment::Flush: Flushing wallet.dat (refcount = 0)...
1212019-03-24T14:21:44Z BerkeleyEnvironment::Flush: wallet.dat checkpoint
1222019-03-24T14:21:44Z msghand thread exit
1232019-03-24T14:21:44Z BerkeleyEnvironment::Flush: wallet.dat detach
1242019-03-24T14:21:44Z net thread exit
1252019-03-24T14:21:44Z BerkeleyEnvironment::Flush: wallet.dat closed
1262019-03-24T14:21:44Z BerkeleyEnvironment::Flush: Flush(false) took              27ms
1272019-03-24T14:21:44Z Added connection peer=0
1282019-03-24T14:21:44Z sending version (103 bytes) peer=0
1292019-03-24T14:21:44Z send version message: version 70015, blocks=0, us=[::]:0, peer=0
1302019-03-24T14:21:44Z opencon thread exit
131
132(hanged here)
133
1342019-03-24T14:22:13Z dnsseed thread exit
1352019-03-24T14:22:13Z Flushed 46 addresses to peers.dat  8ms
1362019-03-24T14:22:13Z disconnecting peer=0
1372019-03-24T14:22:13Z Cleared nodestate for peer=0
1382019-03-24T14:22:13Z scheduler thread interrupt
1392019-03-24T14:22:13Z Dumped mempool: 8e-06s to copy, 0.006101s to dump
1402019-03-24T14:22:13Z Recorded 0 unconfirmed txs from mempool in 1e-06s
1412019-03-24T14:22:13Z WriteBatch memory usage: db=index, before=0.0MiB, after=0.0MiB
1422019-03-24T14:22:13Z Writing final batch of 0.00 MiB
1432019-03-24T14:22:13Z WriteBatch memory usage: db=chainstate, before=0.0MiB, after=0.0MiB
1442019-03-24T14:22:13Z Committed 0 changed transaction outputs (out of 0) to coin database...
1452019-03-24T14:22:14Z WriteBatch memory usage: db=index, before=0.0MiB, after=0.0MiB
1462019-03-24T14:22:14Z Writing final batch of 0.00 MiB
1472019-03-24T14:22:14Z WriteBatch memory usage: db=chainstate, before=0.0MiB, after=0.0MiB
1482019-03-24T14:22:14Z Committed 0 changed transaction outputs (out of 0) to coin database...
1492019-03-24T14:22:14Z BerkeleyEnvironment::Flush: [/Users/joao/Library/Application Support/Bitcoin/wallets] Flush(true)
1502019-03-24T14:22:14Z BerkeleyEnvironment::Flush: Flushing wallet.dat (refcount = 0)...
1512019-03-24T14:22:14Z BerkeleyEnvironment::Flush: wallet.dat checkpoint
1522019-03-24T14:22:14Z BerkeleyEnvironment::Flush: wallet.dat detach
1532019-03-24T14:22:14Z BerkeleyEnvironment::Flush: wallet.dat closed
1542019-03-24T14:22:14Z BerkeleyEnvironment::Flush: Flush(true) took              29ms
1552019-03-24T14:22:14Z [default wallet] Releasing wallet
1562019-03-24T14:22:14Z Shutdown: done

promag commented at 2:42 pm on March 24, 2019: member

The hanging happens in CConnman::ThreadDNSAddressSeed.
promag closed this on Mar 24, 2019
DrahtBot locked this on Dec 16, 2021

Contributors
promag