We should have test infrastructure that bootstraps a new node (both on mainnet and on testnet). People (e.g. myself) have been doing this less formally prior to release, but we should be doing it continuously.
Should also probably test bootstrapping over tor.
Collecting some metrics like time to bootstrap (both to some specified heights as well as to completion) along the way would probably be useful.
@gmaxwell would like to take a stab on this
@fanquake @gmaxwell what were you guys thinking of using for the infrastructure?
People (e.g. myself) have been doing this less formally prior to release
This also doesn't seem to be documented in the release-process.md ?
I suppose it could be run on volunteer funded paid cloud services? Or, for more representative results, their home computer.
Maybe it could be an optional flag for Gitian builds to do an IBD when the build is finished and collect some stats?
What's the latest on this issue? @glaksmono Are you still actively working on this?
Sorry, haven't had a chance to work on this. Feel free to take over @tylerdmace
Awesome, thank you for letting me know!
I'm currently working on this with @MarcoFalke over at https://github.com/chaincodelabs/bitcoin-perfmonitor, hosted at https://bitcoinperf.com.
We're in the early stages at the moment, but plan on doing nightly benchmarks of master for IBD, reindex, microbenchmarks, and build/test duration. Eventually, we'll allow contributors to kick off benchmark runs for specific PRs to allow easy comparison with master and tagged releases.