contrib: Use batched JSON-RPC in linearize.py for speedup #5050

pull laanwj wants to merge 1 commits into bitcoin:master from laanwj:2014_10_linearize_batch changing 1 files +39 −32

laanwj commented at 11:34 AM on October 6, 2014: member

For what it's worth;

$ time python linearize-hashes.py linearize.cfg > hashlist.txt.1
real    4m47.909s
user    2m45.033s
sys     0m49.987s

$ time python linearize-hashes-new.py linearize.cfg > hashlist.txt.2
real    0m9.487s
user    0m2.721s
sys     0m0.363s

$  sha256sum hashlist.txt*
e89d542fb65666eeb63c0a74995e7481b8349d9b48f9139f3ef3056c462837ab  hashlist.txt.1
e89d542fb65666eeb63c0a74995e7481b8349d9b48f9139f3ef3056c462837ab  hashlist.txt.2

(speedup about 30×)

contrib: use batched JSON-RPC in linarize-hashes
Batch up to 10000 requests for a ~30x speedup.
772ab0ea98
jgarzik commented at 11:36 AM on October 6, 2014: contributor

ut ACK. That was always on the todo list, thanks.
laanwj merged this on Oct 8, 2014
laanwj closed this on Oct 8, 2014
laanwj referenced this in commit fb5fa86bb4 on Oct 8, 2014
MarcoFalke locked this on Sep 8, 2021

Contributors

laanwj

jgarzik