Think about tuning the script cache/sigcache ratios #10754

issue TheBlueMatt openend this issue on July 6, 2017

TheBlueMatt commented at 4:57 pm on July 6, 2017: contributor

After #10192, we have two separate caches, which are in memory blocks of equal size. This is likely not the best possible tuning, but sadly its tricky to get right because the sigcache is now used more as a DoS protection/reorg speedup and less as a cache used in normal operation. See-also, @JeremyRubin’s suggestion of using the same table and further discussion at, eg, #10192 (comment).
gmaxwell commented at 4:47 am on July 9, 2017: contributor

I am astonished that as many random memory access as we’re making for these things is actually well tuned. I’d really like to understand how 8 way fanout is optimal, if it is, since that amount of memory latency should significantly slower than e.g. four way fanout into buckets of two esp with caches much larger than L3. Reports were that it wasn’t which suggests to me that something is wrong, either in our implementation or in my understanding of the hardware, maybe our hash function is too slow and thats obscuring it.

Another thing to look at is tuning the eviction/epoch counter part.
JeremyRubin commented at 5:18 am on July 9, 2017: contributor

Greg I think your understanding is deficient, the actual expected number of probes should be a lot closer to 1 for signatures that exist. This is because a recently inserted transaction should be close to it’s first hash-index and a recently inserted transaction is more likely to be mined.

If you want to simulate the worst case you should write a benchmark that tests the cache with a block that has all previously unseen signatures/transactions.
fanquake added the label Brainstorming on Sep 6, 2018
fanquake added the label Resource usage on Sep 6, 2018

willcl-ark commented at 2:11 pm on October 27, 2025: member

I have started to look into this a little further to see whether it might be worth putting more work into, but so far I am not convinced.

I first added some logging to the cache lookups to get a better idea of how well the caches are performing currently, which yeilded these results when logging every minute, plus isolated block acceptance stats:

  0<snip>
  12025-10-18T06:42:40Z Block 00000000000000000000fa029afeee99fbf4d9fbd1d968773895bcc375e9b453 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3350 hits, 0 misses (100.0% hit rate)
  22025-10-18T06:43:06Z Cache stats: signature cache 49.0% hit rate (742539 hits, 772391 misses), script cache 30.9% hit rate (319241 hits, 712792 misses)
  32025-10-18T06:44:06Z Cache stats: signature cache 49.0% hit rate (743936 hits, 773806 misses), script cache 30.9% hit rate (319241 hits, 713322 misses)
  42025-10-18T06:45:06Z Cache stats: signature cache 49.0% hit rate (744371 hits, 774249 misses), script cache 30.9% hit rate (319241 hits, 713734 misses)
  52025-10-18T06:46:06Z Cache stats: signature cache 49.0% hit rate (745028 hits, 774914 misses), script cache 30.9% hit rate (319241 hits, 714190 misses)
  62025-10-18T06:47:06Z Cache stats: signature cache 49.0% hit rate (745777 hits, 776065 misses), script cache 30.9% hit rate (319241 hits, 714602 misses)
  72025-10-18T06:47:30Z Block 0000000000000000000175f5e168eea70cbb84e9a351faae6da38904aa29fcf4 cache stats: signature cache 0 hits, 22 misses (0.0% hit rate); script cache 1664 hits, 23 misses (98.6% hit rate)
  82025-10-18T06:48:06Z Cache stats: signature cache 49.0% hit rate (746109 hits, 776425 misses), script cache 31.0% hit rate (320905 hits, 715065 misses)
  92025-10-18T06:49:06Z Cache stats: signature cache 49.0% hit rate (746587 hits, 776939 misses), script cache 31.0% hit rate (320905 hits, 715589 misses)
 102025-10-18T06:50:06Z Cache stats: signature cache 49.0% hit rate (746914 hits, 777274 misses), script cache 30.9% hit rate (320905 hits, 715995 misses)
 112025-10-18T06:51:06Z Cache stats: signature cache 49.0% hit rate (748423 hits, 778801 misses), script cache 30.9% hit rate (320905 hits, 718031 misses)
 122025-10-18T06:52:06Z Cache stats: signature cache 49.0% hit rate (749440 hits, 779828 misses), script cache 30.8% hit rate (320905 hits, 719833 misses)
 132025-10-18T06:53:06Z Cache stats: signature cache 49.0% hit rate (750213 hits, 780605 misses), script cache 30.8% hit rate (320905 hits, 721169 misses)
 142025-10-18T06:54:06Z Cache stats: signature cache 49.0% hit rate (751297 hits, 781729 misses), script cache 30.8% hit rate (320905 hits, 721959 misses)
 152025-10-18T06:55:06Z Cache stats: signature cache 49.0% hit rate (751880 hits, 782318 misses), script cache 30.8% hit rate (320905 hits, 722421 misses)
 162025-10-18T06:56:06Z Cache stats: signature cache 49.0% hit rate (752490 hits, 782940 misses), script cache 30.7% hit rate (320905 hits, 722703 misses)
 172025-10-18T06:57:06Z Cache stats: signature cache 49.0% hit rate (753182 hits, 783706 misses), script cache 30.7% hit rate (320905 hits, 722987 misses)
 182025-10-18T06:57:18Z Block 00000000000000000000cf68b4f07f9eabcc7a82fc72eaa2b496e1b9680b3e76 cache stats: signature cache 315 hits, 212 misses (59.8% hit rate); script cache 3356 hits, 3 misses (99.9% hit rate)
 192025-10-18T06:58:06Z Cache stats: signature cache 49.0% hit rate (753776 hits, 784197 misses), script cache 31.0% hit rate (324261 hits, 723344 misses)
 202025-10-18T06:59:06Z Cache stats: signature cache 49.0% hit rate (754623 hits, 785056 misses), script cache 30.9% hit rate (324261 hits, 723730 misses)
 212025-10-18T06:59:34Z Block 00000000000000000000fbed1465c4e3e6a9f4a0635f5110a4b820362f57774f cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3228 hits, 0 misses (100.0% hit rate)
 222025-10-18T07:00:06Z Cache stats: signature cache 49.0% hit rate (755719 hits, 786160 misses), script cache 31.1% hit rate (327489 hits, 724602 misses)
 232025-10-18T07:01:06Z Cache stats: signature cache 49.0% hit rate (757427 hits, 787926 misses), script cache 31.1% hit rate (327489 hits, 727218 misses)
 242025-10-18T07:02:06Z Cache stats: signature cache 49.0% hit rate (758988 hits, 789515 misses), script cache 31.0% hit rate (327489 hits, 729842 misses)
 252025-10-18T07:03:06Z Cache stats: signature cache 49.0% hit rate (760606 hits, 791133 misses), script cache 30.9% hit rate (327489 hits, 732734 misses)
 262025-10-18T07:04:06Z Cache stats: signature cache 49.0% hit rate (762083 hits, 792610 misses), script cache 30.8% hit rate (327489 hits, 735158 misses)
 272025-10-18T07:05:06Z Cache stats: signature cache 49.0% hit rate (763308 hits, 793841 misses), script cache 30.8% hit rate (327489 hits, 737282 misses)
 282025-10-18T07:06:06Z Cache stats: signature cache 49.0% hit rate (764241 hits, 794826 misses), script cache 30.7% hit rate (327489 hits, 738780 misses)
 292025-10-18T07:07:06Z Cache stats: signature cache 49.0% hit rate (764496 hits, 795071 misses), script cache 30.7% hit rate (327489 hits, 739100 misses)
 302025-10-18T07:08:06Z Cache stats: signature cache 49.0% hit rate (764985 hits, 795566 misses), script cache 30.7% hit rate (327489 hits, 739574 misses)
 312025-10-18T07:09:06Z Cache stats: signature cache 49.0% hit rate (765822 hits, 796531 misses), script cache 30.7% hit rate (327489 hits, 740154 misses)
 322025-10-18T07:10:06Z Cache stats: signature cache 49.0% hit rate (766139 hits, 796858 misses), script cache 30.7% hit rate (327489 hits, 740608 misses)
 332025-10-18T07:11:06Z Cache stats: signature cache 49.0% hit rate (766791 hits, 797532 misses), script cache 30.6% hit rate (327489 hits, 741148 misses)
 342025-10-18T07:12:06Z Cache stats: signature cache 49.0% hit rate (767243 hits, 797988 misses), script cache 30.6% hit rate (327489 hits, 741714 misses)
 352025-10-18T07:13:06Z Cache stats: signature cache 49.0% hit rate (767725 hits, 798596 misses), script cache 30.6% hit rate (327489 hits, 742146 misses)
 362025-10-18T07:14:06Z Cache stats: signature cache 49.0% hit rate (768102 hits, 798973 misses), script cache 30.6% hit rate (327489 hits, 742588 misses)
 372025-10-18T07:15:06Z Cache stats: signature cache 49.0% hit rate (769607 hits, 800486 misses), script cache 30.6% hit rate (327489 hits, 743310 misses)
 382025-10-18T07:15:54Z Block 00000000000000000001b03161aa967a60f1844f1e46b3d1bc6301227d99bc38 cache stats: signature cache 0 hits, 28 misses (0.0% hit rate); script cache 3350 hits, 8 misses (99.8% hit rate)
 392025-10-18T07:16:06Z Cache stats: signature cache 49.0% hit rate (770139 hits, 800998 misses), script cache 30.8% hit rate (330839 hits, 744006 misses)
 402025-10-18T07:17:06Z Cache stats: signature cache 49.0% hit rate (770636 hits, 801517 misses), script cache 30.8% hit rate (330839 hits, 744748 misses)
 412025-10-18T07:18:06Z Cache stats: signature cache 49.0% hit rate (771163 hits, 802044 misses), script cache 30.7% hit rate (330839 hits, 745610 misses)
 422025-10-18T07:18:21Z Block 0000000000000000000024865d8e67cf3cdfc8ec4e42dc9d33c8f88cd09b20fb cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 5097 hits, 0 misses (100.0% hit rate)
 432025-10-18T07:19:06Z Cache stats: signature cache 49.0% hit rate (771688 hits, 802573 misses), script cache 31.0% hit rate (335936 hits, 746334 misses)
 442025-10-18T07:20:06Z Cache stats: signature cache 49.0% hit rate (773673 hits, 804596 misses), script cache 31.0% hit rate (335936 hits, 746930 misses)
 452025-10-18T07:21:06Z Cache stats: signature cache 49.0% hit rate (774622 hits, 805555 misses), script cache 31.0% hit rate (335936 hits, 748644 misses)
 462025-10-18T07:22:06Z Cache stats: signature cache 49.0% hit rate (776086 hits, 807067 misses), script cache 30.9% hit rate (335936 hits, 751364 misses)
 472025-10-18T07:22:31Z Block 00000000000000000001c98a657032aff9a5fcb4617b45dfec5e77aa8e527bd7 cache stats: signature cache 8 hits, 60 misses (11.8% hit rate); script cache 728 hits, 67 misses (91.6% hit rate)
 482025-10-18T07:23:06Z Cache stats: signature cache 49.0% hit rate (777620 hits, 808657 misses), script cache 30.9% hit rate (336664 hits, 754247 misses)
 492025-10-18T07:24:06Z Cache stats: signature cache 49.0% hit rate (779314 hits, 810419 misses), script cache 30.8% hit rate (336664 hits, 756887 misses)
 502025-10-18T07:25:06Z Cache stats: signature cache 49.0% hit rate (780515 hits, 811640 misses), script cache 30.8% hit rate (336664 hits, 757995 misses)
 512025-10-18T07:26:06Z Cache stats: signature cache 49.0% hit rate (780907 hits, 812148 misses), script cache 30.7% hit rate (336664 hits, 758303 misses)
 522025-10-18T07:27:06Z Cache stats: signature cache 49.0% hit rate (781502 hits, 812749 misses), script cache 30.7% hit rate (336664 hits, 758657 misses)
 532025-10-18T07:28:06Z Cache stats: signature cache 49.0% hit rate (781696 hits, 812949 misses), script cache 30.7% hit rate (336664 hits, 758947 misses)
 542025-10-18T07:29:06Z Cache stats: signature cache 49.0% hit rate (781921 hits, 813178 misses), script cache 30.7% hit rate (336664 hits, 759255 misses)
 552025-10-18T07:30:06Z Cache stats: signature cache 49.0% hit rate (782173 hits, 813432 misses), script cache 30.7% hit rate (336664 hits, 759559 misses)
 562025-10-18T07:31:06Z Cache stats: signature cache 49.0% hit rate (783561 hits, 814856 misses), script cache 30.7% hit rate (336664 hits, 759973 misses)
 572025-10-18T07:32:06Z Cache stats: signature cache 49.0% hit rate (784128 hits, 815437 misses), script cache 30.7% hit rate (336664 hits, 760311 misses)
 582025-10-18T07:33:06Z Cache stats: signature cache 49.0% hit rate (784469 hits, 815784 misses), script cache 30.7% hit rate (336664 hits, 760593 misses)
 592025-10-18T07:34:06Z Cache stats: signature cache 49.0% hit rate (784760 hits, 816077 misses), script cache 30.7% hit rate (336664 hits, 760961 misses)
 602025-10-18T07:35:06Z Cache stats: signature cache 49.0% hit rate (785025 hits, 816344 misses), script cache 30.7% hit rate (336664 hits, 761263 misses)
 612025-10-18T07:35:48Z Block 000000000000000000002c6377c808d9bf5737a9af08a7fa3c1b342ed20289ce cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3431 hits, 0 misses (100.0% hit rate)
 622025-10-18T07:36:06Z Cache stats: signature cache 49.0% hit rate (785414 hits, 816741 misses), script cache 30.9% hit rate (340095 hits, 761665 misses)
 632025-10-18T07:37:06Z Cache stats: signature cache 49.0% hit rate (785825 hits, 817160 misses), script cache 30.9% hit rate (340095 hits, 762101 misses)
 642025-10-18T07:38:06Z Cache stats: signature cache 49.0% hit rate (786420 hits, 817765 misses), script cache 30.8% hit rate (340095 hits, 762477 misses)
 652025-10-18T07:39:06Z Cache stats: signature cache 49.0% hit rate (786927 hits, 818318 misses), script cache 30.8% hit rate (340095 hits, 762927 misses)
 662025-10-18T07:40:06Z Cache stats: signature cache 49.0% hit rate (787562 hits, 818963 misses), script cache 30.8% hit rate (340095 hits, 763703 misses)
 672025-10-18T07:41:06Z Cache stats: signature cache 49.0% hit rate (788385 hits, 819792 misses), script cache 30.8% hit rate (340095 hits, 764213 misses)
 682025-10-18T07:42:06Z Cache stats: signature cache 49.0% hit rate (789342 hits, 820787 misses), script cache 30.8% hit rate (340095 hits, 764643 misses)
 692025-10-18T07:43:06Z Cache stats: signature cache 49.0% hit rate (791611 hits, 823114 misses), script cache 30.8% hit rate (340095 hits, 764999 misses)
 702025-10-18T07:44:06Z Cache stats: signature cache 49.0% hit rate (792008 hits, 823517 misses), script cache 30.8% hit rate (340095 hits, 765311 misses)
 712025-10-18T07:44:39Z Block 000000000000000000003ffe39b6dc8aefda145d07d72c6ff7ad2226a348cf12 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 1623 hits, 0 misses (100.0% hit rate)
 722025-10-18T07:45:06Z Cache stats: signature cache 49.0% hit rate (792544 hits, 824093 misses), script cache 30.9% hit rate (341718 hits, 765743 misses)
 732025-10-18T07:45:40Z Block 00000000000000000001b096688fa8b347984dd79efea216f778390f2ded4c2f cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 205 hits, 0 misses (100.0% hit rate)
 742025-10-18T07:46:06Z Cache stats: signature cache 49.0% hit rate (793263 hits, 824816 misses), script cache 30.9% hit rate (341923 hits, 766255 misses)
 752025-10-18T07:47:06Z Cache stats: signature cache 49.0% hit rate (794399 hits, 825962 misses), script cache 30.8% hit rate (341923 hits, 768323 misses)
 762025-10-18T07:48:06Z Cache stats: signature cache 49.0% hit rate (794690 hits, 826267 misses), script cache 30.8% hit rate (341923 hits, 768669 misses)
 772025-10-18T07:49:06Z Cache stats: signature cache 49.0% hit rate (795098 hits, 826701 misses), script cache 30.8% hit rate (341923 hits, 769065 misses)
 782025-10-18T07:50:06Z Cache stats: signature cache 49.0% hit rate (795552 hits, 827211 misses), script cache 30.8% hit rate (341923 hits, 769405 misses)
 792025-10-18T07:51:06Z Cache stats: signature cache 49.0% hit rate (796408 hits, 828101 misses), script cache 30.8% hit rate (341923 hits, 769747 misses)
 802025-10-18T07:52:06Z Cache stats: signature cache 49.0% hit rate (796748 hits, 828445 misses), script cache 30.7% hit rate (341923 hits, 770085 misses)
 812025-10-18T07:53:06Z Cache stats: signature cache 49.0% hit rate (797044 hits, 828753 misses), script cache 30.7% hit rate (341923 hits, 770393 misses)
 822025-10-18T07:54:06Z Cache stats: signature cache 49.0% hit rate (797308 hits, 829017 misses), script cache 30.7% hit rate (341923 hits, 770717 misses)
 832025-10-18T07:55:06Z Cache stats: signature cache 49.0% hit rate (797629 hits, 829382 misses), script cache 30.7% hit rate (341923 hits, 771011 misses)
 842025-10-18T07:55:08Z Block 000000000000000000004aaeb3d52fc32e0e1fba17e6cd073bcbdb9dad18c78c cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 4358 hits, 0 misses (100.0% hit rate)
 852025-10-18T07:56:06Z Cache stats: signature cache 49.0% hit rate (798163 hits, 829922 misses), script cache 31.0% hit rate (346281 hits, 771371 misses)
 862025-10-18T07:57:07Z Cache stats: signature cache 49.0% hit rate (798511 hits, 830296 misses), script cache 31.0% hit rate (346281 hits, 771807 misses)
 872025-10-18T07:58:07Z Cache stats: signature cache 49.0% hit rate (799342 hits, 831159 misses), script cache 31.0% hit rate (346281 hits, 772149 misses)
 882025-10-18T07:59:07Z Cache stats: signature cache 49.0% hit rate (800048 hits, 831877 misses), script cache 31.0% hit rate (346281 hits, 772487 misses)
 892025-10-18T08:00:07Z Cache stats: signature cache 49.0% hit rate (801558 hits, 833479 misses), script cache 30.9% hit rate (346281 hits, 774349 misses)
 902025-10-18T08:01:07Z Cache stats: signature cache 49.0% hit rate (803274 hits, 835255 misses), script cache 30.8% hit rate (346281 hits, 776467 misses)
 912025-10-18T08:02:07Z Cache stats: signature cache 49.0% hit rate (804442 hits, 836451 misses), script cache 30.8% hit rate (346281 hits, 777065 misses)
 922025-10-18T08:02:59Z Block 00000000000000000000ca6230865b9986fa5e0a55750d553f06ca3d1a64ded0 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3635 hits, 0 misses (100.0% hit rate)
 932025-10-18T08:03:07Z Cache stats: signature cache 49.0% hit rate (804937 hits, 836956 misses), script cache 31.0% hit rate (349916 hits, 777431 misses)
 942025-10-18T08:04:07Z Cache stats: signature cache 49.0% hit rate (805607 hits, 837658 misses), script cache 31.0% hit rate (349916 hits, 777925 misses)
 952025-10-18T08:04:09Z Block 000000000000000000014b41713d209f2e4b155c41c40e77308f41aaabe76ff9 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 5095 hits, 0 misses (100.0% hit rate)
 962025-10-18T08:05:07Z Cache stats: signature cache 49.0% hit rate (806080 hits, 838157 misses), script cache 31.3% hit rate (355011 hits, 778365 misses)
 972025-10-18T08:06:07Z Cache stats: signature cache 49.0% hit rate (807108 hits, 839253 misses), script cache 31.3% hit rate (355011 hits, 779459 misses)
 982025-10-18T08:07:07Z Cache stats: signature cache 49.0% hit rate (808682 hits, 840843 misses), script cache 31.2% hit rate (355011 hits, 782245 misses)
 992025-10-18T08:08:07Z Cache stats: signature cache 49.0% hit rate (810435 hits, 842608 misses), script cache 31.1% hit rate (355011 hits, 785083 misses)
1002025-10-18T08:09:07Z Cache stats: signature cache 49.0% hit rate (812135 hits, 844352 misses), script cache 31.1% hit rate (355011 hits, 787921 misses)
1012025-10-18T08:10:07Z Cache stats: signature cache 49.0% hit rate (814097 hits, 846332 misses), script cache 31.0% hit rate (355011 hits, 790319 misses)
1022025-10-18T08:11:07Z Cache stats: signature cache 49.0% hit rate (815349 hits, 847604 misses), script cache 31.0% hit rate (355011 hits, 791211 misses)
1032025-10-18T08:12:07Z Cache stats: signature cache 49.0% hit rate (816268 hits, 848559 misses), script cache 31.0% hit rate (355011 hits, 791945 misses)
1042025-10-18T08:13:07Z Cache stats: signature cache 49.0% hit rate (816965 hits, 849270 misses), script cache 30.9% hit rate (355011 hits, 792345 misses)
1052025-10-18T08:14:07Z Cache stats: signature cache 49.0% hit rate (817342 hits, 849647 misses), script cache 30.9% hit rate (355011 hits, 792789 misses)
1062025-10-18T08:15:07Z Cache stats: signature cache 49.0% hit rate (817856 hits, 850167 misses), script cache 30.9% hit rate (355011 hits, 793203 misses)
1072025-10-18T08:16:07Z Cache stats: signature cache 49.0% hit rate (818263 hits, 850582 misses), script cache 30.9% hit rate (355011 hits, 793657 misses)
1082025-10-18T08:17:07Z Cache stats: signature cache 49.0% hit rate (818686 hits, 851021 misses), script cache 30.9% hit rate (355011 hits, 794127 misses)

The sig cache is hitting at almost exactly ~50% which is the expected best-rate performance: when we first see a signature we miss, then cache it, then hit on the next usage (only happens once more during ATMP).

The script cache hit-rate is ~zero outside of block acceptance (first time we miss, then store), but inside block connection, and so long as the node has been running a while (i.e. has a “warm” mempool which also has relay policies ~ matching those of miners) I observe an almost 100% script cache hit-rate.

Both cases here are the intended behaviour of the caches, as I understand them.

  0[*] 2025-10-17T09:33:58Z Block 00000000000000000001e98ea7458073be6d58430bc27a6b6d042d1cf9db54ae cache stats: signature cache 0 hits, 49 misses; script cache 2783 hits, 34 misses
  12025-10-17T09:41:45Z Block 00000000000000000000693fcf834071c771bf7c9502c3d2427228ec731cef74 cache stats: signature cache 0 hits, 2243 misses; script cache 144 hits, 1135 misses
  22025-10-17T09:41:47Z Block 00000000000000000001358b7570152c63cf82288b9960db57096cbf2bc007cc cache stats: signature cache 3000 hits, 8665 misses; script cache 233 hits, 4668 misses
  32025-10-17T09:42:34Z Block 00000000000000000001a35a6509ed07fb7b3ce875feb8198833ca58c68e69aa cache stats: signature cache 45 hits, 1549 misses; script cache 3815 hits, 962 misses
  42025-10-17T09:45:16Z Block 000000000000000000019a147a9e4456581e4b57d7519ceac15218d2e192f3c6 cache stats: signature cache 0 hits, 4 misses; script cache 667 hits, 4 misses
  52025-10-17T10:06:13Z Block 000000000000000000000e6f14b764b83f97db2c439e37219b499e7515edb2b2 cache stats: signature cache 23 hits, 905 misses (2.5% hit rate); script cache 3332 hits, 362 misses (90.2% hit rate)
  62025-10-17T10:32:11Z Block 00000000000000000001bd642b78e7739a2cd9ac4fdda972052bbd2fdd061036 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3632 hits, 0 misses (100.0% hit rate)
  72025-10-17T10:37:06Z Block 00000000000000000001e26325df911c52bfc47031363d78892f2e9df2b4ae4a cache stats: signature cache 0 hits, 33 misses (0.0% hit rate); script cache 2976 hits, 12 misses (99.6% hit rate)
  82025-10-17T10:41:34Z Block 000000000000000000014c9694301181fcb81b9381b9ff3c43db1bda92064687 cache stats: signature cache 333 hits, 919 misses (26.6% hit rate); script cache 3332 hits, 322 misses (91.2% hit rate)
  92025-10-17T10:44:35Z Block 00000000000000000001090bebb560190b6c6ad5e3308247425897b3ac45b80c cache stats: signature cache 0 hits, 2 misses (0.0% hit rate); script cache 850 hits, 2 misses (99.8% hit rate)
 102025-10-17T10:50:52Z Block 000000000000000000014d75838895bc4098ac34cc920d06b3b1e2bec7611040 cache stats: signature cache 0 hits, 42 misses (0.0% hit rate); script cache 3507 hits, 42 misses (98.8% hit rate)
 112025-10-17T11:00:28Z Block 00000000000000000000c6f12d7967a3769c826f5f0f9926061205307edc4812 cache stats: signature cache 0 hits, 18 misses (0.0% hit rate); script cache 2343 hits, 4 misses (99.8% hit rate)
 122025-10-17T11:04:41Z Block 00000000000000000000b885c3be9b144b5811914f57a93c3866cf62e4861759 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 1119 hits, 0 misses (100.0% hit rate)
 132025-10-17T11:05:38Z Block 00000000000000000001d4c606efb44e4fc02d24447af99620ddd94a7e5298dd cache stats: signature cache 4 hits, 27 misses (12.9% hit rate); script cache 4566 hits, 27 misses (99.4% hit rate)
 142025-10-17T11:13:59Z Block 00000000000000000000ec3d7af03512c200f461e2a9848d257caac958d955a8 cache stats: signature cache 0 hits, 7 misses (0.0% hit rate); script cache 3862 hits, 8 misses (99.8% hit rate)
 152025-10-17T11:15:40Z Block 0000000000000000000141cc17d6cd82ea6c1d3f6ed14957b18fc3c5121bf51b cache stats: signature cache 0 hits, 42 misses (0.0% hit rate); script cache 546 hits, 28 misses (95.1% hit rate)
 162025-10-17T11:19:13Z Block 000000000000000000009994b9eaf3f988aa5927503410971729095f7cce77c4 cache stats: signature cache 0 hits, 46 misses (0.0% hit rate); script cache 4307 hits, 46 misses (98.9% hit rate)
 172025-10-17T11:44:42Z Block 00000000000000000001172f7379e8c4d8e45bf826cc588771f307af6c5d328b cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3726 hits, 0 misses (100.0% hit rate)
 182025-10-17T12:20:01Z Block 00000000000000000000a11e177b81f6fc493745348b5383cf92a3f7abe901c8 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3850 hits, 0 misses (100.0% hit rate)
 192025-10-17T12:26:27Z Block 000000000000000000009adbfadab3b8c98b76df78f4d3567a4434227b536747 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 2782 hits, 0 misses (100.0% hit rate)
 202025-10-17T12:30:18Z Block 000000000000000000012d94708b0b25a623b2d2edc9a6768ef49f0990f886ac cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3298 hits, 0 misses (100.0% hit rate)
 212025-10-17T12:55:39Z Block 00000000000000000000614967e4fd4e4f1bd0d47d0aa78df91b6156b9f02724 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3735 hits, 0 misses (100.0% hit rate)
 222025-10-17T12:58:42Z Block 0000000000000000000093d1b93045cf0f8067f81b24a69ca795f44086188772 cache stats: signature cache 0 hits, 29 misses (0.0% hit rate); script cache 2704 hits, 18 misses (99.3% hit rate)
 232025-10-17T13:07:05Z Block 0000000000000000000154eaf57002a3da2cae545395e8df05e539c12e774158 cache stats: signature cache 30 hits, 315 misses (8.7% hit rate); script cache 3068 hits, 74 misses (97.6% hit rate)
 242025-10-17T13:09:59Z Block 00000000000000000000c3b59f3db2063d6721c725d8cedd9ee3a930f739224a cache stats: signature cache 11 hits, 150 misses (6.8% hit rate); script cache 2240 hits, 59 misses (97.4% hit rate)
 252025-10-17T13:14:32Z Block 00000000000000000001532bda4852ef488c018bd05aecd7f47da1de826cb652 cache stats: signature cache 0 hits, 98 misses (0.0% hit rate); script cache 2844 hits, 50 misses (98.3% hit rate)
 262025-10-17T13:29:16Z Block 00000000000000000001da344e35b7367658384258eb5fc82e351674a2f3b189 cache stats: signature cache 0 hits, 8 misses (0.0% hit rate); script cache 3337 hits, 8 misses (99.8% hit rate)
 272025-10-17T13:34:48Z Block 00000000000000000000e0a712c7e34ad75f07a06253c178e13c309353e6b8f0 cache stats: signature cache 0 hits, 16 misses (0.0% hit rate); script cache 2927 hits, 12 misses (99.6% hit rate)
 282025-10-17T13:37:36Z Block 00000000000000000000994d66a5f2722c226d3cf73e8a2f7a4c175497826279 cache stats: signature cache 0 hits, 167 misses (0.0% hit rate); script cache 4847 hits, 80 misses (98.4% hit rate)
 292025-10-17T14:18:47Z Block 00000000000000000001ea1aa824423a5aaa6d30f58c1edb4045845989c0d6e6 cache stats: signature cache 0 hits, 114 misses (0.0% hit rate); script cache 3703 hits, 33 misses (99.1% hit rate)
 302025-10-17T14:37:16Z Block 0000000000000000000030e8f3c06e7e248403a93f4d4a7e1b373f05c494ff2d cache stats: signature cache 0 hits, 6 misses (0.0% hit rate); script cache 4030 hits, 4 misses (99.9% hit rate)
 312025-10-17T14:45:48Z Block 00000000000000000000726b01c505251101ad2cff972a90b3420f87468d95af cache stats: signature cache 3 hits, 42 misses (6.7% hit rate); script cache 3744 hits, 26 misses (99.3% hit rate)
 322025-10-17T15:01:20Z Block 00000000000000000000fffea8511885c3f8f99e01ef1b021ad58361a9ec9e2c cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3411 hits, 0 misses (100.0% hit rate)
 332025-10-17T15:01:28Z Block 000000000000000000010afa28d95de6c912be6a3547470ff3a98a12ebee1295 cache stats: signature cache 0 hits, 50 misses (0.0% hit rate); script cache 3728 hits, 32 misses (99.1% hit rate)
 342025-10-17T15:07:13Z Block 00000000000000000000d96e8cabc252832e8a88edb644dca348e535e650d5a8 cache stats: signature cache 0 hits, 19 misses (0.0% hit rate); script cache 2212 hits, 14 misses (99.4% hit rate)
 352025-10-17T15:14:53Z Block 00000000000000000000dd1032cd49feb8d6f751011eada8a3bc2711630e071d cache stats: signature cache 0 hits, 6 misses (0.0% hit rate); script cache 2805 hits, 2 misses (99.9% hit rate)
 362025-10-17T15:44:24Z Block 0000000000000000000028748215876f55567dfb6254d370ad4e624033a99054 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 4147 hits, 0 misses (100.0% hit rate)
 372025-10-17T15:55:31Z Block 000000000000000000003c627e090ce00e7c542b62210f5e1b7c94e9a9bb22d8 cache stats: signature cache 1 hits, 1 misses (50.0% hit rate); script cache 3377 hits, 2 misses (99.9% hit rate)
 382025-10-17T16:00:57Z Block 00000000000000000001e298cc433c820368bd9fbc24ef986c165a206a16a908 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3755 hits, 0 misses (100.0% hit rate)
 392025-10-17T16:01:49Z Block 00000000000000000001d569b0055390d3c1f42621ece5bb38b5f0d34f889a96 cache stats: signature cache 70 hits, 132 misses (34.7% hit rate); script cache 2391 hits, 10 misses (99.6% hit rate)
 402025-10-17T16:06:24Z Block 000000000000000000008223ca67936bcf8df5e0fd1b922f72b7fa0dbf0fa60b cache stats: signature cache 0 hits, 6 misses (0.0% hit rate); script cache 1666 hits, 3 misses (99.8% hit rate)
 412025-10-17T16:15:00Z Block 00000000000000000001d82b01f3583888851e3d3d639a5a2d0daa1115290c73 cache stats: signature cache 0 hits, 159 misses (0.0% hit rate); script cache 2853 hits, 13 misses (99.5% hit rate)
 422025-10-17T16:23:33Z Block 000000000000000000006bf274cb0dca91d0f022cb1a4d382bffb86d344df02e cache stats: signature cache 0 hits, 3 misses (0.0% hit rate); script cache 2653 hits, 1 misses (100.0% hit rate)
 432025-10-17T16:35:14Z Block 00000000000000000000c81f835618909a176992f577d57d044317cc7de3d3e3 cache stats: signature cache 0 hits, 13 misses (0.0% hit rate); script cache 3505 hits, 13 misses (99.6% hit rate)
 442025-10-17T16:39:14Z Block 00000000000000000000e49d8dbf97a4e9a25934d8094fd8f7561b009a1f6474 cache stats: signature cache 0 hits, 26 misses (0.0% hit rate); script cache 3673 hits, 20 misses (99.5% hit rate)
 452025-10-17T16:40:32Z Block 0000000000000000000056c630e1d3122f4f412d621d58eb8e854b38fdc046d4 cache stats: signature cache 11 hits, 227 misses (4.6% hit rate); script cache 4380 hits, 224 misses (95.1% hit rate)
 462025-10-17T16:40:51Z Block 0000000000000000000065afb0508fb3786b15cf4d92fef899dd3cb7b0f08b82 cache stats: signature cache 0 hits, 4 misses (0.0% hit rate); script cache 78 hits, 4 misses (95.1% hit rate)
 472025-10-17T16:52:55Z Block 0000000000000000000029c416c932b7717e745834293aacf3441c9180097c80 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3606 hits, 0 misses (100.0% hit rate)
 482025-10-17T16:58:57Z Block 00000000000000000001d400391744a48665d1a82b6cffc6fd65045e7c8516a1 cache stats: signature cache 0 hits, 317 misses (0.0% hit rate); script cache 4144 hits, 318 misses (92.9% hit rate)
 492025-10-17T17:05:09Z Block 0000000000000000000039cd637e8bc5117d182a95cb2a0d51d64c16b4aa2790 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 4139 hits, 0 misses (100.0% hit rate)
 502025-10-17T17:28:28Z Block 000000000000000000005b760c27a3cac06d4fd51ccc4c7c89f616f6dc2adb91 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3952 hits, 0 misses (100.0% hit rate)
 512025-10-17T17:32:47Z Block 0000000000000000000153c6638075183190ce54072a2680501a06f31e31b2eb cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 2841 hits, 1 misses (100.0% hit rate)
 522025-10-17T17:36:36Z Block 00000000000000000001c0e81d9966e621a997399e803a89fbb41f94cb2ec0f2 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3201 hits, 0 misses (100.0% hit rate)
 532025-10-17T17:53:41Z Block 000000000000000000017c790c0140aeb3ccce7a5207d71eb094bac12fa81c91 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3345 hits, 1 misses (100.0% hit rate)
 542025-10-17T17:55:52Z Block 00000000000000000000deebfe051d9c551ab424f269ad7327917b94693f241e cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 2255 hits, 0 misses (100.0% hit rate)
 552025-10-17T18:17:46Z Block 000000000000000000013f0572e77b61d0a8060c2561693b7646a21255a78462 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3937 hits, 1 misses (100.0% hit rate)
 562025-10-17T18:18:10Z Block 00000000000000000000516d65e5d5a4b164f62cc6aeea73abdcaaebf534406b cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 2694 hits, 0 misses (100.0% hit rate)
 572025-10-17T18:29:57Z Block 000000000000000000006931a43b304616cd5e05a13084d4140e3fd25d0ae92e cache stats: signature cache 0 hits, 3 misses (0.0% hit rate); script cache 2930 hits, 3 misses (99.9% hit rate)
 582025-10-17T18:51:49Z Block 0000000000000000000130e0e8192e611fba164687d41ba24564f6bb274be268 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3718 hits, 0 misses (100.0% hit rate)
 592025-10-17T18:56:40Z Block 000000000000000000012fe76a929444534f386e54f4a8416595619ad147b1c0 cache stats: signature cache 0 hits, 7 misses (0.0% hit rate); script cache 3128 hits, 7 misses (99.8% hit rate)
 602025-10-17T19:04:39Z Block 0000000000000000000042e0180b2d452557882aa60eb52097bc0c6bb9ded182 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3306 hits, 1 misses (100.0% hit rate)
 612025-10-17T19:11:14Z Block 000000000000000000001d2bdc77c0f80b38ed796677f1da67245a5833033678 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3675 hits, 0 misses (100.0% hit rate)
 622025-10-17T19:36:24Z Block 000000000000000000003a6e22ed0b4ad0ac2ade0e842a135eea21b244ec6041 cache stats: signature cache 0 hits, 1 misses (0.0% hit rate); script cache 3961 hits, 1 misses (100.0% hit rate)
 632025-10-17T19:53:02Z Block 00000000000000000001af12bbe2c988572f71af6c7574e4246b80536df7803b cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3586 hits, 0 misses (100.0% hit rate)
 642025-10-17T19:58:08Z Block 00000000000000000000ba5505065def89a09fe7406524af4f19bc67d360c837 cache stats: signature cache 0 hits, 15 misses (0.0% hit rate); script cache 2763 hits, 15 misses (99.5% hit rate)
 652025-10-17T20:02:41Z Block 000000000000000000005df1a00f74418a96f4bbf85ad851c435fc4b2188c3e2 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 2714 hits, 0 misses (100.0% hit rate)
 662025-10-17T20:30:22Z Block 000000000000000000012c7d49fc62ea577c65b4367cbf0e1bf18dc7b60dc7d8 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3952 hits, 1 misses (100.0% hit rate)
 672025-10-17T20:49:47Z Block 000000000000000000019a6b32354343934d91c9b2aa0625d74b3ff1dab0ed5c cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3658 hits, 0 misses (100.0% hit rate)
 682025-10-17T20:54:17Z Block 0000000000000000000190d3c8c7192e13f620dee1da908530fa534ff629b4c8 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 2640 hits, 0 misses (100.0% hit rate)
 692025-10-17T21:20:18Z Block 000000000000000000012bf5596d7ada5ad66fe5206b6b3ff11995674cc43ed8 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3922 hits, 0 misses (100.0% hit rate)
 702025-10-17T21:25:19Z Block 000000000000000000005fa270e5a198c97a2d8681b1ac58b4c2b10ddd0b413e cache stats: signature cache 111 hits, 69 misses (61.7% hit rate); script cache 2477 hits, 1 misses (100.0% hit rate)
 712025-10-17T21:56:11Z Block 00000000000000000001df1c0351e57c99362660ffd76d6fbbe615c4fc9d91f1 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3710 hits, 0 misses (100.0% hit rate)
 722025-10-17T22:13:17Z Block 000000000000000000015d09928272d19b928b556f4b24a2101c5d9016ee06be cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 4152 hits, 0 misses (100.0% hit rate)
 732025-10-17T22:17:04Z Block 0000000000000000000140a2f72e0d7652c24d9faac1eb8846440bca2c422987 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 2447 hits, 0 misses (100.0% hit rate)
 742025-10-17T22:18:49Z Block 00000000000000000000a0386b30e5e808b09a98203f86b7ee3a857ce5599265 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 2916 hits, 0 misses (100.0% hit rate)
 752025-10-17T22:24:39Z Block 000000000000000000010ee7e1efeab887a3dff2edb64bc7e0d20ac1bb1862e8 cache stats: signature cache 1 hits, 5 misses (16.7% hit rate); script cache 1396 hits, 6 misses (99.6% hit rate)
 762025-10-17T22:56:20Z Block 00000000000000000001ae2e739d989d97feca18b8b4d400865070d674858ac1 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3890 hits, 0 misses (100.0% hit rate)
 772025-10-17T23:21:28Z Block 0000000000000000000144709e928ab1e9f8e8adb89c26a198f7da296e842e34 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3665 hits, 0 misses (100.0% hit rate)
 782025-10-17T23:23:24Z Block 00000000000000000001e5111af8574b1e1b1fefd31863a887e183c8dac7c1e8 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 2766 hits, 0 misses (100.0% hit rate)
 792025-10-17T23:42:53Z Block 00000000000000000001b2838a7e7162aeda02bcbf710e96d9cc4a6131dbe430 cache stats: signature cache 0 hits, 15 misses (0.0% hit rate); script cache 3191 hits, 15 misses (99.5% hit rate)
 802025-10-17T23:55:43Z Block 0000000000000000000155b920806041c59e7fa88ef2e288baf27f7e8184ee74 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3361 hits, 0 misses (100.0% hit rate)
 812025-10-18T00:17:13Z Block 00000000000000000000617f92f4c5ba1033e4e16d370c7fabf66da4d46d9d6b cache stats: signature cache 0 hits, 2 misses (0.0% hit rate); script cache 3118 hits, 1 misses (100.0% hit rate)
 822025-10-18T00:18:58Z Block 0000000000000000000080447ba6158ef1c3791f96b764701cd5276c700ed0d7 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 4641 hits, 0 misses (100.0% hit rate)
 832025-10-18T00:23:41Z Block 000000000000000000016834864a0b791957399c311d8dd3b17c9c89404b73ea cache stats: signature cache 0 hits, 7 misses (0.0% hit rate); script cache 4384 hits, 7 misses (99.8% hit rate)
 842025-10-18T00:24:28Z Block 00000000000000000000ed7820a9e587bf91699b61d92321e1e9fa2ba085eff8 cache stats: signature cache 0 hits, 12 misses (0.0% hit rate); script cache 4584 hits, 12 misses (99.7% hit rate)
 852025-10-18T00:31:32Z Block 0000000000000000000064df68f498db805dd793b07e1250c480067377bccc9a cache stats: signature cache 1 hits, 353 misses (0.3% hit rate); script cache 3319 hits, 354 misses (90.4% hit rate)
 862025-10-18T00:47:12Z Block 00000000000000000000a7ca0539ccd0ea254f8da28d60fb874120ebe07f55d9 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3517 hits, 0 misses (100.0% hit rate)
 872025-10-18T00:56:38Z Block 00000000000000000001ea1749302571ffec515ca777bcdbcb94aeb3ca981cb1 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 1597 hits, 0 misses (100.0% hit rate)
 882025-10-18T00:59:50Z Block 000000000000000000001eea25ebc03b7bee0b23778065700fd5c03c15ae0f8d cache stats: signature cache 0 hits, 33 misses (0.0% hit rate); script cache 4710 hits, 33 misses (99.3% hit rate)
 892025-10-18T01:01:37Z Block 0000000000000000000115b531839805e60388aab9dde1c3cb239cf652f445df cache stats: signature cache 14 hits, 15 misses (48.3% hit rate); script cache 4063 hits, 29 misses (99.3% hit rate)
 902025-10-18T01:04:56Z Block 00000000000000000000ce071d99832a2a26c648fac9e041550215b1d162d94c cache stats: signature cache 0 hits, 1 misses (0.0% hit rate); script cache 620 hits, 1 misses (99.8% hit rate)
 912025-10-18T01:12:50Z Block 00000000000000000001b305c60f90647ed297877fb5d4dae718bbf386fa29df cache stats: signature cache 0 hits, 8 misses (0.0% hit rate); script cache 3898 hits, 8 misses (99.8% hit rate)
 922025-10-18T01:15:48Z Block 00000000000000000000870b9ece0578506c67e834e6cc41273b636844cd1ac8 cache stats: signature cache 0 hits, 1 misses (0.0% hit rate); script cache 4774 hits, 1 misses (100.0% hit rate)
 932025-10-18T01:28:10Z Block 00000000000000000000a76c1a23af373bb0677aafc11047bde4057935d460d8 cache stats: signature cache 0 hits, 9 misses (0.0% hit rate); script cache 4084 hits, 9 misses (99.8% hit rate)
 942025-10-18T01:56:28Z Block 00000000000000000000961ed406d29b4f1a001cc0ed86858b9c9fc70ef1f923 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3569 hits, 0 misses (100.0% hit rate)
 952025-10-18T01:57:49Z Block 00000000000000000001dc17b131fe805107286ccf97cde089bd8db9cf02fd94 cache stats: signature cache 1 hits, 20 misses (4.8% hit rate); script cache 4354 hits, 21 misses (99.5% hit rate)
 962025-10-18T02:09:42Z Block 000000000000000000004ce9266dab4cc3396831f034567ee5276554a58b25bb cache stats: signature cache 4 hits, 7 misses (36.4% hit rate); script cache 3580 hits, 9 misses (99.7% hit rate)
 972025-10-18T02:12:56Z Block 0000000000000000000010846a65646415828f04633f1cb1d8e2fb6260713b72 cache stats: signature cache 0 hits, 1 misses (0.0% hit rate); script cache 4701 hits, 2 misses (100.0% hit rate)
 982025-10-18T02:17:33Z Block 0000000000000000000110af0f5eb1da03ed38df23a0328f7fcca1d503200e29 cache stats: signature cache 0 hits, 144 misses (0.0% hit rate); script cache 4084 hits, 136 misses (96.8% hit rate)
 992025-10-18T02:23:22Z Block 00000000000000000001572022e10878c378f3401c78dbcac1b91f96f1d7c6e7 cache stats: signature cache 1 hits, 35 misses (2.8% hit rate); script cache 1036 hits, 10 misses (99.0% hit rate)
1002025-10-18T02:28:22Z Block 000000000000000000006fbba1d7404a1551c2b5263a742fc65e699e28efc99e cache stats: signature cache 7 hits, 17 misses (29.2% hit rate); script cache 4657 hits, 14 misses (99.7% hit rate)
1012025-10-18T02:31:48Z Block 00000000000000000000cc1e7c50610b0261abe39f654da2aebdfac40563d313 cache stats: signature cache 0 hits, 3 misses (0.0% hit rate); script cache 4460 hits, 3 misses (99.9% hit rate)
1022025-10-18T02:39:27Z Block 0000000000000000000135815caf529c9d9e2a0f8fc0e495dc1c74ec767a416b cache stats: signature cache 0 hits, 9 misses (0.0% hit rate); script cache 4405 hits, 9 misses (99.8% hit rate)
1032025-10-18T02:49:16Z Block 00000000000000000000ac8b97aaae9b4a424c9b0788ed5110e48362b0a794a5 cache stats: signature cache 0 hits, 6 misses (0.0% hit rate); script cache 4286 hits, 6 misses (99.9% hit rate)
1042025-10-18T02:51:43Z Block 000000000000000000015b7dced67bc0d6a4a8b507e85cf95bb542fcced06a1c cache stats: signature cache 0 hits, 2 misses (0.0% hit rate); script cache 4734 hits, 2 misses (100.0% hit rate)
1052025-10-18T03:06:08Z Block 000000000000000000009076e9ea05dc3c54b18f67e053bd0103586cf61e305f cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 2090 hits, 0 misses (100.0% hit rate)
1062025-10-18T03:16:45Z Block 000000000000000000011c32790933a0e358940432ecc0488ca530a1675ab83c cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3439 hits, 0 misses (100.0% hit rate)
1072025-10-18T03:39:04Z Block 00000000000000000000e8c0647ab10214c85871cb3e2fb6c39e66a9af075acc cache stats: signature cache 19 hits, 11 misses (63.3% hit rate); script cache 2465 hits, 1 misses (100.0% hit rate)
1082025-10-18T04:17:16Z Block 000000000000000000014758b3cea9bfd0ef536876ae6ba32ebfad72671d977f cache stats: signature cache 0 hits, 4 misses (0.0% hit rate); script cache 2962 hits, 1 misses (100.0% hit rate)
1092025-10-18T04:36:03Z Block 000000000000000000001c422414aae2a6fbd02c47a77367db0d19c5902a349e cache stats: signature cache 0 hits, 1 misses (0.0% hit rate); script cache 4473 hits, 1 misses (100.0% hit rate)
1102025-10-18T05:07:00Z Block 00000000000000000000f7787d5bd147deaabd5e05cc0e6d21f86429ac3cddb8 cache stats: signature cache 0 hits, 27 misses (0.0% hit rate); script cache 3544 hits, 27 misses (99.2% hit rate)
1112025-10-18T05:08:53Z Block 00000000000000000001010784a4ce18480d9b4c598a025b27ec532b88835f32 cache stats: signature cache 0 hits, 14 misses (0.0% hit rate); script cache 4621 hits, 2 misses (100.0% hit rate)
1122025-10-18T05:21:44Z Block 00000000000000000000075a93a9151ceb5c3199c8f521f3f911b68ca3d45267 cache stats: signature cache 0 hits, 6 misses (0.0% hit rate); script cache 3448 hits, 5 misses (99.9% hit rate)
1132025-10-18T05:29:34Z Block 000000000000000000018fbc71be9cf074e6902fd94427f8ed0ebc0d40c60752 cache stats: signature cache 0 hits, 6 misses (0.0% hit rate); script cache 4298 hits, 5 misses (99.9% hit rate)
1142025-10-18T05:36:22Z Block 00000000000000000001c6c3450975891ce452f2fedc133f34fac007a40dcded cache stats: signature cache 0 hits, 1 misses (0.0% hit rate); script cache 4608 hits, 1 misses (100.0% hit rate)
1152025-10-18T05:36:25Z Block 00000000000000000001de11394239b01f8048a0ab7aca02544aefe920d7d0e5 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 4782 hits, 0 misses (100.0% hit rate)
1162025-10-18T05:54:36Z Block 0000000000000000000125f345e6cb766c8927c05790c364497786d98d3b1d2e cache stats: signature cache 0 hits, 3 misses (0.0% hit rate); script cache 3685 hits, 3 misses (99.9% hit rate)
1172025-10-18T06:09:26Z Block 00000000000000000001451587f43121df2907da305bfb75898e8b5f580e4c62 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3377 hits, 0 misses (100.0% hit rate)
1182025-10-18T06:25:25Z Block 00000000000000000001d6246541ca3e68e4b6dbcdceb5b163337a5203f27620 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3919 hits, 0 misses (100.0% hit rate)
1192025-10-18T06:29:31Z Block 0000000000000000000195720f00213efed545511680e74719400dad7fe96a4a cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 4855 hits, 0 misses (100.0% hit rate)
1202025-10-18T06:42:40Z Block 00000000000000000000fa029afeee99fbf4d9fbd1d968773895bcc375e9b453 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3350 hits, 0 misses (100.0% hit rate)
1212025-10-18T06:47:30Z Block 0000000000000000000175f5e168eea70cbb84e9a351faae6da38904aa29fcf4 cache stats: signature cache 0 hits, 22 misses (0.0% hit rate); script cache 1664 hits, 23 misses (98.6% hit rate)
1222025-10-18T06:57:18Z Block 00000000000000000000cf68b4f07f9eabcc7a82fc72eaa2b496e1b9680b3e76 cache stats: signature cache 315 hits, 212 misses (59.8% hit rate); script cache 3356 hits, 3 misses (99.9% hit rate)
1232025-10-18T06:59:34Z Block 00000000000000000000fbed1465c4e3e6a9f4a0635f5110a4b820362f57774f cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3228 hits, 0 misses (100.0% hit rate)
1242025-10-18T07:15:54Z Block 00000000000000000001b03161aa967a60f1844f1e46b3d1bc6301227d99bc38 cache stats: signature cache 0 hits, 28 misses (0.0% hit rate); script cache 3350 hits, 8 misses (99.8% hit rate)
1252025-10-18T07:18:21Z Block 0000000000000000000024865d8e67cf3cdfc8ec4e42dc9d33c8f88cd09b20fb cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 5097 hits, 0 misses (100.0% hit rate)
1262025-10-18T07:22:31Z Block 00000000000000000001c98a657032aff9a5fcb4617b45dfec5e77aa8e527bd7 cache stats: signature cache 8 hits, 60 misses (11.8% hit rate); script cache 728 hits, 67 misses (91.6% hit rate)
1272025-10-18T07:35:48Z Block 000000000000000000002c6377c808d9bf5737a9af08a7fa3c1b342ed20289ce cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3431 hits, 0 misses (100.0% hit rate)
1282025-10-18T07:44:39Z Block 000000000000000000003ffe39b6dc8aefda145d07d72c6ff7ad2226a348cf12 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 1623 hits, 0 misses (100.0% hit rate)
1292025-10-18T07:45:40Z Block 00000000000000000001b096688fa8b347984dd79efea216f778390f2ded4c2f cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 205 hits, 0 misses (100.0% hit rate)
1302025-10-18T07:55:08Z Block 000000000000000000004aaeb3d52fc32e0e1fba17e6cd073bcbdb9dad18c78c cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 4358 hits, 0 misses (100.0% hit rate)
1312025-10-18T08:02:59Z Block 00000000000000000000ca6230865b9986fa5e0a55750d553f06ca3d1a64ded0 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 3635 hits, 0 misses (100.0% hit rate)
1322025-10-18T08:04:09Z Block 000000000000000000014b41713d209f2e4b155c41c40e77308f41aaabe76ff9 cache stats: signature cache 0 hits, 0 misses (0.0% hit rate); script cache 5095 hits, 0 misses (100.0% hit rate)

Does using a different fanout pattern, or size configuration bring us any benefit? To find out more I added a simple benchmark to test lookup performance of an 8 and 2-way fanout (I also tried a 4-way fanout into buckets of 2, but I think my implementation was not optimal, and in any case we can consider results from the 2-way fanout I think). This is the closest scenario to the block connection case where we consult the cache(s) but don’t store anything in them (i.e. cause evictions), and this is the case IMO that we should care most about.

These results were as follows:

8-way fanout: 193.5μs per 4,000 lookups (48.4ns per lookup)
2-way fanout: 142.3μs per 4,000 lookups (35.6ns per lookup)

So 2-way fanout (as expected) is 26% faster for pure lookups. There is certainly a little room for improvement by changing fanout of the cache, but would it be worth it?

If we consider that a block might have ~4k lookups in the script cache, then it follows that the time spent doing lookups in the cache would be:

4,000 lookups × 48.4ns = 194μs total cache time (8-way)
4,000 lookups × 35.6ns = 142μs total cache time (2-way)

This could mean a saving of ~52μs per block by switching to a naive 2-way fanout. In the 4-way fanout into buckets of 2 case this would likely be a smaller saving still.

(I also wrote a benchmark to cause evictions and saw again speedups with a 2-way fanout, but these feel less instructive to me, particularly in the case of block connection.)

In terms of cache sizes, currently these both store ~525,000 32-byte elements with 45% of the cache sized used per-epoch, which equates to ~236,250 elements per epoch. Based on current mempool sizes this seems like more than enough for both caches, which seems to align with my logs seeing ~100% script cache hits during connection.

I did not yet look at tuning the epoch/eviction counter, nor Jeremy’s idea of sharing the same table (or making hashes “sticker” by entering them multiple times) as I saw such good hit-rates with the current configuration in block acceptance, but could do so if there was still interest in that…

So overall, whilst there is some performance improvement possible here, I’m not convinces it’s particularly worth making changes for.

JeremyRubin commented at 10:14 pm on October 29, 2025: contributor

@willcl-ark you can also look at the memory model and seeing if/how you can make the cache more parallel during block validation. IIRC there is some unnecessary locking which can be eliminated/reduced to something like one acquire/release per thread and a single thread holding a unique lock to prevent writers.

Contributors
TheBlueMatt gmaxwell JeremyRubin willcl-ark

Labels
Brainstorming Resource usage