Multiprocess tracking issue

ryanofsky commented at 6:22 pm on October 24, 2023: contributor
This issue will be updated to reflect the current state of bitcoin core multiprocess support.

PRs for review related to building & releasing:
- #32387
- Upstream libmultiprocess pulls
PRs for review related to mining:
- #30437
PRs for review related wallet & gui & cli:
- #29409
- #10102
- #19460
- #19461
- #32297
- #32898
Issues:
- #32275
- #30983
- #31098
- #31109
  
  caused by #31003
  
  resolved by #31283
- #31756
- #32669
- #32802
- #33341
- #33387
- #33439
- #33463
PRs / issues closed:
- ~~#10242~~
- ~~#10295~~
- ~~#10600~~
- ~~#10244~~
- ~~#10605~~
- ~~#14636~~
- ~~#14437~~
- ~~#14711~~
- ~~#15342~~
- ~~#15373~~
- ~~#15288~~
- ~~#15531~~
- ~~#10973~~
- ~~#16839~~
- ~~#17906~~
- ~~#18278~~
- ~~#16367~~
- ~~#17999~~
- ~~#18743~~
- ~~#18587~~
- ~~#18677~~
- ~~#20494~~
- ~~#20046~~
- ~~#21035~~
- ~~#21732~~
- ~~#19160~~
- ~~#22216~~
- ~~#22214~~
- ~~#22218~~
- ~~bitcoin-core/gui#360~~
- ~~#22215~~
- ~~#22217~~
- ~~#19101~~
- ~~#22848~~
- ~~#22219~~
- ~~#23003~~
- ~~#23006~~
- ~~#23004~~
- ~~#23005~~
- ~~#23499~~
- ~~#28721~~
- ~~#28907~~
- ~~#28978~~
- ~~#28921~~
- ~~#28929~~
- ~~#30509~~
- ~~#30510~~
- ~~#31196~~
- ~~#31197~~
- ~~#30940~~
- ~~#30955~~
- ~~#31105~~
- ~~#31003~~
- ~~#31288~~
- ~~#31480~~
- ~~#31318~~
- ~~#31196~~
- ~~#31740~~
- ~~#31151~~
- ~~#31455~~
- ~~#31763~~
- ~~#31815~~
- ~~#31945~~
- ~~#31283~~
- ~~#31827~~
- ~~#31564~~
- ~~#31866~~
- ~~#31992~~
- ~~#31741~~
- ~~#30975~~
- ~~#31785~~
- ~~#32271~~
- ~~#32378~~
- ~~#31375~~
- ~~#32634~~
- ~~#32641~~
- ~~#32690~~
- ~~#31981~~
- ~~#32760~~
- ~~#32781~~
- ~~#31679~~
- ~~#31802~~
- ~~#32345~~
- ~~#33190~~
- ~~#33322~~
- ~~#33222~~
- ~~#33233~~
- ~~#33241~~
- ~~#33219~~
- ~~#33235~~
- ~~#33290~~
- ~~#33315~~
- ~~#33201~~
- ~~#33176~~
- ~~#33308~~
- ~~#33281~~
- ~~#33312~~
- ~~#33256~~
- ~~#33342~~
- ~~#33348~~
- ~~#33412~~
- ~~#33244~~
- ~~#33277~~
- ~~#33380~~
- ~~#33372~~
- ~~#33374~~
- ~~#33459~~
- ~~#33229~~
- ~~#31618~~
Links:
fanquake referenced this in commit 29c2c90362 on Nov 13, 2023
fanquake referenced this in commit a238356823 on Nov 22, 2023
achow101 referenced this in commit d036a86815 on Jan 2, 2024
achow101 referenced this in commit 2f218c664b on Jan 23, 2024
achow101 referenced this in commit 71f0f2273f on May 15, 2024
achow101 referenced this in commit df3f63ccfa on Sep 9, 2024
achow101 referenced this in commit 65f6e7078b on Sep 25, 2024
PastaPastaPasta referenced this in commit 2786b58bf6 on Sep 27, 2024
PastaPastaPasta referenced this in commit ba3378899e on Sep 27, 2024
PastaPastaPasta referenced this in commit 3d589cd31e on Sep 27, 2024
PastaPastaPasta referenced this in commit 6a454fb19f on Sep 28, 2024
PastaPastaPasta referenced this in commit 630e767be7 on Oct 1, 2024
fanquake referenced this in commit ba0a4391ff on Feb 25, 2025
hebasto referenced this in commit 4c1906a500 on Mar 29, 2025
fanquake referenced this in commit b2bb27f40c on Apr 11, 2025
sipa commented at 5:52 pm on April 15, 2025: member

Please let me know if this is already implemented, being discussed elsewhere, or if this is not the right place for it.

Would it make sense to (not now, or even necessarily in the short term), make bitcoin-cli (or bitcoin rpc, with the wrapper binary) support IPC communication with bitcoin-node, which would gain an “RPC-over-IPC” service? Since IPC supports communication over a UNIX socket, and there has been discussion about what would be needed to make RPC support UNIX sockets, this seems like an easy way to achieve the same thing.

This cannot be a replacement for the TCP/IP-based RPC functionality, as it would lack authentication control, but enable an easy, efficient, configuration-free way of executing RPC commands?
ryanofsky commented at 7:21 pm on April 15, 2025: contributor
re: #28722 (comment)

This is an interesting idea. Another place to discuss it might be #5029, depending on what goal of the change is. There are links to different unix socket implementations in #5029, and according to #31194, supporting unix socket RPC calls is a top reason for wanting to drop the dependency on libevent (which is done in #32061).

Probably the cleanest way to support RPCs over a unix socket would be to send JSON-RPC requests directly over the socket as discussed in the previous issues. But it would be pretty easy to implement a new IPC interface similar to the IPC mining interface which could allow bitcoin-cli or another client to make RPC method calls over the IPC socket. I could make a small PR to implement that if it would be interesting. The interface could be as simple as something like:
0interface Rpc $Proxy.wrap("interfaces::Rpc") { 1 callMethod [@0](/bitcoin-bitcoin/contributor/0/) (context :Proxy.Context, request :Text) -> (result :Text); 2};
if it just passes JSON requests and responses. Though probably the interface should be more structured and use separate fields for things like wallet names and user names.

there has been discussion about what would be needed to make RPC support UNIX sockets, this seems like an easy way to achieve the same thing.

Yes, this should be easier to implement than other approaches. The relative downsides are that it would be more internally complicated, and more awkward to write external clients for, since it would require capnproto.

EDIT: Implemented this a draft PR in #32297
ryanofsky referenced this in commit 0d9473f0ca on Apr 17, 2025
ryanofsky referenced this in commit df40f46571 on Apr 17, 2025
ryanofsky referenced this in commit e770c0273a on Apr 18, 2025
ryanofsky referenced this in commit 0394da2fec on Apr 18, 2025
ryanofsky referenced this in commit 113b46d310 on Apr 21, 2025
ryanofsky referenced this in commit a671f5a31d on May 22, 2025
ryanofsky referenced this in commit 15f8e6b034 on May 22, 2025
achow101 referenced this in commit 012f347685 on May 27, 2025
ryanofsky referenced this in commit e58e680bf7 on Jun 4, 2025
ryanofsky referenced this in commit 2007d174e7 on Jun 4, 2025
ryanofsky referenced this in commit 89865a1be4 on Jun 24, 2025
ryanofsky referenced this in commit 7bab20107e on Jul 7, 2025
ryanofsky referenced this in commit 51f6c12979 on Jul 7, 2025
DashCoreAutoGuix referenced this in commit a8622d45c3 on Jul 30, 2025
DashCoreAutoGuix referenced this in commit 885654f285 on Jul 30, 2025
DashCoreAutoGuix referenced this in commit 6df2c577c9 on Aug 6, 2025
DashCoreAutoGuix referenced this in commit 2d38312f80 on Aug 7, 2025
fanquake referenced this in commit 2bb06bcaf2 on Aug 7, 2025
DashCoreAutoGuix referenced this in commit dacdfb87e3 on Aug 8, 2025
fanquake referenced this in commit f58de8749e on Aug 18, 2025
achow101 referenced this in commit 31b29f8eb6 on Sep 25, 2025
glozow added the label Tracking Issue on Oct 9, 2025

Multiprocess tracking issue #28722