Built on top of #23662, coming from comment #23662#pullrequestreview-971407999.
If wallet.GetLabelAddresses() returns an empty vector (the wallet does not have stored destinations with that label in the addressbook) or if none of the returned destinations are from the wallet, we can return the function right away.
Otherwise, we are walking through all the wallet txs + outputs for no reason (output_scripts is empty).