In the x-only world, it makes sense to carry around secp256k1_keypair instead of raw secrets.
However, this means there's no way of accessing secret, i.e. secp256k1_keypair_priv().
I actually want this for debugging, but logically I'd want it if I were to send secrets over the wire...