refactor: Remove settings merge reverse precedence code #17581

pull ryanofsky wants to merge 16 commits into bitcoin:master from ryanofsky:pr/wdrev changing 18 files +1171 −207
  1. ryanofsky commented at 8:17 pm on November 24, 2019: contributor

    This is based on #16545 + #17580 + #17493. The non-base commits are:


    This has no effect on behavior because as of #17493 it’s not possible to specify multiple values for single value settings in the config file.

    This change implements one of the settings simplifications listed in #17508

  2. fanquake added the label Refactoring on Nov 24, 2019
  3. DrahtBot commented at 11:52 pm on November 24, 2019: contributor

    The following sections might be updated with supplementary metadata relevant to reviewers and maintainers.

    Code Coverage

    For detailed information about the code coverage, see the test coverage report.

    Reviews

    See the guideline for information on the review process. A summary of reviews will appear here.

    Conflicts

    Reviewers, this pull request conflicts with the following ones:

    • #30401 (fix: increase consistency of rpcauth parsing by tdb3)
    • #30059 (Add option dbfilesize to control LevelDB target (“max”) file size by luke-jr)
    • #29775 (Testnet4 including PoW difficulty adjustment fix by fjahr)
    • #29043 (fuzz: make FuzzedDataProvider usage deterministic by martinus)
    • #28358 (Drop -dbcache limit by Sjors)

    If you consider this pull request important, please also help to review the conflicting pull requests. Ideally, start with the one that should be merged first.

  4. DrahtBot added the label Needs rebase on Dec 19, 2019
  5. ryanofsky force-pushed on Dec 20, 2019
  6. DrahtBot removed the label Needs rebase on Dec 20, 2019
  7. DrahtBot added the label Needs rebase on Jan 30, 2020
  8. ryanofsky force-pushed on Sep 28, 2020
  9. DrahtBot removed the label Needs rebase on Sep 28, 2020
  10. DrahtBot added the label Needs rebase on Sep 29, 2020
  11. ryanofsky force-pushed on Apr 13, 2021
  12. DrahtBot removed the label Needs rebase on Apr 13, 2021
  13. ryanofsky force-pushed on Apr 14, 2021
  14. DrahtBot added the label Needs rebase on Apr 15, 2021
  15. ryanofsky force-pushed on Jun 17, 2021
  16. DrahtBot removed the label Needs rebase on Jun 18, 2021
  17. DrahtBot added the label Needs rebase on Aug 22, 2021
  18. ryanofsky force-pushed on Dec 30, 2021
  19. DrahtBot removed the label Needs rebase on Dec 30, 2021
  20. DrahtBot added the label Needs rebase on Feb 9, 2022
  21. uvhw referenced this in commit 47d44ccc3e on Feb 14, 2022
  22. ryanofsky force-pushed on Sep 27, 2022
  23. DrahtBot removed the label Needs rebase on Sep 27, 2022
  24. DrahtBot added the label Needs rebase on Nov 15, 2022
  25. ryanofsky force-pushed on Feb 15, 2023
  26. DrahtBot removed the label Needs rebase on Feb 15, 2023
  27. DrahtBot added the label Needs rebase on Mar 20, 2023
  28. achow101 marked this as a draft on Apr 25, 2023
  29. ryanofsky force-pushed on May 3, 2023
  30. DrahtBot removed the label Needs rebase on May 3, 2023
  31. DrahtBot added the label Needs rebase on May 9, 2023
  32. ryanofsky force-pushed on Jul 19, 2024
  33. DrahtBot removed the label Needs rebase on Jul 20, 2024
  34. doc: Add detailed ArgsManager type flag documention
    This commit just adds documentation for the type flags. The flags are actually
    implemented in the following two commits.
    d2c9af993a
  35. Add ArgsManager flags to parse and validate settings on startup
    This commit implements support for new ALLOW_BOOL, ALLOW_INT, ALLOW_STRING, and
    ALLOW_LIST flags by validating settings with these flags earlier on startup and
    providing detailed error messages to users.
    
    The new flags implement stricter error checking than ALLOW_ANY. For example, a
    double negated option like -nosetting=0 is treated like an error instead of
    true, and an unrecognized bool value like -setting=true is treated like an
    error instead of false. And if a non-list setting is assigned multiple times in
    the same section of a configuration file, the later assignments trigger errors
    instead of being silently ignored.
    
    The new flags also provide type information that allows ArgsManager
    GetSettings() and GetSettingsList() methods to return typed integer and boolean
    values instead of unparsed strings.
    
    The changes in this commit have no effect on current application behavior
    because the new flags are only used in unit tests. The existing ALLOW_ANY
    checks in the argsman_tests/CheckValueTest confirm that no behavior is changing
    for current settings, which use ALLOW_ANY.
    d03b7e94cd
  36. Update ArgManager GetArg helper methods to work better with ALLOW flags
    Update GetArg, GetArgs, GetBoolArg, and GetIntArg helper methods to work
    conveniently with ALLOW_BOOL, ALLOW_INT, and ALLOW_STRING flags.
    
    The GetArg methods are convenience wrappers around the GetSetting method. The
    GetSetting method returns the originally parsed settings values in their
    declared bool/int/string types, while the GetArg wrappers provide extra
    type-coercion and default-value fallback features as additional conveniences
    for callers.
    
    This commit makes two changes to GetArg, GetArgs, GetBoolArg, and GetIntArg
    helper methods when BOOL/INT/STRING flags are used:
    
    1. GetArg methods will now raise errors if they are called with inconsistent
       flags. For example, GetArgs will raise a logic_error if it is called on a
       non-LIST setting, GetIntArg will raise a logic_error if it is called
       on a non-INT setting.
    
    2. GetArg methods will now avoid various type coersion footguns when they are
       called on new BOOL/INT/STRING settings. Existing ALLOW_ANY settings are
       unaffected. For example, negated settings will return "" empty strings
       instead of "0" strings (in the past the "0" strings caused strangeness like
       "-nowallet" options creating wallet files named "0"). The new behaviors are
       fully specified and checked by the `CheckValueTest` unit test.
    
    The ergonomics of the GetArg helper methods are subjective and the behaviors
    they implement can be nitpicked and debated endlessly. But behavior of these
    helper methods does not dictate application behavior, and they can be bypassed
    by calling GetSetting and GetSettingList methods instead. If it's necessary,
    behavior of these helper methods can also be changed again in the future.
    
    The changes have no effect on current application behavior because the new
    flags are only used in unit tests. The `setting_args` unit test and ALLOW_ANY
    checks in the `CheckValueTest` unit test are unchanged and confirm that
    `GetArg` methods behave the same as before for ALLOW_ANY flags (returning the
    same values and throwing the same exceptions).
    1d135e7041
  37. test: Add tests to demonstrate usage of ArgsManager flags
    Co-authored-by: Hodlinator <172445034+hodlinator@users.noreply.github.com>
    16fe0c5763
  38. test: Add test for settings.json parsing with type flags
    The type flags aren't currently used to validate or convert settings in the
    settings.json file, but they should be in the future. Add test to check current
    behavior that can be extended when flags are applied.
    
    Co-authored-by: Hodlinator <172445034+hodlinator@users.noreply.github.com>
    1e37bcf9fc
  39. DrahtBot added the label Needs rebase on Aug 5, 2024
  40. Merge remote-tracking branch 'origin/pull/16545/head' f9a61519ae
  41. scripted-diff: Add ALLOW_LIST flag to arguments retrieved with GetArgs
    This change has no effect on behavior, and is basically just a documentation
    change at this point. The ALLOW_LIST flag is currently ignored unless
    ALLOW_BOOL, ALLOW_INT, or ALLOW_STRING flags are also present, and these flags
    are not used yet.
    
    -BEGIN VERIFY SCRIPT-
    for f in `git grep -n 'GetArgs(' | grep -v _tests | sed -n 's/.*GetArgs("\([^"]\+\)".*/\1/p' | sort -u`; do
       git grep -l -- "$f" | xargs sed -i "/AddArg(\"$f[=\"]/ s/ArgsManager::ALLOW_ANY/& | ArgsManager::ALLOW_LIST/g"
    done
    -END VERIFY SCRIPT-
    ed89cf7d52
  42. refactor: Fix more ALLOW_LIST arguments
    - Remove ALLOW_LIST flag from bitcoin-wallet -wallet and -debug arguments. They
      are list arguments for bitcoind, but single arguments for bitcoin-wallet.
    
    - Add ALLOW_LIST flag to -includeconf arg (missed by scripted diff since it's
      not accessed through GetArgs)
    
    - Add ALLOW_LIST flag to -debug, -loglevel, -whitebind, and -whitelist args
      (missed by scripted diff due to line breaks in AddArgs calls)
    
    - Add ALLOW_LIST flag to -zmq args (missed by scripted diff due to programmatic
      GetArgs calls)
    
    This change has no effect on behavior, and is basically just a documentation
    change at this point. The ALLOW_LIST flag is currently ignored unless
    ALLOW_BOOL, ALLOW_INT, or ALLOW_STRING flags are also present, and these flags
    are not used yet.
    a9e8404ca9
  43. Always reject empty -rpcauth="" arguments
    Previous behavior was nonsensical:
    
    - If an empty -rpcauth="" argument was specified as the last command
      line argument, it would cause all other -rpcauth arguments to be
      ignored.
    - If an empty -rpcauth="" argument was specified on the command line
      followed by any nonempty -rpcauth argument, it would cause an error.
    - If an empty "rpcauth=" line was specified after non-empty rpcauth line
      it would cause an error.
    - If an empty "rpcauth=" line in a config file was the entry in the
      config file it would cause all rpcauth entries to be ignored, unless
      the last command line argument was a nonempty -rpcauth argument, in
      which case it would be ignored.
    
    New behavior is simple:
    
    - If an empty "rpcauth=" config line or -rpcauth="" command line
      argument is used it will cause an error
    8116706504
  44. Always reject empty -blockfilterindex="" arguments
    Previous behavior was inconsistent: if -blockfilterindex or
    -blockfilterindex="" arguments were specified they would normally enable all
    block filter indexes, but could also trigger "Unknown -blockfilterindex value"
    errors if followed by later -blockfilterindex arguments.
    
    It was confusing that the same -blockfilterindex options could sometime trigger
    errors and sometimes not depending on option position. It was also confusing
    that an empty -blockfilterindex="" setting could enable all indexes even though
    indexes are disabled by default.
    
    New behavior is more straightforward:
    
    - -blockfilterindex and -blockfilterindex=1 always enable indexes
    - -noblockfilterindex and -blockfilterindex=0 always disable indexes
    - -blockfilterindex="" is always an unknown value error
    
    The meaning of these options no longer changes based on option position.
    e6fcdfb822
  45. refactor: Always enforce ALLOW_LIST in CheckArgFlags
    Prevent GetArg() from being called on ALLOW_LIST arguments, and GetArgs() from
    being called on non-list arguments.
    
    This checking was previously skipped unless typed INT/BOOL/STRING flags were
    present, but now it's always done.
    
    This change has no effect on external behavior. It is just supposed to enforce
    internal consistency and prevent bugs caused by using the wrong GetArg method
    to retrieve settings.
    a1d6506662
  46. Merge remote-tracking branch 'origin/pull/17580/head' 584107fc4a
  47. util: Forbid ambiguous multiple assignments in config file
    Enable error "Multiple values specified for -setting in same section of config
    file.", for ALLOW_ANY settings that don't specify ALLOW_LIST.
    
    Instead of silently ignoring settings, this change makes it an error to provide
    an ambiguous config file that provides assigns multiple values to a
    single-value setting. Change include release notes.
    200c3cda55
  48. test: Extend util_ArgsMerge test to check for "Multiple values specified" errors
    Also skip calling TestArgString in these cases since exact behavior retrieving
    values is irrelevant when parsing values fails.
    
    Also s/TestArgString/GetArg/ to be more efficient and direct, now that it's no
    longer necessary to call with separation of ALLOW_LIST and non ALLOW_LIST
    cases.
    6a42b8e1d4
  49. Merge remote-tracking branch 'origin/pull/17493/head' 372d3608d9
  50. refactor: Remove settings merge reverse precedence code
    This commit has no effect on behavior because as of
    https://github.com/bitcoin/bitcoin/pull/17493 it's not possible to specify
    multiple values for single value settings in the config file.
    137738c91a
  51. ryanofsky force-pushed on Aug 6, 2024
  52. DrahtBot removed the label Needs rebase on Aug 6, 2024
  53. DrahtBot commented at 10:12 pm on August 7, 2024: contributor

    🐙 This pull request conflicts with the target branch and needs rebase.

  54. DrahtBot added the label Needs rebase on Aug 7, 2024
  55. DrahtBot commented at 0:36 am on November 4, 2024: contributor

    ⌛ There hasn’t been much activity lately and the patch still needs rebase. What is the status here?

    • Is it still relevant? ➡️ Please solve the conflicts to make it ready for review and to ensure the CI passes.
    • Is it no longer relevant? ➡️ Please close.
    • Did the author lose interest or time to work on this? ➡️ Please close it and mark it ‘Up for grabs’ with the label, so that it can be picked up in the future.

github-metadata-mirror

This is a metadata mirror of the GitHub repository bitcoin/bitcoin. This site is not affiliated with GitHub. Content is generated from a GitHub metadata backup.
generated: 2024-11-17 09:12 UTC

This site is hosted by @0xB10C
More mirrored repositories can be found on mirror.b10c.me