This list can become very clustered with abandoned addresses, and can make finding specific addresses more difficult.
Deleting addresses should require the password if the wallet is encrypted.
Hiding an address would be preferable, just in case a person receives a transaction to one.