If storing the secrets securely doesn't cause the public settings to be inaccessible where/when they're needed, then you have nothing else to do.
Separate the secret and non-secret data. Don't even use files, just let each item be its own individual value with its own key and permissions.
Also, it doesn't sound like anyone debating this is experienced enough to be making security decisions, even very basic ones.