I'm following up to see if anyone else would categorize this as a bug. It renders my old primaries dead until I do a restore on them.
No, I don’t think so. When you promote a standby; the primary will have to be restored or rewinded using pg_rewind to turn it into a replica. Another approach is to cleanly shutdown the primary and then you can turn it into a replica without doing a restore or pg_rewind.