I set all my forums' permission so that guests can only read topics, but guests can reply and register later. How do I stop that?

Well that sounds like post before register but their replies won’t show until they have registered so if they are showing up it sounds like a permissions issue.

Screenshot the permissions for the forum in question.