Now my forum member theme is different with the visitor theme. How I change the visitor theme same with the member theme?

In AP theme I didnt see any option can change the visitor theme

Your guest theme would be whatever theme is set as default. Please do bear in mind however that you will initially see cache on cloud, so you may not see that change instantly