Any of this done automatically? That might explain why this is happening to you.
Unfortunately, I used 3 browsers which are the most common and that we support; Chrome, Edge, and Firefox. (In your experience, Edge you mentioned had no issues, but Firefox did.) All 3 browsers, I am not having issues. Browsed around, waited, browsed again to mimic behavior of an active admin for a while.
I would recommend disabling and not using these browser history (cache/cookie/etc...) clearing items temporarily to see if this fixes your issue here. I will continue to browse but ultimately, I think this is an abnormal activity you're performing if this is happening mid-browsing thus not something we can "fix."
Apologizes, I missed that.