I have a feeling it's because I reached the 10,000 search result limit I had elastic search set to.
The problem is once the limit is REACHED it should return the newest 10K results not the OLDEST 10K results.
We will see if this is the issue before I get up in arms over this. I updated it to 11,001 and now it's rebuilding