What files can be removed before a 4.0 to 4.1 upgrade?

[Kirill N]

I'm planning to upgrade from 4.0 to 4.1 soon and I was wondering what files can be removed before the upgrade? 

I remember that for a 3.x to 4.x upgrade it was adviced to remove everything except for a couple of folders like /uploads.