It may not. It depends on what amount of cache is then rebuilt. Also, if that task is not running, it may not be clearing at all. While Its set to run every 10 minutes, it is currently running with traffic. So if you have not enough traffic it may not clear at all.
I do have to point out here though that the sizes you were mentioning are not large in any way.