[stable27] perf: Avoid updating the folder size if we know the size difference

[stable27] perf: Avoid updating the folder size if we know the size difference #5781