You must save cache in SQLite3 format : Setting - Options - Cache - Default Cache Type: SQLite3
So you will have only few big files instead of millions of tiles
You can even convert stored cache to SQLite3