Skip to content
  • sdong's avatar
    sst_dump to reduce number of file reads (#6836) · 4a4b8a13
    sdong authored
    Summary:
    sst_dump can issue many file reads from the file system. This doesn't work well with file systems without a OS cache, especially remote file systems. In order to mitigate this problem, several improvements are done:
    1. --readahead_size is added, so that users can specify readahead size when scanning the data.
    2. Force a 512KB tail readahead, which prevents three I/Os for footer, meta index and property blocks and hopefully index and filter blocks too.
    3. Consoldiate SSTDump's I/Os before opening the file for read. Use the same file prefetch buffer.
    Pull Request resolved: https://github.com/facebook/rocksdb/pull/6836
    
    Test Plan: Add a test that covers this new feature.
    
    Reviewed By: pdillinger
    
    Differential Revision: D21516607
    
    fbshipit-source-id: 3ae43526286f67b2f4a5bdedfbc92719d579b87e
    4a4b8a13
To find the state of this project's repository at the time of any of these versions, check out the tags.