1. 10 Jun, 2020 1 commit
  2. 09 May, 2020 1 commit
    • Yanqin Jin's avatar
      Fix a few bugs in best-efforts recovery (#6824) · e72e2167
      Yanqin Jin authored
      1. Update column_family_memtables_ to point to latest column_family_set in
         version_set after recovery.
      2. Normalize file paths passed by application so that directories end with '/'
         or '\\'.
      3. In addition to missing files, corrupted files are also ignored in
         best-efforts recovery.
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/6824
      Test Plan: COMPILE_WITH_ASAN=1 make check
      Reviewed By: anand1976
      Differential Revision: D21463905
      Pulled By: riversand963
      fbshipit-source-id: c48db8843cc93c8c1c7139c474b64e6f775307d2
  3. 06 May, 2020 1 commit
  4. 21 Mar, 2020 1 commit
    • Yanqin Jin's avatar
      Attempt to recover from db with missing table files (#6334) · fb09ef05
      Yanqin Jin authored
      There are situations when RocksDB tries to recover, but the db is in an inconsistent state due to SST files referenced in the MANIFEST being missing. In this case, previous RocksDB will just fail the recovery and return a non-ok status.
      This PR enables another possibility. During recovery, RocksDB checks possible MANIFEST files, and try to recover to the most recent state without missing table file. `VersionSet::Recover()` applies version edits incrementally and "materializes" a version only when this version does not reference any missing table file. After processing the entire MANIFEST, the version created last will be the latest version.
      `DBImpl::Recover()` calls `VersionSet::Recover()`. Afterwards, WAL replay will *not* be performed.
      To use this capability, set `options.best_efforts_recovery = true` when opening the db. Best-efforts recovery is currently incompatible with atomic flush.
      Test plan (on devserver):
      $make check
      $COMPILE_WITH_ASAN=1 make all && make check
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/6334
      Reviewed By: anand1976
      Differential Revision: D19778960
      Pulled By: riversand963
      fbshipit-source-id: c27ea80f29bc952e7d3311ecf5ee9c54393b40a8