[zfs-discuss] cannot import 'home': I/O error Destroy and re-create the pool from a backup source

Anton Gubar'kov anton.gubarkov at iits.ru
Wed Apr 25 13:39:04 EDT 2018


Jeff, I tried "zpool import -m -o readlonly=on"  home command and it ended
very quickly with
Cannot import 'home': I/O error
        Destroy and re-create the pool from
        a backup source.
 Here are the dbg-messages resulting from this run

1524671729   spa.c:5174:spa_tryimport(): spa_tryimport: importing home
1524671729   spa_misc.c:403:spa_load_note(): spa_load($import, config
untrusted): LOADING
1524671729   vdev.c:92:vdev_dbgmsg(): disk vdev
'/dev/disk/by-id/wwn-0x5000c500a41ae340-part1': best uberblock found for
spa $import. txg 1492711
1524671729   spa_misc.c:403:spa_load_note(): spa_load($import, config
untrusted): using uberblock with txg=1492711
1524671730   spa_misc.c:403:spa_load_note(): spa_load($import, config
trusted): LOADED
1524671730   spa_misc.c:403:spa_load_note(): spa_load($import, config
trusted): UNLOADING
1524671730   spa.c:5027:spa_import(): spa_import: importing home,
max_txg=-1 (RECOVERY MODE)
1524671730   spa_misc.c:403:spa_load_note(): spa_load(home, config
untrusted): LOADING
1524671730   vdev.c:92:vdev_dbgmsg(): disk vdev
'/dev/disk/by-id/wwn-0x5000c500a41a0a00-part1': best uberblock found for
spa home. txg 1492711
1524671730   spa_misc.c:403:spa_load_note(): spa_load(home, config
untrusted): using uberblock with txg=1492711
1524671730   spa_misc.c:403:spa_load_note(): spa_load(home, config
trusted): spa_load_verify found 2 metadata errors and 0 data errors
1524671730   spa_misc.c:388:spa_load_failed(): spa_load(home, config
trusted): FAILED: spa_load_verify failed [error=5]
1524671730   spa_misc.c:403:spa_load_note(): spa_load(home, config
trusted): UNLOADING
1524671730   spa_misc.c:403:spa_load_note(): spa_load(home, config
trusted): spa_load_retry: rewind, max txg: 1492710
1524671730   spa_misc.c:403:spa_load_note(): spa_load(home, config
untrusted): LOADING
1524671730   vdev.c:92:vdev_dbgmsg(): disk vdev
'/dev/disk/by-id/wwn-0x5000c500a41a0a00-part1': best uberblock found for
spa home. txg 1492710
1524671730   spa_misc.c:403:spa_load_note(): spa_load(home, config
untrusted): using uberblock with txg=1492710
1524671731   spa_misc.c:403:spa_load_note(): spa_load(home, config
trusted): spa_load_verify found 2 metadata errors and 0 data errors
1524671731   spa_misc.c:388:spa_load_failed(): spa_load(home, config
trusted): FAILED: spa_load_verify failed [error=5]
1524671731   spa_misc.c:403:spa_load_note(): spa_load(home, config
trusted): UNLOADING
1524671731   spa_misc.c:403:spa_load_note(): spa_load(home, config
trusted): spa_load_retry: rewind, max txg: 1492709
1524671731   spa_misc.c:403:spa_load_note(): spa_load(home, config
untrusted): LOADING
1524671731   vdev.c:92:vdev_dbgmsg(): disk vdev
'/dev/disk/by-id/wwn-0x5000c500a41a0a00-part1': best uberblock found for
spa home. txg 1492709
1524671731   spa_misc.c:403:spa_load_note(): spa_load(home, config
untrusted): using uberblock with txg=1492709
1524671732   spa_misc.c:403:spa_load_note(): spa_load(home, config
trusted): spa_load_verify found 2 metadata errors and 0 data errors
1524671732   spa_misc.c:388:spa_load_failed(): spa_load(home, config
trusted): FAILED: spa_load_verify failed [error=5]
1524671732   spa_misc.c:403:spa_load_note(): spa_load(home, config
trusted): UNLOADING
1524671732   spa_misc.c:403:spa_load_note(): spa_load(home, config
untrusted): LOADING
1524671732   vdev.c:92:vdev_dbgmsg(): disk vdev
'/dev/disk/by-id/wwn-0x5000c500a41a0a00-part1': best uberblock found for
spa home. txg 1492708
1524671732   spa_misc.c:403:spa_load_note(): spa_load(home, config
untrusted): using uberblock with txg=1492708
1524671732   spa_misc.c:403:spa_load_note(): spa_load(home, config
trusted): spa_load_verify found 2 metadata errors and 0 data errors
1524671732   spa_misc.c:388:spa_load_failed(): spa_load(home, config
trusted): FAILED: spa_load_verify failed [error=5]
1524671732   spa_misc.c:403:spa_load_note(): spa_load(home, config
trusted): UNLOADING

I did another take with "zpool import -m -FX -o readonly=on home". It ran
for a while producing the following log (attached).
I also examined the output from "zdb -lu home". It lists 32 uberblocks from
last 2 minutes of server's lifetime. Apparently they are all damaged since
I'm not able to rewind the pool to any of the mentioned txgs. I didn't try
doing imports with -T, I tried -FX. I can see in the debug log that all
these txgs are tried in the reversed order and metadata errors are
everywhere.
I fail to understand how come that every txg is spoiled, and  why import
touches my ZIL vdev ignoring -m option.

I have 2 questions on top:

1. is there any hope I can recover my data? I do have some spare storage to
copy the data if I can reach them.
2. What is wrong with my set up so that the best self-healing filesystem
ends up completely screwed up? I'd like to fix it before rebuilding my pool.







>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://list.zfsonlinux.org/pipermail/zfs-discuss/attachments/20180425/3175813c/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: zdb-lu.txt.bz2
Type: application/x-bzip
Size: 1328 bytes
Desc: not available
URL: <http://list.zfsonlinux.org/pipermail/zfs-discuss/attachments/20180425/3175813c/attachment-0002.bin>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: zpool-import.txt.bz2
Type: application/x-bzip
Size: 3560 bytes
Desc: not available
URL: <http://list.zfsonlinux.org/pipermail/zfs-discuss/attachments/20180425/3175813c/attachment-0003.bin>


More information about the zfs-discuss mailing list