[zfs-discuss] Re: spl/zfs-0.6.0-rc12

Brian Behlendorf behlendorf1 at llnl.gov
Mon Nov 19 15:09:32 EST 2012


On 11/19/2012 11:10 AM, vrod_rink at hotmail.com wrote:
> I was running the rc11 of spl/zfs.   And have noticed a major drop in 
> performance.  I am doing a comparison, between LVM/ext3 vs ZFS.   I 
> wrote a performance app, that tests SMALL files size characteristics, 
> and large files characteristics.

That's not good.  We'll want to git bisect the source to find the 
offending commit, is this something your able to do?  If not can you 
share your test case, I'll kick off the testing and see if I can 
reproduce and identify the issue.

Thanks,
Brian

>
> RC11 File System Test V1.0 STATS:
> Create Small Time = 30 Num Of Files = 104
> Dup Small Time = 45 Num Of Files = 104
>  Del Small Time = 1 Num Of Files = 104
>  Create Large File Time = 0
> Random Seek Large File Iterations in 30 Seconds = 6983299
>  Random Read & Write Large File Iterations in 30 Seconds = 4417476
> Random Read & Random Write Large File Iterations in 30 Seconds = 2898397
>
> RC12 File System Test V1.0 STATS:
> Create Small Time = 31 Num Of Files = 39
> Dup Small Time = 21 Num Of Files = 39
> Del Small Time = 0 Num Of Files = 39
> Create Large File Time = 35 Iteration =1 in 30 Seconds
> Random Seek Large File Iterations in 30 Seconds = 2276607
> Random Read & Write Large File Iterations in 30 Seconds = 34243
>  Random Read & Random Write Large File Iterations in 30 Seconds = 28978.
>
> both tests are done on the same hard disk, with copies = 1.   As you 
> can see a major hit in performance.
>
> On Wednesday, November 14, 2012 1:44:26 PM UTC-8, Brian Behlendorf wrote:
>
>     The spl/zfs-0.6.0-rc12 release candidate is available.
>
>     http://github.com/downloads/zfsonlinux/spl/spl-0.6.0-rc12.tar.gz
>     <http://github.com/downloads/zfsonlinux/spl/spl-0.6.0-rc12.tar.gz>
>     http://github.com/downloads/zfsonlinux/zfs/zfs-0.6.0-rc12.tar.gz
>     <http://github.com/downloads/zfsonlinux/zfs/zfs-0.6.0-rc12.tar.gz>
>
>     Highlights include:
>
>        * Added Linux 3.6 compatibility
>        * Fixed 'allocating allocated segment' panic when
>     logbias=througput
>        * Fixed 'zpool replace' so it handles missing devices and short
>     names
>        * Fixed NFS client error when the server reboots
>        * Fixed panic when samba accesses .zfs/ directories
>        * Fixed the zvol+btrfs hang during mount
>        * Update spare and cache device names on import
>        * Added ability to report ZFS send process from Illumos
>        * Added more detail to 'zpool list' from Illumos
>        * SPL slab performance improvements
>        * ZIL performance improvements
>        * Improved 32-bit stability
>
>     Due to popular request I have started publishing the MD5 sums for
>     the official packages in these release announcements.  They can
>     also be found on the zfsonlinux.org <http://zfsonlinux.org> front
>     page.
>
>     --------------------------- MD5 Sums ----------------------------
>     cab16d4aea2ae1a9b5824516b9640d7a  spl-0.6.0-rc12.src.rpm
>     97222567144e2987bb18cd1f83fd6173  spl-0.6.0-rc12.tar.gz
>     9061d9565d20139361f3488ad45c483d  spl-modules-0.6.0-rc12.src.rpm
>     b91901edcdda8e7e2d310c1d51f56bdb
>      spl-modules-dkms-0.6.0-rc12.noarch.rpm
>     d43449a740360e5ea5fab2f2606fe7d1  zfs-0.6.0-rc12.src.rpm
>     6524f2c20fe9ad33a97879981e5c9a45  zfs-0.6.0-rc12.tar.gz
>     edd0561b34e411bb8514e8d40a587247  zfs-modules-0.6.0-rc12.src.rpm
>     5cc6e7ec81b539a84e401eba78d622f4
>      zfs-modules-dkms-0.6.0-rc12.noarch.rpm
>
>     And as always the full short log of changes.
>
>     ----------------------- SPL Change Log ---------------------------
>     Brian Behlendorf (16):
>            Linux 3.7 compat, __clear_close_on_exec() removed
>            Make kstat.ks_update() callback atomic
>            Add KSTAT_TYPE_TXG type
>            Merge remote branch 'eris/stats'
>            Condition variable reference counts
>            splat: Cleanup headers
>            splat: Fix log buffer locking
>            splat atomic:64-bit: Create thread outside spin lock
>            splat kmem:slab_overcommit: Disabled
>            Merge branch 'splat'
>            Improved vmem cached deadlock detection
>            Track emergency object in rbtree
>            Optimize spl_kmem_cache_free()
>            Never spin in kmem_cache_alloc()
>            Merge branch 'kmem-cache-optimization'
>            SPL 0.6.0-rc12
>
>     Etienne Dechamps (1):
>            Add interface for file hole punching.
>
>     Massimo Maggi (1):
>            Switch KM_SLEEP to KM_PUSHPAGE
>
>     Yuxuan Shui (1):
>            Linux 3.6 compat, kern_path_locked() added
>
>     ----------------------- ZFS Change Log ---------------------------
>     Andrew Reid (1):
>            Do not return /dev/loop-control in unused_loop_device
>
>     Bill Pijewski (1):
>            Illumos #2703: add mechanism to report ZFS send progress
>
>     Brian Behlendorf (29):
>            Switch KM_SLEEP to KM_PUSHPAGE
>            Modify vdev_elevator_switch() to use elevator_change()
>            Minimize ztest stack frame size
>            Replace tempnam() with mkstemp()
>            Verify the return value for warn_unused_result functions
>            Realpath arg 2 must be a minimum of PATH_MAX
>            Merge branch 'illumos-ztest'
>            Set default zvol elevator to noop
>            Fix zfs_txg_timeout module parameter
>            Merge branch 'linux-3.6'
>            Disable ztest deadman timer
>            Limit zfs_vdev_aggregation_limit to SPA_MAXBLOCKSIZE
>            Condition variable usage, zevent_cv
>            Condition variable usage, zilog->zl_cv_batch
>            Condition variable usage, zp->r_{rd,wr}_cv
>            Merge branch 'condvar'
>            Merge branch 'zil-performance'
>            Quote snapshot and mountpoint for .zfs automount
>            Allow 'zpool replace' to use short device names
>            Update spare and cache device names on import
>            Remove 'Resized bio's/dio' warning
>            Revert "Don't ashift-align vdev read requests."
>            Add ddt_object_count() error handling
>            Add txgs-<pool> kstat file
>            Log I/Os longer than zio_delay_max (30s default)
>            Merge remote branch 'eris/stats'
>            Fix zvol+btrfs hang
>            Fix "allocating allocated segment" panic
>            zfs-0.6.0-rc12
>
>     Chris Dunlop (1):
>            Switch KM_SLEEP to KM_PUSHPAGE
>
>     Chris Siden (2):
>            Illumos #1948: zpool list should show more detailed pool info
>            Illumos #1950: ztest backwards compatibility testing option.
>
>     Chris Wedgwood (1):
>            zvol_probe should return NULL when the device isn't found.
>
>     Christopher Siden (1):
>            Fix mmap() usage in ztest.
>
>     Cyril Plisko (3):
>            Implement .commit_metadata hook for NFS export
>            txg is spelled as tgx in places
>            Make zfs_immediate_write_sz a module paramater
>
>     Etienne Dechamps (11):
>            Force 4K blocksize when testing ext2 on zvol.
>            Create threads in detached state in userspace.
>            Fix VOP_CLOSE() in userspace.
>            Fix ztest vdev file paths.
>            Temporarily disable the reguid test.
>            Use dynamic file descriptor numbers in ztest.
>            Align DISCARD requests on zvols.
>            Don't ashift-align vdev read requests.
>            Add atomic_sub_* functions to libspl.
>            Add FASTWRITE algorithm for synchronous writes.
>            Use the slog even with logbias=throughput.
>
>     George Wilson (1):
>            Illumos #3129, #3130
>
>     KORN Andras (1):
>            zfs.8: add missing info about dedup, mlslabel
>
>     Massimo Maggi (2):
>            Switch KM_SLEEP to KM_PUSHPAGE
>            Switch KM_SLEEP to KM_PUSHPAGE
>
>     Matthew Ahrens (1):
>            Illumos #3100: zvol rename fails with EBUSY when dirty.
>
>     Richard Lowe (1):
>            Illumos #2399: zfs manual page does not document use of
>     "zfs diff".
>
>     Richard Yao (4):
>            Fix zfs_write_limit_max integer size mismatch on 32-bit
>     systems
>            Remove vmem_size() consumers
>            Linux 3.6 compat, iops->mkdir()
>            Fix hard coded path in 60-vdev.rules.in
>     <http://60-vdev.rules.in>
>
>     Yuxuan Shui (5):
>            Linux 3.6 compat, sops->write_super() removed
>            Linux 3.6 compat, sget()
>            Linux 3.6 compat, iops->lookup()
>            Linux 3.6 compat, iops->create()
>            Return positive error number in zfsctl_shares_lookup.
>
>     -- 
>     Thanks,
>     Brian
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://list.zfsonlinux.org/pipermail/zfs-discuss/attachments/20121119/62dc66e2/attachment.html>


More information about the zfs-discuss mailing list