Comments on: Lessfs-1.6.0-beta1 has been released http://www.lessfs.com/wordpress/?p=688 Open source data de-duplication & data tiering for less Wed, 18 Mar 2015 13:40:57 +0000 hourly 1 http://wordpress.org/?v=4.0.7 By: Mark Ruijter http://www.lessfs.com/wordpress/?p=688&cpage=1#comment-3779 Thu, 19 Apr 2012 09:29:13 +0000 http://www.lessfs.com/wordpress/?p=688#comment-3779 Why did you choose LZO instead of SNAPPY or LZ4.
Both are way faster.

]]> By: Mark Ruijter http://www.lessfs.com/wordpress/?p=688&cpage=1#comment-3778 Thu, 19 Apr 2012 09:28:02 +0000 http://www.lessfs.com/wordpress/?p=688#comment-3778 How did you configure Lessfs?
I suspect that you have compiled in debugging.

Even my laptop does more then 30MB/sec.

]]> By: Mark http://www.lessfs.com/wordpress/?p=688&cpage=1#comment-3777 Thu, 19 Apr 2012 09:23:18 +0000 http://www.lessfs.com/wordpress/?p=688#comment-3777 Is anyone getting any reasonable performance on lessfs? my backend is a fast SAS connected Dell RAID 5 which I can write to at 850MB/s.

Lessfs on it writes at maximum 30-40MB/s and gets slower and slower.

I’m using Berkeley DB 1.4.8 and lzo with fill-in.

After putting in 300GB of data, it got to 7MB/s. not really usable even as a backup solution.

What can I tune?

Thanks.

]]> By: Jean http://www.lessfs.com/wordpress/?p=688&cpage=1#comment-3229 Wed, 15 Feb 2012 14:08:35 +0000 http://www.lessfs.com/wordpress/?p=688#comment-3229 Nicolas, by looking at the website it seems a non-cryptographically-strong hash function. Pay attention to such things in deduplication matters because a malicious user could deduplicate against bogus data, it could destroy backups of a different user or get ahold of his/her data. I would like to see this MurmurHash3 it in lessfs *only* if it is selectable as an OPTION.
Regards
Jean

]]> By: Nicolas http://www.lessfs.com/wordpress/?p=688&cpage=1#comment-3216 Mon, 13 Feb 2012 08:41:35 +0000 http://www.lessfs.com/wordpress/?p=688#comment-3216 Hello,
can you replace/add/test hash tiger algo by http://code.google.com/p/smhasher/
MurmurHash3 bench is very impressive. Some other project uses it.

Regards,
Nicolas

]]> By: Dag Nygren http://www.lessfs.com/wordpress/?p=688&cpage=1#comment-3183 Sun, 05 Feb 2012 09:23:51 +0000 http://www.lessfs.com/wordpress/?p=688#comment-3183 Does this fix the following problem I am seeing using lessfs under heavy load:

lessfs freezes and I get the log entry:

Feb 5 02:51:04 mythserv kernel: INFO: task lessfs:2687 blocked for more than 120 seconds.
Feb 5 02:51:04 mythserv kernel: “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.
Feb 5 02:51:04 mythserv kernel: lessfs D ffff88006faf1998 0 2687 1 0x00000000
Feb 5 02:51:04 mythserv kernel: ffff880066579828 0000000000000086 ffff8800665797b8 ffffffff00000000
Feb 5 02:51:04 mythserv kernel: ffff88006faf1620 0000000000013300 ffff880066579fd8 ffff880066578010
Feb 5 02:51:04 mythserv kernel: ffff880066579fd8 0000000000013300 ffffffff81655020 ffff88006faf1620
Feb 5 02:51:04 mythserv kernel: Call Trace:
Feb 5 02:51:04 mythserv kernel: [] schedule+0x3f/0x60
Feb 5 02:51:04 mythserv kernel: [] get_active_stripe+0x2ea/0x790 [raid456]
Feb 5 02:51:04 mythserv kernel: [] ? try_to_wake_up+0x2b0/0x2b0
Feb 5 02:51:04 mythserv kernel: [] make_request+0x1ae/0x460 [raid456]
Feb 5 02:51:04 mythserv kernel: [] ? wake_up_bit+0x40/0x40
Feb 5 02:51:04 mythserv kernel: [] md_make_request+0xd5/0x200
Feb 5 02:51:04 mythserv kernel: [] generic_make_request+0xbf/0xf0
Feb 5 02:51:04 mythserv kernel: [] submit_bio+0x85/0x110
Feb 5 02:51:04 mythserv kernel: [] ? __bio_add_page+0x110/0x250
Feb 5 02:51:04 mythserv kernel: [] xfs_submit_ioend_bio+0x57/0x80 [xfs]
Feb 5 02:51:04 mythserv kernel: [] xfs_submit_ioend+0xf6/0x110 [xfs]
Feb 5 02:51:04 mythserv kernel: [] xfs_vm_writepage+0x230/0x500 [xfs]
Feb 5 02:51:04 mythserv kernel: [] __writepage+0x17/0x40
Feb 5 02:51:04 mythserv kernel: [] write_cache_pages+0x221/0x4a0
Feb 5 02:51:04 mythserv kernel: [] ? tomoyo_init_request_info+0x3f/0x70
Feb 5 02:51:04 mythserv kernel: [] ? set_page_dirty+0x70/0x70
Feb 5 02:51:04 mythserv kernel: [] generic_writepages+0x51/0x80
Feb 5 02:51:04 mythserv kernel: [] xfs_vm_writepages+0x53/0x70 [xfs]
Feb 5 02:51:04 mythserv kernel: [] do_writepages+0x21/0x40
Feb 5 02:51:04 mythserv kernel: [] __filemap_fdatawrite_range+0x5b/0x60
Feb 5 02:51:04 mythserv kernel: [] filemap_write_and_wait_range+0x5a/0x80
Feb 5 02:51:04 mythserv kernel: [] xfs_file_fsync+0x68/0x2d0 [xfs]
Feb 5 02:51:04 mythserv kernel: [] vfs_fsync_range+0x2b/0x40
Feb 5 02:51:04 mythserv kernel: [] vfs_fsync+0x1c/0x20
Feb 5 02:51:04 mythserv kernel: [] do_fsync+0x3a/0x60
Feb 5 02:51:04 mythserv kernel: [] sys_fsync+0x10/0x20
Feb 5 02:51:04 mythserv kernel: [] system_call_fastpath+0x16/0x1b

]]> By: bsd http://www.lessfs.com/wordpress/?p=688&cpage=1#comment-3134 Wed, 25 Jan 2012 22:01:20 +0000 http://www.lessfs.com/wordpress/?p=688#comment-3134 I can’t wait the results….

]]> By: bsd http://www.lessfs.com/wordpress/?p=688&cpage=1#comment-3133 Wed, 25 Jan 2012 14:01:28 +0000 http://www.lessfs.com/wordpress/?p=688#comment-3133 I can’t wait the figures…

]]>