This version of Lessfs introduces hamsterdb as an alternative to tokyocabinet. It also solves a memory leak as well as a problem with encryption.
-
Archives
- January 2015
- August 2014
- February 2014
- December 2013
- May 2013
- March 2013
- January 2013
- December 2012
- July 2012
- June 2012
- April 2012
- January 2012
- October 2011
- September 2011
- August 2011
- June 2011
- May 2011
- April 2011
- March 2011
- February 2011
- January 2011
- December 2010
- October 2010
- September 2010
- August 2010
- July 2010
- June 2010
- April 2010
- March 2010
- February 2010
- January 2010
- December 2009
- November 2009
- October 2009
- September 2009
- August 2009
- June 2009
- March 2009
-
Meta
Darn src rpm is “failing” on Fedora12 because it can’t find the lessfs.cfg in /etc. I’m going to try to copying the lessfs.cfg-hamsterdb, but so far I haven’t found the right place. Probably going to have to untar then retar. I’ll post an update.
Okay, after an rpmbuild –rebuild lessfs-1.3.1-1.src.rpm
went into SOURCES untarred the tgz, copied lessfs.cfg-hamsterdb to lessfs.cfg and tarred the directory and then did an rpmbuild –bb SPEC/lessfs.spec and build completed.
rpm -Uvh succeeded. Interesting, there is no hamsterdb dependency.
Instead of rebuilding your tarball, consider adding a line like this in the %build section of the spec file:
cp etc/lessfs.cfg-hamsterdb etc/lessfs.cfg
Also, I built a spec file for hamsterdb tonight, if anyone is interested.
When I would do a mklessfs and then a service lessfs start, nothing would happen. I haven’t tried making a lessfs.cfg-hamsterdb in /etc.
sorry to hog the forum but are -o kernel_cache,negative_timeout=0,entry_timeout=0,attr_timeout=0,use_ino,readdir_ino,default_permissions,allow_other,big_writes,max_read=65536,max_write=65536
not needed anymore? they are not in the init.d/lessfs anymore.
I can’t seem to get lessfs to start. I’m going to try testing with 1.2.2.6
Turning off transactions while hamsterdb is active yields a fatal error:
start_flush_commit : failed to commit transaction() returned error -8: Invalid parameter
because txn was never initialized, but you unconditionally call ham_txn_commit() and ham_txn_begin() in commit_transactions() without checking config->transactions first.
(I’m not clear if this option is even *meant* to work with hamsterdb, though.)
Good night!!!
I’m testing lessfs with some mailbox: too much little file so that my little script to get stat from lessfs_stat became very slow…so i tried to make a “little patch” for lib_tc.c just to describe my idea:
root@dedup:~/lessfs-1.3.1# diff lib_tc.c lib_tc.c.orig
1299,1301d1298
< float dedup=0;
< float orig=0;
<
1318,1319d1314
stbuf.st_size;
real_size;
1325,1326d1319
stbuf.st_size;
real_size;
1336,1337d1328
< lines[count++] = as_sprintf("File Dedup Original Perc\n");
< lines[count++] = as_sprintf("%i %.0f %.0f %3.2f\n",count,dedup,orig,dedup/orig*100);
After this mod i add 2 line at bottom of lessfs_stat so we just need to read that 2 line to get some fast summary:
root@dedup:~/lessfs-1.3.1# tail -2 /dedup/.lessfs/lessfs_stats
File Dedup Original Perc
93 59168874496 61916155904 95.56
Perhaps it should be better to put that info in some other file or produce in some other way i dont know.
This is just for suggest my idea
Happy dedup
Gianni
sorry cut & paste left some part
root@dedup:~/lessfs-1.3.1# diff lib_tc.c lib_tc.c.orig
1299,1301d1298
< float dedup=0;
< float orig=0;
<
1318,1319d1314
stbuf.st_size;
real_size;
1325,1326d1319
stbuf.st_size;
real_size;
1336,1337d1328
< lines[count++] = as_sprintf("File Dedup Original Perc\n");
< lines[count++] = as_sprintf("%i %.0f %.0f %3.2f\n",count,dedup,orig,dedup/orig*100);
root@dedup:~/lessfs-1.3.1# tail -2 /dedup/.lessfs/lessfs_stats
File Dedup Original Perc
93 59168874496 61916155904 95.56