Comments on: Lessfs-0.9.0 is available for download.

By: Areq

Areq — Thu, 10 Dec 2009 15:45:27 +0000

mv /mnt/lessfs/s1_last /mnt/lessfs/s1_`date +%s` mkdir /mnt/lessfs/s1_last

isn’t solution for me. I need few independent “full copy” of server in separate directory – one dir = one full backup

I try to avoid coping via rsync all files every time
(slow WAN connection)

By: Dimitri Bellini

Dimitri Bellini — Thu, 10 Dec 2009 08:43:10 +0000

Hi Maru
Yes i know rsync but this tool dont suffer of the same TAR problem (shifting chunk)? Also an integration with a Backup solution like Bacula is very good way to manage small/medium office PC (simple way to restore a data using gui).
So do you think is possible to patch Bacula Backup format for lessfs (dedup friendly)?
Many thanks
Dimitri

By: maru

maru — Thu, 10 Dec 2009 07:25:39 +0000

Instead of cp -a /mnt/lessfs/s1_last /mnt/lessfs/s1_`date +%s` why don’t you

mv /mnt/lessfs/s1_last /mnt/lessfs/s1_`date +%s`
mkdir /mnt/lessfs/s1_last

Moving a directory does hardly take time at all.

Mark

By: Areq

Areq — Thu, 10 Dec 2009 00:05:24 +0000

but lvm snapshot gives significant performce degradation

Currently I’am doing in this way:

rsync -vax s1::/ /mnt/lessfs/s1_last
cp -a /mnt/lessfs/s1_lat /mnt/lessfs/s1_`date +%s`

but normal cp is slow, because must unpack all files from lessfs, check deduplication and update directory structure.

I’m dreaming of sth like lessfscp – with can update only directory structure without touching data part.

By: maru

maru — Wed, 09 Dec 2009 21:36:47 +0000

Easy might not be the appropriate term.
For now you can use lvm snapshots with the lessfs freeze command.

You first freeze lessfs and then create a lvm snapshot.
With the help of drbd you can implement replication.

I hope this helps,

Mark.

By: Areq

Areq — Wed, 09 Dec 2009 21:24:37 +0000

I suspect that the implementation of snapshots will not be quick and easy. Enough at the beginning will be quick way to copy the entire directory tree under lessfs

cp-a backup-2009-12-02 backup-2009-12-03
is very slow now

By: maru

maru — Wed, 09 Dec 2009 18:40:54 +0000

The Bacula Guys should know how to fix this. Some commercial VTL vendors do smart things with the incoming data streams before they store them on a dedup filesystem.

You can imagine that this is very complex because every vendor has it’s own proprietary way to store the data.

I can take a look at tar but don’t hold your breath.

Many people use rsync for backups:
http://www.mikerubel.org/computers/rsync_snapshots/

Mark

By: Dimitri Bellini

Dimitri Bellini — Wed, 09 Dec 2009 13:53:51 +0000

Hi Maru
many thanks for your suggest, i never use lessfs with this method!! My first idea was use in comination of Bacula Backup and LinuxVTL (the Media emulate from LinuxVTL are store on LessFs) but i dont have so big advantage, i supposed for the tar problem.
But where i can found Patched TAR? how is used RSync with dedup?
Many thanks for help

By: maru

maru — Wed, 09 Dec 2009 13:32:47 +0000

snapshots and replication will come in lessfs-2.0
The focus for now is to release lessfs-1.0 stable if possible before the end of this year.

Development of 2.0 will start early next year.

Mark

By: Areq

Areq — Wed, 09 Dec 2009 13:24:12 +0000

What about snapshot ? Manny people really need and waiting for this important for backup process feature.