Page 1 of 1

Try hash

Posted: Wed May 16, 2012 9:26 pm
by rseiler
/hash, that is, in v2.71.

GREAT feature.

We have a full backup that's about 125GB, so it's massive. Differentials against that invariably take 60-75 mins, even the day after making the full backup. But with /hash, which added essentially no time to the full backup, differentials are taking a very consistent 37 mins so far, which is a huge reduction.

I'm guessing this is because the differential process no longer needs to reference the mega-sized full backup file but just the hash file, which is 1/100 the size. The disks must be working a lot less.

Re: Try hash

Posted: Wed May 16, 2012 10:25 pm
by TAC109
On searching the Terabyte site I can only find brief information on
/hash in the imaging manuals.

Can Terabyte make available more technical details of how this feature
works? I'm concerned about the probability that different hard disk
block contents could yield the same hash, causing a changed block to
be excluded from a diff backup.

If this happened, the subsequent restore from this backup would be
incorrect (corrupt).



On Wed, 16 May 2012 14:26:41 PDT, rseiler wrote:

>/hash, that is, in v2.71.
>
>GREAT feature.
>
>We have a full backup that's about 125GB, so it's massive. Differentials against that invariably take 60-75 mins, even the day after making the full backup. But with /hash, which added essentially no time to the full backup, differentials are taking a very consistent 37 mins so far, which is a huge reduction.
>
>I'm guessing this is because the differential process no longer needs to reference the mega-sized full backup file but just the hash file, which is 1/100 the size. The disks must be working a lot less.
>

Re: Try hash

Posted: Thu May 17, 2012 12:37 am
by TeraByte Support
for me about 4x (10min vs 40min) 180G base.

there are some problems that can occur, asking for #1 file when it doesn't
exist, hangs, access violation. these will all be fixed in the upcoming
2.72. if it gives you a problem you can simply delete the #* files and it
reverts back to using normal differential.

The odds of a duplicate sector hash is over 1 in 4 billion (and data has to
be quite different). Same type of hash used on many RAID systems and other
sector consistency checks.

"rseiler" wrote in message news:2329@public.image...

/hash, that is, in v2.71.

GREAT feature.

We have a full backup that's about 125GB, so it's massive. Differentials
against that invariably take 60-75 mins, even the day after making the full
backup. But with /hash, which added essentially no time to the full backup,
differentials are taking a very consistent 37 mins so far, which is a huge
reduction.

I'm guessing this is because the differential process no longer needs to
reference the mega-sized full backup file but just the hash file, which is
1/100 the size. The disks must be working a lot less.


Re: Try hash

Posted: Thu May 17, 2012 10:20 pm
by DrTeeth
Is the attached an example of the issues that will be fixed in 2.72?

This feature is a real time saver and greatly reduces traffic when backing up over a network.

DrTeeth

Re: Try hash

Posted: Sun May 20, 2012 10:19 am
by DrTeeth
On Thu, 17 May 2012 15:20:00 PDT, just as I was about to take a herb,
DrTeeth disturbed my reverie and wrote:

>Is the attached an example of the issues that will be fixed in 2.72?
>
>This feature is a real time saver and greatly reduces traffic when backing up over a network.
>
>DrTeeth

Ping TBU support please.
--

Cheers

DrT
______________________________
We may not be able to prevent the stormy times in
our lives; but we can always choose to dance
in the puddles (Jewish proverb).

Re: Try hash

Posted: Sun May 20, 2012 4:20 pm
by TeraByte Support
"...these will all be fixed in the upcoming 2.72..."

"DrTeeth" wrote in message news:2359@public.image...

On Thu, 17 May 2012 15:20:00 PDT, just as I was about to take a herb,
DrTeeth disturbed my reverie and wrote:

>Is the attached an example of the issues that will be fixed in 2.72?
>
>This feature is a real time saver and greatly reduces traffic when backing
>up over a network.
>
>DrTeeth

Ping TBU support please.
--

Cheers

DrT
______________________________
We may not be able to prevent the stormy times in
our lives; but we can always choose to dance
in the puddles (Jewish proverb).


Re: Try hash

Posted: Mon May 21, 2012 7:53 am
by DrTeeth
Thanks for the confirmation, I just wasn't 110% sure.

It is a brilliant addition to IfW and really cuts down on differential backup time.

Any idea on an ETA for v2.72?

UPDATE:- Could this technology be used in a file copy utility? For example, I backup my network to a hard disk in my main PC, I them copy/sync that folder to an external hard disk. I did notice that network traffic was massively reduced when saving a diff. backup.

DrT

Re: Try hash

Posted: Fri May 25, 2012 9:42 pm
by rseiler
There might be a glitch in paradise with this function: twice now I've seen the scheduled job not complete. Imagew.exe just stays in memory indefinitely, taking one core of the CPU, until I have to kill it with TaskMan (nothing is written to IFW.log). This is the same machine that's been running the very same job successfully for a couple years now, so this is new behavior. Is this one of the known problems?

Re: Try hash

Posted: Fri May 25, 2012 10:33 pm
by TeraByte Support(PP)
Yes, that's one of the known problems.

Re: Try hash

Posted: Sat May 26, 2012 9:42 am
by DrTeeth
On Fri, 25 May 2012 15:33:17 PDT, just as I was about to take a herb,
TeraByte Support(PP) disturbed my reverie and wrote:

>Yes, that's one of the known problems.

Do you have an ETA for 2.72 please?
--

Cheers

DrT
______________________________
We may not be able to prevent the stormy times in
our lives; but we can always choose to dance
in the puddles (Jewish proverb).