Print

Please login or register.
1 Hour 1 Day 1 Week 1 Month Forever
Login with username, password and session length

[grogs]

Maybe this kind of information is what you are looking for then.

I have two DNS-321's. I use one as a primary and the other as a secondary. The primary DNS-321 has two 1TB WD drives while the second DNS-321 has two 1.5TB Seagate drives.

I use the secondary DNS-321 to backup the primary DNS-321 as well as all the computers here.

I currently have 1.5TB used on the primary DNS-321.

To backup the data I am using RoboCopy from my VISA Ultimate based system.

Code: [Select]

REM Backup DNS-321
robocopy \\dlink-59c1b6\Volume_1\Media \\dlink-07195C\Volume_1\Media /MIR /Z /LOG:daily-backup.log /TEE

REM Backup XP system
robocopy "\\HPLAPTOP\C$\Documents and Settings\User\My Documents" "\\dlink-07195C\Volume_1\Backup\Carole\Daily\My Documents" /MIR /FFT /Z /LOG:daily-carole-1.log /TEE
etc...

Robocopy reports 'Mismatch' and 'FAILED' operations. So Robocopy checks to make sure the files copied are not corrupted. If they do not match it will be reported in the log and final report.

For the file missing issue.
When I run Robocopy it reports the number of files and directories added 'copied'. When the backup script is run with no new files added no new files are reported.

I have Robocopy set with the option to remove files that no longer exists on the source. Robocopy will remove any items that no longer exists on the primary. This means if I rename a folder then Robocopy will remove the old folder on the secondary and copy the new files.
Robocopy also reports any such files that are removed in the 'EXTRA' part of the report.

So if I ran Robocopy and no files had been removed from the source I expect the 'EXTRA' field in the report top show a value of zero.

Code: [Select]

# First run, new files added. Some deletions.

robocopy \\dlink-59c1b6\Volume_1\Media \\dlink-07195C\Volume_1\Media /MIR /Z /LOG:daily-backup.log /TEE

------------------------------------------------------------------------------

                Total    Copied   Skipped  Mismatch    FAILED    Extras
     Dirs :      8242        11      8231         0         0         2
    Files :     91917       216     91701         0         0        52
    Bytes :1438.628 g  30.758 g1407.869 g         0         0  311.58 m
    Times :   2:06:35   1:28:06                       0:00:00   0:38:28

    Speed :             6247519 Bytes/sec.
    Speed :             357.485 MegaBytes/min.

    Ended : Sun Dec 06 18:33:46 2009


# Second run. No new files.


robocopy \\dlink-59c1b6\Volume_1\Media \\dlink-07195C\Volume_1\Media /MIR /Z /LOG:daily-backup.log /TEE
------------------------------------------------------------------------------

                Total    Copied   Skipped  Mismatch    FAILED    Extras
     Dirs :      8242         0      8242         0         0         0
    Files :     91917         0     91917         0         0         0
    Bytes :1438.628 g         01438.628 g         0         0         0
    Times :   0:44:48   0:00:00                       0:00:00   0:44:48

    Ended : Sun Dec 06 19:36:36 2009

So I have not seen any data loss due to the DNS-321.

I also did not see data loss with the prior releases of firmware.
Since the DNS-321 is Linux based I would expect no less. The disk is handled by the Linux kernel modules which are standard. The RAID, file system support and everything else related to disk usage and access is all handled by standard Linux modules which are extremely solid and field proven for millions of systems in the wild.

[gunrunnerjohn]

I use Beyond Compare (http://www.scootersoftware.com/), I've used it since the 1.xx days.

[nrf]

thanks for the useful information. I think the problem with the dns earlier related to having services hang because of too many files, not sure. the photo files it lost track of certainly weren't being used by the itunes or media servers, but they disappeared just the same, multiple directories worth.

I'll have to study your examples carefully.

it seems that the adage 'trust but verify' is appropriate here.

I'm also curious if you do any off-site data movement.

[Ryder]

I'm also curious if you do any off-site data movement.

I'm not quite sure what you mean exactly by this nrf, could you explain what you need to know a bit more in-depth please?

Ryder

[nrf]

I'm not asking for more, just saying I have enough to contemplate for a while and I see a serious issue with my own backups whereby I need an off-site mechanism for the worst of disasters.

thanks!
nrf

[gunrunnerjohn]

I use Mozy on-line backup for critical documents, that's added to my other backup levels. 

I'm not sure what DNS issue you're talking about, but my DNS-323 has around 900gigs of data on the RAID-1 array, and over a million files.  I don't know of any issues relating to number of files or file sizes.

[JoeSchmuck]

Off-site backups with sensitive data...  I would never use a third party server to backup sensitive information unless it was 256bit AES encrypted before it left my computer with a strong key.  That's my opinion and anyone can do what they want with thier own data.

nrf, how much data are you talking about, the frequency, and is this personal or company related?

If it's company related and you have another sister locations, make them your site and get the data to them somehow.

If it's personal (home), I think my comment above speaks to it well.  I have a Verizon account which gives me lots of storage space.  I would encrypt it and upload the data.  Or you could backup your data to a USB drive and take it to work and put it in your desk.  It's off-site. 

Getting back to data reliability, I too can testify that I have been using Acronis to backup my home computers to the NAS and running a verification after the backups are complete which alway have passed.  I used EXT3 RAID1 until last week when I made the shift to EXT2 RAID1 to obtain a huge speed boot.  My specific use of the NAS is primary backup of my computers.  If the NAS becomes corrupt then so long as my computer didn't die at the same time, I'm good.  There is always risk, you just need to know what risk is acceptable.

[gunrunnerjohn]

Off-site backups with sensitive data...  I would never use a third party server to backup sensitive information unless it was 256bit AES encrypted before it left my computer with a strong key.  That's my opinion and anyone can do what they want with thier own data.

From the MOZY site.

# 128-bit SSL encryption: The same technology used by banks secures your data during the backup process.
# 448-bit Blowfish encryption: Secures your files while in storage, providing peace of mind that your private data is safe from hackers.

I don't spend any time worrying about the safety of the data there.

[JoeSchmuck]

From the MOZY site.I don't spend any time worrying about the safety of the data there.

Your data is only safe provided there is not an "inside man" at MOZY, or any other site for that fact.  A disgruntled employee in the right area could do a lot of damage.  That's why I say the data should be encrypted before it's uploaded.  OR are you just stating the data you place there is not sensitive so should it be comprimised you have no problem with that?  I'm unsure what you meant.

[gunrunnerjohn]

Well, in the unlikely event that all of my other backups are compromised, and there is strategically placed disgruntled employee at MOZY, I guess I'm out of luck.  OTOH, I probably have a better chance to be hit my lightning.   Since I have two RAID-1 NAS units with identical contents backed up twice a week, I'll probably never need the MOZY backup.  I also have some NDAS drives that get updated every couple of weeks with an archive copy of all the same data.

[nrf]

this is turning out to be a great discussion thread.
what I was thinking about in off-site backup is something like
a fire or major lightning strike. Given I have some things that I would
like to still have after something like that... some may be very personal and
others not so much. This is the data equivalent of a safety deposit box, which
I've not ever used. but one can hope to get wiser, right?

I've read of people using gmail as offsite storage, it sounds like one could pack/encrypt and
drop them as attachments.

maybe the safety deposit box could hold some data once in a while.

more to think about.

anyway, thanks for the engaging discussion.
nrf

[gunrunnerjohn]

One simple method of off-site storage (most of the time anyway) is to stick a copy in your car.  Typically, for most folks, if you're away, so is your car.

[JoeSchmuck]

Well, in the unlikely event that all of my other backups are compromised, and there is strategically placed disgruntled employee at MOZY, I guess I'm out of luck.

Lets hope that doesn't happen.  My point wasn't data loss at a third party location, but someone using your data.  Maybe you store finincial data like Quicken, copies of credit card statements, etc...  My point is identity theft.  It happened to me when my military records were taken and used by someone else.  I never found out who used them but I was able to resolve all the issues that came from it.  Now I check my credit report all the time because I never know if this will pop up again.  So I could be a little sensitive to offloading data to a place you don't control and why I suggest you encrypt it on your computer before sending it for storage.

In the end, everyone will do what they feel is best for thier needs but I just wanted to shed some light on a potiential issue.

-Joe

[gunrunnerjohn]

Obviously, anything's possible.  I don't spend too much time worrying about it.  I really think there are very few people at any of the on-line firms that have access to the data.  If they were having this much trouble with data security, they'd be out of business pretty quickly.

I hasten to add, as far as military records are concerned, there are literally tons of government employees you're trusting with that data, it's a far bigger risk than on-line backup, and you can do absolutely nothing about it.

FWIW, I check my credit report every four months, I do it on a rotating schedule and get my free annual report from each service.  Since most of them have very similar data, rotating them gets me quicker looks at potential issues, and I still don't have to pay for the privilege of seeing my report.
 

[JoeSchmuck]

FWIW, I check my credit report every four months, I do it on a rotating schedule and get my free annual report from each service.  Since most of them have very similar data, rotating them gets me quicker looks at potential issues, and I still don't have to pay for the privilege of seeing my report.
 

I do the same thing.

I think I got us off topic.  Hopefully nrf got the info asked.