Files to tape is painfully slow

Everything about backing up to tape

Files to tape is painfully slow

Veeam Logoby Hevros » Fri Aug 23, 2013 10:59 am

Hi,

so as part of our testing I am doing some backup to tape jobs and some file to tape jobs.

the backup copy to tape runs at 100MB/s which is awesome but the file to tape runs a 1MB/s and that is from files on the local Veeam backup server.
when I run it to backup files on another server it run at a few KB/s
it took 8 hours to backup 12GB !!

I am using a HP MSL2024 library with a fibre attached LTO 5 drive
at this stage it is unusable.

I presume this was tested in beta, do you have any throughput number from that testing?
Hevros
Service Provider
 
Posts: 25
Liked: 1 time
Joined: Thu Jan 17, 2013 5:09 pm
Full Name: Stephen Seagrave

Re: Files to tape is painfully slow

Veeam Logoby v.Eremin » Fri Aug 23, 2013 11:30 am

Hi, Stephen. Is it possible that a file to tape job, in contrast to, a backup to tape one uses hardware compression by any chance? Also, what are the files/folders that are being copied to a tape media ? .vbks? Thanks.
v.Eremin
Veeam Software
 
Posts: 13281
Liked: 970 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: Files to tape is painfully slow

Veeam Logoby Hevros » Fri Aug 23, 2013 11:38 am

Hi,

Yes the file to tape has compression enabled. the files are just a mix of file server type data.
excel, word & PDf's and the like. they are not Veeam backup files.

what I want to sort out is if I have a customer with a single physical file server and the rest are VM's can I use Veeam for a flat file backup of the file server.
Hevros
Service Provider
 
Posts: 25
Liked: 1 time
Joined: Thu Jan 17, 2013 5:09 pm
Full Name: Stephen Seagrave

Re: Files to tape is painfully slow

Veeam Logoby Dima P. » Fri Aug 23, 2013 12:03 pm

Stephen,

Is it possible to do the following comparison:
- Test backup to tape job
- Test file to tape job, on a backup files you used during the backup to tape job

This would be much more honest comparison of speed as in this case you would be transferring to tape the same files? I am thinking that this could be an indexing issue - in case you are pushing too many single files during files to tape.
Thank you.
Dima P.
Veeam Software
 
Posts: 6253
Liked: 440 times
Joined: Mon Feb 04, 2013 2:07 pm
Location: SPb
Full Name: Dmitry Popov

Re: Files to tape is painfully slow

Veeam Logoby Hevros » Fri Aug 23, 2013 12:42 pm

Hi,

ok so I did a backup copy to tape and a file backup to tape of the same 200GB VBK file
both of them ran at 100MB/s
Hevros
Service Provider
 
Posts: 25
Liked: 1 time
Joined: Thu Jan 17, 2013 5:09 pm
Full Name: Stephen Seagrave

Re: Files to tape is painfully slow

Veeam Logoby Dima P. » Fri Aug 23, 2013 1:00 pm

Great,
So it looks like the issue arises only when backing up a bulk of small files using the file to tape job.

From this point I believe you need to contact with our support team, please open a support case and attach Veeam logs + Veeam service logs. Please update this thread with the case number so we could provide deep analysis of this problem. Thank you!
Dima P.
Veeam Software
 
Posts: 6253
Liked: 440 times
Joined: Mon Feb 04, 2013 2:07 pm
Location: SPb
Full Name: Dmitry Popov

Re: Files to tape is painfully slow

Veeam Logoby Dima P. » Fri Aug 23, 2013 1:15 pm

Stephen,

I just confirmed with R&D that low transfer rate problems with running file to tape job on a large number of small files is a known issue, and we will look at addressing it in future releases. Thank you and sorry for an inconvenience!
Dima P.
Veeam Software
 
Posts: 6253
Liked: 440 times
Joined: Mon Feb 04, 2013 2:07 pm
Location: SPb
Full Name: Dmitry Popov

Re: Files to tape is painfully slow

Veeam Logoby TommyB » Thu Aug 29, 2013 7:00 am

Hi,

I have the same issue here - a backup rate of 450 kb/s over a 1Gbit Network is simply not acceptable for any kind of useful backup (14 Hours for 7.5 GB of data and this is only 18% of the whole job...)

Is there already any date for the next release?
TommyB
Expert
 
Posts: 115
Liked: 15 times
Joined: Wed Aug 28, 2013 9:46 am
Location: Germany.Europe.Terra.Sol.Milkyway.Localgroup.Virgo
Full Name: Thomas Braun

Re: Files to tape is painfully slow

Veeam Logoby Dima P. » Thu Aug 29, 2013 8:11 am

Tommy,

Unfortunately , there is no ETA at the moment.
Dima P.
Veeam Software
 
Posts: 6253
Liked: 440 times
Joined: Mon Feb 04, 2013 2:07 pm
Location: SPb
Full Name: Dmitry Popov

Re: Files to tape is painfully slow

Veeam Logoby TommyB » Thu Aug 29, 2013 12:02 pm

I'm not surprised by that (I'm a software developer as well).

First rule: "Never publish a release date" :mrgreen:
TommyB
Expert
 
Posts: 115
Liked: 15 times
Joined: Wed Aug 28, 2013 9:46 am
Location: Germany.Europe.Terra.Sol.Milkyway.Localgroup.Virgo
Full Name: Thomas Braun

Re: Files to tape is painfully slow

Veeam Logoby horst » Thu Aug 29, 2013 4:00 pm

I think, I have the same issue, already written here: http://forums.veeam.com/viewtopic.php?f=29&t=17900
horst
Enthusiast
 
Posts: 38
Liked: 4 times
Joined: Tue Aug 27, 2013 6:55 am
Location: GER

Re: Files to tape is painfully slow

Veeam Logoby TommyB » Fri Aug 30, 2013 12:16 pm

horst wrote:I think, I have the same issue, already written here: http://forums.veeam.com/viewtopic.php?f=29&t=17900


Your backup job is really fast - I have transfer rates of 11 MB/s, even if there are huge files like vhd files from Microsoft server backup.

The backup client on the source machine is idling around 5% processor load, maximum throughput on the LAN is around 40-50 Mbit/s (which is 4-5% on a 1Gbit LAN).

Indeed there is a BIG need for optimization.
TommyB
Expert
 
Posts: 115
Liked: 15 times
Joined: Wed Aug 28, 2013 9:46 am
Location: Germany.Europe.Terra.Sol.Milkyway.Localgroup.Virgo
Full Name: Thomas Braun

Re: Files to tape is painfully slow

Veeam Logoby sierdw » Wed Sep 11, 2013 12:48 pm

Hi all,

As a new VEEAM user (v7.0) I also have some serious File to Tape performance issues. My backup has been running for 16 hours and has only processed 4.3 Gb :?
Image
Backup of VM's is performing normal.

Any tips? Hardware compression is already disabled but doesn't make a difference.
sierdw
Lurker
 
Posts: 1
Liked: never
Joined: Wed Sep 11, 2013 12:41 pm
Full Name: Sierd Weidema

Re: Files to tape is painfully slow

Veeam Logoby foggy » Wed Sep 11, 2013 1:57 pm

Sierd, as stated above, there is a known issue with slow transfer of a large number of smaller files (and you are copying more than 3 million) using file to tape job and this will be addressed in one of the following updates.
foggy
Veeam Software
 
Posts: 14743
Liked: 1081 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Files to tape is painfully slow

Veeam Logoby richhartdr » Wed Sep 11, 2013 5:44 pm

Just chiming in...same issue here....backups to tape about 40MB/s, while files to tape like above examples under 1 MB/s...nice to know a fix is coming in the next version!
richhartdr
Enthusiast
 
Posts: 25
Liked: 4 times
Joined: Tue Dec 07, 2010 9:34 pm
Full Name: Don Richhart

Next

Return to Tape



Who is online

Users browsing this forum: No registered users and 4 guests