We are using the FastSCP functionality through Backup & Replication 4.1.1
All the backup and repl jobs work great and at lighing speeds. The problem comes in when we attempt to "copy" the backup files from local storage and "paste" them to a removable drive that is attached via esata that is hot swapable used for off-site storage of our backups.
We downloaded a benchmark utility and did some testing.
The 1T drives are rated at 88 megs per second average write speed in the benchmark testing on our hardware setup.
We used syncback (a freeware backup tool that we use for moving files around on the network) to write a 55.2 gig file
Estimated speed is: 55 gig x 1024 meg = 56320 megs/60=938.6 seconds=15.64 minutes
ACTUAL speed when we run the job=17.5 minutes
If 55 megs is 1/10th of our data, then it would take 2.92 hours to copy 550 GB if speeds stayed consistent.
When we use FastSCP, the throughput falls off to 9megs it takes 18 hours to copy 550gbs from a local C:drive to and external drive. Can FastSCP not be used in this configuration? What it purely designed to copy just from ESX to ESX.
We wanted to use it so that we did not need to use yet another backup software for this one process. having the database keeping the log is a plus also.
any help is greatly appreciated.thanks
-
- Influencer
- Posts: 14
- Liked: never
- Joined: Jul 13, 2009 5:58 pm
- Full Name: joemagjr
- Contact:
-
- Expert
- Posts: 145
- Liked: 10 times
- Joined: Jun 23, 2010 5:39 pm
- Full Name: Bill Unger
- Contact:
Re: Copy Speeds from local storage to removable drive
We experienced something similar - I think. We were backing up from inside a VM to internal drives and SAN drives and this met our performance expectations; however, backups to external drives ( we tried USB drives ) were pathetic - though everything was USB 2.0, something in the ESX layer slowed down transmission speeds to less than USB 1.1.
Are you backing up from inside a VM through ESX to the external drive? You could be experiencing the same thing...
Bill
Are you backing up from inside a VM through ESX to the external drive? You could be experiencing the same thing...
Bill
-
- Influencer
- Posts: 14
- Liked: never
- Joined: Jul 13, 2009 5:58 pm
- Full Name: joemagjr
- Contact:
Re: Copy Speeds from local storage to removable drive
Veeam is running on a seperate peice of hardware, Dell poweredge 2900 which is outside of the vm infastructure. We backup out vm's from this server to this servers local storage. Then we have attached a removable drive to the dell 2900 server via estata (we also have tested with USB). Using the copy feature of fastscp iside of the veeam product, we copy the data from the local storage backup off to the removable drive. This is where it falls on ots face.
Did you guys find a resolution?
thanks,
Mark
Did you guys find a resolution?
thanks,
Mark
-
- Expert
- Posts: 145
- Liked: 10 times
- Joined: Jun 23, 2010 5:39 pm
- Full Name: Bill Unger
- Contact:
Re: Copy Speeds from local storage to removable drive
Unfortunately, we haven't yet found a completely acceptable removable option. All of our VMs are stored on a SAN, so our current backup plan is this:
- replicate VMs to internal drives on each of our ESX boxes ( there are 3 boxes ). This basically covers us if the SAN drops out
- backup mission-critical apps ( Exchange, SQL Server, user data ) to tape. These are rotated off site
In the next phase of the project, we will put a 2nd SAN in an offsite location and backup/replicate to that.
Bill
- replicate VMs to internal drives on each of our ESX boxes ( there are 3 boxes ). This basically covers us if the SAN drops out
- backup mission-critical apps ( Exchange, SQL Server, user data ) to tape. These are rotated off site
In the next phase of the project, we will put a 2nd SAN in an offsite location and backup/replicate to that.
Bill
-
- Chief Product Officer
- Posts: 31748
- Liked: 7251 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: Copy Speeds from local storage to removable drive
OK, so I just made a test with FastSCP 3.0.2 copy/pasting the file in FastSCP Servers tree from one volume on my desktop to another one (separate hard drives). It took 2 minutes sharp to copy over 9,278,144KB file, which gives 75MB/s average throughtput. Which is exactly what I would expect from those cheap and outdated consumer hard drives I have - they were clearly the bottleneck here. So I am definitely not seeing any performance issues in FastSCP engine on my end. May be a few more people can perform similar test?
Who is online
Users browsing this forum: Baidu [Spider], Thomas_ and 105 guests