Incremental backup of 1.5 TB data over slow WAN link

Backup agent for Microsoft Windows servers and workstations (formerly Veeam Endpoint Backup FREE)

Incremental backup of 1.5 TB data over slow WAN link

Veeam Logoby omfk » Mon Jun 19, 2017 7:05 pm

Hello,

in our remote office we have a server with a file service of approx. 1.5 TB data. Using VAW Free I selected File based backup as I had to exclude some directories. In the following windows, however, volume based is written next to the C and d: volume. The backup was also quite fast.

I transported the hdd to our main office and created a veeam repository with this disk. After a rescan of this repository and some renaming of folders I was able to use this repository for the VAW in the remote office. I was under the impression that of course I would be limited by the slow link for transporting new data (slightly less than 10Mbit/s link) but reading would be much faster. Overall I only expect mostly less then 1GB changes per day with a maximum of 10GB on a single day.

When looking at VAW I see however the following:
19.06.2017 20:22:30 :: CORE (C:) (249,7 GB) 8,6 GB read at 4 MB/s [CBT]

Will I really be limited by the 4MB/s for the full 1,5TB?

Is there any way to speed up the process (apart from upgrading in order to use WAN acceleration)?

BR
Frank
omfk
Enthusiast
 
Posts: 54
Liked: 6 times
Joined: Wed Nov 30, 2016 9:48 pm
Full Name: Frank Knappe

Re: Incremental backup of 1.5 TB data over slow WAN link

Veeam Logoby omfk » Mon Jun 19, 2017 8:31 pm

Update:
Since about nearly 2h the display in VAW is frozen:
19.06.2017 20:22:30 :: CORE (C:) (249,7 GB) 10,7 GB read at 3 MB/s [CBT]

No traffic is flowing between remote site and VBR.

Any ideas?

BR
Frank
omfk
Enthusiast
 
Posts: 54
Liked: 6 times
Joined: Wed Nov 30, 2016 9:48 pm
Full Name: Frank Knappe

Re: Incremental backup of 1.5 TB data over slow WAN link

Veeam Logoby Mike Resseler » Tue Jun 20, 2017 4:37 am

Frank,

So no, you should not be limited. Considering everything froze, and you probably haven't fixed it yet I kindly ask if you could open a support call (post the case ID and follow-up after working with support here) so the logs can be investigated.

Thanks
Mike
Mike Resseler
Veeam Software
 
Posts: 3381
Liked: 384 times
Joined: Fri Feb 08, 2013 3:08 pm
Location: Belgium, the land of the fries, the beer, the chocolate and the diamonds...
Full Name: Mike Resseler

Re: Incremental backup of 1.5 TB data over slow WAN link

Veeam Logoby omfk » Tue Jun 20, 2017 4:49 am

Hi Mike,

small update: It seems that VAW didn't froze totally. Apparently Veeam started to work again at ~3am this morning.

19.06.2017 20:22:30 :: CORE (C:) (249,7 GB) 10,7 GB read at 3 MB/s [CBT]
20.06.2017 02:55:34 :: DATA (D:) (3,4 TB) 16,9 GB read at 1 MB/s [CBT]

The speed, however, remains an issue. Once I'm back in the office later in the afternoon I'll open a support call.

BR
Frank
omfk
Enthusiast
 
Posts: 54
Liked: 6 times
Joined: Wed Nov 30, 2016 9:48 pm
Full Name: Frank Knappe

Re: Incremental backup of 1.5 TB data over slow WAN link

Veeam Logoby omfk » Tue Jun 20, 2017 6:23 pm

Hi all,

sometimes it seems that you just should have faith in the program and keep relaxed until a real error pops up.

19.06.2017 20:22:30 :: CORE (C:) (249,7 GB) 10,7 GB read at 3 MB/s [CBT]
20.06.2017 02:55:34 :: DATA (D:) (3,4 TB) 18,1 GB read at 1 MB/s [CBT]
20.06.2017 07:06:35 :: Finalizing
20.06.2017 07:07:22 :: Processing finished at 20.06.2017 07:07:22

So the backup finished shortly after my previous post.

It seems that the information above don't represent the real progress of the backup status and speed. Is there a better possibility to monitor the process of an VAW backup?

BR
Frank
omfk
Enthusiast
 
Posts: 54
Liked: 6 times
Joined: Wed Nov 30, 2016 9:48 pm
Full Name: Frank Knappe

Re: Incremental backup of 1.5 TB data over slow WAN link

Veeam Logoby Mike Resseler » Wed Jun 21, 2017 6:33 am

Frank,

I am not aware of any other methods to monitor the process. What I would like to know if the next incrementals will behave the same way. Can you let us know?
Mike Resseler
Veeam Software
 
Posts: 3381
Liked: 384 times
Joined: Fri Feb 08, 2013 3:08 pm
Location: Belgium, the land of the fries, the beer, the chocolate and the diamonds...
Full Name: Mike Resseler

Re: Incremental backup of 1.5 TB data over slow WAN link

Veeam Logoby omfk » Thu Jun 22, 2017 10:36 am

Hi Mike,

the next two incrementals are rather strange:

20.06.2017 23:30:13 :: Initializing
21.06.2017 08:00:14 :: Preparing for backup
21.06.2017 08:00:21 :: Required backup infrastructure resources have been assigned
21.06.2017 08:00:52 :: Creating VSS snapshot
21.06.2017 08:19:33 :: Calculating digests
21.06.2017 08:28:13 :: CORE (C:) (249,7 GB) 8,4 GB read at 3 MB/s [CBT]
21.06.2017 13:38:51 :: DATA (D:) (3,4 TB) 12,7 GB read at 557 KB/s [CBT]
21.06.2017 20:16:56 :: Finalizing
21.06.2017 20:17:45 :: Processing finished at 21.06.2017 20:17:45

So this backup took nearly a full day (Initializing ~8h).


Tonight:
20.06.2017 23:30:13 :: Initializing
21.06.2017 23:30:44 :: Preparing for backup
21.06.2017 23:31:09 :: Required backup infrastructure resources have been assigned
21.06.2017 23:31:45 :: Creating VSS snapshot
21.06.2017 23:50:32 :: Calculating digests
21.06.2017 23:58:43 :: CORE (C:) (249,7 GB) 8,2 GB read at 4 MB/s [CBT]
22.06.2017 04:15:50 :: DATA (D:) (3,4 TB) 14,5 GB read at 629 KB/s [CBT]
22.06.2017 10:58:51 :: Finalizing
22.06.2017 10:59:51 :: Processing finished at 22.06.2017 10:59:51


When I look at the link usage between remote office and main office there is only traffic between 0 - 1am and afterwards between 5 - 11am (~6MBit/s which might be the limit of the remote office).

BR
Frank
omfk
Enthusiast
 
Posts: 54
Liked: 6 times
Joined: Wed Nov 30, 2016 9:48 pm
Full Name: Frank Knappe

Re: Incremental backup of 1.5 TB data over slow WAN link

Veeam Logoby Mike Resseler » Thu Jun 22, 2017 2:09 pm

Do you already have a support call? I can be wrong here (and if so, support will certainly tell us) but this just doesn't seem normal in my mind

Thanks
Mike
Mike Resseler
Veeam Software
 
Posts: 3381
Liked: 384 times
Joined: Fri Feb 08, 2013 3:08 pm
Location: Belgium, the land of the fries, the beer, the chocolate and the diamonds...
Full Name: Mike Resseler

Re: Incremental backup of 1.5 TB data over slow WAN link

Veeam Logoby omfk » Thu Jun 22, 2017 3:19 pm

Support call id: #02197740

Created just some minutes ago.

BR
Frank
omfk
Enthusiast
 
Posts: 54
Liked: 6 times
Joined: Wed Nov 30, 2016 9:48 pm
Full Name: Frank Knappe

Re: Incremental backup of 1.5 TB data over slow WAN link

Veeam Logoby Mike Resseler » Thu Jun 22, 2017 3:19 pm

Thanks! Keep us informed

Mike
Mike Resseler
Veeam Software
 
Posts: 3381
Liked: 384 times
Joined: Fri Feb 08, 2013 3:08 pm
Location: Belgium, the land of the fries, the beer, the chocolate and the diamonds...
Full Name: Mike Resseler

Re: Incremental backup of 1.5 TB data over slow WAN link

Veeam Logoby omfk » Sat Jul 08, 2017 6:13 pm 1 person likes this post

Final update:

Long initialization times
The reason for the long initialization times was most likely a side effect with the Windows internal backup which was still running in parallel. After I stopped the Windows backup (in full trust of Veeam) this effect never happened again (~10 days now).

Displayed "read speeds"
Info from Veeam: "This speed described here actually means speed of bottleneck (in your case it seems to be network) not real or possible read speed from your hard drive. You can perceive it like speed of "overall backup processing"."
Maybe the term "read" could be changed to something different in the status window in order to avoid confusion.

Different read values for C and D drive
Info from Veeam: "As your second disk D: is bigger in size than C: - overall processing calculation taking more time and processing speed which is shown for D: is closer to real processing speed (by the way it's average speed too, not peak one)."

Right now the transfer itself is using ~100% of the available bandwidth, which is fine over night.

The overall process takes about 4hm which is also fine. We'll see what happens if there are more data changes during one day.

BR
Frank
omfk
Enthusiast
 
Posts: 54
Liked: 6 times
Joined: Wed Nov 30, 2016 9:48 pm
Full Name: Frank Knappe


Return to Veeam Agent for Windows



Who is online

Users browsing this forum: No registered users and 1 guest