Discussions specific to tape backups
Post Reply
stuartmacgreen
Expert
Posts: 109
Liked: 20 times
Joined: May 01, 2012 11:56 am
Full Name: Stuart Green
Contact:

Feature Request: ARCHIVE files to tape - delete after backup

Post by stuartmacgreen » Mar 05, 2015 3:10 pm

Would like to see an option in Files To Tape Job to delete files after backed up. A true archiving to tape feature.

Looking to use this as a way to backup the SAP redo logs.
We have SAP products (hosted on Linux VM's) write out redo logs to a Linux server over NFS that stores them in /backups/{SID}
We naturally backup our VM's using Veeam Backup. But would like all in solution that can answer the requirement to also backup to tape the sap redo logs files but delete them after backup (what i call true archiving) - using valid credentials of course.

Thanks
Backup Infrastructure: Veeam B&R 9.5 U4 • vSphere 6.5 u2 • HPE MSA 2040 [FC] (Backup Target) • HPE MSL6480 LTO-6 (Tape Storage)
(Veeam Agent for Windows protecting Veeam Proxy / Tape / Repository servers)

veremin
Product Manager
Posts: 17000
Liked: 1455 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by veremin » Mar 05, 2015 3:15 pm

A cleaning script specified as a post-job activity should meet your expectations.

musa_1
Lurker
Posts: 1
Liked: never
Joined: Mar 20, 2015 11:24 am
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by musa_1 » Mar 20, 2015 12:35 pm

What is a cleaning script would look like? Sorry, I'm not proficient at Veeam Powershell scripts and any guidance would be appreciated.

veremin
Product Manager
Posts: 17000
Liked: 1455 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by veremin » Mar 24, 2015 11:42 am

Shell script that cleans a given directory, once a file to tape job has taken place, should be a way to go.

Sam0sval
Novice
Posts: 4
Liked: never
Joined: Apr 08, 2015 6:24 pm
Full Name: Andrey
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by Sam0sval » Apr 08, 2015 6:37 pm

The competitor has such feature :

Configuring Backup Exec to automatically delete files after a backup

Article:HOWTO98917 | Created: 2014-06-02 | Updated: 2015-04-08 | Article URL http://www.symantec.com/docs/HOWTO98917
Article Type
How To

Product(s)
Show all

Environment
Show all

Languages
Show all

When you run a full backup, you can select to back up the files and then delete them. The Delete selected files and folders after successful backup option lets you free disk space on your server by deleting files and folders from the server after they are successfully backed up. Backup Exec backs up the selected data, verifies the backup sets, and then deletes the data from the server. You can back up and delete files for full backups only.

See Configuring file and folder options for backup jobs.

Backup Exec performs a verify operation after the data is backed up. If the verify operation fails, the job stops and you are notified. If you get a verification failure, view the job log. Try to correct the problem, and then retry the job. After the data is backed up and verified, Backup Exec deletes the selected data. The job log contains a list of the data that is deleted.

You can enable the checkpoint restart option for a full backup job that uses the Delete selected files and folders after successful backup option. If the job fails and is resumed, the files are not deleted from the source volume after the backup completes.

The Backup Exec Archive Option offers more features for data archiving.

See About the Archiving Option.

Sam0sval
Novice
Posts: 4
Liked: never
Joined: Apr 08, 2015 6:24 pm
Full Name: Andrey
Contact:

[MERGED] : Backup to tape and delete files after on disk

Post by Sam0sval » Apr 09, 2015 10:10 am

I need similar feature too ( http://forums.veeam.com/post143234.html#p143234 )

Now I can't delete files after their transfer on a tape, but I need to do it.

veremin
Product Manager
Posts: 17000
Liked: 1455 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by veremin » Apr 09, 2015 10:39 am

Hi, Andrey,

As mentioned above, the post-job command that takes care about files present on disk sounds like the best idea.

Also, kindly, avoid posting in multiple threads, making cross-post references. It's better to keep everything within one discussion.

Thanks.

Sam0sval
Novice
Posts: 4
Liked: never
Joined: Apr 08, 2015 6:24 pm
Full Name: Andrey
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by Sam0sval » Apr 09, 2015 11:14 am

Its work only to VM job backups, not for files or tapes. I need delete files after file or tape backup jobs. No "advanced' option in dialog for files or tape backups.

veremin
Product Manager
Posts: 17000
Liked: 1455 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by veremin » Apr 09, 2015 12:13 pm

Which product version are you using? There is Advanced dialog for file to tape job in version 8.

Image

Thanks.

Sam0sval
Novice
Posts: 4
Liked: never
Joined: Apr 08, 2015 6:24 pm
Full Name: Andrey
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by Sam0sval » Apr 09, 2015 4:40 pm

I use version 7 (with TAPE) and 8 without TAPE (home use)

veremin
Product Manager
Posts: 17000
Liked: 1455 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by veremin » Apr 10, 2015 9:04 am

Might be worth updating to first installation to the latest product version to make use of advanced settings (with post-job command included there) of file to tape. Thanks.

stuartmacgreen
Expert
Posts: 109
Liked: 20 times
Joined: May 01, 2012 11:56 am
Full Name: Stuart Green
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by stuartmacgreen » Apr 14, 2015 2:13 pm

My request was one for the source of the files was a Linux server. Does anyone have experience of post-job shell scripts to execute on Linux from Windows using Veeam? Or how to set this up. It is obviously easy on Windows.
Backup Infrastructure: Veeam B&R 9.5 U4 • vSphere 6.5 u2 • HPE MSA 2040 [FC] (Backup Target) • HPE MSL6480 LTO-6 (Tape Storage)
(Veeam Agent for Windows protecting Veeam Proxy / Tape / Repository servers)

veremin
Product Manager
Posts: 17000
Liked: 1455 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by veremin » Apr 14, 2015 6:07 pm

What about leveraging plink tool to run script on a Linux machine from a Windows one?

mcx
Novice
Posts: 7
Liked: 1 time
Joined: Nov 15, 2015 8:37 am
Full Name: Andreas S.
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by mcx » Nov 15, 2015 8:43 am

I actually need VERIFIED file copies to tape (and Verified File Copy jobs too) at least with a checksum method and then automatic delete. This has been a long-time Backup Exec Feature that is needed by many people for all those apps that produce a backup in files that are stored to a share or such... too many to mention specifics... but this is a requirement. It's a real shame this feature doesn't exist... as it makes me skip Veeam as a solution... altogether :(

Dima P.
Product Manager
Posts: 10628
Liked: 872 times
Joined: Feb 04, 2013 2:07 pm
Full Name: Dmitry Popov
Location: Prague
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by Dima P. » Nov 19, 2015 2:55 pm 1 person likes this post

mcx,

Thanks for sharing your feedback – it’s highly appreciated. This feature is on our radar for sure but was postponed due low number of requests.

mcx
Novice
Posts: 7
Liked: 1 time
Joined: Nov 15, 2015 8:37 am
Full Name: Andreas S.
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by mcx » Nov 21, 2015 8:16 am

Thank you for your attention Dmitry!

Be sure to announce it with big red fonts when it's available as I will switch my almost 30 sockets to your solution when it is available...!

(while we're at it... be sure to include encryption on those verified file->tape with delete jobs)

Andreas

Dima P.
Product Manager
Posts: 10628
Liked: 872 times
Joined: Feb 04, 2013 2:07 pm
Full Name: Dmitry Popov
Location: Prague
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by Dima P. » Nov 22, 2015 5:36 pm

Deal! Thanks Andreas.

rreed
Expert
Posts: 354
Liked: 72 times
Joined: Jun 30, 2015 6:06 pm
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by rreed » Nov 24, 2015 2:41 pm

+1 to this feature request please. It would be fantastic to have a "flush to tape" feature. We would use this on a regular basis when we're retiring VM's; setup a one-time backup job that backs it up to tape then cleans up after itself. Right now it's a time and resource consuming process for us as well. Having a one-time backup to tape that completes w/ only data on tape would save us a bunch of time and storage.

And very respectfully, off-loading feature requests to administrators to hand build on their own will not win you any potential business or cool points. We're all here and thrilled that we can give - and Veeam listens to - our input as paying customers, but telling us to go do it ourselves could potentially have people taking a second look at competitors, even when some of us like myself are died in the wool Veeam fans. Let's all be helpful, guys. :wink: And many thanks Dima for throwing our request hats in the ring!
VMware 6
Veeam B&R v9
Dell DR4100's
EMC DD2200's
EMC DD620's
Dell TL2000 via PE430 (SAS)

veremin
Product Manager
Posts: 17000
Liked: 1455 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by veremin » Nov 24, 2015 2:50 pm

If it's more about one time backup, haven't you thought about using combination of VeeamZIP and files to tape job? In the setting of VeeamZIP activity you can enable automatic file deletion (Delete this backup automatically -> Tomorrow Night).

Even being a workaround that still should give you what you're after.

Thanks.

mcx
Novice
Posts: 7
Liked: 1 time
Joined: Nov 15, 2015 8:37 am
Full Name: Andreas S.
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by mcx » Dec 10, 2015 5:18 pm

Although I appreciate the "traction" to have other people post similar problems... plus other Engineers provide other workarounds... the feature request remains AS IS...

"Archive this file or folder of files, verify (CRC at least) they are on destination correctly, DELETE (with or without folder structure)".

Thanks :)


BR,

Andreas

ccatlett1984
Enthusiast
Posts: 83
Liked: 9 times
Joined: Oct 31, 2013 5:11 pm
Full Name: Chris Catlett
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by ccatlett1984 » Dec 10, 2015 5:45 pm

I'll add my vote for this feature.
Would be nice not to have to custom script with all kinds of error handling.

mcx
Novice
Posts: 7
Liked: 1 time
Joined: Nov 15, 2015 8:37 am
Full Name: Andreas S.
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by mcx » Mar 30, 2016 9:56 am

I do hope this would be a v10 feature (pretty please with sugar on it)

veremin
Product Manager
Posts: 17000
Liked: 1455 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by veremin » Mar 30, 2016 4:34 pm

Truth be told we're a little bit reluctant to implement features contradicting with our backup redundancy paradigm (3-2-1 rule). Anyway, thank you for the feedback; much appreciated.

mcx
Novice
Posts: 7
Liked: 1 time
Joined: Nov 15, 2015 8:37 am
Full Name: Andreas S.
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by mcx » Apr 01, 2016 3:57 pm

Kurt Cobain wrote:Truth be told we're a little bit reluctant to implement features contradicting with our backup redundancy paradigm (3-2-1 rule). Anyway, thank you for the feedback; much appreciated.
Well.. there will always be files like that (logs, mailboxes, static exports/data) that will need to be backed up... even on a virtual world... so, 3-2-1 or just 1-1... one needs to "offload" something "someplace"... no matter what. Say I'm a video editor and I produce some hours of video each week... I can't possibly keep all that on disk "forever"... So I can choose BlueRay Disks, or tapes... but not disks...

Anyhow, not to over-complicate things... it's a real need. I don't like the fact that I (and others) have it... but we do :)

mcx
Novice
Posts: 7
Liked: 1 time
Joined: Nov 15, 2015 8:37 am
Full Name: Andreas S.
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by mcx » Jul 18, 2017 7:38 am

2 versions later. One PRICEY Server Agent later... still nothing like the (*hated*) old-school BE... Choose a folder, set filters, get the files, verify backup is done, delete files that were backed up.

Please oh please... think of people needing to archive file exports from those Enterprise applications that only export daily files as backup/archive!!!!

TY!

aevans@ricoh.com.au
Service Provider
Posts: 15
Liked: never
Joined: Jul 25, 2012 6:06 am
Full Name: Andrew Evans
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by aevans@ricoh.com.au » Aug 30, 2017 3:55 am

+1 to this feature request please.
We have just migrated a customer from BE to Veeam and while they like the product they require archive to tape and then delete functionality (for very specific datasets)

aceit
Influencer
Posts: 23
Liked: 8 times
Joined: Jun 20, 2017 3:17 pm
Contact:

Re: Feature Request: ARCHIVE files to tape - delete after ba

Post by aceit » Aug 30, 2017 7:08 pm

Kind of agree with all the posts here requiring the feature.
For file based stuff delete after backup has been in backup softwares since the dawn of times.

While pre/post hooks are useful for other integrations (ie. signal external system etc.), my opinion is that they can't used here reliably (not really their use case) and you CANNOT leave this burden to customers reasonably (many things can go wrong, transactionally and the requirements for data integrity like delete after verification etc....), and it is almost "wrong" to suggest it... this kind of things must be handled by the backup software because has the visibility of the overall process and QA tested edge cases for all of us.

Post Reply

Who is online

Users browsing this forum: No registered users and 1 guest