Cloud

Veeam Tape Backup job to AWS VTL configuration

In a previous article we have explored the options and the steps on how to integrate Veeam Backup with AWS VTL tapes. As a final part of this series the last step is to configure a Veeam Tape Backup job to AWS VTL tapes. This configuration provides the option to send data directly to the Amazon Cloud taking advantage of the durability and availability option of the Cloud Provider. In addition, the option to lower cost over the longer periods when storing data to “colder” tiers like the Amazon Glacier and similar. This applies not just to backups but also to standard files, for example from NAS shares and similar.

The case for using Veeam Tape backup jobs to AWS VTL is an interesting one especially when paired with advanced retention scenarios like GrandFather-Father-Son (GFS) use cases. In general the idea would be to structure a Backup strategy which allows for the maximum amount of Data to be kept On-Premises for reduced RTO times and automatically send weekly, monthly, quarterly and yearly Fulls to the Cloud for a much lower cost per gigabyte. Surely, each Company has it’s own preference on how to best operate based on CAPEX and OPEX filtered by SLAs in place. Especially when comparing the cost with a de-dupe appliance. With so much data sprawling everywhere and on every platform, ensuring data availability across different environments is key. VTL Tapes still provide the flexibility of the physical ones without the “physical” approach of moving them to a tape center when these should be archived. Everything happens seamlessly in the Cloud. Last but not least the air-gap approach from tapes which provide that offsite and offline requirements for these type of media.

This and a lot more is exactly what the Veeam Tape backup job configuration is bringing: the ability to send / copy data to the Cloud taking advantage of the virtual tape infrastructures. All VTL tapes management is completed from a single Veeam console to create Media Pools, Media Sets, Data Retention and additional options like encryption, parallel processing and more.

 

Veeam Tape Backup job to AWS VTL configuration

From the Tape Infrastructure it is possible to create a Media Pool. There are “system” and “custom” Media Pools. The first ones are automatically created to seamlessly manage new tapes and their statuses like online and offline. These cannot be deleted. The custom ones can be added and editable at any time. As soon as a Tape Library is scanned all the available tapes will be included in the Free Media Pool. Let’s create one. In my case I will create a Media Pool per scope like Production VMs, Demo and similar.

domalab.com Veeam Tape Backup new media pool

Next step is to add the number of desired tapes to the Pool. This should be done in conjunction with the amount of data it is expected to be sent to tape. For example the backup chain consisting of the Full backup plus all pertinent incrementals. Should these tapes in the Media Pool not be enough there is also the option to add them from the “Free Pool”, when available of course.

domalab.com Veeam Tape Backup media pool tapes

In the Media Set is possible to create the rules for automatically labelling the tapes used to send the backup to. Very handy it also allows to use variables for a more consistent naming convention.

domalab.com Veeam Tape Backup media set

In the retention section the options to overwrite tapes or even protect them for the desired period of time. In addition, the option to “store” them into a Vault. This feature also works with Veeam Location option.

domalab.com Veeam Tape Backup tape retention

In a final step before reviewing the options, the wizard provides the ability to choose if parallel processing on multiple tapes and encryption should be used. Hardware encryption is preferred when available as it improving performances compared to software encryption.

domalab.com Veeam Tape Backup tape options

And finally a quick summary to review the main options.

domalab.com Veeam Tape Backup summary

With the same principle it is possible to create multiple Media Pools destined to different targets. For example backup jobs for Agents, Production VMs, other Hypervisors like Nutanix AHV and even other types of workloads.

domalab.com Veeam Tape Backup media list

At this point everything is ready in the infrastructure to create a Veeam Tape backup job to AWS VTLs. Let’s create a new Backup to Tape job with the wizard and start by adding the Job name and quick description.

domalab.com Veeam Tape Backup job

Next is to add objects from the infrastructure. The explorer in the wizard now shows the existing backup jobs for which we want to send a copy to the AWS Cloud.

domalab.com Veeam Tape Backup job data

The wizard detects the backup chains in the job and prompts for an entire copy or just the last backup chain. This setting can be changed later on in the advanced settings as well. For example for several backup jobs to the same Media Pool we might want to use different settings.

domalab.com Veeam Tape Backup job data selection

The wizard now prompts where to send the Full Backup files. Let’s choose one of the Media Pools created previously.

domalab.com Veeam Tape Backup full

Let’s repeat the same steps for incremental backups if this should be saved on tapes as well. I would advice generally using the same Media Pool.

domalab.com Veeam Tape Backup incremental

These options are important. As a best practice Veeam offers the option to “eject the VTL tape from the slot” preventing accidental overwrites or deletion that could occur. Even better against ransomware attacks. The export option emulates the action of sending the tape to a tape center. In this case when the media set is exported will instruct the AWS Storage Gateway to “archive” the tape. When this happens the cost of retaining the tape in the AWS Cloud will be a lot lower. Of course it is still possible to retrieve archived VTL tapes. Depending on services this operation can take up to 3-5 hours.

domalab.com Veeam Tape Backup options

Last but not least the option to schedule the Veeam Tape backup job with various options as per screenshot below.

domalab.com Veeam Tape Backup schedule

A final summary to review and wrap up the job configuration.

domalab.com Veeam Tape Backup job summary

When Veeam is running the backup to tape job it also show the information about the tape used along with other useful information.

domalab.com Veeam Tape Backup job progress

Moving to the AWS Storage Gateway VM Monitor tab in VMware vCenter we can take a look at the actual resources. Definitely not consuming that much. Even though I must say this ws just at the beginning of the job. It was consuming more later on during the job. Subsequent ones were less resource intensive. I wonder if there is any caching involved across different jobs on the AWS Gateway.

domalab.com Veeam Tape Backup AWS resources

In the meantime from the AWS Console it is possible to check in real time data coming through and populate the tape as shown by Veeam console. Data is now landing to AWS Storage Gateway.

domalab.com Veeam Tape Backup AWS tape

As soon as the Veeam Tape backup job is completed the tape is ejected and exported. For a short period the status will be updated to in “transit to VTS”. Essentially there are 3 stages as soon as the upload from the AWS Gateway is successfully completed:

  • IN TRANSIT TO VTS: Gateway is uploading data to AWS Cloud Storage
  • ARCHIVING: Data upload is complete and the AWS Gateway is moving the tape to the archive
  • ARCHIVED: The tape is moved and archived and is also available for retrieval

domalab.com Veeam Tape Backup AWS Tape in transit

The tape is now archived and available for retrieval.

domalab.com Veeam Tape Backup AWS tape archived

For each backup Veeam creates a catalog that is also helping for faster restores and to browse the content of the tapes in this case. As expected the Veeam Tape backup job included the Full and Incremental files from the chain.

domalab.com Veeam Tape Backup explore content

From Backup jobs to tape it is possible to restore Full VMs and even run file level recovery with auxiliary staging areas that can be any network share and even existing Backup Repositories.

About the author

Michele Domanico

Passionate about Virtualization, Storage, Data Availability and Software Defined Data Center technologies. The aim of Domalab.com is sharing with the Community the knowledge and experience gained with customers, industry leaders and like minded peers. Always open to constructive feedback and new challenges.

Add Comment

Click here to post a comment

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Browse articles

December 2018
M T W T F S S
« Nov    
 12
3456789
10111213141516
17181920212223
24252627282930
31  

Articles by Category

Archives

%d bloggers like this: