Standalone backup agents for Linux, Mac, AIX & Solaris workloads on-premises or in the public cloud
Post Reply
maxilee
Influencer
Posts: 10
Liked: never
Joined: Oct 23, 2018 7:58 am
Full Name: Marek Czardybon
Contact:

veeam agent and block size on storage.

Post by maxilee »

Hi.

on VBR we can define which block will be used for a job ( in advanced settings per job, storage -> storage optimization ).
in standalone veeam agent ( not connected to VBR / VCC ) we can store backups direct on S3 storage.
our S3 storage solution vendor - cloudian - recomends that we should use 8MB block size or 4MB due to limits objects count on S3 storage , wehre too many object can impact performance of whole S3.

In veeam agent in settings ( veeam.ini or TUI ) I can't find that settings.
but - when I've deep dive to sqlite database , I've found that agent by default use 1MB block size : KbBlockSize1024.
which is reported by veeam job info :
Block size: 1024 KB

I've manualy changed entries in sqlite database to KbBlockSize8192 and restarted job.
On S3 level I've noticed reduction of objects created by veeam agent went from 11k ( on block size 1024kb ) to 2k ( block size 8192Kb).
overal object size increased from 0.5MB to 3 MB :)

this change has direct impact to our S3 srKbBlockSize1024torage performance.

and question to Veeam staff :)

Will you add feature to change block size to veeam agent settings in TUI ?
Or I can change it directly in database and this will not provide any impact to veeam agent itself ?

I'm asking because we have go we clients which use only standalone agents and the send backup direct to our S3 storage.
there are not so many but the are killing performance for whole S3.

on VBR we can change block size to 4 or even 8MB and we did that.
but on agents there no simple/official way :(
rovshan.pashayev
Veeam Software
Posts: 615
Liked: 119 times
Joined: Jul 03, 2023 12:44 pm
Full Name: Rovshan Pashayev
Location: Czechia
Contact:

Re: veeam agent and block size on storage.

Post by rovshan.pashayev »

Hello Marek,

Your request is noted!
Rovshan Pashayev
Analyst
Veeam Agent for Linux, Mac, AIX & Solaris
maxilee
Influencer
Posts: 10
Liked: never
Joined: Oct 23, 2018 7:58 am
Full Name: Marek Czardybon
Contact:

Re: veeam agent and block size on storage.

Post by maxilee »

Hi Rovshan.

fine that it is noted :)
but this option will be added to TUI ?
is that change in database will be supported ?
If you need what I've changed in database I can give you that info :) ( I'm not sure I can post it here :)
rovshan.pashayev
Veeam Software
Posts: 615
Liked: 119 times
Joined: Jul 03, 2023 12:44 pm
Full Name: Rovshan Pashayev
Location: Czechia
Contact:

Re: veeam agent and block size on storage.

Post by rovshan.pashayev »

Hello Marek,

There is actually a command line option for your case, as described in the User Guide here:

Code: Select all

--blocksize <256|512|1024|4096>
Specifies the block size in kilobytes.
Rovshan Pashayev
Analyst
Veeam Agent for Linux, Mac, AIX & Solaris
maxilee
Influencer
Posts: 10
Liked: never
Joined: Oct 23, 2018 7:58 am
Full Name: Marek Czardybon
Contact:

Re: veeam agent and block size on storage.

Post by maxilee »

hi.
I've searched for that parameter but I've found it :(
my bad.

thx very much for this.

case close :)
rovshan.pashayev
Veeam Software
Posts: 615
Liked: 119 times
Joined: Jul 03, 2023 12:44 pm
Full Name: Rovshan Pashayev
Location: Czechia
Contact:

Re: veeam agent and block size on storage.

Post by rovshan.pashayev »

You are welcome!

Also, keep in mind that if the backup job has already been run meaning several restore points have been created and then the blockSize was edited, you need to run an Active Full.

If you edit the blockSize before the job is run for the first time, everything is fine, a full backup will be created right away and everything will work correctly.
Rovshan Pashayev
Analyst
Veeam Agent for Linux, Mac, AIX & Solaris
Post Reply

Who is online

Users browsing this forum: Baidu [Spider] and 1 guest