Changing the size of S3 chunk.

[aleksey20220211]

Hi there.

Is there a way to change the size of S3 chunk?
What are recommendations for it?

Thanks in advance

[chris.arceneaux]

Hi aleksey,

The size of the chunk matches the block size set in the job configuration. The recommendation is to leave the default block size (1 MB) as it's the most optimized. Increasing the block size will result in fewer S3 objects but will increase the overall storage consumption. We do not recommend decreasing the block size for backups sent to object storage.

More information can be found in Veeam documentation:

• Storage Optimization
• Changing Storage Optimization Settings

[sfirmes]

@aleksey20220211 Here is another resource @olivier.rossi wrote about this topic Object Storage: Impact of Job Storage Optimization Settings (in v11). Even though it references v11, his analysis and conclusions are still true with v12.

[aleksey20220211]

Ok, but there is a problem here

We have 2 buckets for 2 jobs.




Minio console shows that ~10TB used, OS shows - ~25TB used. Why?

[chris.arceneaux]

Now you've changed the topic of this thread

Unfortunately, I won't be able to support your MinIO installation. That said, I'll try to point you in the right direction...

I recommend checking out what data is present on the OS volume in question (/mnt/minio). You might find data that's not related to MinIO. Given the disparity between MinIO and the OS, something is going on and further investigation is required in the OS.

If available, reaching out to MinIO support would be prudent.

Hope this helps!