Just for the numbers:
Our tsm backup job scans 31 million files in 3 hours, including 300,000 deletes and 25,000 new files backed up:
This fantastical performance was achieved after activating GZIP compression on the mail zfs pool and copying all mail files to compressed format.
The machine is a 2xOpteron Dual Core with 20 GB of memory and 1200 mail users online connected.
Machine load did not go up noticeably. The mail pool is a zfs mirror with two SAN pools (7 TB each resulting in 7 TB mail capacity).
Tivoli Compression is set to on, and we use encryption to our TSM server.
We are using TSM client 5.5.1.0 for Solaris x86:
Using that TSM client
Our tsm backup job scans 31 million files in 3 hours, including 300,000 deletes and 25,000 new files backed up:
01/03/09 23:38:48 --- SCHEDULEREC STATUS BEGIN
01/03/09 23:38:48 Total number of objects inspected: 31,305,555
01/03/09 23:38:48 Total number of objects backed up: 25,347
01/03/09 23:38:48 Total number of objects updated: 0
01/03/09 23:38:48 Total number of objects rebound: 0
01/03/09 23:38:48 Total number of objects deleted: 0
01/03/09 23:38:48 Total number of objects expired: 308,991
01/03/09 23:38:48 Total number of objects failed: 0
01/03/09 23:38:48 Total number of bytes transferred: 2.56 GB
01/03/09 23:38:48 Data transfer time: 280.87 sec
01/03/09 23:38:48 Network data transfer rate: 9,594.01 KB/sec
01/03/09 23:38:48 Aggregate data transfer rate: 209.05 KB/sec
01/03/09 23:38:48 Objects compressed by: 15%
01/03/09 23:38:48 Elapsed processing time: 03:34:49
01/03/09 23:38:48 --- SCHEDULEREC STATUS END
01/03/09 23:38:48 --- SCHEDULEREC OBJECT END SA_SO_MAIL 01/03/09 20:00:00
01/03/09 23:38:48
Executing Operating System command or script:
/mail/bin/pr_backupsnapshot_off
This fantastical performance was achieved after activating GZIP compression on the mail zfs pool and copying all mail files to compressed format.
The machine is a 2xOpteron Dual Core with 20 GB of memory and 1200 mail users online connected.
Machine load did not go up noticeably. The mail pool is a zfs mirror with two SAN pools (7 TB each resulting in 7 TB mail capacity).
Tivoli Compression is set to on, and we use encryption to our TSM server.
We are using TSM client 5.5.1.0 for Solaris x86:
# dsmc
IBM Tivoli Storage Manager
Command Line Backup/Archive Client Interface
Client Version 5, Release 5, Level 1.0
Client date/time: 01/08/09 09:40:56
(c) Copyright by IBM Corporation and other(s) 1990, 2008. All Rights Reserved.
Using that TSM client
memoryefficientbackup yesis very important in dsm.sys, otherwise dsmc will crash after having used 4 GB of RAM (it is a 32 bit executable, there is no 64 bit version for Solaris x86 available from IBM yet - in contrast to the SPARC 64 bit-Version).
