storeBackupUpdateBackup.pl

You need to run this program if you use the option lateLinks in storeBackup.pl. See section 5.4.3 about performance why you perhaps want to use this option, and section 7.6 how to use it.
This program includes the necessary copying if you are using the replication of backups.
StoreBackupUpdateBackup.pl does the job of generating hard links, directories, symbolic links, compression of files and setting permissions storeBackup.pl does not do with option lateLinks. Before it starts doing this, it will check the consistency of your references resulting from the use of lateLinks in your backup repository, e.g. it detects if one backup is missing.

To correct inconsistencies, use storeBackupUpdateBackup.pl in interactive mode (option --interactive).

To generate configuration files for replication of backups, use the options --genBackupBaseTreeConf and --genDeltaCacheConf.

    storeBackupUpdateBackup.pl - updates / finalizes backups created by
    storeBackup.pl with option --lateLink, --lateCompress
SYNOPSIS
            storeBackupUpdateBackup.pl -b backupDirectory [--autorepair]
                  [--print] [--verbose] [--debug] [--lockFile] [--noCompress]
                  [--progressReport number] [--checkOnly] [--copyBackupOnly]
                  [--dontCopyBackup] [-A archiveDurationDeltaCache]
                  [--dontDelInDeltaCache] [-T tmpdir]
                  [--logFile
                   [--suppressTime] [-m maxFilelen]
                   [[-n noOfOldFiles] | [--saveLogs]]
                   [--compressWith compressprog]]
            storeBackupUpdateBackup.pl --interactive --backupDir topLevlDir
                  [--autorepair] [--print]
            storeBackupUpdateBackup.pl --genBackupBaseTreeConf directory
            storeBackupUpdateBackup.pl --genDeltaCacheConf directory

The only option you have to specify is backupDir, the rest of the options are optional. This program only accepts parameters on the command line. It is not possible to use a configuration file.

--interactive / -i
Interactive mode for repairing/deleting currupted backups created with the option lateLinks.
--backupDir
The repository, where all your backups are stored. This program can be used on the master backup or a backup copy (e.g., a copy created via replication). The meaning of this parameter is similar to the option backupDir of storeBackup, see section 6.2.
--autorepair / -a
If storeBackupUpdateBackup.pl detects inconsistencies which do not harm your repository, it will repair the reference files automatically without asking you. It will only write an INFO message in the log file and tells you what it repaired.
For instance, if you deleted your last backup with lateLinks using rm (which you should not do before successfully running this program!), then the internal referencing structure of your backups is inconsistent. StoreBackupUpdateBackup.pl (and also storeBackup.pl) will recognize that a backup which referenced to another one is missing. But correcting the reference structure does not lead to a loss of data, so this is an example when it can be repaired without user intervention. (For more information see special files.)
--print
Prints the options used and stops after printing the options. In case of difficult quoting (especially on the command line) this gives you the chance to see what's really used in the program.
--verbose / -v
Generate verbose messages.
--debug / -d
Generate detailed information about linking, compressing, etc.
--lockFile / -L
Specify a lock file. If the lock file exists and a process with the id stored in it is running, then the program will immediately stop to avoid running it multiple times (which would be a very bad idea). The default is /tmp/storeBackupUpdateBackup.lock. You should also not run storeBackupUpdateBackup.pl parallel to storeBackup.pl.
This type of lock files does not work across multiple servers and is not designed to separate storeBackup.pl and storeBackupUpdateBackup.pl or any other storeBackup process in a separate PID14 space. If you want to use lock files across multiple servers you should build your own solution (maybe on top of these lock files) or use an ``enterprise job scheduler''.
--noCompress
Maximal number of parallel compression operations. The default value is chosen automatically (number of cores plus 1).
--checkOnly / -c
Do not perform any action, only check the consistency. Use this in combination with option --debug to get detailed information.
--copyBackupOnly
If you use replication, only replicate to/from delta cache, do not do any hard linking, compressing, or changing of file permissions
--dontCopyBackup
Do not do any replication tasks.
NOTE: If used on a master backup this option will disrupt the data flow for replication!
--archiveDurationDeltaCache / -A
Duration after which already in backupCopy copied and linked backups will be deleted. This affects all series in deltacaches processedBackups directory. The duration has to be specified in format 'dhms', e.g. 10d4h means 10 days and 4 hours, default is 99d (the format is similar to option keepAll in storeBackupDel.pl)
--dontDelInDeltaCache
Do not delete any backup in deltaCache
--tmpdir / -T /tmpdir
Directory for temporary files, the default value is picked from the environment variable $TMPDIR. If it does not exist, /tmp is set as the default value.
--progressReport
Print a progress report:
after each number files when compressing
after each number * 1000 files when linking
after each number * 10000 files when performing chmod
--logFile / -l
Name of the log file. Default is stdout.
--suppressTime
Suppress the output of the actual time in the log file.
--maxFilelen / -m
Maximal size of a log file. After reaching this size, the log file will be rotated (see option noOfOldFiles) or compressed (see option saveLogs).
--noOfOldFiles / -n
Number of old rotated log files, default is 5. With default values, it will look like this:

$ ls -l /tmp/storebackup.log*
-rw------- 1 hjc  root  328815 30. Aug 12:12 /tmp/storebackup.log
-rw------- 1 root root 1000087 27. Aug 21:18 /tmp/storebackup.log.1
-rw------- 1 root root 1000038 20. Aug 19:02 /tmp/storebackup.log.2
-rw------- 1 root root 1000094 11. Aug 18:51 /tmp/storebackup.log.3
-rw------- 1 root root 1000147 11. Aug 18:49 /tmp/storebackup.log.4
-rw------- 1 root root 1000030 11. Aug 18:49 /tmp/storebackup.log.5

Older log files than *.5 have been deleted automatically.

--saveLogs
Save the log files with a time and date stamp instead of deleting them after rotating. (Setting this option overwrites the default value of option noOfOldFiles.)
--compressWith
Specifies the program to compress the saved log files (e.g., with gzip -9). Default value is bzip2.
On the command line, the parameter to this option is parsed like a line in the configuration file and normally has to be quoted.
--genBackupBaseTreeConf
If you want to replicate your backups, you can use this option to generate one of the required configuration file as a template. See replication of backups for details.
--genDeltaCacheConf
If you want to replicate your backups, you can use this option to generate one of the required configuration file as a template. See replication of backups for details.

Heinz-Josef Claes 2014-04-20