IBM Spectrum Protect (Tivoli Storage Manager) is a data protection platform that gives enterprises a single point of control and administration for backup and recovery. It is the flagship product in the IBM Spectrum Protect (Tivoli Storage Manager) family.
It enables backups and recovery for virtual, physical and cloud environments of all sizes.
This product is part of the IBM Spectrum Software Defined Storage suite of products and is unrelated to the
Tivoli Management Framework
Tivoli may refer to:
* Tivoli, Lazio, a town in Lazio, Italy, known for historic sites; the inspiration for other places named Tivoli
Buildings
* Tivoli (Baltimore, Maryland), a mansion built about 1855
* Tivoli Building (Cheyenne, Wyoming), ...
.
History
TSM descended from a project done at IBM's Almaden Research Center around 1988 to back up VM/CMS systems. The first product that emerged was ''Workstation Data Save Facility'' (WDSF). WDSF's original purpose was to back up PC/DOS, OS/2, and AIX workstation data onto a VM/CMS (and later MVS) server. WDSF morphed into ''ADSTAR Distributed Storage Manager'' (ADSM) and was re-branded Tivoli Storage Manager in 1999.
![Original IBM Almaden Research WDSF team from an IBM technical award](https://upload.wikimedia.org/wikipedia/commons/7/7d/Original_IBM_Almaden_Research_WDSF_team_from_an_IBM_technical_award.jpg)
The TSM database (through release 5.5) was a bespoke
B+ tree database; although the TSM database uses many of the same underlying technologies as IBM's Db2, has a SQL engine (for read-only use), and supports access through ODBC, the database has an architectural limit of approximately 530 GB, and 13 GB of log space. Starting with TSM 6.1, released in May 2009, TSM uses a Db2 instance as its database (thus eliminating the architectural limitations of the previous TSM database).
Product details
TSM maintains a relational database (limit 534GB through TSM v5.5, 4TB with TSM v6.3.3+) and recovery log (aka transaction log, limit 13 GB through TSM v5.5, 128GB with TSM v6.1+) for logging, configuration, statistical information, and object metadata. v5.5 DB pages are always 4KB, and partitions every 4MB. Single row inserts only. On average, 20GB of space is consumed for every 25 million objects. Shallow directory structures use less TSM DB space than deeper paths. This database may generally be queried via an emulated SQL-98 compliant interface, or through undocumented SHOW, CREATE or DELETE commands.
Actual user data is managed via a cascading hierarchy of storage media (Primary Storage Pools) presented as raw devices (UNIX), filesystem containers (Windows and Linux), streaming tape or optical media. Additionally, emulated tape from a
Virtual Tape Library
A virtual tape library (VTL) is a data storage virtualization technology used typically for backup and recovery purposes. A VTL presents a storage component (usually hard disk storage) as tape libraries or tape drives for use with existing backup ...
or
EMC Centera WORM archival device is supported. Duplicate copies (Backupsets or Copy Storage Pools) of any subset of data may be created on sequential media for redundancy or off-site management.
The 5.5 release of the TSM Server is supported on
AIX
Aix or AIX may refer to:
Computing
* AIX, a line of IBM computer operating systems
*An Alternate Index, for a Virtual Storage Access Method Key Sequenced Data Set
* Athens Internet Exchange, a European Internet exchange point
Places Belgi ...
,
HP-UX,
Linux
Linux ( or ) is a family of open-source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991, by Linus Torvalds. Linux is typically packaged as a Linux distribution, w ...
,
Solaris,
Windows Server
Windows Server (formerly Windows NT Server) is a group of operating systems (OS) for servers that Microsoft has been developing since July 27, 1993. The first OS that was released for this platform was Windows NT 3.1 Advanced Server. With the r ...
, and
z/OS
z/OS is a 64-bit operating system for IBM z/Architecture mainframes, introduced by IBM in October 2000. It derives from and is the successor to OS/390, which in turn was preceded by a string of MVS versions.Starting with the earliest:
* ...
. The TSM Client of the same release is supported on
NetWare,
macOS
macOS (; previously OS X and originally Mac OS X) is a Unix operating system developed and marketed by Apple Inc. since 2001. It is the primary operating system for Apple's Mac computers. Within the market of desktop and lapt ...
, AIX, HP-UX, Linux, z/OS, Solaris, and Windows 32/64-bit.
The 6.1 release of the TSM Server is supported on AIX, HP-UX, Linux, Solaris, and Windows Server, while the TSM Client is supported on the same operating systems as 5.5.
On October 21, 2011, TSM 6.3 was released.
Components
Tivoli Storage Manager as a system is made up of several different components. The major components of TSM include: TSM Server, TSM Client, TSM Storage Agent, TSM Data Protector, TSM Operation Center and TSM Administration Center.
Data Sources
The most Common data source for TSM is the TSM Client ("TSM Backup/Archive Client" or "B/A Client"). The B/A Client allows backup and restore of data both "selectively" and "incrementally", which is generally known as "Progressive Incremental" or "Incremental Forever", as each unique client+filespace+path+file combination is separately tracked for retention. Further, a separate method is provided by the B/A Client which is known as archive (and retrieve). This method generates groupings of objects to be retained as a single unit. This still differs from traditional full/incremental style backup products in that the files are stored separately or in smaller aggregates rather than as a monolithic image. Additionally, there is no provision for an incremental archive.
Other data injectors include policy-based
hierarchical storage management
Hierarchical storage management (HSM), also known as Tiered storage, is a data storage and Data management technique that automatically moves data between high-cost and low-cost storage media. HSM systems exist because high-speed storage devices, ...
(HSM) components for AIX, Linux and Windows. These allow migration of data from production disk into one or more of the TSM storage hierarchies while maintaining transparent access to that data by the use of
DMAPI or NTFS reparse points.
IBM General Parallel File System
GPFS (General Parallel File System, brand name IBM Spectrum Scale) is high-performance clustered file system software developed by IBM. It can be deployed in shared-disk or shared-nothing distributed parallel modes, or a combination of these. It ...
(
GPFS) can use TSM as a storage tier for GPFS' Information Lifecycle Management (ILM) which provides HSM for a GPFS filesystem. A GPFS filesystem can be simultaneously accessed from multiple servers running Linux, Windows, and AIX by using GPFS filesystem software installed on any of these operating system platforms. GPFS provides transparent access to data whether online on disk or migrated to tape by requesting file saves and retrieves from TSM.
Additionally, many applications provide or are provided with TSM API connections allowing the storage of databases, mail systems, system backups and even arbitrary user data within TSM's repository. Aside from TSM's UNIX HSM product, only the "Backup" and "Archive" management facilities are accessed through the client API.
Agents
The TSM architecture makes use of two special-purpose agents. The LAN-Free Storage Agent is a limited function TSM server which is configured as a library client and uses server-to-server communication to coordinate the use of storage resources which are configured to TSM but which are also presented to the storage agent. Usually this
LAN-free and
server-free backup agent is installed on the specific client; however, it is network accessible and could be utilized to bypass network bottlenecks. One example would be to connect via
infiniband
InfiniBand (IB) is a computer networking communications standard used in high-performance computing that features very high throughput and very low latency. It is used for data interconnect both among and within computers. InfiniBand is also use ...
between two Bladecenter chassis, where one has SAN attachment to tape, and the other does not. This could bypass limited ethernet bandwidth without having to move the TSM server instance.
The NDMP API agent is used by NetApp devices and other network attached storage (
NAS) devices to allow backup access to the appliance itself rather than having to back up the device via an attached NAS client.appliance direct access to shared tape.
Administration
Administrative functions are accessed through the TSM Administrative command line interface tool or via a web based portal application known as the TSM Operations Center. There are also third-party admin API clients like TSMManager
or the Power Administrator for TSM.
Subproducts & Other Products
Enterprise Edition Features
* The Disaster Recovery Manager (DRM) - A set of commands which aid in the management of offsite secondary copies of data, the TSM Database backups required to access those media, and the configuration data required to recover the TSM database in case of a loss.
* IBM TSM for
NDMP NDMP, or Network Data Management Protocol, is a protocol meant to transport data between network attached storage (NAS) devices and backup devices. This removes the need for transporting the data through the backup server itself, thus enhancing spee ...
- A marketing name for TSM Enterprise Edition (TSM EE) features allowing both LAN and LAN-free backups of
network attached storage
Network-attached storage (NAS) is a file-level (as opposed to block-level storage) computer data storage server connected to a computer network providing data access to a heterogeneous group of clients. The term "NAS" can refer to both the tech ...
(NAS). Specifically,
NetApp filer
A NetApp FAS is a computer storage product by NetApp running the ONTAP operating system; the terms ONTAP, AFF, ASA, FAS are often used as synonyms. "Filer" is also used as a synonym although this is not an official name. There are three types of ...
s or
EMC Celerra datamovers are supported; however, any NDMP v3 or NDMP v4 client is likely functional.
* IBM TSM for Storage Archive Manager - A marketing name for TSM EE features which help maintain archive retention for regulatory purposes.
Associated Products
IBM's naming convention is to prefix every product name with "IBM Tivoli Storage Manager"; most products require an additional license. See also
IBM Tivoli Storage Manager FastBack for more information on IBM's TSM product for block-level, continuous data protection.
* Client aka Backup/Archive Client for most major operating systems at supported versions
* Server for most major server operating systems
* for Advanced Copy Services (Formerly ITSM for Hardware) - Hardware-based
snapshot
Snapshot, snapshots or snap shot may refer to:
* Snapshot (photography), a photograph taken without preparation
Computing
* Snapshot (computer storage), the state of a system at a particular point in time
* Snapshot (file format) or SNP, a file ...
s for major database backups. Although it still exists as a product today the newer releases are re-branded as FCM (
FlashCopy Manager).
* for Copy Services - Windows snapshots for
Exchange
Exchange may refer to:
Physics
*Gas exchange is the movement of oxygen and carbon dioxide molecules from a region of higher concentration to a region of lower concentration. Places United States
* Exchange, Indiana, an unincorporated community
* ...
and
MSSQL.
* for Databases - An API for
Oracle RMAN and a GUI & CLI tool for
MSSQL backups.
* for Data retention - A
zOS client to manage long-term archiving of data.
* for Enterprise Resource Planning - - Allows online backup of SAP R/3 stored in Oracle or Db2. Formerly
backint developed by IBM Germany by the Enterprise Service Division (ESD) as a "Support Offering" to back up SAP R/3 directly into TSM. This product was acquired by Tivoli as Tivoli Data Protection for R/3.
* for Mail - External applications that tie into the API for Lotus Domino (aka Notes) and Microsoft Exchange for online backups.
* for SharePoint - A repackaged copy of DocAve, still marketed by its OEM
AvePoint.
* for Space Management - (
HSM) for Linux and AIX. Automatically moves inactive data to less expensive media and frees online disk space for important active data. The Windows product ("
IBM TSM HSM for Windows") is
OpenStore for File Servers produced by
INTERCOPE GmbH.
* for
Storage Area Network
A storage area network (SAN) or storage network is a computer network which provides access to consolidated, block-level data storage. SANs are primarily used to access data storage devices, such as disk arrays and tape libraries from ser ...
s (SAN) - aka "LAN Free Storage Agent" A modified version of the TSM Server itself, offering no local TSM Database. Configuration is purely for server-to-server library sharing. This allows the agent to write to tapes managed by the primary TSM server without having to pass data over the network.
* for System Backup and Recovery - A standalone product for AIX bare metal recovery. The original name was Sysback/6000, produced by Tony Johnson in the 1990s and sold by IBM as a service offering through IBM Global Services. Sysback can back up and restore files, filesystems, volume groups, and entire systems to local or remote disk, local or remote tape, NIM servers, and TSM. Current versions can also recover systems via the files backed up using the TSM B/A Client. There is a major branch of this product. When Tony Johnson left IBM in 1998, he started a company and product named Storix. Storix is feature rich and supports AIX and Linux, has a GUI management interface, and is very similar in origins to Sysback. Storix actively competes with IBM's Sysback due differing price structures and features.
* for Virtual Environments - Provides advanced data protection and flexible recovery options for VMware vSphere ESX and ESXi servers.
Interface Products
* IBM Tivoli Storage Manager Operational Reporting - A portion of the TSM Microsoft Management Console (MMC) Plug-in for Windows which can generate webpages and email out of SQL queries and simple processing of that data. Custom SQL can be added; however, the reporting tool provides no trending or graphing functionality. This is seen as one of the major faults of TSM.
* Power Administrator for TSM
- Complete and easy to use GUI for administration, management, monitoring, reporting and error analysis of TSM environments. Includes a report builder to define custom reports with many different performance elements. Capable of sending SNMP traps and emails for new TSM messages, generated reports, and even trouble tickets.
* Operator for TSM (OTSM) - Debriefing Software's Windows based GUI for managing one or more TSM servers. Allows easy handling of offsite volumes through animated step-by-step instructions.
* TSMExplorer is easy and comfortable product for managing and monitoring Tivoli Storage Manager. Product allows to manage many TSM servers from single sign-on. It is written in Java using the SWT widget toolkit.
* Wizards Storage Portal - Debriefing Software's cloud based monitoring and reporting tool for TSM and SVC (SAN Volume Controller). Includes 24x7 monitoring, user defined dashboards, graphic reporting, remote TSM-management and integration with Operator for TSM.
Non-Tivoli API Clients
* ADINT - developed by IBM Germany by the Enterprise Service Division (ESD) as a "Support Offering" to back up
SAP
Sap is a fluid transported in xylem cells (vessel elements or tracheids) or phloem sieve tube elements of a plant. These cells transport water and nutrients throughout the plant.
Sap is distinct from latex, resin, or cell sap; it is a separ ...
MaxDB directly into TSM.
* adsmpipe - an unsupported tool provided by
IBM through its
RedBook site for piping data directly into TSM. Commonly used to back up
MySQL
MySQL () is an open-source relational database management system (RDBMS). Its name is a combination of "My", the name of co-founder Michael Widenius's daughter My, and "SQL", the acronym for Structured Query Language. A relational database ...
* Archive Backup Client for OpenVMS - A product by STORServer Inc. to back up
OpenVMS systems into TSM. With ABC you can back up, archive, restore, query and manage OpenVMS files stored on TSM servers as a logical extension to the on-line OpenVMS ODS-2 or ODS-5 file systems.
* Caminosoft Managed Server HSM, Tivoli Edition - Hierarchical Storage Management software for file system archiving of seldom accessed files to TSM. Supports N series,
NetApp
NetApp, Inc. is an American hybrid cloud data services and data management company headquartered in San Jose, California. It has ranked in the Fortune 500 from 2012–2021. Founded in 1992 with an IPO in 1995, NetApp offers cloud data service ...
,
Windows
Windows is a group of several proprietary graphical operating system families developed and marketed by Microsoft. Each family caters to a certain sector of the computing industry. For example, Windows NT for consumers, Windows Server for ser ...
,
Linux
Linux ( or ) is a family of open-source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991, by Linus Torvalds. Linux is typically packaged as a Linux distribution, w ...
, and
NetWare.
* CBMR/TBMR - A product by Cristie sold as a
bare metal restore (BMR) tool for
Linux
Linux ( or ) is a family of open-source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991, by Linus Torvalds. Linux is typically packaged as a Linux distribution, w ...
,
Solaris,
AIX
Aix or AIX may refer to:
Computing
* AIX, a line of IBM computer operating systems
*An Alternate Index, for a Virtual Storage Access Method Key Sequenced Data Set
* Athens Internet Exchange, a European Internet exchange point
Places Belgi ...
and
Windows
Windows is a group of several proprietary graphical operating system families developed and marketed by Microsoft. Each family caters to a certain sector of the computing industry. For example, Windows NT for consumers, Windows Server for ser ...
using TSM as a datastore.
* DB Protection for MariaDB - a solution from
ttps://repostor.com Repostorto backup, restore a MariaDB database using IBM Spectrum Protect.
* DB Protection for MongoDB - a solution from
ttps://repostor.com Repostorto backup, restore a MariaDB database using IBM Spectrum Protect.
* DB Protection for MySQL - a solution from
ttps://repostor.com Repostorto backup, restore a MySQL database using IBM Spectrum Protect.
* DB Protection for PostgreSQL - a solution from
ttps://repostor.com Repostorto backup, restore a PostgreSQL database using IBM Spectrum Protect.
* DB Protection for SAP ASE - a solution from
ttps://repostor.com Repostorto backup, restore a SAP ASE database using IBM Spectrum Protect.
* DB Protection for SAPIQ - a solution from
ttps://repostor.com Repostorto backup, restore a SAPIQ database using IBM Spectrum Protect.
*
IBM Db2 - As a major internally developed product, Db2 contains its own direct connection into the TSM API.
* SQL-Backtrack - A product by
BMC Software to back up a variety of database products into TSM.
* STORServer Data Protection for Oracle RDB on
OpenVMS - A product by STORServer Inc. to back up
Oracle databases on
OpenVMS into TSM.
* STORServer Appliance for VMware Consolidated Backup - A product by STORServer Inc. to back up
VMware
VMware, Inc. is an American cloud computing and virtualization technology company with headquarters in Palo Alto, California. VMware was the first commercially successful company to virtualize the x86 architecture.
VMware's desktop software ru ...
to TSM Servers.
* SPFS - a filesystem for Spectrum Protect - A product b
spictera to backup
KVM,
PostgreSQL,
MongoDB
MongoDB is a source-available cross-platform document-oriented database program. Classified as a NoSQL database program, MongoDB uses JSON-like documents with optional schemas. MongoDB is developed by MongoDB Inc. and licensed under the Ser ...
,
MariaDB
MariaDB is a community-developed, commercially supported fork of the MySQL relational database management system (RDBMS), intended to remain free and open-source software under the GNU General Public License. Development is led by some of the ori ...
,
MySQL
MySQL () is an open-source relational database management system (RDBMS). Its name is a combination of "My", the name of co-founder Michael Widenius's daughter My, and "SQL", the acronym for Structured Query Language. A relational database ...
,
OpenEdge,
SAP IQ
SAP IQ (formerly known as SAP Sybase IQ or Sybase IQ; IQ for Intelligent Query) is a column-based, petabyte scale, relational database software system used for business intelligence, data warehousing, and data marts. Produced by Sybase Inc., n ...
,
SAP ASE,
SQL Server,
Ingres,
FirebirdSQL,
Cassandra
Cassandra or Kassandra (; Ancient Greek: Κασσάνδρα, , also , and sometimes referred to as Alexandra) in Greek mythology was a Trojan priestess dedicated to the god Apollo and fated by him to utter true prophecies but never to be belie ...
,
SAP HANA
SAP HANA (HochleistungsANalyseAnwendung or High-performance ANalytic Application) is an in-memory, column-oriented, relational database management system developed and marketed by SAP SE. Its primary function as the software running a databa ...
,
Redis,
Oracle,
ElasticSearch
Elasticsearch is a search engine based on the Lucene library. It provides a distributed, multitenant-capable full-text search engine with an HTTP web interface and schema-free JSON documents. Elasticsearch is developed in Java and is dual ...
,
IBM Db2,
Neo4j,
SQL Server Express
Microsoft SQL Server Express is a version of Microsoft's SQL Server relational database management system that is free to download, distribute and use. It comprises a database specifically targeted for embedded and smaller-scale applications. Th ...
,
SQL Anywhere,
Greenplum
Greenplum is a big data technology based on MPP architecture and the Postgres open source database technology. The technology was created by a company of the same name headquartered in San Mateo, California around 2005. Greenplum was acquired ...
to Spectrum Protect Servers by mounting the filespaces anywhere on your servers.
*
TapeTrack Tape Management Framework - A tape tracking software product that interfaces with TSM to provide end-to-end asset management of tape volumes. Sold by GazillaByte LLC.
* Zmanda Recovery Manager - a MySQL backup product integrated with TSM provided by
Zmanda
See also
*
List of backup software
This is a list of notable backup software that performs data backups. Archivers, transfer protocols, and version control systems are often used for backups but only software focused on backup is listed here. See Comparison of backup softwar ...
*
Adstar
*
Tape Management System
References
{{Authority control
Tivoli Storage Manager, Spectrum Protect
Backup