|Publication number||US7065623 B2|
|Application number||US 10/719,536|
|Publication date||Jun 20, 2006|
|Filing date||Nov 20, 2003|
|Priority date||Nov 20, 2003|
|Also published as||US20050114566|
|Publication number||10719536, 719536, US 7065623 B2, US 7065623B2, US-B2-7065623, US7065623 B2, US7065623B2|
|Inventors||James C. Chen, Olympia Gluck, Gabriel G. Walder, Yelena Zilberstein, Warren K. Stanley, Edward H. Lin|
|Original Assignee||International Business Machines Corporation|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (3), Referenced by (16), Classifications (20), Legal Events (3)|
|External Links: USPTO, USPTO Assignment, Espacenet|
The present invention relates generally to peer-to-peer remote copy (PPRC) storage systems and, in particular, to increasing the efficiency with which write operations are performed between a primary storage control unit and a secondary storage control unit.
Data integrity is a critical factor in large computer data systems. Consequently, backup data storage systems have been developed to prevent the loss of data in the event of various types of failures. One such backup system, known as “peer-to-peer remote copy” (PPRC), maintains a separate, consistent copy of data. As illustrated in
Typically, a block of data to be copied to the secondary unit 140 is first received by the primary unit 120 as a plurality of substantially equal-size units or tracks. A first track is then associated with a tack, thread or other operating system unit of execution, such as a task control block (TCB) and transferred from the primary unit to the secondary over one of the links. Upon successful receipt of the track, the secondary replies with a “complete” status message. The TCB is then released and the next track may then be associated with the TCB and transferred to the secondary. The process is repeated until all of the tracks have been successfully transferred to the secondary. Such a serial operation may fail to take full advantage of the bandwidth available between the primary and secondary storage units.
It is also possible to transfer tracks in a “piped” fashion in which the transfer of a second track begins before the status message has been received from the secondary unit confirming successful receipt of the first track. However, there may be insufficient resources in the primary unit to complete the transfer of all of the tracks of a block of data in such a fashion. Additionally, if too many resources are allocated to piping tracks, other operations may not have sufficient resources and may be delayed.
Consequently, it remains desirable to provide a more efficient and flexible process for transferring blocks of data from a primary storage unit to a secondary storage unit.
The present invention provides method, system and computer program product to improve the efficiency of data transfers in a PPRC environment. A block of data to be transferred is divided into tracks. Each track is allocated to a data mover task control block (TCB) with a master TCB being assigned to supervise the data mover TCBs. The tracks are then transferred from the primary storage controller to the secondary controller in a piped fashion over a link coupling the primary and secondary storage controllers. However, the usage of resources is monitored by a resource management algorithm and, if too many TCBs are being used for a transfer (or if the supply of data mover TCBs is exhausted), the transfer is automatically switched whereby the master TCB now serves as the data mover TCB for the remaining tracks.
In addition, the various links coupling the primary and secondary storage controllers are monitored to determine which link will provide the fastest transfer. If, during a transfer of tracks over one link, a faster link is identified, the transfer may be switched to the second, faster link.
Thus, the efficiency of a transfer of data is improved and the utilization of the bandwidth of links is similarly improved.
The secondary storage controller also includes a processor 242 to execute instructions relating to the receipt and ultimate storage of data.
The network 230 preferably includes a plurality of links 232, 234 and 236 through which data and messages may be transferred between the primary and secondary storage controllers 220 and 240. Although three such links 232, 234 and 236 are shown in
In operation, a block of data 400 (
The master mover TCB 410 directs that a first track 402 be transferred using a first data mover TCB 422 over a first link 232 through which the primary and secondary storage controllers 220 and 240 are coupled (step 310). The first data mover TCB 422 is released (step 312) and may be used during the transfer of another block of data. Prior to receiving an acknowledgment from the secondary storage controller 240 that the first track 402 was successfully received, the next track 404 is transferred using a next data mover TCB 424 (step 314) over the same link 232; the second data mover TCB is then released (step 316).
Usage of the data mover TCBs 420 is monitored by a resource management algorithm (step 318). If a sufficient number of data mover TCBs 420 are available to complete the transfer of the block of data 400, transfer of the remaining tracks continues as before until all of the tracks have been transferred (step 320). However, if an insufficient number of data mover TCBs 420 are available or if the supply of data mover TCBs 420 is exhausted, the master TCB 410 becomes a data mover TCB (step 322) and the remaining tracks are transferred serially (step 324) with the transfer of a next track delayed until the track has been received (step 326) and an acknowledgment from the secondary storage controller 240 is received (step 328).
At the secondary storage control unit 240, the tracks are received (step 326), an acknowledgment transmitted (step 328) and the tracks are reassembled into the block of data 400 (step 330) which is ultimately stored on the storage device 248 (step 330), thereby completing the write operation. Upon receipt by the primary storage controller 220 from the secondary storage controller 240 that all of the tracks have been successfully received (step 334), the master TCB 410 is released (step 336) and may be used for the transfer of another block of data.
The objects of the invention have been fully realized through the embodiments disclosed herein. Those skilled in the art will appreciate that the various aspects of the invention may be achieved through different embodiments without departing from the essential function of the invention. The particular embodiments are illustrative and not meant to limit the scope of the invention as set forth in the following claims.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4445176 *||Dec 28, 1979||Apr 24, 1984||International Business Machines Corporation||Block transfers of information in data processing networks|
|US5892925 *||Nov 12, 1997||Apr 6, 1999||Intel Corporation||Method of communicating data from a host to a network controller|
|US6920537 *||Jul 17, 2002||Jul 19, 2005||Emc Corporation||Apparatus and methods for copying, backing up and restoring logical objects in a computer storage system by transferring blocks out of order or in parallel|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7620710 *||Nov 17, 2009||Commvault Systems, Inc.||System and method for performing multi-path storage operations|
|US7761610||Jul 20, 2010||International Business Machines Corporation||Methods and computer program products for defining synchronous replication devices in a subchannel set other than subchannel set zero|
|US7975061||Nov 7, 2005||Jul 5, 2011||Commvault Systems, Inc.||System and method for performing multistream storage operations|
|US8112543||Feb 7, 2012||Commvault Systems, Inc.||System and method for performing multistream storage operations|
|US8281028||Oct 2, 2012||Commvault Systems, Inc.||System and method for performing multistream storage operations|
|US8296475||Oct 23, 2012||Commvault Systems, Inc.||Systems and methods for performing multi-path storage operations|
|US8307129||Nov 6, 2012||International Business Machines Corporation||Methods and computer program products for swapping synchronous replication secondaries from a subchannel set other than zero to subchannel set zero using dynamic I/O|
|US8438332 *||May 7, 2013||International Business Machines Corporation||Apparatus and method to maintain write operation atomicity where a data transfer operation crosses a data storage medium track boundary|
|US8504741||Sep 14, 2012||Aug 6, 2013||Commvault Systems, Inc.||Systems and methods for performing multi-path storage operations|
|US8516173||Jul 28, 2008||Aug 20, 2013||International Business Machines Corporation||Swapping PPRC secondaries from a subchannel set other than zero to subchannel set zero using control block field manipulation|
|US8615769 *||Feb 8, 2011||Dec 24, 2013||Nec Corporation||Data processing system, data processing method, and data processing program|
|US20090182996 *||Jul 16, 2009||International Business Machines Corporation||Methods and Computer Program Products for Swapping Synchronous Replication Secondaries from a Subchannel Set Other Than Zero to Subchannel Set Zero Using Dynamic I/O|
|US20090193292 *||Jul 30, 2009||International Business Machines Corporation||Methods And Computer Program Products For Defing Synchronous Replication Devices In A Subchannel Set Other Than Subchannel Set Zero|
|US20100023647 *||Jul 28, 2008||Jan 28, 2010||International Business Machines Corporation||Swapping pprc secondaries from a subchannel set other than zero to subchannel set zero using control block field manipulation|
|US20100325376 *||Jun 22, 2009||Dec 23, 2010||International Business Machines Corporation||Apparatus and Method to Maintain Write Operation Atomicity Where a Data Transfer Operation Crosses a Data Storage Medium Track Boundary|
|US20110214130 *||Sep 1, 2011||Yoshihiko Nishihata||Data processing system, data processing method, and data processing program|
|U.S. Classification||711/169, 710/57, 711/172, 710/33, 710/38, 714/E11.108, 711/171|
|International Classification||G06F3/06, G06F12/00, G06F3/00|
|Cooperative Classification||G06F11/201, G06F3/0626, G06F11/2076, G06F3/0689, G06F11/2066, G06F3/065|
|European Classification||G06F3/06A4H4, G06F3/06A6L4R, G06F3/06A2Z, G06F11/20S2P4|
|Mar 8, 2004||AS||Assignment|
Owner name: INTERNATIONAL BUSINESS MACHINES (IBM) CORPORATION,
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHEN, JAMES C;GLUCK, OLYMPIA;WALDER, GABRIEL G;AND OTHERS;REEL/FRAME:014395/0687;SIGNING DATES FROM 20031120 TO 20040301
|Jan 25, 2010||REMI||Maintenance fee reminder mailed|
|Jun 20, 2010||LAPS||Lapse for failure to pay maintenance fees|