Sun Microsystems Sun StorEdge Network Data Replicator 3.0 Configuration manual

Taper
Configuration manual
Sun Microsystems, Inc.
901 San Antonio Road
Palo Alto, CA 94303-4900 U.S.A.
650-960-1300
Send comments about this document to: docfeedback@sun.com
Sun StorEdge
Network Data Replicator 3.0
Configuration Guide
Part No. 806-7550-10
June 2001, Revision A
Please
Recycle
Copyright 2001 Sun Microsystems, Inc., 901 San Antonio Road • Palo Alto, CA 94303USA. All rights reserved.
This productor document is protectedby copyright and distributedunder licensesrestricting itsuse, copying, distribution, and
decompilation. No part of this product or document may be reproduced in any formby anymeans without prior written authorization
of Sun and its licensors,if any. Third-party software, including font technology, is copyrighted and licensed from Sun suppliers.
Parts of the product may be derived from Berkeley BSD systems, licensed from the Universityof California. UNIX is a registered trademark in
the U.S. and other countries, exclusively licensed through X/Open Company, Ltd.
Sun, Sun Microsystems, the Sun logo, Sun StorEdge, Sun Enterprise, Solstice Disksuite, Sun Trunking, SunScreen, AnswerBook, andSolaris are
trademarks, registered trademarks, or service marks of Sun Microsystems, Inc. in the U.S. and other countries.
The OPEN LOOK and Sun™ Graphical User Interface was developed by Sun Microsystems, Inc. for its users and licensees. Sun acknowledges
the pioneering efforts of Xerox in researching and developing the concept of visual or graphical user interfaces for the computer industry. Sun
holds a non-exclusive license from Xerox to the Xerox Graphical User Interface, which license also covers Sun’s licensees who implement OPEN
LOOK GUIs and otherwise comply with Sun’s written license agreements.
RESTRICTED RIGHTS: Use, duplication, or disclosure by the U.S. Government is subject to restrictions of FAR 52.227-14(g)(2)(6/87) and
FAR 52.227-19(6/87), or DFAR 252.227-7015(b)(6/95) and DFAR 227.7202-3(a).
DOCUMENTATION IS PROVIDED “AS IS” AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES,
INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-
INFRINGEMENT, ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.
Copyright 2001 Sun Microsystems, Inc., 901 San Antonio Road • Palo Alto, CA 94303Etats-Unis. Tousdroits réservés.
Ce produit ou document est protégé par un copyright et distribué avec des licences qui en restreignent l’utilisation, la copie, la distribution, et la
décompilation. Aucune partie de ce produit ou document ne peut être reproduite sous aucune forme, par quelque moyen que ce soit, sans
l’autorisation préalable et écrite de Sun et de ses bailleurs de licence, s’il yen a. Le logiciel détenu par des tiers, et qui comprend la technologie
relativeaux polices de caractères, est protégé par uncopyright et licencié par des fournisseurs de Sun.
Des parties de ce produit pourront êtredérivées des systèmes Berkeley BSD licenciés par l’Université de Californie. UNIX est une marque
déposée aux Etats-Unis et dans d’autres pays et licenciée exclusivement par X/Open Company, Ltd.
Sun, Sun Microsystems, le logo Sun, Sun StorEdge, Sun Enterprise, Solstice Disksuite, Sun Trunking, SunScreen, AnswerBook, et Solaris sont
des marques de fabrique ou des marques déposées, ou marques de service, de Sun Microsystems, Inc. aux Etats-Unis et dans d’autres pays.
Toutes les marques SPARC sont utilisées sous licence et sont des marques de fabrique ou des marques déposées de SPARC International, Inc.
aux Etats-Unis et dansd’autres pays. Les produits portantlesmarques SPARC sont basés sur une architecture développéepar Sun
Microsystems,Inc.
L’interface d’utilisation graphique OPEN LOOK et Sun™ a été développée par Sun Microsystems, Inc. pour ses utilisateurs et licenciés. Sun
reconnaît les efforts de pionniers de Xerox pour la recherche et le développement du concept des interfaces d’utilisation visuelleou graphique
pour l’industrie de l’informatique. Sun détient une licence non exclusive de Xerox sur l’interface d’utilisation graphique Xerox, cette licence
couvrant également les licenciés de Sun qui mettent en place l’interface d’utilisation graphique OPEN LOOK et qui en outre se conforment aux
licencesécrites de Sun.
CETTE PUBLICATION EST FOURNIE "EN L’ETAT" ET AUCUNE GARANTIE, EXPRESSE OU IMPLICITE, N’EST ACCORDEE, Y
COMPRIS DES GARANTIES CONCERNANT LA VALEUR MARCHANDE, LAPTITUDE DE LA PUBLICATION A REPONDRE A UNE
UTILISATION PARTICULIERE, OU LE FAIT QU’ELLE NE SOIT PAS CONTREFAISANTE DE PRODUIT DE TIERS. CE DENI DE
GARANTIE NE S’APPLIQUERAIT PAS, DANS LA MESURE OU IL SERAIT TENU JURIDIQUEMENT NUL ET NON AVENU.
iii
Contents
Preface v
1. Overview 1
Sun SNDR Software Description 1
Supported Hardware and Software 3
TCP/IP Connection Hardware Components 3
Network Multipathing 4
Applications 5
Architecture 5
2. Configuration Considerations 7
Volumes Eligible for Replication 7
Choosing Volume Level Protection 8
Bitmap Volumes for Scoreboard Logs 8
Choosing a Connection Medium to Link My Sites 9
ATM Link Advantages 9
Configuring Redundant Links Between Sites 10
Link Security 10
Choosing Between Synchronous and Asynchronous Replication 11
When To Suspend Replication to the Secondary Site 12
iv Sun StorEdge Network Data Replicator 3.0 Configuration Guide June 2001
Configuring The Sun SNDR Software for Mutual Replication 12
Order-Dependent Writes and Volume Set Grouping 13
Recovery Considerations 14
Failing Over to the Secondary Site 14
Recovering the Primary or Secondary Site 14
Using The Sun SNDR and Sun StorEdge Instant Image Software 16
Sun SNDR Software and Sun StorEdge Fast Write Cache Software 17
One-to-Many and Multihop Volume Sets 18
Using The Sun SNDR Software in a Firewall Environment 19
v
Preface
The Sun StorEdge Network Data Replicator 3.0 Configuration Guide describes the Sun
StorEdge™ Network Data Replicator (Sun SNDR) software and general information
about its use. This guide is intended for system administrators who have experience
with the Solaris™ operating environment and related disk storage systems.
Before You Read This Book
To fully use the information in this document, you must have thorough knowledge
of the topics discussed in these books:
Sun StorEdge Network Data Replicator 3.0 System Administrator’s Guide
Sun StorEdge Network Data Replicator 3.0 Installation Guide
Sun StorEdge Network Data Replicator 3.0 Release Notes
The Sun SNDR software must be installed as described in the installation and release
documentation.
vi Sun StorEdge Network Data Replicator 3.0 Configuration Guide June 2001
Using UNIX Commands
This document may not contain information on basic UNIX®commands and
procedures such as shutting down the system, booting the system, and configuring
devices.
Refer to the software documentation that you received with your system.
Documentation Conventions
Typeface or
Symbol Meaning Examples
AaBbCc123 The names of commands,
files, and directories;
on-screen computer output.
Edit your .login file.
Use ls -a to list all files.
% You have mail.
AaBbCc123 What you type, when
contrasted with on-screen
computer output.
%su
Password:
AaBbCc123 Book titles, new words or
terms, words to be
emphasized.
Command-line variable;
replace with a real name or
value.
Read Chapter 6 in the Users Guide.
These are called class options.
You must be root to do this.
To delete a file, type rm filename.
[ ] In syntax, brackets indicate
that an argument is optional. scmadm [dsec][rn[:n][,n]...] [z]
{arg | arg} In syntax, braces and pipes
indicate that one of the
arguments must be specified.
sndradm -b {phost | shost}
Preface vii
Shell Prompts
Related Documentation
Shell Prompt
Cshell machine_name%
Cshellsuperuser machine_name#
Bourne shell and Korn shell $
Bourne shell and Korn shell superuser #
Application Title Part Number
man pages sndradm
scmadm
svadm
iiadm
N/A
Latest information SunStorEdgeNetworkDataReplicator3.0Software
Notes 806-7513
Sun StorEdge Instant Image 3.0 Release Notes 806-7678
Installation and User SunStorEdgeNetworkDataReplicator3.0
Installation Guide 806-7514
Sun StorEdge Instant Image 3.0 Installation Guide 806-7675
SunATM 3.0 Installation and Users Guide
Sun ATM 4.0 Installation and User’s Guide 805-0331
805-6552
Sun Gigabit Ethernet FC-AL/P Combination Adapter
Installation Guide 806-2385
Sun Gigabit Ethernet/S 2.0 Adapter Installation and
User’s Guide
Sun Gigabit Ethernet/P 2.0 Adapter Installation and
User’s Guide
805-2784
805-2785
Sun Trunking 1.2.1 Installation and User's Guide 806-4207
viii Sun StorEdge Network Data Replicator 3.0 Configuration Guide June 2001
Platform Notes: The Sun Quad FastEthernet Device
Driver 806-3989
Sun Enterprise 10000 InterDomain Networks User
Guide 806-4131
System administration Sun StorEdge Instant Image 3.0
System Administrators Guide 806-7677
SunStorEdgeNetworkDataReplicator3.0
System Administrators Guide 806-7512
TCP/IP and Data Communications Administration
Guide 805-4003
SunScreen 3.1 Administration Guide 806-4127
Solaris Bandwidth Manager 1.6 System
Administration Guide 806-4704
Configuration Sun Enterprise 10000 InterDomain Network
Configuration Guide 806-5230
Sun StorEdge Instant Image 3.0 Configuration Guide 806-7676
Application Title Part Number
Preface ix
Accessing Sun Documentation Online
A broad selection of Sun system documentation is located at:
http://www.sun.com/products-n-solutions/hardware/docs
A complete set of Solaris documentation and many other titles are located at:
http://docs.sun.com
For the latest version of released storage software documentation, go to:
http://www.sun.com/products-n-solutions/hardware/docs/Software/
Ordering Sun Documentation
For the latest version of storage software documentation, go to:
http://www.sun.com/products-n-solutions/hardware/docs/Software/
Fatbrain.com, an Internet professional bookstore, stocks select product
documentation from Sun Microsystems, Inc.
For a list of documents and how to order them, visit the Sun Documentation Center
on Fatbrain.com at:
http://www.fatbrain.com/documentation/sun
Sun Welcomes Your Comments
Sun is interested in improving its documentation and welcomes your comments and
suggestions. You can email your comments to Sun at:
docfeedback@sun.com
Please include Part No. 806-7550-10 in the subject line of your email.
xSun StorEdge Network Data Replicator 3.0 Configuration Guide June 2001
1
CHAPTER 1
Overview
Caution – Do not install or use the Sun StorEdge Version 3.0 Core and data services
software on servers in a Sun Cluster 3.0 environment. The Version 3.0 software is
not co-existent with the Sun Cluster 3.0 environment. The Version 3.0 software is
co-existent in the Sun Cluster 2.2 environment, where it will not interfere with
failover. The Version 3.0 core and data services software is cluster aware in the Sun
Cluster 3.0 Update 1 environment and provides high availability for the Sun
StorEdge software.
Sun SNDR Software Description
The Sun SDNR software is a remote replication facility for the Solaris™ operating
environment. It is intended for use as part of a disaster recovery and business
continuance plan to provide redundant storage of critical information across
physically separate sites. It is designed to be active during normal application access
to the data volumes, and it will continually replicate the data to the remote site.
The Sun SDNR software enables you to replicate disk volumes between physically
separate primary and secondary hosts in real time. To transport data, the Sun SDNR
software uses any Sun network adapter that supports TCP/IP.
The Sun SNDR software volume set consists of a primary volume residing on a local
host and a secondary volume residing on a remote host. The volume set also
includes a bitmap volume on each host to track write operations and differences
between the volumes.
Youcanupdatethedataonthesecondaryvolumebyissuingacommandto
resynchronize the volumes. You can also restore data from the secondary volume to
the primary volume by issuing a command to reverse resynchronize the volumes.
2Sun StorEdge Network Data Replicator 3.0 Configuration Guide June 2001
The replication mode can be synchronous or asynchronous based as a user-selectable
parameter for each Sun SNDR volume set. (Use the sndradm enable command and
select the sync or async parameter Use the sndradm -R m command to change
the replication mode thereafter.) The volumes can be updated synchronously in real
time or asynchronously using a store-and-forward technique.
Typically, a primary volume is first explicitly copied to a designated secondary
volume to establish matching contents. As applications write to the primary volume,
the Sun SDNR software replicates changes to the secondary volume, keeping the two
volumes consistent.
In synchronous mode, a write operation is not confirmed as complete until the
remote volume has been updated. Synchronous mirroring forces the Sun SNDR
software to wait until an acknowledgement of the receipt of the data is received
from the secondary by the primary before returning to the application.
In asynchronous mode, a write operation is confirmed as complete before the
remote volume has been updated. Asynchronous mirroring allows the Sun SNDR
software to return to the host as soon as the write has been completed on the
primary volume and been placed on a per volume queue for the secondary site.
Subsequently, the secondary site receives the queued requests in the order that
they were queued. Once the I/O has been completed at the secondary site,
notification is sent to the primary.
In the event of planned or unplanned outages, the Sun SNDR software maintains
per-device scoreboard bitmap volumes that are marked to indicate changed blocks
with a granularity of 32 Kbytes per segment. This technique allows for optimized
resynchronization by allowing the Sun SNDR software to resynchronize only the
blocks that have changed.
OtherfeaturesincludedaspartoftheSunSNDRsoftwareare:
Grouping volume sets —TheSunSNDRsoftwareenablesyoutogroupvolume
sets. Grouping volume sets guarantees write ordering. For example, in a
synchronization from the primary host to the secondary host, write operations to
the secondary volumes in the group occur in the same order as the write
operations to the primary volumes in the group.
You can also assign specific volume sets to a group to perform sndradm
commands on these volume sets and not on others you have configured. See
“Order-Dependent Writes and Volume Set Grouping” on page 13.
Note – You can also group volume sets according to their cluster or resource tag to
perform replication in a Sun Cluster 2.2 or 3.0 Update 1 clustered environment only.
Chapter 1 Overview 3
One-to-many and multihop volume sets The Sun SNDR software enables you
to create one-to-many and multihop volume sets. In a one-to-many volume set,
you can replicate data from one primary volume to many secondary volumes
residing on one or more hosts. In a multihop set, the secondary host volume of
one volume set can be the primary host volume of another volume set. See
“One-to-Many and Multihop Volume Sets” on page 18.
Supported Hardware and Software
TCP/IP Connection Hardware Components
The Sun SNDR software requires a TCP/IP connection between the primary and
secondary server. Each server must have the proper ATM or Ethernet hardware
installed to support the TCP/IP link.
The Sun SNDR software operates over any TCP/IP networking technology but has
been qualified only on 10, 100, and 1000 Mbit Ethernet and ATM 166 and 622
technologies.
A dedicated TCP/IP link is not required.
Operating Environment Solaris 7 or 8 operating environment or subsequent compatible version
Supporting Software Network transport software such as SunATM™ or Gigabit Ethernet transports
Optional
Software Sun StorEdge Instant Image software Version 3.0; install this package for
additional point-in-time capability
Supported Volume Manager
Software Sun Logical Volume Manager
Sun Solstice DiskSuite™
Veritas Volume Manager
Host Types Server hosts using the Solaris operating environment and any Sun-supported
network interface card. Hosts include:
Sun Enterprise™ Server models 2x0 through 4x0
Sun Enterprise Server models 3x00 through 10000
Supported Attached Storage The Sun SNDR software is storage-hardware independent
4Sun StorEdge Network Data Replicator 3.0 Configuration Guide June 2001
Network Multipathing
Network multipathing with failover is supported on hosts running the Solaris 8,
Update 3 operating environment. This feature is provided as part of the standard
Solaris operating environment and is transparent to the Sun SNDR software.
The Sun SNDR software does not natively support the functionality listed in TABLE 1.
However, other Sun products can be used with the Sun SNDR software to provide
these facilities.
TABLE 1 Sun SNDR Software Related Functionality
Functionality Sun Product
Network interface aggregation and
network alternate pathing Sun Trunkingsoftware and the native
facilities provided in a Solaris operating
environment update.
Network encryption SunScreenSoftware
Network bandwidth allocation Solaris Bandwidth Manager
Chapter 1 Overview 5
Applications
The Sun SNDR software provides protection of critical enterprise information. The
following information types are candidates for remote replication:
Database partitions and logs
Data that is important for business continuance in a disaster situation
The Sun SNDR software can be leveraged for additional applications, such as:
Data migration
Remote backup
Remote data analysis
Test and development
Architecture
The Sun SNDR software operates on logical volumes that can be linear, striped, or
RAID devices. You can create the logical volumes by using the Sun Solstice
DiskSuite™ or Veritas Volume Manager software.
The core Sun SNDR software code is a kernel module that interfaces to the network
storage control module (NSCTL) data service framework. The Sun SNDR software is
configurable on any device that is accessible through the NSCTL data service
framework. The sndradm CLI is the external user interface used to manage the Sun
SNDR software.
FIGURE 1 shows the relationship between SNDR and the rest of the NSCTL data
service framework.
6Sun StorEdge Network Data Replicator 3.0 Configuration Guide June 2001
FIGURE 1 The Sun SNDR Software Architecture
Primary host
Application User
Sun STE or SV Kernel
Sun StorEdge
Instant Image
Sun SNDR
SDBC
Device driver
NSCTL -
Network storage
control module
Secondary host
User
Sun STE or SV Kernel
Sun StorEdge
Instant Image
Sun SNDR
SDBC
Device driver NSCTL -
Network storage
control module
HardwareHardware
IP
7
CHAPTER 2
Configuration Considerations
Volumes Eligible for Replication
Generally, include the following critical volumes in the Sun SNDR configuration:
Database and database management system (DBMS) logs (the total database or
online DBMS log)
Access control files
You can exclude volumes from the Sun SNDR software configuration if they can be
reconstructed at the recovery site or if they seldom change:
Temporary volumes (such as those used in sort operations)
Spool files
Paging volumes
When selecting a volume to be used in the Sun SNDR software volume set, ensure
that volume does not contain disk label private areas (for example, slice 2 on a
Solaris operating environment-formatted volume). The disk label region is contained
in the first sectors of cylinder 0 of a disk. The safest method is to ensure that cylinder
0 is not part of any logical volume that is replicated (except for volumes under
Veritas Volume Manager control, where cylinder 0 can be part of a logical volume
that is replicated).
8Sun StorEdge Network Data Replicator 3.0 Configuration Guide June 2001
Choosing Volume Level Protection
In general, customers should protect their data with some level of RAID. With the
Sun SNDR software, the primary volumes can be protected by any software or
hardware RAID level desired. The protection level of the secondary volumes does
not have to match that of the primary volumes. For example, if the primary volumes
are RAID1, the secondary volumes could be RAID5.
Bitmap Volumes for Scoreboard Logs
Note – After editing the /usr/kernel/drv/rdc.conf file, reboot your server.
The Sun SNDR Version 3.0 software does not support bitmap files.TheSunSNDR
software uses regular raw devices to store bitmaps, used to maintain the Sun SNDR
scoreboard logs. For example, you can specify a bitmap volume as
/dev/rdsk/c6t0d0s4.
Theserawdevicesshouldbestoredonadiskseparatefromthediskthatcontains
the data. Configure RAID (such as mirrored partitions) for these bitmap devices and
ensurethatthemirroredmembersarenotstoredonthesamediskasthedata.
In a clustered environment, a bitmap must reside only on a volume. The bitmap
volume in this case must be part of the same disk group or cluster resource group as
the corresponding primary or secondary data volume.
A bitmap maintained on disk can persist across a system crash, depending on the
setting of rdc_bitmap_mode in /usr/kernel/drv/rdc.conf. For example:
# rdc_bitmap_mode
# - Sets the mode of the RDC bitmap operation, acceptable values are:
# 0 - autodetect bitmap mode depending on the state of SDBC (default).
# 1 - force bitmap writes for every write operation, so an update resync
# can be performed after a crash or reboot.
# 2-onlywritethebitmaponshutdown,soafullresyncis
# required after a crash, but an update resync is required after
# a reboot.
#
rdc_bitmap_mode=0;
Chapter 2 Configuration Considerations 9
If your server is configured in a clustered environment, set the bitmap mode to 1. If
your server is not configured in a clustered environment, you can also choose the
bitmap mode setting of 1 to improve error or disaster recovery.
Choosing a Connection Medium to Link
My Sites
The primary and secondary sites must be connected by a standard medium that
supports TCP/IP. For example, you can use any medium such as ATM, ISDN,
Ethernet, Gigabit-Ethernet, or T1 and T3 lines to replicate data. Consider cost,
bandwidth, and latency when choosing a connection medium.
The Sun SNDR software uses the maximum network bandwidth available to it. If the
Sun SNDR software must share the network connection with other applications, you
can use a bandwidth allocator to restrict the bandwidth available to an application.
ATM Link Advantages
ATM is a standards-based high-performance WAN protocol that establishes routes at
circuit initialization. Its performance, combined with SONET/SDH’s ring-healing
resiliency, have made it the choice of carriers in their core backbone networks.
ATM Quality of Service parameters allow customers to choose the circuit
characteristics that best suit their needs and budget. They define how different WAN
ports competing for bandwidth should be prioritized relative to each other, each
having “virtual paths” through the network fabric. Voice, video, and LAN traffic can
move over the same connection as critical remote mirroring connections between
primary and recovery sites. ATM switches make these varied protocol adaptations
possible.
The Sun SNDR software will operate over any TCP/IP networking technology but
has only been qualified on 10, 100, and 1000 Mbit Ethernet and ATM technologies.
10 Sun StorEdge Network Data Replicator 3.0 Configuration Guide June 2001
Configuring Redundant Links Between Sites
The Solaris 8 operating environment offers IP multipathing. This feature permits a
Solaris host to group multiple physical network interfaces into a single logical
interface. Redundancy between paths permits transparent operation in the event of a
failure anywhere on the path including failures of network interface cards, links,
switches and routers.
This feature also provides the Sun SNDR software with the transparent means for
surviving link failures. It provides the ability to aggregate bandwidth across the
physical interfaces permitting a pair of ATM 622 Mbit links to operate as one logical
1244 Mbit link with resiliency.
Link Security
Solaris 8 operating environment offers IPsec, the industry standard form of
integrating encryption and authentication mechanisms into standard IP
internetworking. A Solaris 8 host can authenticate and encrypt traffic on a
conversation-by-conversation basis.
Additionally, Sun offers SunScreenTM software technology that permits both
encryption and authentication of IP traffic. Coupled with the Sun SNDR software,
SunScreen software can provide an additional level of security to the data being
transmitted between sites. SunScreen software uses public key encryption
technology to guarantee that traffic is strongly encrypted. The public key mechanism
is also used to authenticate that the sender of the traffic is the correct entity.
SunScreen software is normally configured at the edge of the data center network.
Of course, cooperating SunScreen software is required at each data center.
  • Page 1 1
  • Page 2 2
  • Page 3 3
  • Page 4 4
  • Page 5 5
  • Page 6 6
  • Page 7 7
  • Page 8 8
  • Page 9 9
  • Page 10 10
  • Page 11 11
  • Page 12 12
  • Page 13 13
  • Page 14 14
  • Page 15 15
  • Page 16 16
  • Page 17 17
  • Page 18 18
  • Page 19 19
  • Page 20 20
  • Page 21 21
  • Page 22 22
  • Page 23 23
  • Page 24 24
  • Page 25 25
  • Page 26 26
  • Page 27 27
  • Page 28 28
  • Page 29 29
  • Page 30 30

Sun Microsystems Sun StorEdge Network Data Replicator 3.0 Configuration manual

Taper
Configuration manual