Parameters to be added prior to the EMC powerpath installation in solaris
1.install the latest QLogic driver
2.The /etc/system file must have the following entries:
set lwp_default_stksize=0x6000
set ssd:ssd_max_throttle=20
set ssd:ssd_io_time=0x3c
set fcp:fcp_offline_delay=20
set fcp:ssfcp_enable_auto_configuration=1
3.If the host agent is running on the server, stop it:
/etc/init.d/agent stop
4.Uncomment the following line in the /kernel/drv/iscsi.conf file:
mpxio-disable="yes"
? In addition, if the following line appears in the iscsi.conf file:
mpxio-disable="no"
5.To install PowerPath from a downloaded tar file, for example, after
downloading the package from Powerlink, use this procedure:
1. Select or create a directory where you can unload the PowerPath
tar file. For example, type:
mkdir /unload
2. Change directories to the unload directory.
Note: Ensure that the unload directory is empty.
For example, type cd /unload
3. Copy the tar file to the unload directory. Type:
cp <source_location>/<package_name>
4.pkgadd -d .
6.You see one of the following prompts:
On SPARC hosts:
The following packages are available:
1 EMCpower EMC PowerPath
(sparc) 5.3.x_bxxx
Select package(s) you wish to process (or 'all' to
process all packages). (default: all) [?,??,q]:
You are prompted for the directory where the PowerPath
program files will be installed:
Note: PowerPath installs its files in /basedir/EMCpower; the installation
process creates the EMCpower subdirectory. Make a note of the name
and location of the PowerPath base directory for future reference.
Enter package base directory (default: /opt):
Press Enter to accept the default base directory (/opt), or type the
path to an alternate base directory and press Enter.
7. You will see the following prompt:
This package contains scripts which will be executed
with super-user permission during the process of
installing this package.
Do you want to continue with the installation of
<EMCpower> [y,n,?]
Type y and press Enter.
8. The screen displays information about the installation ending
with:
-------------------------------------------------------
* EMCpower Installation:
*
* Installation is successful.
*
* Please REBOOT the host to complete the remaining steps
* of the installation. Refer to the PowerPath for Solaris
Installation and Administration Guide for more
* information.
*
* If you have a license key card, register now.
*
* License registration is NOT required to manage the
* CLARiiON AX series array.
------------------------------------------------------
Installation of <EMCpower> was successful.
9.Register PowerPath on the host
If you have previously registered an earlier version of PowerPath on
the host, PowerPath will use your old key; you need not reregister.
However, if your previous registration was for evaluation purposes,
and the registration has expired, you must reregister before you
reboot the host.
Registering PowerPath after you install the software and before you
reboot the host sets the appropriate default load balancing and
failover policy.
Note:Rebooting before registering PowerPath
If you reboot the host before you register PowerPath:
1. Run the powermt set policy command to reset the load balancing
and failover policy.
2. Run powermt save to save the settings in the powermt.custom
file.
10.To register the PowerPath software:
1. Type /etc/emcpreg -install
Output similar to the following appears:
============ EMC PowerPath Registration =============
Do you have a new registration key or keys to enter? [n]
2. Type y and press Enter.
Output similar to the following appears:
Enter the registration key(s) for your product(s),
one per line, pressing Enter after each key.
After typing all keys, press Enter again.
Key (Enter if done):
3. Type the PowerPath registration key and press Enter. You can
also add keys for other technologies, such as PowerPath
Migration Enabler or PowerPath Encryption with RSA.
If you typed a valid key, output similar to the following appears:
1 key(s) successfully added.
Key successfully installed.
Key (Enter if done):
4. When you have finished typing keys, press Enter. You will see the
following output if you typed one key:
1 key(s) successfully registered.
11.If you are registering PowerPath on a Solaris 10 host, perform
these additional steps. Otherwise, proceed to the next section.
c. Run the powermt set policy command to reset the load
balancing and failover policy.
d. Run powermt save to save the settings in the powermt.custom file
12.Reboot the host
If you are installing PowerPath for the first time and are prompted to
reboot, you must reboot now by typing reboot -- -r
If the sd or ssd driver does not exist on the host, you see one of the
following messages during boot:
WARNING: forceload of drv/sd failed
or
WARNING: forceload of drv/ssd failed
You can safely ignore this warning.
13.To verify the PowerPath installation:
1. Type pkginfo -l EMCpower to verify that PowerPath is installed
properly on the host.
Output similar to the following appears:
Note: When you install PowerPath on an x86 host, i386 appears in the
ARCH row.
PKGINST: EMCpower
NAME: EMC PowerPath
CATEGORY: system
ARCH: sparc
VERSION: 5.3.0_bxxx
BASEDIR: /opt
VENDOR: EMC Corporation
PSTAMP: cambridgeServerABCDE
INSTDATE: Feb 22 2008 13:07
STATUS: completely installed
FILES: 312 installed pathnames
42 directories
121 executables
183332 blocks used (approx)
13.Type modinfo | grep emcp to verify that the PowerPath kernel
extension is loaded on the host.
Output similar to the following appears on SPARC hosts:
Note: The emcpmp, emcpmpc, emcpmpap, and emcpmpaa extensions
present in previous releases have been replaced by the emcpmpx
extension in PowerPath 5.2 for Solaris.
33 12a5d00 36a8 287 1 emcpsf (PP SF 5.3.0)
34 12a8de8 2a2d8 286 1 emcp (PP Driver 5.3.0)
38 130cdc0 2ac0 - 1 emcpgpx (PP GPX Ext 5.3.0)
39 130f1f8 28e90 - 1 emcpmpx (PP MPX Ext 5.3.0)
40 132dee8 d6ef0 - 1 emcpsapi (PP SAPI Ext 5.3.0)
41 13cef58 10d48 - 1 emcpcg (PP CG Ext 5.3.0)
42 13deef0 6c78 - 1 emcpvlumd (PP VLUMD Manager 5.3.0)
43 13e49d8 1a5b0 - 1 emcpxcrypt (PP XCRYPT Manager 5.3.0)
44 7be00000 b588 - 1 emcpdm (PP DM Manager 5.3.0)
45 7be09d38 4c0 - 1 emcpioc (PP PIOC 5.3.0)
14.Verify PowerPath devices are configured on the host
To verify that PowerPath devices are configured on the host in a Fibre
Channel and iSCSI environment:
1. Type powermt display dev=all
Output similar to the following appears for each device in a Fibre
Channel environment:
Pseudo name=emcpower0a
Symmetrix ID=000000003269
Logical device ID=048
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
====================================================================
------------ Hosts ----------- - Sys - -I/O Paths - --- Stats -
### HW Path I/0 Path Interf. Mode State Q-IOs Errors
====================================================================
2300 sbus@f/QLGC,isp@2 c2t1d0 SA 16aB active alive 0 0
2301 sbus@f/QLGC,isp@2 c1t1d0 SA 16aA active alive 0 0
2302 sbus@f/QLGC,isp@2 c3t1d0 SA 16bB active alive 0 0
15.#echo | format
AVAILABLE DISK SELECTIONS:
0. c0t0d0 <TOSHIBA-MBF2300RC-3706 cyl 46873 alt 2 hd 20 sec 625>
/pci@0,600000/pci@0/pci@0/scsi@0/sd@0,0
1. c0t2d0 <TOSHIBA-MBF2300RC-3706 cyl 46873 alt 2 hd 20 sec 625>
/pci@0,600000/pci@0/pci@0/scsi@0/sd@2,0
2. c0t3d0 <TOSHIBA-MBF2300RC-3706 cyl 46873 alt 2 hd 20 sec 625>
/pci@0,600000/pci@0/pci@0/scsi@0/sd@3,0
3. c1t500601603EA04412d0 <DGC-RAID5-0531 cyl 44556 alt 2 hd 255 sec 189>
/pci@1,700000/pci@0/pci@8/SUNW,qlc@0/fp@0,0/ssd@w500601603ea04412,0
4. c2t500601683EA04412d0 <DGC-RAID5-0531 cyl 44556 alt 2 hd 255 sec 189>
/pci@1,700000/pci@0/pci@9/SUNW,qlc@0/fp@0,0/ssd@w500601683ea04412,0
5. emcpower0a <DGC-RAID5-0531 cyl 44556 alt 2 hd 255 sec 189>
/pseudo/emcp@0
Specify disk (enter its number): Specify disk (enter its number):
Application Pre-Deployment Requirements
· Root access to the OS
· Access to a SAN disk which needs to utilise PowerPath for Fault Tolerance
Check if EMC PowerPath is installed
# powermt check_registration
Key AB66-EF77-1234-I99L-5378-KLOP
Product: PowerPath
Capabilities: All
1. Log into the target host with a domain account then su to root.
# sudo su -
2. check powerpath devices
# powermt display dev=all
Pseudo name=emcpower0a
CLARiiON ID=APM00063103821 [solaris]
Logical device ID=600601601C0XXXXXXXXXXXXXXXXXXX11 [LUN 356]
state=alive; policy=CLAROpt; priority=0; queued-IOs=0;
Owner: default=SP A, current=SP A Array failover mode: 1
==============================================================================
--------------- Host --------------- - Stor - -- I/O Path -- -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================================================
3074 pci@7c0/pci@0/pci@9/SUNW,emlxs@0/fp@0,0 c3t500601234567890Bd0s0 SP A1
active alive 0 1
3074 pci@7c0/pci@0/pci@9/SUNW,emlxs@0/fp@0,0 c3t500601234567891Bd0s0 SP B1
active alive 0 0
3075 pci@7c0/pci@0/pci@9/SUNW,emlxs@0,1/fp@0,0 c3t500601234567892Bd0s0 SP A3
active alive 0 1
3075 pci@7c0/pci@0/pci@9/SUNW,emlxs@0,1/fp@0,0 c3t500601234567893Bd0s0 SP B3
active alive 0 0
If you don't see anything, you would need to reset powerpath
# powercf -q
# powermt config
# powermt set policy=co dev=all
# powermt save
# powermt display dev=all
If you still don't see anything, submit a TEM ticket.
use format command and make sure emcpower devices are listed
# format
Searching for disks...done
AVAILABLE DISK SELECTIONS:
0. c1t0d0 <SUN146G cyl 14087 alt 2 hd 24 sec 848>
/pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w500000e011f7a661,0
1. c1t1d0 <SUN146G cyl 14087 alt 2 hd 24 sec 848>
/pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w500000e011f7f4a1,0
2. c1t2d0 <FUJITSU-MAX3147FCSUN146G-1103 cyl 14087 alt 2 hd 24 sec 848>
/pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w500000e011ac9601,0
3. c1t3d0 <FUJITSU-MAX3147FCSUN146G-1103 cyl 14087 alt 2 hd 24 sec 848>
/pci@8,600000/SUNW,qlc@2/fp@0,0/ssd@w500000e011ac7251,0
4. c6t5006016A44600750d0 <DGC-RAID5-0428 cyl 61438 alt 2 hd 256 sec 40>
/pci@9,600000/SUNW,emlxs@1/fp@0,0/ssd@w5006016a44600750,0
5. c6t5006016A44600750d1 <DGC-RAID5-0428 cyl 43518 alt 2 hd 256 sec 32>
/pci@9,600000/SUNW,emlxs@1/fp@0,0/ssd@w5006016a44600750,1
6. c6t5006016A44600750d2 <DGC-VRAID-0428 cyl 58878 alt 2 hd 256 sec 32>
/pci@9,600000/SUNW,emlxs@1/fp@0,0/ssd@w5006016a44600750,2
7. c6t5006016344600750d0 <DGC-RAID5-0428 cyl 61438 alt 2 hd 256 sec 40>
/pci@9,600000/SUNW,emlxs@1/fp@0,0/ssd@w5006016344600750,0
8. c6t5006016344600750d1 <DGC-RAID5-0428 cyl 43518 alt 2 hd 256 sec 32>
/pci@9,600000/SUNW,emlxs@1/fp@0,0/ssd@w5006016344600750,1
9. c6t5006016344600750d2 <DGC-VRAID-0428 cyl 58878 alt 2 hd 256 sec 32>
/pci@9,600000/SUNW,emlxs@1/fp@0,0/ssd@w5006016344600750,2
10. c7t5006016B44600750d0 <DGC-RAID5-0428 cyl 61438 alt 2 hd 256 sec 40>
/pci@9,600000/SUNW,emlxs@2/fp@0,0/ssd@w5006016b44600750,0
11. c7t5006016B44600750d1 <DGC-RAID5-0428 cyl 43518 alt 2 hd 256 sec 32>
/pci@9,600000/SUNW,emlxs@2/fp@0,0/ssd@w5006016b44600750,1
12. c7t5006016B44600750d2 <DGC-VRAID-0428 cyl 58878 alt 2 hd 256 sec 32>
/pci@9,600000/SUNW,emlxs@2/fp@0,0/ssd@w5006016b44600750,2
13. c7t5006016244600750d0 <DGC-RAID5-0428 cyl 61438 alt 2 hd 256 sec 40>
/pci@9,600000/SUNW,emlxs@2/fp@0,0/ssd@w5006016244600750,0
14. c7t5006016244600750d1 <DGC-RAID5-0428 cyl 43518 alt 2 hd 256 sec 32>
/pci@9,600000/SUNW,emlxs@2/fp@0,0/ssd@w5006016244600750,1
15. c7t5006016244600750d2 <DGC-VRAID-0428 cyl 58878 alt 2 hd 256 sec 32>
/pci@9,600000/SUNW,emlxs@2/fp@0,0/ssd@w5006016244600750,2
16. emcpower0a <DGC-RAID5-0428 cyl 61438 alt 2 hd 256 sec 40>
/pseudo/emcp@0
17. emcpower1a <DGC-RAID5-0428 cyl 43518 alt 2 hd 256 sec 32>
/pseudo/emcp@1
18. emcpower2a <DGC-VRAID-0428 cyl 58878 alt 2 hd 256 sec 32>
/pseudo/emcp@2
Specify disk (enter its number):
Press Ctrl-C to get out.
Check if the disks are already configured
# vxdisk list
DEVICE TYPE DISK GROUP STATUS
disk_0 auto:cdsdisk - - online
disk_1 auto:cdsdisk - - online
disk_2 auto:SVM - - SVM
disk_3 auto:SVM - - SVM
emcpower0s2 auto:cdsdisk FCSQAgr01 FCSQAgr online nohotuse
emcpower1s2 auto:cdsdisk FCSQAgr02 FCSQAgr online nohotuse
emcpower2s2 auto:cdsdisk FCSQAgr03 FCSQAgr online nohotuse
If you see a listing similar to the above, the disks are configured. SVM is Solaris Volume Manager and FCSQAgr is the volume group with three SAN disks inside.
Check if partitions are configured.
# df -k
Filesystem kbytes used avail capacity Mounted on
/dev/md/dsk/d0 15493250 4742037 10596281 31% /
/devices 0 0 0 0% /devices
ctfs 0 0 0 0% /system/contract
proc 0 0 0 0% /proc
mnttab 0 0 0 0% /etc/mnttab
swap 21779944 1336 21778608 1% /etc/svc/volatile
objfs 0 0 0 0% /system/object
sharefs 0 0 0 0% /etc/dfs/sharetab
/platform/sun4u-us3/lib/libc_psr/libc_psr_hwcap2.so.1
15493250 4742037 10596281 31% /platform/sun4u-us3/lib/libc_psr.so.1
/platform/sun4u-us3/lib/sparcv9/libc_psr/libc_psr_hwcap2.so.1
15493250 4742037 10596281 31% /platform/sun4u-us3/lib/sparcv9/libc_psr.so.1
fd 0 0 0 0% /dev/fd
/dev/md/dsk/d3 12396483 5211506 7061013 43% /var
swap 524288 0 524288 0% /tmp
swap 21778616 8 21778608 1% /var/run
swap 21778608 0 21778608 0% /dev/vx/dmp
swap 21778608 0 21778608 0% /dev/vx/rdmp
/dev/vx/dsk/FCSQAgr/muhiltemp
103218991 40823849 61362953 40% /MuhilTemp
MD means multidisk which is Raid. As you can see MuhilTemp is cut from the Powerpath VG FCSQAgr.
If you don't see the Powerpath VG being used, you have to backup, delete and create them using PowerPath VG.
# format
The syntax is straightforward, but if you are not sure about how to configure the disk, ask a team member or submit a TEM ticket to have the disk configured.
Installation Verification
Once the installation is completed, issue the following to verify that PowerPath is active.
# powermt display
Symmetrix logical device count=0
CLARiiON logical device count=1
Hitachi logical device count=0
HP xp logical device count=0
Ess logical device count=0
Invista logical device count=0
==============================================================================
----- Host Bus Adapters --------- ------ I/O Paths ----- ------ Stats ------
### HW Path Summary Total Dead IO/Sec Q-IOs Errors
==============================================================================
1 qla2xxx optimal 2 0 - 0 0
3 qla2xxx optimal 2 0 - 0 0
Execute the following to verify paths are working.
# powermt display dev=all
Pseudo name=emcpowera
CLARiiON ID=APM00111103781 [FCMIBCCLPFDB01]
Logical device ID=60060160C5302E00D4B3082F6868E111 [LUN 1388]
state=alive; policy=BasicFailover; priority=0; queued-IOs=0;
Owner: default=SP A, current=SP A Array failover mode: 4
==============================================================================
--------------- Host --------------- - Stor - -- I/O Path -- -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================================================
1 qla2xxx sda SP A7 active alive 0 0
1 qla2xxx sdb SP B5 active alive 0 0
3 qla2xxx sdc SP A5 unlic alive 0 0
3 qla2xxx sdd SP B7 unlic alive 0 0
If you see only one active path, please contact TEM. If you see none or the following, Powerpath is not working.
Bad dev value emcpowera, or not under Powerpath control.
1.5. Back-out/Roll-back Procedures
Remove the PowerPath package and reboot.
# yum remove EMCpower.LINUX
0 comments:
Post a Comment