new-sfrac简要操作手册.doc

[VERITAS 大中国区顾问服务]

舟山大宗商品交易所

Storage Foundation for RAC
操作手册

VERITAS Consulting Services
Greater China

大中国区顾问服务

1 文件信息
Version
Document Title
舟山大宗商品交易所Storage Foundation for RAC操作手册
Subject
VERITAS 大中国区的顾问服务
Version
1.0
Date
2011/10
Author
Teller
Filename
operation.doc
Comments

作者
这一份文件可以与下列作者取的联系
Teller Pan
Consultant
VERITAS Consulting Service Greater China
Teller_pan@
相关的文件
Id
Title
Organisation
Author
Version

2 目录
1 文件信息 2
Version 2
作者 2
相关的文件 2
2 目录 3
3 Storage Foundation for RAC简单操作 4
3.1命令行操作简介 4
3.1.0如何重启主机 4
3.1.1检查cluster状态 4
3.1.2 启动服务组 5
3.1.3 停止服务组 5
3.1.4 切换服务组 5
3.1.5 停止某个资源 5
3.1.6启动某个资源 5
3.1.7发现某个资源出错后清除错误 5
3.1.8如果资源无法启动或停止需要flush状态 6
3.1.9查看心跳信息 6
3.1.10查看cluster支持RAC的状态 6
3.1.11查看磁盘状态 6
3.1.12查看 disk group 状态 7
3.1.13查看disk group 剩余空间 7
3.1.14查看 volume 的状态 8
3.1.15 添加一个disk group 13
3.1.16在disk group中添加一块盘 13
3.1.17创建stripe的volume 13
3.1.18创建文件系统 13
3.1.19 mount文件系统 13
3.1.20查看cluster的日志 14
3.1.21查看volume manager的日志 14
3.1.22删除一个volume 14
3.1.23删除一个disk group 14
3.1.24如何扩大或缩小文件系统 14
3.1.25如何禁止fencing 15
3.1.26 shutdown说明 15
3.1.27检查磁盘的serial number 15
3.1.28如何查看license key 16
3.1.29如何添加license key 16
3.1.30如何查看多路径信息 16
3.1.31如何让cluster两主机都停止后启动一台主机提供服务 16
3.1.32如何停止一个HBA卡上的I/O（用于升级微码） 16
3.1.33如何更换一个HBA卡 17
3.1.34如何添加一个oracle使用的裸设备 17
3.1.35如何停止cluster软件 17
3.2 图形界面简介 17
3.2.1 cluster图形界面 17
3.2.2 Volume Manager图形界面 28

3 Storage Foundation for RAC简单操作
Storage Foundation for RAC的操作可以采用命令行、java图形界面和web界面进行。
3.1命令行操作简介
3.1.0如何重启主机
SFRAC for AIX环境下要使用shutdown –Fr命令来重启主机，不能使用 reboot命令
shutdown –Fr命令会执行/etc/rc.d下的K脚本，会正常地停止cluster软件，而reboot不会。

如果使用reboot命令重启后，需要查看errpt,如果有fencing的报错，并且无法import disk group, 就要使用 vxfenclearpre命令后重启主机才能恢复正常。

3.1.1检查cluster状态
jxysdb1:/#hastatus –sum 查看总体的cluster状态

# hastatus
attempting to connect....
attempting to connect....connected

group resource system message
--------------- -------------------- -------------------- --------------------
kadb1 RUNNING
kadb2 RUNNING
ClusterService kadb1 ONLINE
ClusterService kadb2 OFFLINE
-------------------------------------------------------------------------
cvm kadb1 ONLINE
cvm kadb2 ONLINE
rac-sg kadb1 ONLINE
rac-sg kadb2 ONLINE
wac kadb1 ONLINE
-------------------------------------------------------------------------
wac kadb2 OFFLINE
webip kadb1 ONLINE
webip kadb2 OFFLINE
csgnic kadb1 ONLINE
csgnic kadb2 ONLINE
-------------------------------------------------------------------------
ocr-mnt-res kadb1 ONLINE
ocr-mnt-res kadb2 ONLINE
vxfsckd kadb1 ONLINE
vxfsckd kadb2 ONLINE
cvm_clus kadb1 ONLINE
-------------------------------------------------------------------------
cvm_clus kadb2 ONLINE
ocrvotedg-res kadb1 ONLINE
ocrvotedg-res kadb2 ONLINE
cvm_vxconfigd kadb1 ONLINE
cvm_vxconfigd kadb2 ONLINE
-------------------------------------------------------------------------
cssd kadb1 ONLINE
cssd kadb2 ONLINE
arch-mnt-res kadb1 ONLINE
arch-mnt-res kadb2 ONLINE
data-mnt-res kadb1 ONLINE
-------------------------------------------------------------------------
data-mnt-res kadb2 ONLINE
datadg-res kadb1 ONLINE
datadg-res kadb2 ONLINE

3.1.2 启动服务组
#hagrp –online <service group name> -sys <host name>
#hagrp –online cvm –sys kadb1

3.1.3 停止服务组
#hagrp –offline <service group name> -sys <host name>
#hagrp –offline cvm –sys kadb1

3.1.4 切换服务组
这个操作相当于在一边停止服务组，在另一边驱动服务组
#hagrp –switch <service group name> -to <host name>
#hagrp –switch ClusterService –to kadb1

3.1.5 停止某个资源
#hares –offline <resource name> -sys <host name>
#hares –offline cssd –sys kadb1

3.1.6启动某个资源
#hares –online <resource name> -sys <host name>
#hares –online cssd –sys kadb1

3.1.7发现某个资源出错后清除错误
#hares –clear <resource name> -sys <host name>
# hares -clear cssd -sys kadb1

3.1.8如果资源无法启动或停止需要flush状态
#hagrp –flush <service group name> -sys <host name>
# hagrp -flush rac-sg -sys kadb1

3.1.9查看心跳信息
jxysdb1:/#gabconfig -a
GAB Port Memberships
===============================================================
Port a gen 705d01 membership 01
Port b gen 705d07 membership 01
Port d gen 705d06 membership 01
Port f gen 705d0f membership 01
Port h gen 705d05 membership 01
Port o gen 705d04 membership 01
Port v gen 705d0b membership 01
Port w gen 705d0d membership 01

3.1.10查看cluster支持RAC的状态
jxysdb1:/#vxdctl -c mode
mode: enabled: cluster active - SLAVE
master: jxysdb2
相当与oracle中的lsnodes

3.1.11查看磁盘状态
# vxdisk -o alldgs list
DEVICE TYPE DISK GROUP STATUS
disk_0 auto:LVM - - LVM
disk_1 auto:LVM - - LVM
ibm_ds8x000_5000 auto:cdsdisk ibm_ds8x000_0 datadg online shared
ibm_ds8x000_5001 auto:cdsdisk ibm_ds8x000_1 datadg online shared
ibm_ds8x000_5100 auto:cdsdisk ibm_ds8x000_2 datadg online shared
ibm_ds8x000_5101 auto:cdsdisk ibm_ds8x000_3 datadg online shared
ibm_ds8x000_5200 auto:cdsdisk ibm_ds8x000_4 datadg online shared
ibm_ds8x000_5300 auto:cdsdisk ibm_ds8x000_5 datadg online shared
ibm_ds8x000_5301 auto:cdsdisk ibm_ds8x000_6 datadg online shared
ibm_ds8x000_5400 auto:cdsdisk ibm_ds8x000_7 datadg online shared
ibm_ds8x000_5401 auto:cdsdisk ibm_ds8x000_8 datadg online shared
ibm_ds8x000_5500 auto:cdsdisk ibm_ds8x000_9 datadg online shared
ibm_ds8x000_5501 auto:cdsdisk ibm_ds8x000_10 datadg online shared
ibm_ds8x000_5600 auto:cdsdisk ibm_ds8x000_11 datadg online shared
ibm_ds8x000_5601 auto:cdsdisk ibm_ds8x000_12 datadg online shared
ibm_ds8x000_5700 auto:cdsdisk ibm_ds8x000_13 datadg online shared
ibm_ds8x000_5701 auto:cdsdisk ibm_ds8x000_14 datadg online shared
ibm_ds8x000_9004 auto:cdsdisk ibm_ds8x000_15 ocrvotedg online shared
ibm_ds8x000_9104 auto:cdsdisk ibm_ds8x000_16 ocrvotedg online shared
ibm_ds8x000_9204 auto:cdsdisk - (vxfencoorddg) online
ibm_ds8x000_9304 auto:cdsdisk - (vxfencoorddg) online
ibm_ds8x000_9404 auto:cdsdisk - (vxfencoorddg) online
#
3.1.12查看 disk group 状态

# vxdg list
NAME STATE ID
datadg enabled,shared,cds 1318391345.111.wlmhdb1
ocrvotedg enabled,shared,cds 1318391230.109.wlmhdb1

3.1.13查看disk group 剩余空间
# vxdg free
GROUP DISK DEVICE TAG OFFSET LENGTH FLAGS
datadg ibm_ds8x000_4 ibm_ds8x000_5200 ibm_ds8x000_5200 185440320 24199600 -
datadg ibm_ds8x000_12 ibm_ds8x000_5601 ibm_ds8x000_5601 170920560 38719360 -
datadg ibm_ds8x000_13 ibm_ds8x000_5700 ibm_ds8x000_5700 0 209639920 -
datadg ibm_ds8x000_14 ibm_ds8x000_5701 ibm_ds8x000_5701 0 209639920 -
ocrvotedg ibm_ds8x000_15 ibm_ds8x000_9004 ibm_ds8x000_9004 1946144 81120 -
ocrvotedg ibm_ds8x000_16 ibm_ds8x000_9104 ibm_ds8x000_9104 1946144 81120 -
3.1.14查看 volume 的状态

# vxprint -v
Disk group: datadg

TY NAME ASSOC KSTATE LENGTH PLOFFS STATE TUTIL0 PUTIL0
v archvol fsgen ENABLED 1638400000 - ACTIVE - -
v datavol fsgen ENABLED 1024000000 - ACTIVE - -

Disk group: ocrvotedg

TY NAME ASSOC KSTATE LENGTH PLOFFS STATE TUTIL0 PUTIL0
v ocrvotevol fsgen ENABLED 1945600 - ACTIVE - -
v ocrvotevol_dcl gen ENABLED 544 - ACTIVE - -

# vxprint -htf
Disk group: datadg

DG NAME NCONFIG NLOG MINORS GROUP-ID
ST NAME STATE DM_CNT SPARE_CNT APPVOL_CNT
DM NAME DEVICE TYPE PRIVLEN PUBLEN STATE
RV NAME RLINK_CNT KSTATE STATE PRIMARY DATAVOLS SRL
RL NAME RVG KSTATE STATE REM_HOST REM_DG REM_RLNK
CO NAME CACHEVOL KSTATE STATE
VT NAME RVG KSTATE STATE NVOLUME
V NAME RVG/VSET/CO KSTATE STATE LENGTH READPOL PREFPLEX UTYPE
PL NAME VOLUME KSTATE STATE LENGTH LAYOUT NCOL/WID MODE
SD NAME PLEX DISK DISKOFFS LENGTH [COL/]OFF DEVICE MODE
SV NAME PLEX VOLNAME NVOLLAYR LENGTH [COL/]OFF AM/NM MODE
SC NAME PLEX CACHE DISKOFFS LENGTH [COL/]OFF DEVICE MODE
DC NAME PARENTVOL LOGVOL
SP NAME SNAPVOL DCO
EX NAME ASSOC VC PERMS MODE STATE
SR NAME KSTATE

dg datadg default default 52000 1318391345.111.wlmhdb1

dm ibm_ds8x000_0 ibm_ds8x000_5000 auto 65536 209639920 -
dm ibm_ds8x000_1 ibm_ds8x000_5001 auto 65536 209639920 -
dm ibm_ds8x000_2 ibm_ds8x000_5100 auto 65536 209639920 -
dm ibm_ds8x000_3 ibm_ds8x000_5101 auto 65536 209639920 -
dm ibm_ds8x000_4 ibm_ds8x000_5200 auto 65536 209639920 -
dm ibm_ds8x000_5 ibm_ds8x000_5300 auto 65536 209639920 -
dm ibm_ds8x000_6 ibm_ds8x000_5301 auto 65536 209639920 -
dm ibm_ds8x000_7 ibm_ds8x000_5400 auto 65536 209639920 -
dm ibm_ds8x000_8 ibm_ds8x000_5401 auto 65536 209639920 -
dm ibm_ds8x000_9 ibm_ds8x000_5500 auto 65536 209639920 -
dm ibm_ds8x000_10 ibm_ds8x000_5501 auto 65536 209639920 -
dm ibm_ds8x000_11 ibm_ds8x000_5600 auto 65536 209639920 -
dm ibm_ds8x000_12 ibm_ds8x000_5601 auto 65536 209639920 -
dm ibm_ds8x000_13 ibm_ds8x000_5700 auto 65536 209639920 -
dm ibm_ds8x000_14 ibm_ds8x000_5701 auto 65536 209639920 -

v archvol - ENABLED ACTIVE 1638400000 SELECT - fsgen
pl archvol-01 archvol ENABLED ACTIVE 1638400000 CONCAT - RW
sd ibm_ds8x000_5-01 archvol-01 ibm_ds8x000_5 0 209639920 0 ibm_ds8x000_5300 ENA
sd ibm_ds8x000_6-01 archvol-01 ibm_ds8x000_6 0 209639920 209639920 ibm_ds8x000_5301 ENA
sd ibm_ds8x000_7-01 archvol-01 ibm_ds8x000_7 0 209639920 419279840 ibm_ds8x000_5400 ENA
sd ibm_ds8x000_8-01 archvol-01 ibm_ds8x000_8 0 209639920 628919760 ibm_ds8x000_5401 ENA
sd ibm_ds8x000_9-01 archvol-01 ibm_ds8x000_9 0 209639920 838559680 ibm_ds8x000_5500 ENA
sd ibm_ds8x000_10-01 archvol-01 ibm_ds8x000_10 0 209639920 1048199600 ibm_ds8x000_5501 ENA
sd ibm_ds8x000_11-01 archvol-01 ibm_ds8x000_11 0 209639920 1257839520 ibm_ds8x000_5600 ENA
sd ibm_ds8x000_12-01 archvol-01 ibm_ds8x000_12 0 170920560 1467479440 ibm_ds8x000_5601 ENA

v datavol - ENABLED ACTIVE 1024000000 SELECT - fsgen
pl datavol-01 datavol ENABLED ACTIVE 1024000000 CONCAT - RW
sd ibm_ds8x000_0-01 datavol-01 ibm_ds8x000_0 0 209639920 0 ibm_ds8x000_5000 ENA
sd ibm_ds8x000_1-01 datavol-01 ibm_ds8x000_1 0 209639920 209639920 ibm_ds8x000_5001 ENA
sd ibm_ds8x000_2-01 datavol-01 ibm_ds8x000_2 0 209639920 419279840 ibm_ds8x000_5100 ENA
sd ibm_ds8x000_3-01 datavol-01 ibm_ds8x000_3 0 209639920 628919760 ibm_ds8x000_5101 ENA
sd ibm_ds8x000_4-01 datavol-01 ibm_ds8x000_4 0 185440320 838559680 ibm_ds8x000_5200 ENA

Disk group: ocrvotedg

DG NAME NCONFIG NLOG MINORS GROUP-ID
ST NAME STATE DM_CNT SPARE_CNT APPVOL_CNT
DM NAME DEVICE TYPE PRIVLEN PUBLEN STATE
RV NAME RLINK_CNT KSTATE STATE PRIMARY DATAVOLS SRL
RL NAME RVG KSTATE STATE REM_HOST REM_DG REM_RLNK
CO NAME CACHEVOL KSTATE STATE
VT NAME RVG KSTATE STATE NVOLUME
V NAME RVG/VSET/CO KSTATE STATE LENGTH READPOL PREFPLEX UTYPE
PL NAME VOLUME KSTATE STATE LENGTH LAYOUT NCOL/WID MODE
SD NAME PLEX DISK DISKOFFS LENGTH [COL/]OFF DEVICE MODE
SV NAME PLEX VOLNAME NVOLLAYR LENGTH [COL/]OFF AM/NM MODE
SC NAME PLEX CACHE DISKOFFS LENGTH [COL/]OFF DEVICE MODE
DC NAME PARENTVOL LOGVOL
SP NAME SNAPVOL DCO
EX NAME ASSOC VC PERMS MODE STATE
SR NAME KSTATE

dg ocrvotedg default default 60000 1318391230.109.wlmhdb1

dm ibm_ds8x000_15 ibm_ds8x000_9004 auto 65536 2027264 -
dm ibm_ds8x000_16 ibm_ds8x000_9104 auto 65536 2027264 -

v ocrvotevol - ENABLED ACTIVE 1945600 SELECT - fsgen
pl ocrvotevol-01 ocrvotevol ENABLED ACTIVE 1945600 CONCAT - RW
sd ibm_ds8x000_15-01 ocrvotevol-01 ibm_ds8x000_15 0 1945600 0 ibm_ds8x000_9004 ENA
pl ocrvotevol-02 ocrvotevol ENABLED ACTIVE 1945600 CONCAT - RW
sd ibm_ds8x000_16-01 ocrvotevol-02 ibm_ds8x000_16 0 1945600 0 ibm_ds8x000_9104 ENA
dc ocrvotevol_dco ocrvotevol ocrvotevol_dcl
v ocrvotevol_dcl - ENABLED ACTIVE 544 SELECT - gen
pl ocrvotevol_dcl-01 ocrvotevol_dcl ENABLED ACTIVE 544 CONCAT - RW
sd ibm_ds8x000_15-02 ocrvotevol_dcl-01