SUN cluster 双机服务添加新磁盘
因业务需要，需在现有环境中添加两个新存储lun
环境如下：
两台solaris 系统使用sun cluster软件配置为双机系统，
运行oracle数据库服务，模式为主备。
第一步
存储划分合适配置的空间，并完成主机映射。
第二步
主机识别存储空间并配置
映射完成后，使用
dmesg
命令可以查看到主机已经检测到新lun信息，磁盘号和存储lun号一致。
Mar 19 11:15:39 T71CWSERV2 scsi: ssd6 at scsi_vhci0: unit-address g6000b08414b30303336363233390007a: g6000b08414b30303336363233390007a Mar 19 11:15:39 T71CWSERV2 genunix: ssd6 is /scsi_vhci/ssd@g6000b08414b30303336363233390007a Mar 19 11:15:39 T71CWSERV2 scsi: WARNING: /scsi_vhci/ssd@g6000b08414b30303336363233390007a (ssd6): Mar 19 11:15:39 T71CWSERV2 Corrupt label; wrong magic number Mar 19 11:15:39 T71CWSERV2 genunix: WARNING: Page83 data not standards compliant Oracle Oracle FS1-2 6203 Mar 19 11:15:39 T71CWSERV2 genunix: /scsi_vhci/ssd@g6000b08414b30303336363233390007a (ssd6) online Mar 19 11:15:39 T71CWSERV2 genunix: /scsi_vhci/ssd@g6000b08414b30303336363233390007a (ssd6) multipath status: degraded: path 25 fp1/ssd@w2100000e1ec7e9a0,6 is online Mar 19 11:15:39 T71CWSERV2 genunix: /scsi_vhci/ssd@g6000b08414b30303336363233390007a (ssd6) multipath status: optimal: path 26 fp0/ssd@w2100000e1ec7ea70,6 is online: Load balancing: round-robin Mar 19 11:15:39 T71CWSERV2 scsi: WARNING: /scsi_vhci/ssd@g6000b08414b30303336363233390007a (ssd6): Mar 19 11:15:39 T71CWSERV2 Corrupt label; wrong magic number Mar 19 11:15:40 T71CWSERV2 genunix: WARNING: Page83 data not standards compliant Oracle Oracle FS1-2 6203 Mar 19 11:15:40 T71CWSERV2 last message repeated 13 times Mar 19 11:15:40 T71CWSERV2 genunix: /scsi_vhci/ssd@g6000b08414b30303336363233390007a (ssd6) multipath status: optimal: path 27 fp1/ssd@w2100000e1ec7ebc0,6 is online: Load balancing: round-robin Mar 19 11:15:40 T71CWSERV2 genunix: /scsi_vhci/ssd@g6000b08414b30303336363233390007a (ssd6) multipath status: optimal: path 28 fp0/ssd@w2100000e1ec7e9b0,6 is online: Load balancing: round-robin
使用format 进行新磁盘laber操作。
查看现有did磁盘
root@T71CWSERV2 # scdidadm -l 1 T71CWSERV2:/dev/rdsk/c0d0 /dev/did/rdsk/d1 2 T71CWSERV2:/dev/rdsk/c0d1 /dev/did/rdsk/d2 3 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900074d0 /dev/did/rdsk/d3 4 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900078d0 /dev/did/rdsk/d4 5 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900077d0 /dev/did/rdsk/d5 6 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900076d0 /dev/did/rdsk/d6 7 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900075d0 /dev/did/rdsk/d7 8 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900034d0 /dev/did/rdsk/d8
root@T71CWSERV2 # scdidadm -L 1 T71CWSERV2:/dev/rdsk/c0d0 /dev/did/rdsk/d1 2 T71CWSERV2:/dev/rdsk/c0d1 /dev/did/rdsk/d2 3 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900074d0 /dev/did/rdsk/d3 3 T72CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900074d0 /dev/did/rdsk/d3 4 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900078d0 /dev/did/rdsk/d4 4 T72CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900078d0 /dev/did/rdsk/d4 5 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900077d0 /dev/did/rdsk/d5 5 T72CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900077d0 /dev/did/rdsk/d5 6 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900076d0 /dev/did/rdsk/d6 6 T72CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900076d0 /dev/did/rdsk/d6 7 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900075d0 /dev/did/rdsk/d7 7 T72CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900075d0 /dev/did/rdsk/d7 8 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900034d0 /dev/did/rdsk/d8 8 T72CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900034d0 /dev/did/rdsk/d8 9 T72CWSERV2:/dev/rdsk/c0d0 /dev/did/rdsk/d9 10 T72CWSERV2:/dev/rdsk/c0d1 /dev/did/rdsk/d10
识别新的lun为did磁盘
root@T71CWSERV2 # scdidadm -L 1 T71CWSERV2:/dev/rdsk/c0d0 /dev/did/rdsk/d1 2 T71CWSERV2:/dev/rdsk/c0d1 /dev/did/rdsk/d2 3 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900074d0 /dev/did/rdsk/d3 3 T72CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900074d0 /dev/did/rdsk/d3 4 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900078d0 /dev/did/rdsk/d4 4 T72CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900078d0 /dev/did/rdsk/d4 5 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900077d0 /dev/did/rdsk/d5 5 T72CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900077d0 /dev/did/rdsk/d5 6 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900076d0 /dev/did/rdsk/d6 6 T72CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900076d0 /dev/did/rdsk/d6 7 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900075d0 /dev/did/rdsk/d7 7 T72CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900075d0 /dev/did/rdsk/d7 8 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900034d0 /dev/did/rdsk/d8 8 T72CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900034d0 /dev/did/rdsk/d8 9 T72CWSERV2:/dev/rdsk/c0d0 /dev/did/rdsk/d9 10 T72CWSERV2:/dev/rdsk/c0d1 /dev/did/rdsk/d10 root@T71CWSERV2 # scgdevs Configuring DID devices did instance 11 created. did subpath T71CWSERV2:/dev/rdsk/c1t6000B08414B30303336363233390007Ad0 created for instance 11. Configuring the /dev/global directory (global devices) devfsadm: no minor name for /global/.devices/node@1//devices/pci@310/pci@1:/SYS/RCSA/PCIE16 obtaining access to all attached disks root@T71CWSERV2 # scdidadm -L 1 T71CWSERV2:/dev/rdsk/c0d0 /dev/did/rdsk/d1 2 T71CWSERV2:/dev/rdsk/c0d1 /dev/did/rdsk/d2 3 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900074d0 /dev/did/rdsk/d3 3 T72CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900074d0 /dev/did/rdsk/d3 4 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900078d0 /dev/did/rdsk/d4 4 T72CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900078d0 /dev/did/rdsk/d4 5 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900077d0 /dev/did/rdsk/d5 5 T72CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900077d0 /dev/did/rdsk/d5 6 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900076d0 /dev/did/rdsk/d6 6 T72CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900076d0 /dev/did/rdsk/d6 7 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900075d0 /dev/did/rdsk/d7 7 T72CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900075d0 /dev/did/rdsk/d7 8 T71CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900034d0 /dev/did/rdsk/d8 8 T72CWSERV2:/dev/rdsk/c1t6000B08414B303033363632333900034d0 /dev/did/rdsk/d8 9 T72CWSERV2:/dev/rdsk/c0d0 /dev/did/rdsk/d9 10 T72CWSERV2:/dev/rdsk/c0d1 /dev/did/rdsk/d10 11 T71CWSERV2:/dev/rdsk/c1t6000B08414B30303336363233390007Ad0 /dev/did/rdsk/d11 11 T72CWSERV2:/dev/rdsk/c1t6000B08414B30303336363233390007Ad0 /dev/did/rdsk/d11
添加磁盘到metaset中
root@T71CWSERV2 # metaset -s cworacle -a /dev/did/dsk/d11 root@T71CWSERV2 # metaset
Set name = cworacle, Set number = 1
Host Owner T71CWSERV2 Yes T72CWSERV2
Drive Dbase
d3 Yes
d4 Yes
d5 Yes
d6 Yes
d7 Yes
d11 Yes
创建条带
root@T71CWSERV2 # metainit -s cworacle d110 1 1 /dev/did/rdsk/d11s0 cworacle/d110: Concat/Stripe is setup
创建文件系统
root@T71CWSERV2 # newfs /dev/md/cworacle/rdsk/d110 newfs: construct a new file system /dev/md/cworacle/rdsk/d110: (y/n)? y Warning: 2800 sector(s) in last cylinder unallocated /dev/md/cworacle/rdsk/d110: 2148099344 sectors in 349626 cylinders of 48 tracks, 128 sectors 1048876.6MB in 21852 cyl groups (16 c/g, 48.00MB/g, 64 i/g) super-block backups (for fsck -F ufs -o b=#) at: 32, 98464, 196896, 295328, 393760, 492192, 590624, 689056, 787488, 885920, Initializing cylinder groups: ............................................................................... ............................................................................... ............................................................................... ............................................................................... ............................................................................... ......................................... super-block backups for last 10 cylinder groups at: 2147158304, 2147256736, 2147355168, 2147453600, 2147552032, 2147650464, 2147748896, 2147847328, 2147945760, 2148044192
修改/etc/vfstab 创建挂载点
修改sun cluster 配置
scrgadm -c -j cworacle_rs -x FilesystemMountPoints="/oracle,/oradata1,/oradata2,/oradata3,/oraback1,/oraback2"