First look # tw_cli info c2 Unit UnitType Status %RCmpl %V/I/M Stripe Size(GB) Cache AVrfy ------------------------------------------------------------------------------ u0 RAID-5 OK - - 256K 4190.89 ON OFF Port Status Unit Size Blocks Serial --------------------------------------------------------------- p0 OK u0 698.63 GB 1465149168 3QD04LMV p1 OK u0 698.63 GB 1465149168 3QD04NEF p2 OK u0 698.63 GB 1465149168 3QD0271T p3 OK u0 698.63 GB 1465149168 3QD02MLY p4 DEVICE-ERROR u0 698.63 GB 1465149168 3QD04SV3 p5 OK u0 698.63 GB 1465149168 3QD04LQ1 p6 OK u0 698.63 GB 1465149168 3QD04YM8 p7 NOT-PRESENT - - - - kick drive 7 from controller 2 from the raid group # tw_cli /c2/p7 export Removing /c2/p7 will take the disk offline. Do you want to continue ? Y|N [N]: y Removing port /c2/p7 ... Done. root@beast:~# tw_cli info c2 Unit UnitType Status %RCmpl %V/I/M Stripe Size(GB) Cache AVrfy ------------------------------------------------------------------------------ u0 RAID-5 OK - - 256K 4190.89 ON OFF Port Status Unit Size Blocks Serial --------------------------------------------------------------- p0 OK u0 698.63 GB 1465149168 3QD04LMV p1 OK u0 698.63 GB 1465149168 3QD04NEF p2 OK u0 698.63 GB 1465149168 3QD0271T p3 OK u0 698.63 GB 1465149168 3QD02MLY p4 OK u0 698.63 GB 1465149168 3QD04SV3 p5 OK u0 698.63 GB 1465149168 3QD04LQ1 p6 OK u0 698.63 GB 1465149168 3QD04YM8 p7 NOT-PRESENT - - - - root@beast:~# tw_cli /c2 rescan Rescanning controller /c2 for units and drives ...Done. Found the following unit(s): [/c2/u1]. Found the following drive(s): [none]. root@beast:~# tw_cli info c2 Unit UnitType Status %RCmpl %V/I/M Stripe Size(GB) Cache AVrfy ------------------------------------------------------------------------------ u0 RAID-5 OK - - 256K 4190.89 ON OFF u1 RAID-5 INOPERABLE - - 256K 4190.89 OFF OFF Port Status Unit Size Blocks Serial --------------------------------------------------------------- p0 OK u0 698.63 GB 1465149168 3QD04LMV p1 OK u0 698.63 GB 1465149168 3QD04NEF p2 OK u0 698.63 GB 1465149168 3QD0271T p3 OK u0 698.63 GB 1465149168 3QD02MLY p4 OK u0 698.63 GB 1465149168 3QD04SV3 p5 OK u0 698.63 GB 1465149168 3QD04LQ1 p6 OK u0 698.63 GB 1465149168 3QD04YM8 p7 OK u1 698.63 GB 1465149168 3QD04LKV =========================== http://www.freebsddiary.org/3ware-netsaint-plugin.php /cx/ux start rebuild disk=p [ignoreECC] This command allows you to rebuild a DEGRADED unit by using the specified disk=p. Rebuild only applies to redundant arrays such as RAID-1, RAID-5, RAID-10 and RAID-50. During rebuild, bad sectors on the source disk will cause the rebuild to fail. You can allow for the operation to continue via ignoreECC. Rebuild process is a background task and will change the state of a unit to REBUILDING. Various show commands also show a percent completion as rebuilding progresses. Note that the disk to be used to rebuild a unit, must be a SPARE or unconfigured disk. ---------------------------------- //beast> info c2 Unit UnitType Status %RCmpl %V/I/M Stripe Size(GB) Cache AVrfy ------------------------------------------------------------------------------ u0 RAID-5 REBUILDING 0 - 256K 4190.89 ON OFF u1 SPARE OK - - - 698.629 - OFF Port Status Unit Size Blocks Serial --------------------------------------------------------------- p0 OK u0 698.63 GB 1465149168 3QD04LMV p1 OK u0 698.63 GB 1465149168 3QD04NEF p2 OK u0 698.63 GB 1465149168 3QD0271T p3 OK u0 698.63 GB 1465149168 3QD02MLY p4 DEGRADED u0 698.63 GB 1465149168 3QD04SV3 p5 OK u0 698.63 GB 1465149168 3QD04LQ1 p6 OK u0 698.63 GB 1465149168 3QD04YM8 p7 OK u1 698.63 GB 1465149168 3QD04LKV //beast> maint remove c2 p4 Removing port /c2/p4 ... Done. //beast> info c2 Unit UnitType Status %RCmpl %V/I/M Stripe Size(GB) Cache AVrfy ------------------------------------------------------------------------------ u0 RAID-5 DEGRADED - - 256K 4190.89 ON OFF u1 SPARE OK - - - 698.629 - OFF Port Status Unit Size Blocks Serial --------------------------------------------------------------- p0 OK u0 698.63 GB 1465149168 3QD04LMV p1 OK u0 698.63 GB 1465149168 3QD04NEF p2 OK u0 698.63 GB 1465149168 3QD0271T p3 OK u0 698.63 GB 1465149168 3QD02MLY p4 NOT-PRESENT - - - - p5 OK u0 698.63 GB 1465149168 3QD04LQ1 p6 OK u0 698.63 GB 1465149168 3QD04YM8 p7 OK u1 698.63 GB 1465149168 3QD04LKV //beast> maint rebuild c2 u0 p7 Sending rebuild start request to /c2/u0 on 1 disk(s) [7] ... Done. //beast> info c2 Unit UnitType Status %RCmpl %V/I/M Stripe Size(GB) Cache AVrfy ------------------------------------------------------------------------------ u0 RAID-5 REBUILDING 0 - 256K 4190.89 ON OFF Port Status Unit Size Blocks Serial --------------------------------------------------------------- p0 OK u0 698.63 GB 1465149168 3QD04LMV p1 OK u0 698.63 GB 1465149168 3QD04NEF p2 OK u0 698.63 GB 1465149168 3QD0271T p3 OK u0 698.63 GB 1465149168 3QD02MLY p4 NOT-PRESENT - - - - p5 OK u0 698.63 GB 1465149168 3QD04LQ1 p6 OK u0 698.63 GB 1465149168 3QD04YM8 p7 DEGRADED u0 698.63 GB 1465149168 3QD04LKV ====================================== //beast> /c2 show all /c2 Driver Version = 2.26.02.012 /c2 Model = 9650SE-8LPML /c2 Available Memory = 224MB /c2 Firmware Version = FE9X 4.08.00.006 /c2 Bios Version = BE9X 4.08.00.001 /c2 Boot Loader Version = BL9X 3.05.00.002 /c2 Serial Number = L326021A7100195 /c2 PCB Version = Rev 032 /c2 PCHIP Version = 2.00 /c2 ACHIP Version = 1.90 /c2 Number of Ports = 8 /c2 Number of Drives = 8 /c2 Number of Units = 2 /c2 Total Optimal Units = 0 /c2 Not Optimal Units = 2 /c2 JBOD Export Policy = off /c2 Disk Spinup Policy = 1 /c2 Spinup Stagger Time Policy (sec) = 1 /c2 Auto-Carving Policy = off /c2 Auto-Carving Size = 2048 GB /c2 Auto-Rebuild Policy = on /c2 Controller Bus Type = PCIe /c2 Controller Bus Width = 4 lanes /c2 Controller Bus Speed = 2.5 Gbps/lane Unit UnitType Status %RCmpl %V/I/M Stripe Size(GB) Cache AVrfy ------------------------------------------------------------------------------ u0 RAID-5 REBUILDING 1 - 256K 4190.89 OFF OFF u1 RAID-5 INOPERABLE - - 256K 4190.89 OFF OFF Port Status Unit Size Blocks Serial --------------------------------------------------------------- p0 OK u0 698.63 GB 1465149168 3QD04LMV p1 OK u0 698.63 GB 1465149168 3QD04NEF p2 OK u0 698.63 GB 1465149168 3QD0271T p3 OK u0 698.63 GB 1465149168 3QD02MLY p4 DEGRADED u0 698.63 GB 1465149168 3QD04SV3 p5 OK u0 698.63 GB 1465149168 3QD04LQ1 p6 OK u0 698.63 GB 1465149168 3QD04YM8 p7 OK u1 698.63 GB 1465149168 3QD04LKV //beast> ^[[A Error: (CLI:041) Invalid shell command. //beast> /c2/u1 del Deleting /c2/u1 will cause the data on the unit to be permanently lost. Do you want to continue ? Y|N [N]: y Deleting unit c2/u1 ...Done. //beast> /c2/p7 show all /c2/p7 Status = OK /c2/p7 Model = ST3750640AS /c2/p7 Firmware Version = 3.AAC /c2/p7 Serial = 3QD04LKV /c2/p7 Capacity = 698.63 GB (1465149168 Blocks) /c2/p7 Link Speed Supported = 1.5 Gbps and 3.0 Gbps /c2/p7 Link Speed = unknown /c2/p7 NCQ Supported = Yes /c2/p7 NCQ Enabled = Yes /c2/p7 Identify Status = N/A /c2/p7 Belongs to Unit = N/A /c2/p7 Drive Smart Data: 0A 00 01 0F 00 6B 5A 62 FE CE 00 00 00 00 03 03 00 56 55 00 00 00 00 00 00 00 04 32 00 64 64 C4 00 00 00 00 00 00 05 33 00 64 64 1B 00 00 00 00 00 00 07 0F 00 58 3C 11 0F 93 28 00 00 00 09 32 00 51 51 04 43 00 00 00 00 00 0A 13 00 64 64 00 00 00 00 00 00 00 0C 32 00 64 64 C8 00 00 00 00 00 00 BB 32 00 64 64 00 00 00 00 00 00 00 BD 3A 00 64 64 00 00 00 00 00 00 00 BE 22 00 40 34 24 00 23 24 00 00 00 C2 22 00 24 30 24 00 00 00 0D 00 00 C3 1A 00 4E 33 B6 4F B4 03 00 00 00 C5 12 00 63 62 20 00 00 00 00 00 00 C6 10 00 63 62 20 00 00 00 00 00 00 C7 3E 00 C8 C8 00 00 00 00 00 00 00 C8 00 00 64 FD 00 00 00 00 00 00 00 CA 32 00 64 FD 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 82 00 AE 01 00 5B 03 00 01 00 01 CA 02 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 0F 0F 0F 0F 0F 0D 0F 0F 00 00 00 00 00 00 00 00 01 C6 ED 1C 09 00 00 00 00 00 00 47 88 65 7F 60 08 00 00 20 00 00 00 00 00 00 00 00 00 C6 ED 1C 09 00 00 00 00 00 00 00 00 02 00 01 00 00 00 00 00 00 00 3B FE 7A D0 07 00 00 00 50 00 00 00 00 00 00 00 04 43 00 00 00 00 7E 0F 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 51 //beast> /c2 add type=spare disk=7 Creating new unit on controller /c2 ... Done. The new unit is /c2/u1. WARNING: This Spare unit may replace failed drive of same interface type only