Understanding DELL PERC RAID Disk Controllers. Part of cheatsheets to help the MySQL DBA in the administration of MySQL
This document is under development
Understanding PERC RAID Controllers
Overview
Dell 1950 & 2950 systems appear to come standard with PERC RAID controller cards.
Various models include:
- Vendor: DELL Model: PERC 5/i Rev: 1.03
- DELL PERC 6/i 1.11
Tools
On closer inspection there appears to be three different tools that can be used to gain greaterlower level information on these cards.
- For Dell Systems it is possible to install Dell OpenManage Server Administrator which includes a Web GUI and CLI versions of various commands.
- For the specific LSI Logic SAS based MegaRAID driver, LSI provides a MegaCli tool.
- An Open Source project megactl exists
Installation of MegaCli
The LSI website forces you to accept terms before being able to download this tool, so no direct link to the software exists. The following steps will download the software.
- Goto http://www.lsi.com/storage_home/products_home/internal_raid/megaraid_sas/megaraid_sas_8480e
- Select the Support & Downloads tab in the center of the screen
- Scroll to the bottom of the page to the Miscellaneous section, and select the MegaCLI - Linux link.
- Select the I accept link to start the download.
$ su - $ unzip 1.01.39_Linux_Cli.zip Archive: 1.01.39_Linux_Cli.zip inflating: MegaCli-1.01.39-0.i386.rpm inflating: 1.01.39_Linux_Cli.txt $ rpm -i MegaCli-1.01.39-0.i386.rpm $ ls -l /opt/MegaRAID/MegaCli/ total 2044 -rwxr-xr-x 1 root root 2082360 Aug 2 2007 MegaCli64 $ echo "PATH=/opt/MegaRAID/MegaCli:\$PATH;export PATH" > /etc/profile.d/megacli.sh . /etc/profile.d/megacli.sh # For ease of cut/paste with online Docs $ ln -s /opt/MegaRAID/MegaCli/MegaCli64 /opt/MegaRAID/MegaCli/MegaCli
Installation for Ubuntu
The LSI Linux software is rpm only. To install it's best to first install alien.
$ sudo apt-get install -y alien $ alien -- $ sudo alien --to-tgz MegaCli-1.01.39-0.i386.rpm # To install in same directory do cd # cd / $ tar xvfz MegaCli-1.01.39.tgz
MegaCli 2.x Version
It's a pain to find
$ wget http://www.lsi.com/DistributionSystem/AssetDocument/support/downloads/megaraid/miscellaneous/linux/2.00.15_Linux_MegaCLI.zip $ unzip 2.00.15_Linux_MegaCLI.zip $ unzip MegaCliLin.zip $ sudo alien --to-tgz MegaCli-2.00.15-1.i386.rpm $ tar xvfz MegaCli-2.00.15.tgz $ opt/MegaRAID/MegaCli/MegaCli64 -EncInfo -aALLNOTE: While I found this, it still failed to work with Perc 6i on Ubuntu 9.10
MegaCli Output
- Adapter
- Physical Drives
- Logical Drives
$/opt/MegaRAID/MegaCli/MegaCli64 -AdpAllInfo -aALL
Adapter #0
==============================================================================
Versions
================
Product Name : PERC 5/i Integrated
Serial No : 12345
FW Package Build: 5.1.1-0040
Mfg. Data
================
Mfg. Date : 00/00/00
Rework Date : 00/00/00
Revision No : @??A
Image Versions In Flash:
================
Boot Block Version : R.2.3.12
BIOS Version : MT28
MPT Version : MPTFW-00.10.47.00-IT
FW Version : 1.03.10-0216
WebBIOS Version : 1.03-04
Ctrl-R Version : 1.04-017A
Pending Images In Flash
================
None
PCI Info
================
Vendor Id : 1028
Device Id : 0015
SubVendorId : 1028
SubDeviceId : 1f03
Host Interface : PCIE
Number of Frontend Port: 0
Device Interface : PCIE
Number of Backend Port: 8
Port : Address
0 500000e015107ad2
1 500000e015107a12
2 500000e015100922
3 500000e015107b32
4 0000000000000000
5 0000000000000000
6 0000000000000000
7 0000000000000000
HW Configuration
================
SAS Address : 50019b90bf11f700
BBU : Present
Alarm : Absent
NVRAM : Present
Serial Debugger : Present
Memory : Present
Flash : Present
Settings
================
Current Time : 12:29:21 6/2, 2009
Predictive Fail Poll Interval : 300sec
Interrupt Throttle Active Count : 16
Interrupt Throttle Completion : 50us
Rebuild Rate : 30%
PR Rate : 30%
Resynch Rate : 30%
Check Consistency Rate : 30%
Reconstruction Rate : 30%
Cache flush interval : 4s
Max drives to spinup at one time : 2
Delay among spinup groups : 12s
Physical drive coercion mode : 128MB
Cluster mode : Disabled
Alarm : Disabled
Auto Rebuild : Enabled
Battery Warning : Enabled
Ecc Bucket Size : 15
Ecc Bucket Leak Rate : 1440 Minutes
Restore HotSpare On Insertion : Disabled
Expose Enclosure Devices : Disabled
Maintain PD Fail History : Disabled
Host Request Reordering : Enabled
Capabilities
================
RAID Level Supported : RAID0, RAID1, RAID5, RAID10, RAID50
Supported Drives : SAS, SATA
Allowed Mixing:
Mix In Enclosure Allowed
Status
================
ECC Bucket Count : 0
Limitations
================
Max Arms Per VD : 32
Max Spans Per VD : 8
Max Arrays : 128
Max Number of VDs : 64
Max Parallel Commands : 1008
Max SGE Count : 80
Max Data Transfer Size : 8192 sectors
Max Strips PerIO : 84
Min Stripe Size : 8kB
Max Stripe Size : 128kB
Device Present
================
Virtual Drives : 1
Degraded : 0
Offline : 0
Physical Devices : 5
Disks : 4
Critical Disks : 0
Failed Disks : 0
Supported Adapter Operations
================
Rebuild Rate : Yes
CC Rate : Yes
BGI Rate : Yes
Reconstruct Rate : Yes
Patrol Read Rate : Yes
Alarm Control : Yes
Cluster Support : No
BBU : Yes
Spanning : Yes
Dedicated Hot Spare : Yes
Revertible Hot Spares : No
Foreign Config Import : Yes
Self Diagnostic : Yes
Allow Mixed Redundancy On Array : No
Global Hot Spares : Yes
Deny SCSI Passthrough : No
Deny SMP Passthrough : No
Deny STP Passthrough : No
Supported VD Operations
================
Read Policy : Yes
Write Policy : Yes
IO Policy : Yes
Access Policy : Yes
Disk Cache Policy : Yes
Reconstruction : Yes
Deny Locate : No
Deny CC : No
Supported PD Operations
================
Force Online : Yes
Force Offline : Yes
Force Rebuild : Yes
Deny Force Failed : No
Deny Force Good/Bad : No
Deny Missing Replace : No
Deny Clear : No
Deny Locate : No
Error Counters
================
Memory Correctable Errors : 0
Memory Uncorrectable Errors : 0
Cluster Information
================
Cluster Permitted : No
Cluster Active : No
Default Settings
================
Phy Polarity : 0
Phy PolaritySplit : 0
Backgroud Rate : 30
Stripe Size : 64kB
Flush Time : 4 seconds
Write Policy : WB
Read Policy : None
Cache When BBU Bad : Disabled
Cached IO : No
SMART Mode : Mode 6
Alarm Disable : No
Coercion Mode : 128MB
ZCR Config : IDSEL
Dirty LED Shows Drive Activity : No
BIOS Continue On Error : No
Spin Down Mode : None
Allowed Device Type : SAS/SATA Mix
Allow Mix In Enclosure : Yes
Allow Mix In VD : No
Allow SATA In Cluster : No
Max Chained Enclosures : 1
Disable Ctrl-R : No
Enable Web BIOS : No
Direct PD Mapping : No
BIOS Enumerate VDs : No
Restore Hot Spare On Insertion : No
Expose Enclosure Devices : No
Maintain PD Fail History : No
Disable Puncturing : No
Zero Based Enclosure Enumeration: No
PreBoot CLI Enabled : Yes
LED Show Drive Activity : No
Cluster Disable : Yes
SAS Disable : No
Perc 6/i
Adapter #0
==============================================================================
Versions
================
Product Name : PERC 6/i Integrated
Serial No : 1122334455667788
FW Package Build: 6.2.0-0013
Mfg. Data
================
Mfg. Date : 06/24/08
Rework Date : 06/24/08
Revision No :
Battery FRU : N/A
Image Versions in Flash:
================
FW Version : 1.22.02-0612
BIOS Version : 2.04.00
WebBIOS Version : 1.1-46-e_15-Rel
Ctrl-R Version : 1.02-015B
Preboot CLI Version: 01.00-023:#%00006
Boot Block Version : 1.00.00.01-0011
Pending Images in Flash
================
None
PCI Info
================
Vendor Id : 1000
Device Id : 0060
SubVendorId : 1028
SubDeviceId : 1f0c
Host Interface : PCIE
Number of Frontend Port: 0
Device Interface : PCIE
Number of Backend Port: 8
Port : Address
0 500000e113902f12
1 500000e113910332
2 500000e113907bf2
3 500000e1139034e2
4 500000e1138ffd92
5 500000e1138fdff2
6 0000000000000000
7 0000000000000000
HW Configuration
================
SAS Address : 5a4badb011c89600
BBU : Present
Alarm : Absent
NVRAM : Present
Serial Debugger : Present
Memory : Present
Flash : Present
Memory Size : 256MB
TPM : Absent
Settings
================
Current Time : 19:48:59 8/2, 2010
Predictive Fail Poll Interval : 300sec
Interrupt Throttle Active Count : 16
Interrupt Throttle Completion : 50us
Rebuild Rate : 30%
PR Rate : 30%
Resynch Rate : 30%
Check Consistency Rate : 30%
Reconstruction Rate : 30%
Cache Flush Interval : 4s
Max Drives to Spinup at One Time : 2
Delay Among Spinup Groups : 12s
Physical Drive Coercion Mode : 128MB
Cluster Mode : Disabled
Alarm : Disabled
Auto Rebuild : Enabled
Battery Warning : Enabled
Ecc Bucket Size : 15
Ecc Bucket Leak Rate : 1440 Minutes
Restore HotSpare on Insertion : Disabled
Expose Enclosure Devices : Disabled
Maintain PD Fail History : Disabled
Host Request Reordering : Enabled
Auto Detect BackPlane Enabled : SGPIO/i2c SEP
Load Balance Mode : Auto
Use FDE Only : No
Security Key Assigned : No
Security Key Failed : No
Security Key Not Backedup : No
Any Offline VD Cache Preserved : No
Capabilities
================
RAID Level Supported : RAID0, RAID1, RAID5, RAID6, RAID10, RAID50, RAID60, PRL 11, PRL 11 with spanning, SRL 3 supported
Supported Drives : SAS, SATA
Allowed Mixing:
Mix in Enclosure Allowed
Status
================
ECC Bucket Count : 0
Limitations
================
Max Arms Per VD : 32
Max Spans Per VD : 8
Max Arrays : 128
Max Number of VDs : 64
Max Parallel Commands : 1008
Max SGE Count : 80
Max Data Transfer Size : 8192 sectors
Max Strips PerIO : 42
Min Stripe Size : 8 KB
Max Stripe Size : 1.0 MB
Device Present
================
Virtual Drives : 1
Degraded : 0
Offline : 0
Physical Devices : 7
Disks : 6
Critical Disks : 0
Failed Disks : 0
Supported Adapter Operations
================
Rebuild Rate : Yes
CC Rate : Yes
BGI Rate : Yes
Reconstruct Rate : Yes
Patrol Read Rate : Yes
Alarm Control : Yes
Cluster Support : No
BBU : Yes
Spanning : Yes
Dedicated Hot Spare : Yes
Revertible Hot Spares : Yes
Foreign Config Import : Yes
Self Diagnostic : Yes
Allow Mixed Redundancy on Array : No
Global Hot Spares : Yes
Deny SCSI Passthrough : No
Deny SMP Passthrough : No
Deny STP Passthrough : No
Support Security : No
Supported VD Operations
================
Read Policy : Yes
Write Policy : Yes
IO Policy : Yes
Access Policy : Yes
Disk Cache Policy : Yes
Reconstruction : Yes
Deny Locate : No
Deny CC : No
Allow Ctrl Encryption: No
Supported PD Operations
================
Force Online : Yes
Force Offline : Yes
Force Rebuild : Yes
Deny Force Failed : No
Deny Force Good/Bad : No
Deny Missing Replace : No
Deny Clear : No
Deny Locate : No
Disable Copyback : No
Enable Copyback on SMART : No
Enable Copyback to SSD on SMART Error : No
Enable SSD Patrol Read : No
Error Counters
================
Memory Correctable Errors : 0
Memory Uncorrectable Errors : 0
Cluster Information
================
Cluster Permitted : No
Cluster Active : No
Default Settings
================
Phy Polarity : 0
Phy PolaritySplit : 0
Background Rate : 30
Stripe Size : 64kB
Flush Time : 4 seconds
Write Policy : WB
Read Policy : None
Cache When BBU Bad : Disabled
Cached IO : No
SMART Mode : Mode 6
Alarm Disable : No
Coercion Mode : 128MB
ZCR Config : Unknown
Dirty LED Shows Drive Activity : No
BIOS Continue on Error : No
Spin Down Mode : None
Allowed Device Type : SAS/SATA Mix
Allow Mix in Enclosure : Yes
Allow HDD SAS/SATA Mix in VD : No
Allow SSD SAS/SATA Mix in VD : No
Allow HDD/SSD Mix in VD : No
Allow SATA in Cluster : No
Max Chained Enclosures : 1
Disable Ctrl-R : No
Enable Web BIOS : No
Direct PD Mapping : Yes
BIOS Enumerate VDs : Yes
Restore Hot Spare on Insertion : No
Expose Enclosure Devices : No
Maintain PD Fail History : No
Disable Puncturing : No
Zero Based Enclosure Enumeration : Yes
PreBoot CLI Enabled : No
LED Show Drive Activity : No
Cluster Disable : Yes
SAS Disable : No
Auto Detect BackPlane Enable : SGPIO/i2c SEP
Use FDE Only : No
Enable Led Header : No
Delay during POST : 0
Exit Code: 0x00
$ /opt/MegaRAID/MegaCli/MegaCli64 -LDPDInfo -aall Adapter #0 Number of Virtual Disks: 1 Virtual Disk: 0 (target id: 0) Name:Virtual Disk 0 RAID Level: Primary-5, Secondary-0, RAID Level Qualifier-3 Size:208128MB State: Optimal Stripe Size: 64kB Number Of Drives:4 Span Depth:1 Default Cache Policy: WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU Current Cache Policy: WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU Access Policy: Read/Write Disk Cache Policy: Disk's Default Number of Spans: 1 Span: 0 - Number of PDs: 4 PD: 0 Information Enclosure Device ID: 8 Slot Number: 0 Device Id: 0 Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 Raw Size: 70007MB [0x88bb93a Sectors] Non Coerced Size: 69495MB [0x87bb93a Sectors] Coerced Size: 69376MB [0x8780000 Sectors] Firmware state: Online SAS Address(0): 0x500000e015107ad2 SAS Address(1): 0x0 Connected Port Number: 0 Inquiry Data: FUJITSU MAY2073RC D108B363P7305KAU PD: 1 Information Enclosure Device ID: 8 Slot Number: 1 Device Id: 1 Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 Raw Size: 70007MB [0x88bb93a Sectors] Non Coerced Size: 69495MB [0x87bb93a Sectors] Coerced Size: 69376MB [0x8780000 Sectors] Firmware state: Online SAS Address(0): 0x500000e015107a12 SAS Address(1): 0x0 Connected Port Number: 1 Inquiry Data: FUJITSU MAY2073RC D108B363P7305KAJ PD: 2 Information Enclosure Device ID: 8 Slot Number: 2 Device Id: 2 Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 Raw Size: 70007MB [0x88bb93a Sectors] Non Coerced Size: 69495MB [0x87bb93a Sectors] Coerced Size: 69376MB [0x8780000 Sectors] Firmware state: Online SAS Address(0): 0x500000e015100922 SAS Address(1): 0x0 Connected Port Number: 2 Inquiry Data: FUJITSU MAY2073RC D108B363P7305JSW PD: 3 Information Enclosure Device ID: 8 Slot Number: 3 Device Id: 3 Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 Raw Size: 70007MB [0x88bb93a Sectors] Non Coerced Size: 69495MB [0x87bb93a Sectors] Coerced Size: 69376MB [0x8780000 Sectors] Firmware state: Online SAS Address(0): 0x500000e015107b32 SAS Address(1): 0x0 Connected Port Number: 3 Inquiry Data: FUJITSU MAY2073RC D108B363P7305KB1
$ MegaCli -LDInfo -Lall -aALL
Adapter 0 -- Virtual Drive Information:
Virtual Disk: 0 (target id: 0)
Name:Virtual Disk 0
RAID Level: Primary-5, Secondary-0, RAID Level Qualifier-3
Size:208128MB
State: Optimal
Stripe Size: 64kB
Number Of Drives:4
Span Depth:1
Default Cache Policy: WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU
Current Cache Policy: WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU
Access Policy: Read/Write
Disk Cache Policy: Disk's Default
[root@alpha ~]# MegaCli -PDList -aALL
Adapter #0
Enclosure Device ID: 8
Slot Number: 0
Device Id: 0
Sequence Number: 2
Media Error Count: 0
Other Error Count: 0
Predictive Failure Count: 0
Last Predictive Failure Event Seq Number: 0
Raw Size: 70007MB [0x88bb93a Sectors]
Non Coerced Size: 69495MB [0x87bb93a Sectors]
Coerced Size: 69376MB [0x8780000 Sectors]
Firmware state: Online
SAS Address(0): 0x500000e015107ad2
SAS Address(1): 0x0
Connected Port Number: 0
Inquiry Data: FUJITSU MAY2073RC D108B363P7305KAU
Enclosure Device ID: 8
Slot Number: 1
Device Id: 1
Sequence Number: 2
Media Error Count: 0
Other Error Count: 0
Predictive Failure Count: 0
Last Predictive Failure Event Seq Number: 0
Raw Size: 70007MB [0x88bb93a Sectors]
Non Coerced Size: 69495MB [0x87bb93a Sectors]
Coerced Size: 69376MB [0x8780000 Sectors]
Firmware state: Online
SAS Address(0): 0x500000e015107a12
SAS Address(1): 0x0
Connected Port Number: 1
Inquiry Data: FUJITSU MAY2073RC D108B363P7305KAJ
Enclosure Device ID: 8
Slot Number: 2
Device Id: 2
Sequence Number: 2
Media Error Count: 0
Other Error Count: 0
Predictive Failure Count: 0
Last Predictive Failure Event Seq Number: 0
Raw Size: 70007MB [0x88bb93a Sectors]
Non Coerced Size: 69495MB [0x87bb93a Sectors]
Coerced Size: 69376MB [0x8780000 Sectors]
Firmware state: Online
SAS Address(0): 0x500000e015100922
SAS Address(1): 0x0
Connected Port Number: 2
Inquiry Data: FUJITSU MAY2073RC D108B363P7305JSW
Enclosure Device ID: 8
Slot Number: 3
Device Id: 3
Sequence Number: 2
Media Error Count: 0
Other Error Count: 0
Predictive Failure Count: 0
Last Predictive Failure Event Seq Number: 0
Raw Size: 70007MB [0x88bb93a Sectors]
Non Coerced Size: 69495MB [0x87bb93a Sectors]
Coerced Size: 69376MB [0x8780000 Sectors]
Firmware state: Online
SAS Address(0): 0x500000e015107b32
SAS Address(1): 0x0
Connected Port Number: 3
Inquiry Data: FUJITSU MAY2073RC D108B363P7305KB1
Battery
$ MegaCli -AdpBbuCmd -aALL
^M
BBU status for Adapter: 0
BatteryType: BBU
Voltage: 4058 mV
Current: 0 mA
Temperature: 23 C
Firmware Status: 00000000
Battery state:
GasGuageStatus:
Fully Discharged : No
Fully Charged : Yes
Discharging : Yes
Initialized : Yes
Remaining Time Alarm : No
Remaining Capacity Alarm: No
Discharge Terminated : No
Over Temperature : No
Charging Terminated : No
Over Charged : No
Relative State of Charge: 100 %
Charger Status: Complete
Remaining Capacity: 1665 mAh
Full Charge Capacity: 1665 mAh
isSOHGood: Yes
BBU Capacity Info for Adapter: 0
Relative State of Charge: 100 %
Absolute State of charge: 88 %
Remaining Capacity: 1665 mAh
Full Charge Capacity: 1665 mAh
Run time to empty: 65535 Min
Average time to empty: 65535 Min
Average Time to full: 65535 Min
Cycle Count: 11
Max Error: 100 %
Remaining Capacity Alarm: 190 mAh
Remaining Time Alarm: 10 Min
BBU Design Info for Adapter: 0
Date of Manufacture: 03/16, 2007
Design Capacity: 1900 mAh
Design Voltage: 3700 mV
Specification Info: 8000
oSerial Number: 3262
Pack Stat Configuration: 0xe4ac
Manufacture Name: SMP-PA
Device Name: X848373
Device Chemistry: LION
BBU Properties for Adapter: 0
Auto Learn Period: 7776000 Sec
Next Learn time: 304978518 Sec
Learn Delay Interval:0 Hours
Auto-Learn Mode: Enabled
Other References
These links contains information that helped in generating this page, however not information was also found to be complete or accurate.
DELL PERC5/i Integrated (LSI Logic MegaRAID)Dell/LSI Mega raid CLI command cheatsheet
RAID System performance surprises
RAID and Storage Linux Notes