Alex
2016-11-26 15:04:48 UTC
Hi,
I have a set of four WD30EFRX 3TB disks on a fedora24 system in a
RAID5 config, and it appears one of them is failing. I happened to
notice it while just checking 'dmesg' recently.
smartd is running, and I received no alerts, so I wanted to make sure
it was configured properly. I also don't see any indication of drive
problems in the logs.
How can I be sure smartd is running properly? Shouldn't it have
alerted me to the impending problem this drive appears to be having?
Also, the "Rotation Rate" says 5400, but I understood this to be a
7200 RPM drive. Is that not the case?
Please find below my smartctl output as well as the relevant dmesg
output showing the drive failure messages. How serious is this drive
failure message?
# smartctl --all /dev/sde
smartctl 6.5 2016-05-07 r4318 [x86_64-linux-4.7.9-200.fc24.x86_64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Model Family: Western Digital Red
Device Model: WDC WD30EFRX-68EUZN0
Serial Number: WD-WCC4N7HD33ZS
LU WWN Device Id: 5 0014ee 2b6c504e5
Firmware Version: 82.00A82
User Capacity: 3,000,592,982,016 bytes [3.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 5400 rpm
Device is: In smartctl database [for details use: -P show]
ATA Version is: ACS-2 (minor revision not indicated)
SATA Version is: SATA 3.0, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time is: Sat Nov 26 09:57:08 2016 EST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x00) Offline data collection activity
was never started.
Auto Offline Data Collection: Disabled.
Self-test execution status: ( 121) The previous self-test completed having
the read element of the test failed.
Total time to complete Offline
data collection: (40080) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection
on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 2) minutes.
Extended self-test routine
recommended polling time: ( 402) minutes.
Conveyance self-test routine
recommended polling time: ( 5) minutes.
SCT capabilities: (0x703d) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.
SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE
UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x002f 200 200 051 Pre-fail
Always - 352
3 Spin_Up_Time 0x0027 180 179 021 Pre-fail
Always - 5983
4 Start_Stop_Count 0x0032 100 100 000 Old_age
Always - 28
5 Reallocated_Sector_Ct 0x0033 200 200 140 Pre-fail
Always - 2
7 Seek_Error_Rate 0x002e 200 200 000 Old_age
Always - 0
9 Power_On_Hours 0x0032 086 086 000 Old_age
Always - 10719
10 Spin_Retry_Count 0x0032 100 253 000 Old_age
Always - 0
11 Calibration_Retry_Count 0x0032 100 253 000 Old_age
Always - 0
12 Power_Cycle_Count 0x0032 100 100 000 Old_age
Always - 28
192 Power-Off_Retract_Count 0x0032 200 200 000 Old_age
Always - 19
193 Load_Cycle_Count 0x0032 001 001 000 Old_age
Always - 1541419
194 Temperature_Celsius 0x0022 125 112 000 Old_age
Always - 25
196 Reallocated_Event_Count 0x0032 198 198 000 Old_age
Always - 2
197 Current_Pending_Sector 0x0032 200 200 000 Old_age
Always - 3
198 Offline_Uncorrectable 0x0030 100 253 000 Old_age
Offline - 0
199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age
Always - 0
200 Multi_Zone_Error_Rate 0x0008 100 253 000 Old_age
Offline - 0
SMART Error Log Version: 1
No Errors Logged
SMART Self-test log structure revision number 1
Num Test_Description Status Remaining
LifeTime(hours) LBA_of_first_error
# 1 Short offline Completed: read failure 90% 10718
97815064
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
# ps ax|grep smartd
781 ? Ss 0:01 /usr/sbin/smartd -n -q never
# cat /proc/mdstat
Personalities : [raid1] [raid6] [raid5] [raid4]
md125 : active raid1 sdb3[0] sda3[1]
98240 blocks super 1.0 [2/2] [UU]
bitmap: 0/1 pages [0KB], 65536KB chunk
md2 : active raid5 sdf1[4] sdc1[0] sde1[2] sdd1[1]
8790402048 blocks super 1.2 level 5, 512k chunk, algorithm 2 [4/4] [UUUU]
bitmap: 2/22 pages [8KB], 65536KB chunk
md126 : active raid1 sdb2[0] sda2[1]
512704 blocks super 1.2 [2/2] [UU]
bitmap: 0/1 pages [0KB], 65536KB chunk
md127 : active raid1 sda1[1] sdb1[0]
54284288 blocks super 1.2 [2/2] [UU]
bitmap: 1/1 pages [4KB], 65536KB chunk
[2384403.363128] ata5.00: exception Emask 0x0 SAct 0x7fffffff SErr 0x0
action 0x0
[2384403.363955] ata5.00: irq_stat 0x40000008
[2384403.364736] ata5.00: failed command: READ FPDMA QUEUED
[2384403.365537] ata5.00: cmd 60/08:90:98:a1:76/00:00:06:00:00/40 tag
18 ncq 4096 in
res 41/40:00:98:a1:76/00:00:06:00:00/40
Emask 0x409 (media error) <F>
[2384403.367139] ata5.00: status: { DRDY ERR }
[2384403.367919] ata5.00: error: { UNC }
[2384403.369728] ata5.00: configured for UDMA/133
[2384403.370517] sd 4:0:0:0: [sde] tag#18 FAILED Result:
hostbyte=DID_OK driverbyte=DRIVER_SENSE
[2384403.371298] sd 4:0:0:0: [sde] tag#18 Sense Key : Medium Error [current]
[2384403.372089] sd 4:0:0:0: [sde] tag#18 Add. Sense: Unrecovered read
error - auto reallocate failed
[2384403.373630] sd 4:0:0:0: [sde] tag#18 CDB: Read(16) 88 00 00 00 00
00 06 76 a1 98 00 00 00 08 00 00
[2384403.375248] blk_update_request: I/O error, dev sde, sector 108437912
[2384403.376102] ata5: EH complete
Thanks for any ideas
------------------------------------------------------------------------------
I have a set of four WD30EFRX 3TB disks on a fedora24 system in a
RAID5 config, and it appears one of them is failing. I happened to
notice it while just checking 'dmesg' recently.
smartd is running, and I received no alerts, so I wanted to make sure
it was configured properly. I also don't see any indication of drive
problems in the logs.
How can I be sure smartd is running properly? Shouldn't it have
alerted me to the impending problem this drive appears to be having?
Also, the "Rotation Rate" says 5400, but I understood this to be a
7200 RPM drive. Is that not the case?
Please find below my smartctl output as well as the relevant dmesg
output showing the drive failure messages. How serious is this drive
failure message?
# smartctl --all /dev/sde
smartctl 6.5 2016-05-07 r4318 [x86_64-linux-4.7.9-200.fc24.x86_64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Model Family: Western Digital Red
Device Model: WDC WD30EFRX-68EUZN0
Serial Number: WD-WCC4N7HD33ZS
LU WWN Device Id: 5 0014ee 2b6c504e5
Firmware Version: 82.00A82
User Capacity: 3,000,592,982,016 bytes [3.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 5400 rpm
Device is: In smartctl database [for details use: -P show]
ATA Version is: ACS-2 (minor revision not indicated)
SATA Version is: SATA 3.0, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time is: Sat Nov 26 09:57:08 2016 EST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x00) Offline data collection activity
was never started.
Auto Offline Data Collection: Disabled.
Self-test execution status: ( 121) The previous self-test completed having
the read element of the test failed.
Total time to complete Offline
data collection: (40080) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection
on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 2) minutes.
Extended self-test routine
recommended polling time: ( 402) minutes.
Conveyance self-test routine
recommended polling time: ( 5) minutes.
SCT capabilities: (0x703d) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.
SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE
UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x002f 200 200 051 Pre-fail
Always - 352
3 Spin_Up_Time 0x0027 180 179 021 Pre-fail
Always - 5983
4 Start_Stop_Count 0x0032 100 100 000 Old_age
Always - 28
5 Reallocated_Sector_Ct 0x0033 200 200 140 Pre-fail
Always - 2
7 Seek_Error_Rate 0x002e 200 200 000 Old_age
Always - 0
9 Power_On_Hours 0x0032 086 086 000 Old_age
Always - 10719
10 Spin_Retry_Count 0x0032 100 253 000 Old_age
Always - 0
11 Calibration_Retry_Count 0x0032 100 253 000 Old_age
Always - 0
12 Power_Cycle_Count 0x0032 100 100 000 Old_age
Always - 28
192 Power-Off_Retract_Count 0x0032 200 200 000 Old_age
Always - 19
193 Load_Cycle_Count 0x0032 001 001 000 Old_age
Always - 1541419
194 Temperature_Celsius 0x0022 125 112 000 Old_age
Always - 25
196 Reallocated_Event_Count 0x0032 198 198 000 Old_age
Always - 2
197 Current_Pending_Sector 0x0032 200 200 000 Old_age
Always - 3
198 Offline_Uncorrectable 0x0030 100 253 000 Old_age
Offline - 0
199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age
Always - 0
200 Multi_Zone_Error_Rate 0x0008 100 253 000 Old_age
Offline - 0
SMART Error Log Version: 1
No Errors Logged
SMART Self-test log structure revision number 1
Num Test_Description Status Remaining
LifeTime(hours) LBA_of_first_error
# 1 Short offline Completed: read failure 90% 10718
97815064
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
# ps ax|grep smartd
781 ? Ss 0:01 /usr/sbin/smartd -n -q never
# cat /proc/mdstat
Personalities : [raid1] [raid6] [raid5] [raid4]
md125 : active raid1 sdb3[0] sda3[1]
98240 blocks super 1.0 [2/2] [UU]
bitmap: 0/1 pages [0KB], 65536KB chunk
md2 : active raid5 sdf1[4] sdc1[0] sde1[2] sdd1[1]
8790402048 blocks super 1.2 level 5, 512k chunk, algorithm 2 [4/4] [UUUU]
bitmap: 2/22 pages [8KB], 65536KB chunk
md126 : active raid1 sdb2[0] sda2[1]
512704 blocks super 1.2 [2/2] [UU]
bitmap: 0/1 pages [0KB], 65536KB chunk
md127 : active raid1 sda1[1] sdb1[0]
54284288 blocks super 1.2 [2/2] [UU]
bitmap: 1/1 pages [4KB], 65536KB chunk
[2384403.363128] ata5.00: exception Emask 0x0 SAct 0x7fffffff SErr 0x0
action 0x0
[2384403.363955] ata5.00: irq_stat 0x40000008
[2384403.364736] ata5.00: failed command: READ FPDMA QUEUED
[2384403.365537] ata5.00: cmd 60/08:90:98:a1:76/00:00:06:00:00/40 tag
18 ncq 4096 in
res 41/40:00:98:a1:76/00:00:06:00:00/40
Emask 0x409 (media error) <F>
[2384403.367139] ata5.00: status: { DRDY ERR }
[2384403.367919] ata5.00: error: { UNC }
[2384403.369728] ata5.00: configured for UDMA/133
[2384403.370517] sd 4:0:0:0: [sde] tag#18 FAILED Result:
hostbyte=DID_OK driverbyte=DRIVER_SENSE
[2384403.371298] sd 4:0:0:0: [sde] tag#18 Sense Key : Medium Error [current]
[2384403.372089] sd 4:0:0:0: [sde] tag#18 Add. Sense: Unrecovered read
error - auto reallocate failed
[2384403.373630] sd 4:0:0:0: [sde] tag#18 CDB: Read(16) 88 00 00 00 00
00 06 76 a1 98 00 00 00 08 00 00
[2384403.375248] blk_update_request: I/O error, dev sde, sector 108437912
[2384403.376102] ata5: EH complete
Thanks for any ideas
------------------------------------------------------------------------------