From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1755642Ab0AWOJW (ORCPT ); Sat, 23 Jan 2010 09:09:22 -0500 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1755441Ab0AWOJV (ORCPT ); Sat, 23 Jan 2010 09:09:21 -0500 Received: from lucidpixels.com ([75.144.35.66]:42780 "EHLO lucidpixels.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1754960Ab0AWOJU (ORCPT ); Sat, 23 Jan 2010 09:09:20 -0500 Date: Sat, 23 Jan 2010 09:09:19 -0500 (EST) From: Justin Piszcz To: linux-kernel@vger.kernel.org cc: linux-raid@vger.kernel.org, xfs@oss.sgi.com, Alan Piszcz Subject: 2.6.32.3: INFO: task flush-9:3:29267 blocked for more than 120 seconds. Message-ID: User-Agent: Alpine 2.00 (DEB 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; format=flowed; charset=US-ASCII Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hello, I recently saw this under 2.6.32.3: Running raid-1 w/2 raptors & a raid-5 with some 750GB drives. All mdadm / 0.90 superblocks / XFS. Debian Testing x86_64 Is this normal? [1128155.188452] md: data-check of RAID array md0 [1128155.188465] md: minimum _guaranteed_ speed: 30000 KB/sec/disk. [1128155.188468] md: using maximum available idle IO bandwidth (but not more than 50000 KB/sec) for data-check. [1128155.188473] md: using 128k window, over a total of 16787776 blocks. [1128156.201359] md: delaying data-check of md1 until md0 has finished (they share one or more physical units) [1128157.204843] md: delaying data-check of md2 until md1 has finished (they share one or more physical units) [1128157.204907] md: delaying data-check of md1 until md0 has finished (they share one or more physical units) [1128158.208350] md: data-check of RAID array md3 [1128158.208363] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [1128158.208366] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for data-check. [1128158.208373] md: using 128k window, over a total of 732571648 blocks. [1128493.349066] md: md0: data-check done. [1128493.368842] md: data-check of RAID array md1 [1128493.368846] md: delaying data-check of md2 until md1 has finished (they share one or more physical units) [1128493.368864] md: minimum _guaranteed_ speed: 30000 KB/sec/disk. [1128493.368867] md: using maximum available idle IO bandwidth (but not more than 50000 KB/sec) for data-check. [1128493.368871] md: using 128k window, over a total of 136448 blocks. [1128496.003606] md: md1: data-check done. [1128496.026560] md: data-check of RAID array md2 [1128496.026578] md: minimum _guaranteed_ speed: 30000 KB/sec/disk. [1128496.026581] md: using maximum available idle IO bandwidth (but not more than 50000 KB/sec) for data-check. [1128496.026588] md: using 128k window, over a total of 129596288 blocks. [1131179.410906] md: md2: data-check done. [1148640.440503] INFO: task xfssyncd:1655 blocked for more than 120 seconds. [1148640.440516] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [1148640.440520] xfssyncd D ffff88023fb6a028 0 1655 2 0x00000000 [1148640.440533] ffff8800af9693e0 0000000000000046 ffff8801f866e6d8 000000002baa9928 [1148640.440545] 000000000000c928 ffff88023a329fd8 ffff88023f956210 ffff88023f956488 [1148640.440552] 0000000100000000 ffffffff8134cb47 ffff88002828c928 ffff88023f956488 [1148640.440558] Call Trace: [1148640.440572] [] ? get_active_stripe+0x417/0x630 [1148640.440577] [] ? md_write_start+0xb5/0x1b0 [1148640.440583] [] ? autoremove_wake_function+0x0/0x30 [1148640.440587] [] ? release_stripe+0x3d/0x60 [1148640.440592] [] ? make_request+0x3c/0x700 [1148640.440595] [] ? autoremove_wake_function+0x0/0x30 [1148640.440603] [] ? cpumask_next_and+0x23/0x40 [1148640.440606] [] ? md_make_request+0xbc/0x130 [1148640.440612] [] ? generic_make_request+0x1ec/0x2f0 [1148640.440616] [] ? submit_bio+0x5a/0xe0 [1148640.440620] [] ? _xfs_buf_ioapply+0x120/0x280 [1148640.440626] [] ? xfs_buf_iorequest+0x29/0x90 [1148640.440631] [] ? xlog_bdstrat_cb+0x3d/0x50 [1148640.440638] [] ? xlog_sync+0x20b/0x4e0 [1148640.440641] [] ? xlog_state_sync_all+0x1b8/0x230 [1148640.440647] [] ? del_timer_sync+0x1a/0x30 [1148640.440650] [] ? _xfs_log_force+0x6b/0x80 [1148640.440654] [] ? xfs_log_force+0xb/0x40 [1148640.440658] [] ? xfs_sync_worker+0x19/0x60 [1148640.440662] [] ? xfssyncd+0x13c/0x1c0 [1148640.440665] [] ? xfssyncd+0x0/0x1c0 [1148640.440668] [] ? kthread+0x96/0xa0 [1148640.440674] [] ? child_rip+0xa/0x20 [1148640.440680] [] ? kthread+0x0/0xa0 [1148640.440683] [] ? child_rip+0x0/0x20 [1148640.440730] INFO: task flush-9:3:29267 blocked for more than 120 seconds. [1148640.440733] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [1148640.440736] flush-9:3 D ffff88023fb6a028 0 29267 2 0x00000000 [1148640.440743] ffff88023f9578d0 0000000000000046 ffff8801f868e108 ffff880109a41900 [1148640.440749] 000000000000c928 ffff880109a41fd8 ffff88023fa82bf0 ffff88023fa82e68 [1148640.440758] 0000000209a41944 ffffffff811babef 0000000000000000 ffff88023fa82e68 [1148640.440764] Call Trace: [1148640.440770] [] ? xfs_bmap_search_multi_extents+0xaf/0x120 [1148640.440774] [] ? md_write_start+0xb5/0x1b0 [1148640.440780] [] ? autoremove_wake_function+0x0/0x30 [1148640.440784] [] ? make_request+0x3c/0x700 [1148640.440790] [] ? test_set_page_writeback+0xd4/0x170 [1148640.440794] [] ? md_make_request+0xbc/0x130 [1148640.440798] [] ? generic_make_request+0x1ec/0x2f0 [1148640.440805] [] ? xfs_cluster_write+0x11c/0x160 [1148640.440809] [] ? submit_bio+0x5a/0xe0 [1148640.440815] [] ? __mark_inode_dirty+0x68/0x170 [1148640.440819] [] ? xfs_submit_ioend_bio+0x4f/0x70 [1148640.440822] [] ? xfs_submit_ioend+0x9a/0xd0 [1148640.440826] [] ? xfs_page_state_convert+0x3e2/0x6c0 [1148640.440830] [] ? xfs_vm_writepage+0x77/0x130 [1148640.440834] [] ? __writepage+0xa/0x40 [1148640.440840] [] ? write_cache_pages+0x1df/0x3c0 [1148640.440844] [] ? __writepage+0x0/0x40 [1148640.440848] [] ? writeback_single_inode+0xd2/0x390 [1148640.440851] [] ? writeback_inodes_wb+0x3ff/0x5e0 [1148640.440856] [] ? wb_writeback+0x11e/0x1f0 [1148640.440859] [] ? try_to_del_timer_sync+0x5e/0x90 [1148640.440863] [] ? wb_do_writeback+0x17b/0x180 [1148640.440866] [] ? bdi_writeback_task+0x5d/0xa0 [1148640.440871] [] ? bdi_start_fn+0x0/0xf0 [1148640.440874] [] ? bdi_start_fn+0x7e/0xf0 [1148640.440877] [] ? bdi_start_fn+0x0/0xf0 [1148640.440880] [] ? kthread+0x96/0xa0 [1148640.440884] [] ? child_rip+0xa/0x20 [1148640.440888] [] ? kthread+0x0/0xa0 [1148640.440893] [] ? child_rip+0x0/0x20 [1148760.440444] INFO: task xfssyncd:1655 blocked for more than 120 seconds. [1148760.440458] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [1148760.440462] xfssyncd D ffff88023fb6a028 0 1655 2 0x00000000 [1148760.440469] ffff8800af9693e0 0000000000000046 ffff8801f866e6d8 000000002baa9928 [1148760.440483] 000000000000c928 ffff88023a329fd8 ffff88023f956210 ffff88023f956488 [1148760.440489] 0000000100000000 ffffffff8134cb47 ffff88002828c928 ffff88023f956488 [1148760.440497] Call Trace: [1148760.440510] [] ? get_active_stripe+0x417/0x630 [1148760.440516] [] ? md_write_start+0xb5/0x1b0 [1148760.440523] [] ? autoremove_wake_function+0x0/0x30 [1148760.440528] [] ? release_stripe+0x3d/0x60 [1148760.440532] [] ? make_request+0x3c/0x700 [1148760.440536] [] ? autoremove_wake_function+0x0/0x30 [1148760.440542] [] ? cpumask_next_and+0x23/0x40 [1148760.440546] [] ? md_make_request+0xbc/0x130 [1148760.440551] [] ? generic_make_request+0x1ec/0x2f0 [1148760.440556] [] ? submit_bio+0x5a/0xe0 [1148760.440561] [] ? _xfs_buf_ioapply+0x120/0x280 [1148760.440565] [] ? xfs_buf_iorequest+0x29/0x90 [1148760.440572] [] ? xlog_bdstrat_cb+0x3d/0x50 [1148760.440576] [] ? xlog_sync+0x20b/0x4e0 [1148760.440580] [] ? xlog_state_sync_all+0x1b8/0x230 [1148760.440586] [] ? del_timer_sync+0x1a/0x30 [1148760.440590] [] ? _xfs_log_force+0x6b/0x80 [1148760.440593] [] ? xfs_log_force+0xb/0x40 [1148760.440598] [] ? xfs_sync_worker+0x19/0x60 [1148760.440601] [] ? xfssyncd+0x13c/0x1c0 [1148760.440605] [] ? xfssyncd+0x0/0x1c0 [1148760.440609] [] ? kthread+0x96/0xa0 [1148760.440615] [] ? child_rip+0xa/0x20 [1148760.440619] [] ? kthread+0x0/0xa0 [1148760.440623] [] ? child_rip+0x0/0x20 [1148760.440667] INFO: task flush-9:3:29267 blocked for more than 120 seconds. [1148760.440671] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [1148760.440673] flush-9:3 D ffff88023fb6a028 0 29267 2 0x00000000 [1148760.440679] ffff88023f9578d0 0000000000000046 ffff8801f868e108 ffff880109a41900 [1148760.440686] 000000000000c928 ffff880109a41fd8 ffff88023fa82bf0 ffff88023fa82e68 [1148760.440693] 0000000209a41944 ffffffff811babef 0000000000000000 ffff88023fa82e68 [1148760.440701] Call Trace: [1148760.440707] [] ? xfs_bmap_search_multi_extents+0xaf/0x120 [1148760.440711] [] ? md_write_start+0xb5/0x1b0 [1148760.440716] [] ? autoremove_wake_function+0x0/0x30 [1148760.440720] [] ? make_request+0x3c/0x700 [1148760.440725] [] ? test_set_page_writeback+0xd4/0x170 [1148760.440730] [] ? md_make_request+0xbc/0x130 [1148760.440733] [] ? generic_make_request+0x1ec/0x2f0 [1148760.440738] [] ? xfs_cluster_write+0x11c/0x160 [1148760.440742] [] ? submit_bio+0x5a/0xe0 [1148760.440748] [] ? __mark_inode_dirty+0x68/0x170 [1148760.440751] [] ? xfs_submit_ioend_bio+0x4f/0x70 [1148760.440755] [] ? xfs_submit_ioend+0x9a/0xd0 [1148760.440759] [] ? xfs_page_state_convert+0x3e2/0x6c0 [1148760.440764] [] ? xfs_vm_writepage+0x77/0x130 [1148760.440767] [] ? __writepage+0xa/0x40 [1148760.440770] [] ? write_cache_pages+0x1df/0x3c0 [1148760.440774] [] ? __writepage+0x0/0x40 [1148760.440778] [] ? writeback_single_inode+0xd2/0x390 [1148760.440782] [] ? writeback_inodes_wb+0x3ff/0x5e0 [1148760.440786] [] ? wb_writeback+0x11e/0x1f0 [1148760.440791] [] ? try_to_del_timer_sync+0x5e/0x90 [1148760.440794] [] ? wb_do_writeback+0x17b/0x180 [1148760.440798] [] ? bdi_writeback_task+0x5d/0xa0 [1148760.440802] [] ? bdi_start_fn+0x0/0xf0 [1148760.440805] [] ? bdi_start_fn+0x7e/0xf0 [1148760.440808] [] ? bdi_start_fn+0x0/0xf0 [1148760.440812] [] ? kthread+0x96/0xa0 [1148760.440816] [] ? child_rip+0xa/0x20 [1148760.440819] [] ? kthread+0x0/0xa0 [1148760.440822] [] ? child_rip+0x0/0x20 [1148880.440706] INFO: task xfssyncd:1655 blocked for more than 120 seconds. [1148880.440718] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [1148880.440723] xfssyncd D ffff88023fb6a028 0 1655 2 0x00000000 [1148880.440730] ffff8800af9693e0 0000000000000046 ffff8801f866e6d8 000000002baa9928 [1148880.440744] 000000000000c928 ffff88023a329fd8 ffff88023f956210 ffff88023f956488 [1148880.440751] 0000000100000000 ffffffff8134cb47 ffff88002828c928 ffff88023f956488 [1148880.440757] Call Trace: [1148880.440767] [] ? get_active_stripe+0x417/0x630 [1148880.440771] [] ? md_write_start+0xb5/0x1b0 [1148880.440777] [] ? autoremove_wake_function+0x0/0x30 [1148880.440781] [] ? release_stripe+0x3d/0x60 [1148880.440785] [] ? make_request+0x3c/0x700 [1148880.440790] [] ? autoremove_wake_function+0x0/0x30 [1148880.440796] [] ? cpumask_next_and+0x23/0x40 [1148880.440801] [] ? md_make_request+0xbc/0x130 [1148880.440806] [] ? generic_make_request+0x1ec/0x2f0 [1148880.440810] [] ? submit_bio+0x5a/0xe0 [1148880.440817] [] ? _xfs_buf_ioapply+0x120/0x280 [1148880.440820] [] ? xfs_buf_iorequest+0x29/0x90 [1148880.440825] [] ? xlog_bdstrat_cb+0x3d/0x50 [1148880.440829] [] ? xlog_sync+0x20b/0x4e0 [1148880.440832] [] ? xlog_state_sync_all+0x1b8/0x230 [1148880.440838] [] ? del_timer_sync+0x1a/0x30 [1148880.440842] [] ? _xfs_log_force+0x6b/0x80 [1148880.440845] [] ? xfs_log_force+0xb/0x40 [1148880.440849] [] ? xfs_sync_worker+0x19/0x60 [1148880.440853] [] ? xfssyncd+0x13c/0x1c0 [1148880.440856] [] ? xfssyncd+0x0/0x1c0 [1148880.440859] [] ? kthread+0x96/0xa0 [1148880.440864] [] ? child_rip+0xa/0x20 [1148880.440868] [] ? kthread+0x0/0xa0 [1148880.440871] [] ? child_rip+0x0/0x20 [1148880.440914] INFO: task flush-9:3:29267 blocked for more than 120 seconds. [1148880.440917] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [1148880.440919] flush-9:3 D ffff88023fb6a028 0 29267 2 0x00000000 [1148880.440925] ffff88023f9578d0 0000000000000046 ffff8801f868e108 ffff880109a41900 [1148880.440934] 000000000000c928 ffff880109a41fd8 ffff88023fa82bf0 ffff88023fa82e68 [1148880.440944] 0000000209a41944 ffffffff811babef 0000000000000000 ffff88023fa82e68 [1148880.440953] Call Trace: [1148880.440959] [] ? xfs_bmap_search_multi_extents+0xaf/0x120 [1148880.440963] [] ? md_write_start+0xb5/0x1b0 [1148880.440968] [] ? autoremove_wake_function+0x0/0x30 [1148880.440972] [] ? make_request+0x3c/0x700 [1148880.440976] [] ? test_set_page_writeback+0xd4/0x170 [1148880.440982] [] ? md_make_request+0xbc/0x130 [1148880.440987] [] ? generic_make_request+0x1ec/0x2f0 [1148880.440992] [] ? xfs_cluster_write+0x11c/0x160 [1148880.440997] [] ? submit_bio+0x5a/0xe0 [1148880.441002] [] ? __mark_inode_dirty+0x68/0x170 [1148880.441006] [] ? xfs_submit_ioend_bio+0x4f/0x70 [1148880.441009] [] ? xfs_submit_ioend+0x9a/0xd0 [1148880.441013] [] ? xfs_page_state_convert+0x3e2/0x6c0 [1148880.441017] [] ? xfs_vm_writepage+0x77/0x130 [1148880.441020] [] ? __writepage+0xa/0x40 [1148880.441023] [] ? write_cache_pages+0x1df/0x3c0 [1148880.441026] [] ? __writepage+0x0/0x40 [1148880.441030] [] ? writeback_single_inode+0xd2/0x390 [1148880.441034] [] ? writeback_inodes_wb+0x3ff/0x5e0 [1148880.441037] [] ? wb_writeback+0x11e/0x1f0 [1148880.441044] [] ? try_to_del_timer_sync+0x5e/0x90 [1148880.441048] [] ? wb_do_writeback+0x17b/0x180 [1148880.441051] [] ? bdi_writeback_task+0x5d/0xa0 [1148880.441055] [] ? bdi_start_fn+0x0/0xf0 [1148880.441059] [] ? bdi_start_fn+0x7e/0xf0 [1148880.441062] [] ? bdi_start_fn+0x0/0xf0 [1148880.441066] [] ? kthread+0x96/0xa0 [1148880.441069] [] ? child_rip+0xa/0x20 [1148880.441072] [] ? kthread+0x0/0xa0 [1148880.441075] [] ? child_rip+0x0/0x20 [1149000.440407] INFO: task xfssyncd:1655 blocked for more than 120 seconds. [1149000.440421] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [1149000.440427] xfssyncd D ffff88023fb6a028 0 1655 2 0x00000000 [1149000.440438] ffff8800af9693e0 0000000000000046 ffff8801f866e6d8 000000002baa9928 [1149000.440446] 000000000000c928 ffff88023a329fd8 ffff88023f956210 ffff88023f956488 [1149000.440452] 0000000100000000 ffffffff8134cb47 ffff88002828c928 ffff88023f956488 [1149000.440461] Call Trace: [1149000.440475] [] ? get_active_stripe+0x417/0x630 [1149000.440481] [] ? md_write_start+0xb5/0x1b0 [1149000.440488] [] ? autoremove_wake_function+0x0/0x30 [1149000.440493] [] ? release_stripe+0x3d/0x60 [1149000.440497] [] ? make_request+0x3c/0x700 [1149000.440501] [] ? autoremove_wake_function+0x0/0x30 [1149000.440506] [] ? cpumask_next_and+0x23/0x40 [1149000.440510] [] ? md_make_request+0xbc/0x130 [1149000.440515] [] ? generic_make_request+0x1ec/0x2f0 [1149000.440520] [] ? submit_bio+0x5a/0xe0 [1149000.440524] [] ? _xfs_buf_ioapply+0x120/0x280 [1149000.440528] [] ? xfs_buf_iorequest+0x29/0x90 [1149000.440532] [] ? xlog_bdstrat_cb+0x3d/0x50 [1149000.440536] [] ? xlog_sync+0x20b/0x4e0 [1149000.440544] [] ? xlog_state_sync_all+0x1b8/0x230 [1149000.440549] [] ? del_timer_sync+0x1a/0x30 [1149000.440553] [] ? _xfs_log_force+0x6b/0x80 [1149000.440556] [] ? xfs_log_force+0xb/0x40 [1149000.440560] [] ? xfs_sync_worker+0x19/0x60 [1149000.440563] [] ? xfssyncd+0x13c/0x1c0 [1149000.440567] [] ? xfssyncd+0x0/0x1c0 [1149000.440570] [] ? kthread+0x96/0xa0 [1149000.440578] [] ? child_rip+0xa/0x20 [1149000.440582] [] ? kthread+0x0/0xa0 [1149000.440585] [] ? child_rip+0x0/0x20 [1149000.440633] INFO: task flush-9:3:29267 blocked for more than 120 seconds. [1149000.440635] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [1149000.440637] flush-9:3 D ffff88023fb6a028 0 29267 2 0x00000000 [1149000.440643] ffff88023f9578d0 0000000000000046 ffff8801f868e108 ffff880109a41900 [1149000.440654] 000000000000c928 ffff880109a41fd8 ffff88023fa82bf0 ffff88023fa82e68 [1149000.440660] 0000000209a41944 ffffffff811babef 0000000000000000 ffff88023fa82e68 [1149000.440669] Call Trace: [1149000.440676] [] ? xfs_bmap_search_multi_extents+0xaf/0x120 [1149000.440680] [] ? md_write_start+0xb5/0x1b0 [1149000.440684] [] ? autoremove_wake_function+0x0/0x30 [1149000.440687] [] ? make_request+0x3c/0x700 [1149000.440691] [] ? test_set_page_writeback+0xd4/0x170 [1149000.440697] [] ? md_make_request+0xbc/0x130 [1149000.440701] [] ? generic_make_request+0x1ec/0x2f0 [1149000.440710] [] ? xfs_cluster_write+0x11c/0x160 [1149000.440713] [] ? submit_bio+0x5a/0xe0 [1149000.440719] [] ? __mark_inode_dirty+0x68/0x170 [1149000.440723] [] ? xfs_submit_ioend_bio+0x4f/0x70 [1149000.440727] [] ? xfs_submit_ioend+0x9a/0xd0 [1149000.440731] [] ? xfs_page_state_convert+0x3e2/0x6c0 [1149000.440736] [] ? xfs_vm_writepage+0x77/0x130 [1149000.440739] [] ? __writepage+0xa/0x40 [1149000.440743] [] ? write_cache_pages+0x1df/0x3c0 [1149000.440745] [] ? __writepage+0x0/0x40 [1149000.440749] [] ? writeback_single_inode+0xd2/0x390 [1149000.440753] [] ? writeback_inodes_wb+0x3ff/0x5e0 [1149000.440756] [] ? wb_writeback+0x11e/0x1f0 [1149000.440760] [] ? try_to_del_timer_sync+0x5e/0x90 [1149000.440764] [] ? wb_do_writeback+0x17b/0x180 [1149000.440767] [] ? bdi_writeback_task+0x5d/0xa0 [1149000.440774] [] ? bdi_start_fn+0x0/0xf0 [1149000.440776] [] ? bdi_start_fn+0x7e/0xf0 [1149000.440780] [] ? bdi_start_fn+0x0/0xf0 [1149000.440783] [] ? kthread+0x96/0xa0 [1149000.440786] [] ? child_rip+0xa/0x20 [1149000.440790] [] ? kthread+0x0/0xa0 [1149000.440793] [] ? child_rip+0x0/0x20 [1149120.440754] INFO: task xfssyncd:1655 blocked for more than 120 seconds. [1149120.440768] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [1149120.440772] xfssyncd D ffff88023fb6a028 0 1655 2 0x00000000 [1149120.440778] ffff8800af9693e0 0000000000000046 ffff8801f866e6d8 000000002baa9928 [1149120.440786] 000000000000c928 ffff88023a329fd8 ffff88023f956210 ffff88023f956488 [1149120.440792] 0000000100000000 ffffffff8134cb47 ffff88002828c928 ffff88023f956488 [1149120.440802] Call Trace: [1149120.440812] [] ? get_active_stripe+0x417/0x630 [1149120.440817] [] ? md_write_start+0xb5/0x1b0 [1149120.440824] [] ? autoremove_wake_function+0x0/0x30 [1149120.440828] [] ? release_stripe+0x3d/0x60 [1149120.440831] [] ? make_request+0x3c/0x700 [1149120.440835] [] ? autoremove_wake_function+0x0/0x30 [1149120.440840] [] ? cpumask_next_and+0x23/0x40 [1149120.440845] [] ? md_make_request+0xbc/0x130 [1149120.440851] [] ? generic_make_request+0x1ec/0x2f0 [1149120.440855] [] ? submit_bio+0x5a/0xe0 [1149120.440860] [] ? _xfs_buf_ioapply+0x120/0x280 [1149120.440863] [] ? xfs_buf_iorequest+0x29/0x90 [1149120.440869] [] ? xlog_bdstrat_cb+0x3d/0x50 [1149120.440874] [] ? xlog_sync+0x20b/0x4e0 [1149120.440878] [] ? xlog_state_sync_all+0x1b8/0x230 [1149120.440883] [] ? del_timer_sync+0x1a/0x30 [1149120.440886] [] ? _xfs_log_force+0x6b/0x80 [1149120.440889] [] ? xfs_log_force+0xb/0x40 [1149120.440894] [] ? xfs_sync_worker+0x19/0x60 [1149120.440898] [] ? xfssyncd+0x13c/0x1c0 [1149120.440902] [] ? xfssyncd+0x0/0x1c0 [1149120.440906] [] ? kthread+0x96/0xa0 [1149120.440914] [] ? child_rip+0xa/0x20 [1149120.440917] [] ? kthread+0x0/0xa0 [1149120.440920] [] ? child_rip+0x0/0x20 [1149120.440962] INFO: task flush-9:3:29267 blocked for more than 120 seconds. [1149120.440965] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [1149120.440968] flush-9:3 D ffff88023fb6a028 0 29267 2 0x00000000 [1149120.440973] ffff88023f9578d0 0000000000000046 ffff8801f868e108 ffff880109a41900 [1149120.440979] 000000000000c928 ffff880109a41fd8 ffff88023fa82bf0 ffff88023fa82e68 [1149120.440985] 0000000209a41944 ffffffff811babef 0000000000000000 ffff88023fa82e68 [1149120.440992] Call Trace: [1149120.440997] [] ? xfs_bmap_search_multi_extents+0xaf/0x120 [1149120.441001] [] ? md_write_start+0xb5/0x1b0 [1149120.441005] [] ? autoremove_wake_function+0x0/0x30 [1149120.441011] [] ? make_request+0x3c/0x700 [1149120.441015] [] ? test_set_page_writeback+0xd4/0x170 [1149120.441019] [] ? md_make_request+0xbc/0x130 [1149120.441023] [] ? generic_make_request+0x1ec/0x2f0 [1149120.441027] [] ? xfs_cluster_write+0x11c/0x160 [1149120.441030] [] ? submit_bio+0x5a/0xe0 [1149120.441034] [] ? __mark_inode_dirty+0x68/0x170 [1149120.441040] [] ? xfs_submit_ioend_bio+0x4f/0x70 [1149120.441043] [] ? xfs_submit_ioend+0x9a/0xd0 [1149120.441047] [] ? xfs_page_state_convert+0x3e2/0x6c0 [1149120.441052] [] ? xfs_vm_writepage+0x77/0x130 [1149120.441055] [] ? __writepage+0xa/0x40 [1149120.441059] [] ? write_cache_pages+0x1df/0x3c0 [1149120.441062] [] ? __writepage+0x0/0x40 [1149120.441069] [] ? writeback_single_inode+0xd2/0x390 [1149120.441073] [] ? writeback_inodes_wb+0x3ff/0x5e0 [1149120.441076] [] ? wb_writeback+0x11e/0x1f0 [1149120.441080] [] ? try_to_del_timer_sync+0x5e/0x90 [1149120.441083] [] ? wb_do_writeback+0x17b/0x180 [1149120.441086] [] ? bdi_writeback_task+0x5d/0xa0 [1149120.441090] [] ? bdi_start_fn+0x0/0xf0 [1149120.441093] [] ? bdi_start_fn+0x7e/0xf0 [1149120.441096] [] ? bdi_start_fn+0x0/0xf0 [1149120.441101] [] ? kthread+0x96/0xa0 [1149120.441104] [] ? child_rip+0xa/0x20 [1149120.441108] [] ? kthread+0x0/0xa0 [1149120.441112] [] ? child_rip+0x0/0x20 Justin.