From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1756453AbZFVOyu (ORCPT ); Mon, 22 Jun 2009 10:54:50 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1754716AbZFVOyj (ORCPT ); Mon, 22 Jun 2009 10:54:39 -0400 Received: from cantor2.suse.de ([195.135.220.15]:33323 "EHLO mx2.suse.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1755367AbZFVOyh (ORCPT ); Mon, 22 Jun 2009 10:54:37 -0400 Date: Mon, 22 Jun 2009 16:54:39 +0200 Message-ID: From: Takashi Iwai To: David Howells Cc: Linux filesystem caching discussion list , LKML Subject: Re: [Linux-cachefs] CacheFiles: Readpage failed on backing file In-Reply-To: <6950.1245661098@redhat.com> References: <6950.1245661098@redhat.com> User-Agent: Wanderlust/2.12.0 (Your Wildest Dreams) SEMI/1.14.6 (Maruoka) FLIM/1.14.7 (=?ISO-8859-4?Q?Sanj=F2?=) APEL/10.6 Emacs/22.3 (x86_64-suse-linux-gnu) MULE/5.0 (SAKAKI) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=US-ASCII Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org At Mon, 22 Jun 2009 09:58:18 +0100, David Howells wrote: > > Christian Kujau wrote: > > > [ 399.332346] [] ? ext3_truncate+0x26a/0x9e0 > > Can you try the attached patch, please? I've got similar messages with the very latest Linus git tree, and tried you patch, but still gives the same error. The log is below. FWIW, it's on ext3. thanks, Takashi === FS-Cache: Netfs 'nfs' registered for caching ======================================================= [ INFO: possible circular locking dependency detected ] 2.6.30-test #7 ------------------------------------------------------- swapper/0 is trying to acquire lock: (&cwq->lock){-.-...}, at: [] __queue_work+0x1f/0x4e but task is already holding lock: (&q->lock){-.-.-.}, at: [] __wake_up+0x26/0x5c which lock already depends on the new lock. the existing dependency chain (in reverse order) is: -> #1 (&q->lock){-.-.-.}: [] __lock_acquire+0xfd6/0x12d5 [] lock_acquire+0xb7/0xeb [] _spin_lock_irqsave+0x3d/0x5e [] __wake_up+0x26/0x5c [] insert_work+0x7b/0x95 [] __queue_work+0x2e/0x4e [] delayed_work_timer_fn+0x3c/0x4f [] run_timer_softirq+0x180/0x206 [] __do_softirq+0xc3/0x18d [] do_softirq+0x44/0x7a [] irq_exit+0x43/0x87 [] smp_apic_timer_interrupt+0x7c/0x9b [] apic_timer_interrupt+0x36/0x40 [] cpu_idle+0xa2/0xbe [] rest_init+0x66/0x79 [] start_kernel+0x396/0x3ae [] __init_begin+0x7f/0x98 [] 0xffffffff -> #0 (&cwq->lock){-.-...}: [] __lock_acquire+0xd26/0x12d5 [] lock_acquire+0xb7/0xeb [] _spin_lock_irqsave+0x3d/0x5e [] __queue_work+0x1f/0x4e [] queue_work_on+0x48/0x63 [] queue_work+0x23/0x38 [] schedule_work+0x1e/0x31 [] fscache_enqueue_operation+0xc5/0x102 [fscache] [] cachefiles_read_waiter+0xb3/0xcd [cachefiles] [] __wake_up_common+0x4c/0x85 [] __wake_up+0x38/0x5c [] __wake_up_bit+0x34/0x4b [] unlock_page+0x55/0x6a [] mpage_end_io_read+0x4e/0x71 [] bio_endio+0x31/0x44 [] req_bio_endio+0xab/0xde [] blk_update_request+0x17d/0x321 [] blk_update_bidi_request+0x22/0x62 [] blk_end_bidi_request+0x25/0x6e [] blk_end_request+0x1a/0x30 [] scsi_io_completion+0x193/0x3bb [scsi_mod] [] scsi_finish_command+0xd9/0xf2 [scsi_mod] [] scsi_softirq_done+0xf4/0x10d [scsi_mod] [] blk_done_softirq+0x6f/0x8e [] __do_softirq+0xc3/0x18d [] do_softirq+0x44/0x7a [] irq_exit+0x43/0x87 [] do_IRQ+0x8d/0xb2 [] common_interrupt+0x35/0x40 [] cpu_idle+0xa2/0xbe [] rest_init+0x66/0x79 [] start_kernel+0x396/0x3ae [] __init_begin+0x7f/0x98 [] 0xffffffff other info that might help us debug this: 1 lock held by swapper/0: #0: (&q->lock){-.-.-.}, at: [] __wake_up+0x26/0x5c stack backtrace: Pid: 0, comm: swapper Not tainted 2.6.30-test #7 Call Trace: [] ? printk+0x1d/0x33 [] print_circular_bug_tail+0xaf/0xcb [] __lock_acquire+0xd26/0x12d5 [] ? __queue_work+0x1f/0x4e [] lock_acquire+0xb7/0xeb [] ? __queue_work+0x1f/0x4e [] ? __queue_work+0x1f/0x4e [] _spin_lock_irqsave+0x3d/0x5e [] ? __queue_work+0x1f/0x4e [] __queue_work+0x1f/0x4e [] queue_work_on+0x48/0x63 [] queue_work+0x23/0x38 [] schedule_work+0x1e/0x31 [] fscache_enqueue_operation+0xc5/0x102 [fscache] [] cachefiles_read_waiter+0xb3/0xcd [cachefiles] [] __wake_up_common+0x4c/0x85 [] __wake_up+0x38/0x5c [] __wake_up_bit+0x34/0x4b [] unlock_page+0x55/0x6a [] mpage_end_io_read+0x4e/0x71 [] bio_endio+0x31/0x44 [] req_bio_endio+0xab/0xde [] blk_update_request+0x17d/0x321 [] blk_update_bidi_request+0x22/0x62 [] blk_end_bidi_request+0x25/0x6e [] blk_end_request+0x1a/0x30 [] scsi_io_completion+0x193/0x3bb [scsi_mod] [] ? trace_hardirqs_on+0x19/0x2c [] ? scsi_device_unbusy+0x92/0xaa [scsi_mod] [] scsi_finish_command+0xd9/0xf2 [scsi_mod] [] scsi_softirq_done+0xf4/0x10d [scsi_mod] [] blk_done_softirq+0x6f/0x8e [] __do_softirq+0xc3/0x18d [] do_softirq+0x44/0x7a [] irq_exit+0x43/0x87 [] do_IRQ+0x8d/0xb2 [] common_interrupt+0x35/0x40 [] ? mwait_idle+0x98/0xec [] cpu_idle+0xa2/0xbe [] rest_init+0x66/0x79 [] start_kernel+0x396/0x3ae [] __init_begin+0x7f/0x98 Pid: 2282, comm: kslowd Not tainted 2.6.30-test #7 Call Trace: [] cachefiles_read_waiter+0x5a/0xcd [cachefiles] [] __wake_up_common+0x4c/0x85 [] __wake_up+0x38/0x5c [] __wake_up_bit+0x34/0x4b [] unlock_page+0x55/0x6a [] ext3_truncate+0x40f/0x79d [ext3] [] ? trace_hardirqs_on+0x19/0x2c [] ? vmtruncate+0xe3/0x12e [] vmtruncate+0xf9/0x12e [] inode_setattr+0x67/0x149 [] ext3_setattr+0x170/0x1c6 [ext3] [] notify_change+0x178/0x2c9 [] ? mutex_lock_nested+0x259/0x272 [] cachefiles_attr_changed+0x16f/0x1ef [cachefiles] [] ? cachefiles_attr_changed+0x16f/0x1ef [cachefiles] [] cachefiles_lookup_object+0x92/0xc1 [cachefiles] [] fscache_lookup_object+0xe9/0x10d [fscache] [] fscache_object_slow_work_execute+0x1b4/0x65e [fscache] [] ? trace_hardirqs_on+0x19/0x2c [] slow_work_thread+0x25a/0x435 [] ? autoremove_wake_function+0x0/0x50 [] ? slow_work_thread+0x0/0x435 [] kthread+0x71/0x76 [] ? kthread+0x0/0x76 [] kernel_thread_helper+0x7/0x10 CacheFiles: I/O Error: Readpage failed on backing file 10000810 FS-Cache: Cache cachefiles stopped due to I/O error