From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1755967AbZGGHVk (ORCPT ); Tue, 7 Jul 2009 03:21:40 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1753393AbZGGHVd (ORCPT ); Tue, 7 Jul 2009 03:21:33 -0400 Received: from cantor.suse.de ([195.135.220.2]:48476 "EHLO mx1.suse.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1750939AbZGGHVc (ORCPT ); Tue, 7 Jul 2009 03:21:32 -0400 Date: Tue, 07 Jul 2009 09:21:34 +0200 Message-ID: From: Takashi Iwai To: David Howells Cc: Linux filesystem caching discussion list , LKML Subject: Re: [Linux-cachefs] CacheFiles: Readpage failed on backing file In-Reply-To: References: <6950.1245661098@redhat.com> User-Agent: Wanderlust/2.12.0 (Your Wildest Dreams) SEMI/1.14.6 (Maruoka) FLIM/1.14.7 (=?ISO-8859-4?Q?Sanj=F2?=) APEL/10.6 Emacs/22.3 (x86_64-suse-linux-gnu) MULE/5.0 (SAKAKI) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=US-ASCII Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org At Mon, 22 Jun 2009 16:54:39 +0200, I wrote: > > At Mon, 22 Jun 2009 09:58:18 +0100, > David Howells wrote: > > > > Christian Kujau wrote: > > > > > [ 399.332346] [] ? ext3_truncate+0x26a/0x9e0 > > > > Can you try the attached patch, please? > > I've got similar messages with the very latest Linus git tree, > and tried you patch, but still gives the same error. > > The log is below. FWIW, it's on ext3. The bug is still present on 2.6.31-rc2. Takashi > > > thanks, > > Takashi > > === > > FS-Cache: Netfs 'nfs' registered for caching > > ======================================================= > [ INFO: possible circular locking dependency detected ] > 2.6.30-test #7 > ------------------------------------------------------- > swapper/0 is trying to acquire lock: > (&cwq->lock){-.-...}, at: [] __queue_work+0x1f/0x4e > > but task is already holding lock: > (&q->lock){-.-.-.}, at: [] __wake_up+0x26/0x5c > > which lock already depends on the new lock. > > > the existing dependency chain (in reverse order) is: > > -> #1 (&q->lock){-.-.-.}: > [] __lock_acquire+0xfd6/0x12d5 > [] lock_acquire+0xb7/0xeb > [] _spin_lock_irqsave+0x3d/0x5e > [] __wake_up+0x26/0x5c > [] insert_work+0x7b/0x95 > [] __queue_work+0x2e/0x4e > [] delayed_work_timer_fn+0x3c/0x4f > [] run_timer_softirq+0x180/0x206 > [] __do_softirq+0xc3/0x18d > [] do_softirq+0x44/0x7a > [] irq_exit+0x43/0x87 > [] smp_apic_timer_interrupt+0x7c/0x9b > [] apic_timer_interrupt+0x36/0x40 > [] cpu_idle+0xa2/0xbe > [] rest_init+0x66/0x79 > [] start_kernel+0x396/0x3ae > [] __init_begin+0x7f/0x98 > [] 0xffffffff > > -> #0 (&cwq->lock){-.-...}: > [] __lock_acquire+0xd26/0x12d5 > [] lock_acquire+0xb7/0xeb > [] _spin_lock_irqsave+0x3d/0x5e > [] __queue_work+0x1f/0x4e > [] queue_work_on+0x48/0x63 > [] queue_work+0x23/0x38 > [] schedule_work+0x1e/0x31 > [] fscache_enqueue_operation+0xc5/0x102 [fscache] > [] cachefiles_read_waiter+0xb3/0xcd [cachefiles] > [] __wake_up_common+0x4c/0x85 > [] __wake_up+0x38/0x5c > [] __wake_up_bit+0x34/0x4b > [] unlock_page+0x55/0x6a > [] mpage_end_io_read+0x4e/0x71 > [] bio_endio+0x31/0x44 > [] req_bio_endio+0xab/0xde > [] blk_update_request+0x17d/0x321 > [] blk_update_bidi_request+0x22/0x62 > [] blk_end_bidi_request+0x25/0x6e > [] blk_end_request+0x1a/0x30 > [] scsi_io_completion+0x193/0x3bb [scsi_mod] > [] scsi_finish_command+0xd9/0xf2 [scsi_mod] > [] scsi_softirq_done+0xf4/0x10d [scsi_mod] > [] blk_done_softirq+0x6f/0x8e > [] __do_softirq+0xc3/0x18d > [] do_softirq+0x44/0x7a > [] irq_exit+0x43/0x87 > [] do_IRQ+0x8d/0xb2 > [] common_interrupt+0x35/0x40 > [] cpu_idle+0xa2/0xbe > [] rest_init+0x66/0x79 > [] start_kernel+0x396/0x3ae > [] __init_begin+0x7f/0x98 > [] 0xffffffff > > other info that might help us debug this: > > 1 lock held by swapper/0: > #0: (&q->lock){-.-.-.}, at: [] __wake_up+0x26/0x5c > > stack backtrace: > Pid: 0, comm: swapper Not tainted 2.6.30-test #7 > Call Trace: > [] ? printk+0x1d/0x33 > [] print_circular_bug_tail+0xaf/0xcb > [] __lock_acquire+0xd26/0x12d5 > [] ? __queue_work+0x1f/0x4e > [] lock_acquire+0xb7/0xeb > [] ? __queue_work+0x1f/0x4e > [] ? __queue_work+0x1f/0x4e > [] _spin_lock_irqsave+0x3d/0x5e > [] ? __queue_work+0x1f/0x4e > [] __queue_work+0x1f/0x4e > [] queue_work_on+0x48/0x63 > [] queue_work+0x23/0x38 > [] schedule_work+0x1e/0x31 > [] fscache_enqueue_operation+0xc5/0x102 [fscache] > [] cachefiles_read_waiter+0xb3/0xcd [cachefiles] > [] __wake_up_common+0x4c/0x85 > [] __wake_up+0x38/0x5c > [] __wake_up_bit+0x34/0x4b > [] unlock_page+0x55/0x6a > [] mpage_end_io_read+0x4e/0x71 > [] bio_endio+0x31/0x44 > [] req_bio_endio+0xab/0xde > [] blk_update_request+0x17d/0x321 > [] blk_update_bidi_request+0x22/0x62 > [] blk_end_bidi_request+0x25/0x6e > [] blk_end_request+0x1a/0x30 > [] scsi_io_completion+0x193/0x3bb [scsi_mod] > [] ? trace_hardirqs_on+0x19/0x2c > [] ? scsi_device_unbusy+0x92/0xaa [scsi_mod] > [] scsi_finish_command+0xd9/0xf2 [scsi_mod] > [] scsi_softirq_done+0xf4/0x10d [scsi_mod] > [] blk_done_softirq+0x6f/0x8e > [] __do_softirq+0xc3/0x18d > [] do_softirq+0x44/0x7a > [] irq_exit+0x43/0x87 > [] do_IRQ+0x8d/0xb2 > [] common_interrupt+0x35/0x40 > [] ? mwait_idle+0x98/0xec > [] cpu_idle+0xa2/0xbe > [] rest_init+0x66/0x79 > [] start_kernel+0x396/0x3ae > [] __init_begin+0x7f/0x98 > Pid: 2282, comm: kslowd Not tainted 2.6.30-test #7 > Call Trace: > [] cachefiles_read_waiter+0x5a/0xcd [cachefiles] > [] __wake_up_common+0x4c/0x85 > [] __wake_up+0x38/0x5c > [] __wake_up_bit+0x34/0x4b > [] unlock_page+0x55/0x6a > [] ext3_truncate+0x40f/0x79d [ext3] > [] ? trace_hardirqs_on+0x19/0x2c > [] ? vmtruncate+0xe3/0x12e > [] vmtruncate+0xf9/0x12e > [] inode_setattr+0x67/0x149 > [] ext3_setattr+0x170/0x1c6 [ext3] > [] notify_change+0x178/0x2c9 > [] ? mutex_lock_nested+0x259/0x272 > [] cachefiles_attr_changed+0x16f/0x1ef [cachefiles] > [] ? cachefiles_attr_changed+0x16f/0x1ef [cachefiles] > [] cachefiles_lookup_object+0x92/0xc1 [cachefiles] > [] fscache_lookup_object+0xe9/0x10d [fscache] > [] fscache_object_slow_work_execute+0x1b4/0x65e [fscache] > [] ? trace_hardirqs_on+0x19/0x2c > [] slow_work_thread+0x25a/0x435 > [] ? autoremove_wake_function+0x0/0x50 > [] ? slow_work_thread+0x0/0x435 > [] kthread+0x71/0x76 > [] ? kthread+0x0/0x76 > [] kernel_thread_helper+0x7/0x10 > CacheFiles: I/O Error: Readpage failed on backing file 10000810 > FS-Cache: Cache cachefiles stopped due to I/O error > -- > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > Please read the FAQ at http://www.tux.org/lkml/ >