From: Jens Axboe <jens.axboe@oracle.com>
To: linux-kernel@vger.kernel.org
Cc: zach.brown@oracle.com, hch@infradead.org,
Jens Axboe <jens.axboe@oracle.com>
Subject: [PATCH 4/4] direct-io: get rid of irq flag saving where it isn't needed
Date: Tue, 18 Aug 2009 10:35:01 +0200 [thread overview]
Message-ID: <1250584501-31140-5-git-send-email-jens.axboe@oracle.com> (raw)
In-Reply-To: <1250584501-31140-1-git-send-email-jens.axboe@oracle.com>
We use the flags saving variant of the spin lock functions everywhere
in fs/direct-io.c, even in places where we otherwise block. Get rid
of that except for the end_io path, which may indeed be called with
irqs disabled.
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
---
fs/direct-io.c | 24 ++++++++++--------------
1 files changed, 10 insertions(+), 14 deletions(-)
diff --git a/fs/direct-io.c b/fs/direct-io.c
index 0e923f2..2f73593 100644
--- a/fs/direct-io.c
+++ b/fs/direct-io.c
@@ -259,13 +259,12 @@ dio_bio_alloc(struct dio *dio, struct block_device *bdev,
static void dio_bio_submit(struct dio *dio)
{
struct bio *bio = dio->bio;
- unsigned long flags;
bio->bi_private = dio;
- spin_lock_irqsave(&dio->bio_lock, flags);
+ spin_lock_irq(&dio->bio_lock);
dio->refcount++;
- spin_unlock_irqrestore(&dio->bio_lock, flags);
+ spin_unlock_irq(&dio->bio_lock);
if (dio->is_async && dio->rw == READ)
bio_set_pages_dirty(bio);
@@ -295,10 +294,9 @@ static void dio_cleanup(struct dio *dio)
*/
static struct bio *dio_await_one(struct dio *dio)
{
- unsigned long flags;
struct bio *bio = NULL;
- spin_lock_irqsave(&dio->bio_lock, flags);
+ spin_lock_irq(&dio->bio_lock);
/*
* Wait as long as the list is empty and there are bios in flight. bio
@@ -309,17 +307,17 @@ static struct bio *dio_await_one(struct dio *dio)
while (dio->refcount > 1 && dio->bio_list == NULL) {
__set_current_state(TASK_UNINTERRUPTIBLE);
dio->waiter = current;
- spin_unlock_irqrestore(&dio->bio_lock, flags);
+ spin_unlock_irq(&dio->bio_lock);
io_schedule();
/* wake up sets us TASK_RUNNING */
- spin_lock_irqsave(&dio->bio_lock, flags);
+ spin_lock_irq(&dio->bio_lock);
dio->waiter = NULL;
}
if (dio->bio_list) {
bio = dio->bio_list;
dio->bio_list = bio->bi_private;
}
- spin_unlock_irqrestore(&dio->bio_lock, flags);
+ spin_unlock_irq(&dio->bio_lock);
return bio;
}
@@ -388,14 +386,13 @@ static int dio_bio_reap(struct dio *dio)
if (dio->reap_counter++ >= 64) {
while (dio->bio_list) {
- unsigned long flags;
struct bio *bio;
int ret2;
- spin_lock_irqsave(&dio->bio_lock, flags);
+ spin_lock_irq(&dio->bio_lock);
bio = dio->bio_list;
dio->bio_list = bio->bi_private;
- spin_unlock_irqrestore(&dio->bio_lock, flags);
+ spin_unlock_irq(&dio->bio_lock);
ret2 = dio_bio_complete(dio, bio);
if (ret == 0)
ret = ret2;
@@ -870,7 +867,6 @@ direct_io_worker(struct kiocb *iocb, struct inode *inode,
struct dio_args *args, unsigned blkbits, get_block_t get_block,
dio_iodone_t end_io, struct dio *dio)
{
- unsigned long flags;
int rw = args->rw;
ssize_t ret = 0;
ssize_t ret2;
@@ -984,9 +980,9 @@ direct_io_worker(struct kiocb *iocb, struct inode *inode,
* completion paths can drop their ref and use the remaining count to
* decide to wake the submission path atomically.
*/
- spin_lock_irqsave(&dio->bio_lock, flags);
+ spin_lock_irq(&dio->bio_lock);
ret2 = --dio->refcount;
- spin_unlock_irqrestore(&dio->bio_lock, flags);
+ spin_unlock_irq(&dio->bio_lock);
if (ret2 == 0) {
ret = dio_complete(dio, args->offset, ret);
--
1.6.4.53.g3f55e
next prev parent reply other threads:[~2009-08-18 8:35 UTC|newest]
Thread overview: 13+ messages / expand[flat|nested] mbox.gz Atom feed top
2009-08-18 8:34 [PATCH 0/4] Page based O_DIRECT v2 Jens Axboe
2009-08-18 8:34 ` [PATCH 1/4] direct-io: unify argument passing by adding a dio_args structure Jens Axboe
2009-08-18 8:34 ` [PATCH 2/4] direct-io: make O_DIRECT IO path be page based Jens Axboe
2009-08-18 8:35 ` [PATCH 3/4] direct-io: add a "IO for kernel" flag to kiocb Jens Axboe
2009-08-18 8:35 ` Jens Axboe [this message]
2009-08-19 12:44 ` [PATCH 0/4] Page based O_DIRECT v2 Boaz Harrosh
2009-08-19 13:01 ` Jens Axboe
2009-08-19 19:05 ` Alan D. Brunelle
2009-08-19 22:06 ` Jens Axboe
2009-08-19 22:23 ` Alan D. Brunelle
2009-08-20 10:40 ` Jens Axboe
2009-08-20 23:12 ` Alan D. Brunelle
2009-08-20 10:17 [PATCH 0/6] Lazy workqueues Jens Axboe
2009-08-20 10:17 ` [PATCH 1/4] direct-io: unify argument passing by adding a dio_args structure Jens Axboe
2009-08-20 10:17 ` [PATCH 1/6] workqueue: replace singlethread/freezable/rt parameters and variables with flags Jens Axboe
2009-08-20 10:17 ` [PATCH 2/4] direct-io: make O_DIRECT IO path be page based Jens Axboe
2009-08-20 10:17 ` [PATCH 2/6] workqueue: add support for lazy workqueues Jens Axboe
2009-08-20 10:17 ` [PATCH 3/6] crypto: use " Jens Axboe
2009-08-20 10:17 ` [PATCH 3/4] direct-io: add a "IO for kernel" flag to kiocb Jens Axboe
2009-08-20 10:17 ` [PATCH 4/6] libata: use lazy workqueues for the pio task Jens Axboe
2009-08-20 10:17 ` [PATCH 4/5] loop: support O_DIRECT transfer mode Jens Axboe
2009-08-20 10:17 ` [PATCH 5/6] aio: use lazy workqueues Jens Axboe
2009-08-20 10:17 ` [PATCH 4/4] direct-io: get rid of irq flag saving where it isn't needed Jens Axboe
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1250584501-31140-5-git-send-email-jens.axboe@oracle.com \
--to=jens.axboe@oracle.com \
--cc=hch@infradead.org \
--cc=linux-kernel@vger.kernel.org \
--cc=zach.brown@oracle.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®