mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: Yu Kuai <yukuai1@huaweicloud.com>
To: Xiao Ni <xni@redhat.com>, Yu Kuai <yukuai1@huaweicloud.com>
Cc: paul.e.luse@linux.intel.com, song@kernel.org, neilb@suse.com,
	shli@fb.com, linux-raid@vger.kernel.org,
	linux-kernel@vger.kernel.org, yi.zhang@huawei.com,
	yangerkun@huawei.com, "yukuai (C)" <yukuai3@huawei.com>
Subject: Re: [PATCH md-6.9 06/10] md/raid1: factor out read_first_rdev() from read_balance()
Date: Tue, 27 Feb 2024 09:06:44 +0800	[thread overview]
Message-ID: <4f2ae964-5030-907e-bc06-4d9e1fc8f3e8@huaweicloud.com> (raw)
In-Reply-To: <CALTww2-ypx2YJOeXTzj7Y0EtXMkfrTOAJzzmDnnUK=1irspWtQ@mail.gmail.com>

Hi,

在 2024/02/26 22:16, Xiao Ni 写道:
> On Thu, Feb 22, 2024 at 4:04 PM Yu Kuai <yukuai1@huaweicloud.com> wrote:
>>
>> From: Yu Kuai <yukuai3@huawei.com>
>>
>> read_balance() is hard to understand because there are too many status
>> and branches, and it's overlong.
>>
>> This patch factor out the case to read the first rdev from
>> read_balance(), there are no functional changes.
>>
>> Co-developed-by: Paul Luse <paul.e.luse@linux.intel.com>
>> Signed-off-by: Paul Luse <paul.e.luse@linux.intel.com>
>> Signed-off-by: Yu Kuai <yukuai3@huawei.com>
>> ---
>>   drivers/md/raid1.c | 63 +++++++++++++++++++++++++++++++++-------------
>>   1 file changed, 46 insertions(+), 17 deletions(-)
>>
>> diff --git a/drivers/md/raid1.c b/drivers/md/raid1.c
>> index 8089c569e84f..08c45ca55a7e 100644
>> --- a/drivers/md/raid1.c
>> +++ b/drivers/md/raid1.c
>> @@ -579,6 +579,47 @@ static sector_t align_to_barrier_unit_end(sector_t start_sector,
>>          return len;
>>   }
>>
>> +static void update_read_sectors(struct r1conf *conf, int disk,
>> +                               sector_t this_sector, int len)
>> +{
>> +       struct raid1_info *info = &conf->mirrors[disk];
>> +
>> +       atomic_inc(&info->rdev->nr_pending);
>> +       if (info->next_seq_sect != this_sector)
>> +               info->seq_start = this_sector;
>> +       info->next_seq_sect = this_sector + len;
>> +}
>> +
>> +static int choose_first_rdev(struct r1conf *conf, struct r1bio *r1_bio,
>> +                            int *max_sectors)
>> +{
>> +       sector_t this_sector = r1_bio->sector;
>> +       int len = r1_bio->sectors;
>> +       int disk;
>> +
>> +       for (disk = 0 ; disk < conf->raid_disks * 2 ; disk++) {
>> +               struct md_rdev *rdev;
>> +               int read_len;
>> +
>> +               if (r1_bio->bios[disk] == IO_BLOCKED)
>> +                       continue;
>> +
>> +               rdev = conf->mirrors[disk].rdev;
>> +               if (!rdev || test_bit(Faulty, &rdev->flags))
>> +                       continue;
>> +
>> +               /* choose the first disk even if it has some bad blocks. */
>> +               read_len = raid1_check_read_range(rdev, this_sector, &len);
>> +               if (read_len > 0) {
>> +                       update_read_sectors(conf, disk, this_sector, read_len);
>> +                       *max_sectors = read_len;
>> +                       return disk;
>> +               }
> 
> Hi Kuai
> 
> It needs to update max_sectors even if the bad block starts before
> this_sector. Because it can't read more than bad_blocks from other
> member disks. If it reads more data than bad blocks, it will cause
> data corruption. One rule here is read from the primary disk (the
> first readable disk) if it has no bad block and read the
> badblock-data-length data from other disks.

Noted that raid1_check_read_range() will return readable length from
this rdev, hence if bad block starts before this_sector, 0 is returned,
and 'len' is updated to the length of badblocks(if not exceed read
range), and following iteration will find the first disk to read updated
'len' data and update max_sectors.

Thanks,
Kuai

> 
> Best Regards
> Xiao
> 
>> +       }
>> +
>> +       return -1;
>> +}
>> +
>>   /*
>>    * This routine returns the disk from which the requested read should
>>    * be done. There is a per-array 'next expected sequential IO' sector
>> @@ -603,7 +644,6 @@ static int read_balance(struct r1conf *conf, struct r1bio *r1_bio, int *max_sect
>>          sector_t best_dist;
>>          unsigned int min_pending;
>>          struct md_rdev *rdev;
>> -       int choose_first;
>>
>>    retry:
>>          sectors = r1_bio->sectors;
>> @@ -613,10 +653,11 @@ static int read_balance(struct r1conf *conf, struct r1bio *r1_bio, int *max_sect
>>          best_pending_disk = -1;
>>          min_pending = UINT_MAX;
>>          best_good_sectors = 0;
>> -       choose_first = raid1_should_read_first(conf->mddev, this_sector,
>> -                                              sectors);
>>          clear_bit(R1BIO_FailFast, &r1_bio->state);
>>
>> +       if (raid1_should_read_first(conf->mddev, this_sector, sectors))
>> +               return choose_first_rdev(conf, r1_bio, max_sectors);
>> +
>>          for (disk = 0 ; disk < conf->raid_disks * 2 ; disk++) {
>>                  sector_t dist;
>>                  sector_t first_bad;
>> @@ -662,8 +703,6 @@ static int read_balance(struct r1conf *conf, struct r1bio *r1_bio, int *max_sect
>>                                   * bad_sectors from another device..
>>                                   */
>>                                  bad_sectors -= (this_sector - first_bad);
>> -                               if (choose_first && sectors > bad_sectors)
>> -                                       sectors = bad_sectors;
>>                                  if (best_good_sectors > sectors)
>>                                          best_good_sectors = sectors;
>>
>> @@ -673,8 +712,6 @@ static int read_balance(struct r1conf *conf, struct r1bio *r1_bio, int *max_sect
>>                                          best_good_sectors = good_sectors;
>>                                          best_disk = disk;
>>                                  }
>> -                               if (choose_first)
>> -                                       break;
>>                          }
>>                          continue;
>>                  } else {
>> @@ -689,10 +726,6 @@ static int read_balance(struct r1conf *conf, struct r1bio *r1_bio, int *max_sect
>>
>>                  pending = atomic_read(&rdev->nr_pending);
>>                  dist = abs(this_sector - conf->mirrors[disk].head_position);
>> -               if (choose_first) {
>> -                       best_disk = disk;
>> -                       break;
>> -               }
>>                  /* Don't change to another disk for sequential reads */
>>                  if (conf->mirrors[disk].next_seq_sect == this_sector
>>                      || dist == 0) {
>> @@ -760,13 +793,9 @@ static int read_balance(struct r1conf *conf, struct r1bio *r1_bio, int *max_sect
>>                  rdev = conf->mirrors[best_disk].rdev;
>>                  if (!rdev)
>>                          goto retry;
>> -               atomic_inc(&rdev->nr_pending);
>> -               sectors = best_good_sectors;
>> -
>> -               if (conf->mirrors[best_disk].next_seq_sect != this_sector)
>> -                       conf->mirrors[best_disk].seq_start = this_sector;
>>
>> -               conf->mirrors[best_disk].next_seq_sect = this_sector + sectors;
>> +               sectors = best_good_sectors;
>> +               update_read_sectors(conf, disk, this_sector, sectors);
>>          }
>>          *max_sectors = sectors;
>>
>> --
>> 2.39.2
>>
>>
> 
> .
> 


  reply	other threads:[~2024-02-27  1:06 UTC|newest]

Thread overview: 42+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2024-02-22  7:57 [PATCH md-6.9 00/10] md/raid1: refactor read_balance() and some minor fix Yu Kuai
2024-02-22  7:57 ` [PATCH md-6.9 01/10] md: add a new helper rdev_has_badblock() Yu Kuai
2024-02-26  9:01   ` Xiao Ni
2024-02-22  7:57 ` [PATCH md-6.9 02/10] md: record nonrot rdevs while adding/removing rdevs to conf Yu Kuai
2024-02-26 13:12   ` Xiao Ni
2024-02-26 13:25     ` Yu Kuai
2024-02-26 13:27       ` Xiao Ni
2024-02-22  7:57 ` [PATCH md-6.9 03/10] md/raid1: fix choose next idle in read_balance() Yu Kuai
2024-02-26  8:55   ` Xiao Ni
2024-02-26  9:12     ` Yu Kuai
2024-02-26  9:24       ` Xiao Ni
2024-02-26  9:40         ` Yu Kuai
2024-02-26 13:20           ` Xiao Ni
2024-02-27  2:23   ` Xiao Ni
2024-02-27  2:38     ` Yu Kuai
2024-02-27  4:49       ` Xiao Ni
2024-02-27 14:26         ` Luse, Paul E
2024-02-22  7:58 ` [PATCH md-6.9 04/10] md/raid1-10: add a helper raid1_check_read_range() Yu Kuai
2024-02-26  9:15   ` Xiao Ni
2024-02-22  7:58 ` [PATCH md-6.9 05/10] md/raid1-10: factor out a new helper raid1_should_read_first() Yu Kuai
2024-02-26 13:46   ` Xiao Ni
2024-02-22  7:58 ` [PATCH md-6.9 06/10] md/raid1: factor out read_first_rdev() from read_balance() Yu Kuai
2024-02-26 14:16   ` Xiao Ni
2024-02-27  1:06     ` Yu Kuai [this message]
2024-02-27  1:23       ` Xiao Ni
2024-02-27  1:42         ` Xiao Ni
2024-02-27  1:43         ` Yu Kuai
2024-02-27  2:50           ` Xiao Ni
2024-02-27  2:50   ` Xiao Ni
2024-02-22  7:58 ` [PATCH md-6.9 07/10] md/raid1: factor out choose_slow_rdev() " Yu Kuai
2024-02-26 14:44   ` Xiao Ni
2024-02-22  7:58 ` [PATCH md-6.9 08/10] md/raid1: factor out choose_bb_rdev() " Yu Kuai
2024-02-27  1:50   ` Xiao Ni
2024-02-22  7:58 ` [PATCH md-6.9 09/10] md/raid1: factor out the code to manage sequential IO Yu Kuai
2024-02-27  2:04   ` Xiao Ni
2024-02-22  7:58 ` [PATCH md-6.9 10/10] md/raid1: factor out helpers to choose the best rdev from read_balance() Yu Kuai
2024-02-27  4:47   ` Xiao Ni
2024-02-22  8:40 ` [PATCH md-6.9 00/10] md/raid1: refactor read_balance() and some minor fix Paul Menzel
2024-02-22  9:08   ` Yu Kuai
2024-02-22 13:04     ` Luse, Paul E
2024-02-22 15:30       ` Paul Menzel
2024-02-27  0:27 ` Song Liu

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4f2ae964-5030-907e-bc06-4d9e1fc8f3e8@huaweicloud.com \
    --to=yukuai1@huaweicloud.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-raid@vger.kernel.org \
    --cc=neilb@suse.com \
    --cc=paul.e.luse@linux.intel.com \
    --cc=shli@fb.com \
    --cc=song@kernel.org \
    --cc=xni@redhat.com \
    --cc=yangerkun@huawei.com \
    --cc=yi.zhang@huawei.com \
    --cc=yukuai3@huawei.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®