Slow I/O with megaraid and u160 scsi jbod

Slow I/O with megaraid and u160 scsi jbod

[Phil Dier]

Hi,

I've had luck with this patch[1] (it at least eliminated the oopses
I was getting), but now I'm having a different sort of problem with
my setup[2] (the 2.6.13 release exhibits this behaviour as well). I
have 2 u160 scsi jbods connected to this machine[3]. One is connected
to an Adaptec card, and the other is connected to the Fusion MPT card
(megaraid). All of the disks connected to the Adaptec card work fine,
but when doing I/O on disks 2 and 3 on the megaraid card, it stalls
considerably. When trying to sync a RAID1 device using the 4 148GB
disks, the sync speed never goes above 2KB/s. When they finally get
synched, IO stalls constantly. Watching with iostat confirms this. I've
formatted the disks in question with a single JFS partition and they
still exhibit this behaviour when used by themselves. I have verified
that this behaviour is not present up until at least 2.6.12.3. Let me
know what info I can collect that would be helpful.. Thanks.



[1] http://www.ussg.iu.edu/hypermail/linux/kernel/0508.1/1952.html
[2] http://www.icglink.com/debug-2.6.13-rc6.html
[3] Diagram:

+---------+
| Adaptec |
+---------+
     |
+-------+-------+-------+-------+-------+
| id: 0 | id: 1 | id: 2 | id: 3 | id: 4 |
| 73GB  | 73GB  | 148GB | 148GB | 73GB  |
+-------+-------+-------+-------+-------+

+----------+
| megaraid |
+----------+
     |
+-------+-------+-------+-------+-------+
| id: 0 | id: 1 | id: 2 | id: 3 | id: 4 |
| 73GB  | 73GB  | 148GB | 148GB | 73GB  |
+-------+-------+-------+-------+-------+

-- 

Phil Dier (ICGLink.com -- 615 370-1530 x733)

/* vim:set noai nocindent ts=8 sw=8: */

Re: Slow I/O with megaraid and u160 scsi jbod

[Phil Dier]

On Mon, 29 Aug 2005 15:03:43 -0400
"Ju, Seokmann" <sju@lsil.com> wrote:

> Hi,
> 
> > formatted the disks in question with a single JFS partition and they
> > still exhibit this behaviour when used by themselves. I have verified
> > that this behaviour is not present up until at least 2.6.12.3. Let me
> > know what info I can collect that would be helpful.. Thanks.
> Can you please specify following?
> - driver version on 2.6.12.3

>From Documentation/scsi/ChangeLog.megaraid:
Release Date    : Thu Feb 03 12:27:22 EST 2005 - Seokmann Ju <sju@lsil.com>
Current Version : 2.20.4.5 (scsi module), 2.20.2.5 (cmm module)
Older Version   : 2.20.4.4 (scsi module), 2.20.2.4 (cmm module)


> - F/W version on the controller you are using.
> 

scsi2 : ioc0: LSI53C1030, FwRev=01013d00h, Ports=1, MaxQ=255, IRQ=24
                          ^^^^^^^^^^^^^^^

Is this it?  If not, how do you find it?




-- 

Phil Dier (ICGLink.com -- 615 370-1530 x733)

/* vim:set noai nocindent ts=8 sw=8: */

RE: Slow I/O with megaraid and u160 scsi jbod

[Ju, Seokmann]

Hi,

> formatted the disks in question with a single JFS partition and they
> still exhibit this behaviour when used by themselves. I have verified
> that this behaviour is not present up until at least 2.6.12.3. Let me
> know what info I can collect that would be helpful.. Thanks.
Can you please specify following?
- driver version on 2.6.12.3
- F/W version on the controller you are using.

Thank you.

> -----Original Message-----
> From: Phil Dier [mailto:phil@icglink.com] 
> Sent: Monday, August 29, 2005 2:14 PM
> To: linux-kernel@vger.kernel.org
> Cc: Scott Holdren; ziggy; Jack Massari
> Subject: Slow I/O with megaraid and u160 scsi jbod
> 
> Hi,
> 
> I've had luck with this patch[1] (it at least eliminated the oopses
> I was getting), but now I'm having a different sort of problem with
> my setup[2] (the 2.6.13 release exhibits this behaviour as well). I
> have 2 u160 scsi jbods connected to this machine[3]. One is connected
> to an Adaptec card, and the other is connected to the Fusion MPT card
> (megaraid). All of the disks connected to the Adaptec card work fine,
> but when doing I/O on disks 2 and 3 on the megaraid card, it stalls
> considerably. When trying to sync a RAID1 device using the 4 148GB
> disks, the sync speed never goes above 2KB/s. When they finally get
> synched, IO stalls constantly. Watching with iostat confirms 
> this. I've
> formatted the disks in question with a single JFS partition and they
> still exhibit this behaviour when used by themselves. I have verified
> that this behaviour is not present up until at least 2.6.12.3. Let me
> know what info I can collect that would be helpful.. Thanks.
> 
> 
> 
> [1] http://www.ussg.iu.edu/hypermail/linux/kernel/0508.1/1952.html
> [2] http://www.icglink.com/debug-2.6.13-rc6.html
> [3] Diagram:
> 
> +---------+
> | Adaptec |
> +---------+
>      |
> +-------+-------+-------+-------+-------+
> | id: 0 | id: 1 | id: 2 | id: 3 | id: 4 |
> | 73GB  | 73GB  | 148GB | 148GB | 73GB  |
> +-------+-------+-------+-------+-------+
> 
> +----------+
> | megaraid |
> +----------+
>      |
> +-------+-------+-------+-------+-------+
> | id: 0 | id: 1 | id: 2 | id: 3 | id: 4 |
> | 73GB  | 73GB  | 148GB | 148GB | 73GB  |
> +-------+-------+-------+-------+-------+
> 
> -- 
> 
> Phil Dier (ICGLink.com -- 615 370-1530 x733)
> 
> /* vim:set noai nocindent ts=8 sw=8: */
> -
> To unsubscribe from this list: send the line "unsubscribe 
> linux-kernel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at  http://www.tux.org/lkml/
>