From: "Waskiewicz Jr, Peter P" <peter.p.waskiewicz.jr@intel.com>
To: "David Miller" <davem@davemloft.net>,
"Kirsher, Jeffrey T" <jeffrey.t.kirsher@intel.com>
Cc: <jeff@garzik.org>, <netdev@vger.kernel.org>,
<linux-kernel@vger.kernel.org>
Subject: RE: [PATCH 1/2] net: Add the CPU id to skb->queue_mapping's upper 8 bits
Date: Wed, 25 Jun 2008 11:31:01 -0700 [thread overview]
Message-ID: <D5C1322C3E673F459512FB59E0DDC329054E55AF@orsmsx414.amr.corp.intel.com> (raw)
In-Reply-To: <20080624.163742.224488012.davem@davemloft.net>
>Well:
>
>1) All of this multiqueue stuff is going away with my changes in
> net-tx-2.6
Do you have a guestimate of which kernel you'll be targeting these
changes? I'm very interested in this schedule.
>2) This CPU number is going to be wrong half of the time.
>
>For #2, when TCP is processing ACKs, it sends packets out from
>whichever CPU the ACK landed on.
>
>So you could end up retargetting the RX flow back and forth between
>cpus. The cpu that sends the packet into the device layer is far
>from the cpu that should be used to target the RX flow at.
>
>So this idea is pretty seriously flawed and the infrastructure it's
>using is going away anyways.
The whole point is to identify the flow and redirect your Rx filtering
to the CPU it came from. So if you did this properly, the ACKs would be
landing on the CPU that originally opened the TCP flow. I don't follow
why the scheduler would move the process if the Rx traffic is returning
to that core.
I also understand the infrastructure is going away. But without knowing
when things are being changed, we can't be expected to delay sending in
patches to this area of the kernel if there is something we see a
potential benefit for. We have seen benefit in our labs of keeping
flows on dedicated CPUs and Tx/Rx queue pairs. I think the concept is
also sensible. But if my method of getting it working in the kernel is
flawed, then that's fine. Is there an alternative we can use, or is
this something we can influence the new Tx flow design with?
>It also adds all sorts of arbitray limitations (256 queues and cpus? I
>already have systems coming to me with more than 256 cpus)
I was trying to fit this into existing infrastructure to support the
more common case, which is probably 4-64 CPUs. Plus I'm not aware of
any NICs out there that support upwards of 256 Tx queues in the physical
function, but I guess I wouldn't be surprised if there are some on the
market.
-PJ Waskiewicz
next prev parent reply other threads:[~2008-06-25 18:31 UTC|newest]
Thread overview: 5+ messages / expand[flat|nested] mbox.gz Atom feed top
2008-06-24 23:27 Jeff Kirsher
2008-06-24 23:28 ` [PATCH 2/2] net: Fix consumers of skb->queue_mapping to use lower " Jeff Kirsher
2008-06-24 23:37 ` [PATCH 1/2] net: Add the CPU id to skb->queue_mapping's upper " David Miller
2008-06-25 18:31 ` Waskiewicz Jr, Peter P [this message]
2008-06-25 23:37 ` David Miller
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=D5C1322C3E673F459512FB59E0DDC329054E55AF@orsmsx414.amr.corp.intel.com \
--to=peter.p.waskiewicz.jr@intel.com \
--cc=davem@davemloft.net \
--cc=jeff@garzik.org \
--cc=jeffrey.t.kirsher@intel.com \
--cc=linux-kernel@vger.kernel.org \
--cc=netdev@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®