From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S965409AbcAUTDe (ORCPT ); Thu, 21 Jan 2016 14:03:34 -0500 Received: from mx1.redhat.com ([209.132.183.28]:48764 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1759572AbcAUTDc (ORCPT ); Thu, 21 Jan 2016 14:03:32 -0500 Date: Thu, 21 Jan 2016 21:03:27 +0200 From: "Michael S. Tsirkin" To: Cornelia Huck Cc: virtio@lists.oasis-open.org, virtio-dev@lists.oasis-open.org, kvm@vger.kernel.org, dev@dpdk.org, linux-kernel@vger.kernel.org, qemu-devel@nongnu.org, virtualization@lists.linux-foundation.org, "Xie, Huawei" Subject: Re: virtio ring layout changes for optimal single-stream performance Message-ID: <20160121210230-mutt-send-email-mst@redhat.com> References: <20160121145418-mutt-send-email-mst@redhat.com> <20160121163836.1091943d.cornelia.huck@de.ibm.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20160121163836.1091943d.cornelia.huck@de.ibm.com> Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Jan 21, 2016 at 04:38:36PM +0100, Cornelia Huck wrote: > On Thu, 21 Jan 2016 15:39:26 +0200 > "Michael S. Tsirkin" wrote: > > > Hi all! > > I have been experimenting with alternative virtio ring layouts, > > in order to speed up single stream performance. > > > > I have just posted a benchmark I wrote for the purpose, and a (partial) > > alternative layout implementation. This achieves 20-40% reduction in > > virtio overhead in the (default) polling mode. > > > > http://article.gmane.org/gmane.linux.kernel.virtualization/26889 > > > > The layout is trying to be as simple as possible, to reduce > > the number of cache lines bouncing between CPUs. > > Some kind of diagram or textual description would really help to review > this. > > > > > For benchmarking, the idea is to emulate virtio in user-space, > > artificially adding overhead for e.g. signalling to match what happens > > in case of a VM. > > Hm... is this overhead comparable enough between different platform so > that you can get a halfway realistic scenario? On x86 is seems pretty stable. It's a question of setting VMEXIT_CYCLES and VMENTRY_CYCLES correctly. > What about things like > endianness conversions? I didn't bother with them yet. > > > > I'd be very curious to get feedback on this, in particular, some people > > discussed using vectored operations to format virtio ring - would it > > conflict with this work? > > > > You are all welcome to post enhancements or more layout alternatives as > > patches. > > Let me see if I can find time to experiment a bit.