From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S932409AbZEHAgr (ORCPT ); Thu, 7 May 2009 20:36:47 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1761797AbZEHAMk (ORCPT ); Thu, 7 May 2009 20:12:40 -0400 Received: from mail.crca.org.au ([67.207.131.56]:41120 "EHLO crca.org.au" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1762033AbZEHAMj (ORCPT ); Thu, 7 May 2009 20:12:39 -0400 X-Bogosity: Ham, spamicity=0.000000 Subject: Re: [TuxOnIce-devel] [RFC] TuxOnIce From: Nigel Cunningham Reply-To: nigel@tuxonice.net To: Jesse Barnes Cc: "Rafael J. Wysocki" , Fabio Comolli , linux-kernel@vger.kernel.org, Pavel Machek , linux-pm@lists.linux-foundation.org, tuxonice-devel@lists.tuxonice.net In-Reply-To: <20090507164334.0d3890ef@jbarnes-g45> References: <1241620755-22133-1-git-send-email-nigel@tuxonice.net> <200905072022.15202.rjw@sisk.pl> <200905072127.11995.rjw@sisk.pl> <1241728860.19600.207.camel@nigel-laptop> <20090507161406.35d953df@jbarnes-g45> <1241739155.19600.233.camel@nigel-laptop> <20090507164334.0d3890ef@jbarnes-g45> Content-Type: text/plain Date: Fri, 08 May 2009 10:13:38 +1000 Message-Id: <1241741618.19600.236.camel@nigel-laptop> Mime-Version: 1.0 X-Mailer: Evolution 2.24.3 Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi. On Thu, 2009-05-07 at 16:43 -0700, Jesse Barnes wrote: > On Fri, 08 May 2009 09:32:34 +1000 > Nigel Cunningham wrote: > > On Thu, 2009-05-07 at 16:14 -0700, Jesse Barnes wrote: > > > On Fri, 08 May 2009 06:41:00 +1000 > > > Nigel Cunningham wrote: > > > > > > > Hi. > > > > > > > > On Thu, 2009-05-07 at 21:27 +0200, Rafael J. Wysocki wrote: > > > > > In fact I agree, but there's a catch. The way in which TuxOnIce > > > > > operates LRU pages is based on some assumptions that may or may > > > > > not be satisfied in future, so if we decide to merge it, then > > > > > we'll have to make sure these assumptions will be satisfied. > > > > > That in turn is going to require quite some discussion I guess. > > > > > > > > Agreed. That's why I've got that GEMS patch - it's putting pages > > > > on the LRU that don't satisfy the former assumptions: they are > > > > used during hibernating and need to be atomically copied. If > > > > there are further developments in that area, I would hope we > > > > could just extend what's been done with GEMS. > > > > > > Another option here would be to suspend all DRM operations earlier. > > > The suspend hook for i915 already does this, but maybe it needs to > > > happen sooner? We'll probably want a generic DRM suspend hook soon > > > too (as the radeon memory manager lands) to shut down GPU activity > > > in the suspend and hibernate cases. > > > > > > All that assumes I understand what's going on here though. :) It > > > appears you delay saving the GEM (just GEM by the way, for > > > Graphics/GPU Execution Manager) backing store until late to avoid > > > having the pages move around out from under you? > > > > Yeah. TuxOnIce saves some pages without doing an atomic copy of them. > > Up 'til now, the algorithm has been LRU pages - pages used for > > TuxOnIce's userspace helpers. With GEM, we also need to make sure GEM > > pages are atomically copied and so also 'subtract' them from the list > > of pages that aren't atomically copied. > > > > It's no great problem to do this, so I wouldn't ask you to change GEM > > to suspend DRM operations earlier. It's more important that GEM > > doesn't allocate extra pages unexpectedly - and I don't think that's > > likely anyway since we've switched away from X. This is important > > because TuxOnIce depends (for reliability) on having memory usage > > being predictable much more than swsusp and uswsusp do. (Larger > > images, less free RAM to begin with). > > Yeah X is typically the one causing GEM allocations and performing > execution, but there are other possibilities too. E.g. Wayland is a > non-X based display system that may be running instead, or maybe > there's an EGL or GPGPU program running in the background. > > So I think it's best if we suspend DRM fairly early, otherwise you > *may* get extra allocations and will probably see all sorts of GPU > memory mapping activity and execution while you're trying to hibernate > things. On the plus side I don't think this is a radical redesign or > anything, and mostly something we can do in our suspend and hibernate > callbacks. That won't stop updates to the framebuffer? > Thanks, Thank _you_! Nigel