From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S968486AbdEYFlk (ORCPT ); Thu, 25 May 2017 01:41:40 -0400 Received: from mx0a-001b2d01.pphosted.com ([148.163.156.1]:46412 "EHLO mx0a-001b2d01.pphosted.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1034179AbdEYFkZ (ORCPT ); Thu, 25 May 2017 01:40:25 -0400 From: Sukadev Bhattiprolu To: Michael Ellerman Cc: Benjamin Herrenschmidt , mikey@neuling.org, stewart@linux.vnet.ibm.com, apopple@au1.ibm.com, hbabu@us.ibm.com, oohall@gmail.com, bsingharora@gmail.com, linuxppc-dev@ozlabs.org, Subject: [PATCH v5 08/10] VAS: Define vas_win_close() interface Date: Wed, 24 May 2017 22:39:48 -0700 X-Mailer: git-send-email 2.7.4 In-Reply-To: <1495690790-12172-1-git-send-email-sukadev@linux.vnet.ibm.com> References: <1495690790-12172-1-git-send-email-sukadev@linux.vnet.ibm.com> X-TM-AS-GCONF: 00 x-cbid: 17052505-0044-0000-0000-00000338B36A X-IBM-SpamModules-Scores: X-IBM-SpamModules-Versions: BY=3.00007113; HX=3.00000241; KW=3.00000007; PH=3.00000004; SC=3.00000212; SDB=6.00865294; UDB=6.00429638; IPR=6.00645070; BA=6.00005372; NDR=6.00000001; ZLA=6.00000005; ZF=6.00000009; ZB=6.00000000; ZP=6.00000000; ZH=6.00000000; ZU=6.00000002; MB=3.00015576; XFM=3.00000015; UTC=2017-05-25 05:40:22 X-IBM-AV-DETECTION: SAVI=unused REMOTE=unused XFE=unused x-cbparentid: 17052505-0045-0000-0000-00000766C164 Message-Id: <1495690790-12172-9-git-send-email-sukadev@linux.vnet.ibm.com> X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2017-05-25_02:,, signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 spamscore=0 suspectscore=2 malwarescore=0 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1703280000 definitions=main-1705250110 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Define the vas_win_close() interface which should be used to close a send or receive windows. While the hardware configurations required to open send and receive windows differ, the configuration to close a window is the same for both. So we use a single interface to close the window. Signed-off-by: Sukadev Bhattiprolu --- Changelog[v4]: - Drop the poll for credits return (we can set the required credit, but cannot really find the available credit at a point in time) - Export the symbol Changelog[v3]: - Fix order of parameters in GET_FIELD(). - Update references and sequence for closing/quiescing a window. --- arch/powerpc/include/asm/vas.h | 7 +++ arch/powerpc/platforms/powernv/vas-window.c | 97 +++++++++++++++++++++++++++-- 2 files changed, 100 insertions(+), 4 deletions(-) diff --git a/arch/powerpc/include/asm/vas.h b/arch/powerpc/include/asm/vas.h index 09ea6f7..c923b8f 100644 --- a/arch/powerpc/include/asm/vas.h +++ b/arch/powerpc/include/asm/vas.h @@ -76,4 +76,11 @@ extern void vas_init_rx_win_attr(struct vas_rx_win_attr *rxattr, extern struct vas_window *vas_rx_win_open(int vasid, enum vas_cop_type cop, struct vas_rx_win_attr *attr); +/* + * Close the send or receive window identified by @win. For receive windows + * return -EAGAIN if there are active send windows attached to this receive + * window. + */ +int vas_win_close(struct vas_window *win); + #endif /* _MISC_VAS_H */ diff --git a/arch/powerpc/platforms/powernv/vas-window.c b/arch/powerpc/platforms/powernv/vas-window.c index 2cc9850..caacc28 100644 --- a/arch/powerpc/platforms/powernv/vas-window.c +++ b/arch/powerpc/platforms/powernv/vas-window.c @@ -477,7 +477,7 @@ int vas_assign_window_id(struct ida *ida) return winid; } -void vas_window_free(struct vas_window *window) +static void vas_window_free(struct vas_window *window) { unmap_winctx_mmio_bars(window); kfree(window->paste_addr_name); @@ -505,10 +505,12 @@ static struct vas_window *vas_window_alloc(struct vas_instance *vinst, int id) return NULL; } -/* stub for now */ -int vas_win_close(struct vas_window *window) +static void put_rx_win(struct vas_window *rxwin) { - return -1; + /* Better not be a send window! */ + WARN_ON_ONCE(rxwin->tx_win); + + atomic_dec(&rxwin->num_txwins); } struct vas_window *get_vinstance_rxwin(struct vas_instance *vinst, @@ -715,3 +717,90 @@ struct vas_window *vas_rx_win_open(int vasid, enum vas_cop_type cop, return ERR_PTR(rc); } EXPORT_SYMBOL_GPL(vas_rx_win_open); + +static void poll_window_busy_state(struct vas_window *window) +{ + int busy; + uint64_t val; + +retry: + /* + * Poll Window Busy flag + */ + val = read_hvwc_reg(window, VREG(WIN_STATUS)); + busy = GET_FIELD(VAS_WIN_BUSY, val); + if (busy) { + val = 0; + schedule_timeout(2000); + goto retry; + } +} + +static void poll_window_castout(struct vas_window *window) +{ + int cached; + uint64_t val; + + /* Cast window context out of the cache */ +retry: + val = read_hvwc_reg(window, VREG(WIN_CTX_CACHING_CTL)); + cached = GET_FIELD(VAS_WIN_CACHE_STATUS, val); + if (cached) { + val = 0ULL; + val = SET_FIELD(VAS_CASTOUT_REQ, val, 1); + val = SET_FIELD(VAS_PUSH_TO_MEM, val, 0); + write_hvwc_reg(window, VREG(WIN_CTX_CACHING_CTL), val); + + schedule_timeout(2000); + goto retry; + } +} + +/* + * Close a window. + * + * See Section 1.12.1 of VAS workbook v1.05 for details on closing window: + * - disable new paste operations (unmap paste address) + * - Poll for the "Window Busy" bit to be cleared + * - Clear the Open/Enable bit for the Window. + * - Poll for return of window Credits (implies FIFO empty for Rx win?) + * - Unpin and cast window context out of cache + * + * Besides the hardware, kernel has some bookkeeping of course. + */ +int vas_win_close(struct vas_window *window) +{ + uint64_t val; + + if (!window) + return 0; + + if (!window->tx_win && atomic_read(&window->num_txwins) != 0) { + pr_devel("VAS: Attempting to close an active Rx window!\n"); + WARN_ON_ONCE(1); + return -EAGAIN; + } + + unmap_winctx_paste_kaddr(window); + + poll_window_busy_state(window); + + /* Unpin window from cache and close it */ + val = read_hvwc_reg(window, VREG(WINCTL)); + val = SET_FIELD(VAS_WINCTL_PIN, val, 0); + val = SET_FIELD(VAS_WINCTL_OPEN, val, 0); + write_hvwc_reg(window, VREG(WINCTL), val); + + poll_window_castout(window); + + /* if send window, drop reference to matching receive window */ + if (window->tx_win) + put_rx_win(window->rxwin); + + vas_release_window_id(&window->vinst->ida, window->winid); + + vas_window_free(window); + + return 0; +} +EXPORT_SYMBOL_GPL(vas_win_close); -- 2.7.4