From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mx0a-0031df01.pphosted.com (mx0a-0031df01.pphosted.com [205.220.168.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id DE5172D4B68 for ; Fri, 16 Jan 2026 00:38:14 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=205.220.168.131 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1768523896; cv=none; b=SSHUs8QPNXZudChkVXOcL2Z3eI6PgS/lGQB4AaT+9hlC40Qg+nJV+lpTTSNQ2Jz1Zrb86sGj/3tth2no1KFCQCnncI0KpN7nTbFM+3t2ASl5pAdZrv/LtthfZlh+DRu2MkKd4/h1Ft6lnZEiimSDW8r0Roe1/2atVfatHVTJnng= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1768523896; c=relaxed/simple; bh=/ecBY8F1aLTc5+EeesU+tmKORoC0VRSCzXyNM0cJbmM=; h=Message-ID:Date:MIME-Version:Subject:To:Cc:References:From: In-Reply-To:Content-Type; b=h77gTBBtb1ToNT2C18NRVRVqSXxmGis6UbwIFJKG451GdGGxNqFExfQoCI5IrF5mw8rqX7U3Y3xZRhJ1pIKO1Z2es3cppZaEyR5k+XnN3L2NJRn4/1LjhRsLInDBZmH0lKNiSY9gCqOlXOPdb/qVycAJBMJSlRLD+xUxEJfd7UA= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=oss.qualcomm.com; spf=pass smtp.mailfrom=oss.qualcomm.com; dkim=pass (2048-bit key) header.d=qualcomm.com header.i=@qualcomm.com header.b=FzI2T7VV; dkim=pass (2048-bit key) header.d=oss.qualcomm.com header.i=@oss.qualcomm.com header.b=NgB3eFpz; arc=none smtp.client-ip=205.220.168.131 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=oss.qualcomm.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=oss.qualcomm.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=qualcomm.com header.i=@qualcomm.com header.b="FzI2T7VV"; dkim=pass (2048-bit key) header.d=oss.qualcomm.com header.i=@oss.qualcomm.com header.b="NgB3eFpz" Received: from pps.filterd (m0279862.ppops.net [127.0.0.1]) by mx0a-0031df01.pphosted.com (8.18.1.11/8.18.1.11) with ESMTP id 60FMclCb4100790 for ; Fri, 16 Jan 2026 00:38:14 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=qualcomm.com; h= cc:content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to; s=qcppdkim1; bh= WQxRRPqzei3Ob8ntQIgpcuTXfDyfzjtfKi4+4zEPK80=; b=FzI2T7VVn4jWMDII lfF5rkts8XeZKhwXcdhVX6KmnAZ+2wN9IRyPcrnV5z3Loe3ETZEZpOydrlh0niJ2 JWMinGI11qQYxgaWFsxeM9RocyfTAXTTkRD8FvvChc/rBo127hXrrGRSHpFP4CmB rKhSorH3Ge+mxmxEjRAP6GMapml9kgfEF7z0ryNDW1a3EWNNt4Ozq5CfS+cuAgnK MC1NiRAXKzzVJjM9MAyUw0+bdv4MdqIsuoqAjwhEmpt3jQHQtJEilu65sS4RILfS IkoYurRbCaewSJFiHBwzHozHdTRKZJGONqqXO8PHxPsvYZ9gq9wr8Jf3YNxR8KwH bFeUxg== Received: from mail-dl1-f69.google.com (mail-dl1-f69.google.com [74.125.82.69]) by mx0a-0031df01.pphosted.com (PPS) with ESMTPS id 4bq97507q0-1 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NOT) for ; Fri, 16 Jan 2026 00:38:13 +0000 (GMT) Received: by mail-dl1-f69.google.com with SMTP id a92af1059eb24-123395a5559so23138c88.0 for ; Thu, 15 Jan 2026 16:38:13 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oss.qualcomm.com; s=google; t=1768523893; x=1769128693; darn=vger.kernel.org; h=content-transfer-encoding:in-reply-to:from:content-language :references:cc:to:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=WQxRRPqzei3Ob8ntQIgpcuTXfDyfzjtfKi4+4zEPK80=; b=NgB3eFpz9rtIvjosJy95ah1V6f1htfgdt8syHBoocBX0yMB+SRAz4hZT1SOIMoq8i8 hRu+6G2rPJRATkBXWVufjmHiDkah5t5jbnEG8F4m7YwYNYp8K5FHGCPUEHWtc4jjSYch JqTuGTJX5Uy9IwWF4vMjQM+NXzEQyJlXaDqglAM1Fzcwfc+KQdaryu4WtOL9t4XoTnOA on287H4rF/6gdvJoSw43ZuoQEfZgWb1uLdmp3hsMiIlJTuK1qn+t5/A9WlN3fmlgTsM3 19Sz9aMH5tE2nmPc4wvDRJRzP0i+DJhc9eT7XKdV7b2mmx8Cn/pqEzspg9AU/gidPrq0 YFUg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1768523893; x=1769128693; h=content-transfer-encoding:in-reply-to:from:content-language :references:cc:to:subject:user-agent:mime-version:date:message-id :x-gm-gg:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=WQxRRPqzei3Ob8ntQIgpcuTXfDyfzjtfKi4+4zEPK80=; b=Gf1jdjil3AFvI80O1TXg2NeKC1NlbjwZeN4wemHD6h6mn5pCWXjCrotfxmiyRjm8Ln tKNDJdbBn4XK9z/CEuOkC+60NwhQlUtwCgE57L0BYuongHAOsr87jDF0uSDItZCwa4mN AqUJFavpXGbQXyvccQf/UYcuVuoVvqur9IIUnlFJPMeADeHxqObBbdZV3LhKdKFRkOpA qV2XpAqubnmMVzz4QT89mRZpq9svylnBB6wIWKAhvTduyvI0ZNMUNkUx3l3z0L9N2xjC ZMY+xNssOFLVSxIkhrBpYPVMGWbzFd0LXWgGeEpaFs8k+pQVFrj4OvQE7ssd1w+R7j/9 JHZg== X-Forwarded-Encrypted: i=1; AJvYcCXyLtZcxNdxgXbKaCQQ5RFc6MfL/YkK6lcol/Xrr/HzphJnBfSJvdmFch0Q8bW1vA/1mO/TAUD1O+EIgCw=@vger.kernel.org X-Gm-Message-State: AOJu0YzMIYaXzi3DkL7tuv9HZDkiA9KNUdLunnr1LM1nayvVnorj9tls 5e3sRMFH7Vt4HZD9gF3Cj+I5snZgjZRAzCs/UibqUj9cAKFYMo/NeRj933htbnl3aOdyi+RiH98 G9envSQZQjTA5CHlsNyJiNJWMG6lNDZj502528XFnRMZR8DqqjI+Ssv3B1McJEYVDkYvBygAons 8= X-Gm-Gg: AY/fxX439ayyCNlnaN+6LxSG4osMANXEd8a8GIzubvfHhqZILy17HswJOsa7GceukGQ gGtteLII3kIaTUDZ/Mt1UrZIqE5/l559lcz+eCLZr2ZD5tevm7j/mjcEoyexciVWaT2oKPfviA6 V0iLb8VqmAKf3xGUMzqFPybB96JiczX20PGYWyVNyc6QL232+DELbwpEQlk1X+W25A+EvtGBcNa vnwMNufgZWthOlAohrSIifbyQrwOImBzwEhoemEmQK0l/w6y8/zdYYJj/kbhuLrLdVYIIAmOG0r xawjUatASTmxr2Xc6QGbzr832I/RMFIKS+BKw8Xlc7G5K7BDYxNrBqYThddzMeBX0QBV1o7GCVr mNdsYZlhK+Q3tpe0URGU4qgUAd+aeVMh6AfXnPgv/DBYZnWXQXgLFv84X3kqze3SwPale7ilw X-Received: by 2002:a05:7022:3b83:b0:11e:3e9:3e9c with SMTP id a92af1059eb24-1244a817bd4mr685466c88.7.1768523893055; Thu, 15 Jan 2026 16:38:13 -0800 (PST) X-Received: by 2002:a05:7022:3b83:b0:11e:3e9:3e9c with SMTP id a92af1059eb24-1244a817bd4mr685453c88.7.1768523892405; Thu, 15 Jan 2026 16:38:12 -0800 (PST) Received: from [10.110.121.92] (i-global254.qualcomm.com. [199.106.103.254]) by smtp.gmail.com with ESMTPSA id a92af1059eb24-1244af10e21sm1085336c88.16.2026.01.15.16.38.11 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 15 Jan 2026 16:38:12 -0800 (PST) Message-ID: <0232a3fc-8774-4540-a718-eddb1d89e6d2@oss.qualcomm.com> Date: Thu, 15 Jan 2026 16:38:10 -0800 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [RFC PATCH 0/3] Implement Region of Interest(ROI) support. To: Nicolas Dufresne , Mauro Carvalho Chehab , Vikash Garodia , Dikshita Agarwal , Abhinav Kumar , Bryan O'Donoghue Cc: linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, linux-arm-msm@vger.kernel.org References: <20260113-iris_enc_roi-v1-0-6c86eba38587@oss.qualcomm.com> <6b5746cd16edf589fca79e2e6f8cf7f706309815.camel@ndufresne.ca> Content-Language: en-US From: Deepa Guthyappa Madivalara In-Reply-To: <6b5746cd16edf589fca79e2e6f8cf7f706309815.camel@ndufresne.ca> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Proofpoint-Spam-Details-Enc: AW1haW4tMjYwMTE2MDAwMyBTYWx0ZWRfX6PCqAmp6TLld Ln8GrxAKm/mZgYqtXMr3XlxzVhvS3Epor1lDKvLuQKunXIUO7iiqaCutTZUHoQmzDZE2r8FqfP8 TW8s2UWyMHmSKHngjmyhIs2hXYs9pAI3/nhxKnZMHHts86zKIvA3ZATRivcPKVMkZ4EwIhwhsb3 7mmKUV2cGBzUsx0wN9FMvzFAenWS85nnJwO3fY3kJy97aBrW9viMJedZ91dulxhgC307thJ9Ynt BnVBJTfthQcQrXBB0uULfKuvBHp02EF1tf9Lvp1+/097pUmysauRHPF0YTIIysLadQpCZOOeQdk U+MgYnimz8YLb3p+eDbjTZiG4P/eQy917KqjWU1b+NGPN66IO6VkkfxNOrUCr8Nn0GUlnUY3U+c VZSu/cbWmIF0g9ZWIC0JPyMoKr2NVShtAwMTToFQIS1znUDx5Y7wTMZDV6xv8p/37c5MpRyIVeE oLLR6VRE+U4oxak3pXQ== X-Authority-Analysis: v=2.4 cv=Sv6dKfO0 c=1 sm=1 tr=0 ts=69698876 cx=c_pps a=kVLUcbK0zfr7ocalXnG1qA==:117 a=JYp8KDb2vCoCEuGobkYCKw==:17 a=IkcTkHD0fZMA:10 a=vUbySO9Y5rIA:10 a=s4-Qcg_JpJYA:10 a=VkNPw1HP01LnGYTKEx00:22 a=zBYVM8QCAAAA:8 a=Dy9dXtnXAAAA:8 a=JsNoqYpyAAAA:8 a=PlHZZfusjfnJ1J766TcA:9 a=qcg49hLlgF0N60+LroqrWnV/Vu4=:19 a=3ZKOabzyN94A:10 a=QEXdDO2ut3YA:10 a=pqcTjcuDZwkA:10 a=1JuLLl_Xj_IA:10 a=vr4QvYf-bLy2KjpDp97w:22 a=ArXkYGXkE6hBHcUMFODu:22 a=7b_YKI4FLZevj963FIVU:22 a=2FlLF0J1BH4NsEBlSY-u:22 X-Proofpoint-GUID: 9yyl1vVQnE6d6nX_ziiWyueMsNaRuAgt X-Proofpoint-ORIG-GUID: 9yyl1vVQnE6d6nX_ziiWyueMsNaRuAgt X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.293,Aquarius:18.0.1121,Hydra:6.1.9,FMLib:17.12.100.49 definitions=2026-01-15_07,2026-01-15_02,2025-10-01_01 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 malwarescore=0 clxscore=1015 impostorscore=0 bulkscore=0 adultscore=0 phishscore=0 spamscore=0 suspectscore=0 lowpriorityscore=0 priorityscore=1501 classifier=typeunknown authscore=0 authtc= authcc= route=outbound adjust=0 reason=mlx scancount=1 engine=8.22.0-2512120000 definitions=main-2601160003 On 1/15/2026 5:42 AM, Nicolas Dufresne wrote: > Hi, > > Le mercredi 14 janvier 2026 à 14:14 -0800, Deepa Guthyappa Madivalara a écrit > > > [...] > >> Thanks for the quick comments. >> Qp map for can be too much data to be sent from user space to firmware >> via control per frame. >> Ex: Avc has mbsize as 16 and the max mbpf iris driver supports is 8192x4352. >> This would mean 136kb of data (8bit Qp) needs to be transferred for each >> frame in worst case. >> While are still evaluating Qp map option, due to firmware performance >> issues we are >> gravitating more towards rectangle ROI. >> I am not sure if we will need to support the Qp map in the future. > Have you read how this is implemented in Vulkan and D3D12 ? Please have a read: > > - Vulkan Video, see quantizationMapTexelSize [0] > - D3D, see QPMapRegionPixelsSize [1] > > [0] https://docs.vulkan.org/features/latest/features/proposals/VK_KHR_video_encode_quantization_map.html > [1] https://microsoft.github.io/DirectX-Specs/d3d/D3D12_Video_Encoding_Texture_QPMap_DirtyMap_MotionVectors.html > > Note that D3D also support dirty regions (what you call ROI in this proposal), > with no limits, since these are translated into map by drivers (its a software > feature on top) and motion search hints, that one seems rare. > > I'm not against having ROI in our API, its common in older chips designs, but > its clearly going away in the long run since most fixed hardware impose very low > region count, which is not usable for modern application. ROI it trivial to > implement on top of QP maps. > > A typical use case for that is to use lightweight AI or traditional CV to locate > most relevant portion of a video. The result is more like a heat map, not a set > of rectangles. Then we roughly map that in a low granularity QPMap before > encoding. This allow maintaining very low bandwidth, while preserving the > information needed for the heavier processing in the cloud. I'm including one of > the many example of that, this is a talk from Spiideo [2]. > > [2] https://gstconf.ubicast.tv/videos/region-based-compression-in-gstreamer/ > > > regards, > Nicolas Thank you for the detailed information. I reviewed the documentation and agree with your assessment. I am following up with my team to explore this further. Thanks, Deepa