From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mx0b-0031df01.pphosted.com (mx0b-0031df01.pphosted.com [205.220.180.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id B472F3264CB for ; Sat, 15 Aug 2026 19:22:39 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=205.220.180.131 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786821766; cv=none; b=Ru6K9Zsz+XiYYjfXmxPZy3RABjMSFU6ls1gHYNVEbWan/B9nubDvMM6VsezO5ZyOkkWFKPtydmM0gyWYL13OmS3DdYDsDz20v9cMTDbsfvn6SWE2sDrA3PNOZ6DgpXJ5JoqG3EPCeGZHYbFWtuSiKlQ2KbkwysFlHvz8aTkMgEQ= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786821766; c=relaxed/simple; bh=XnTtuJ1JAiWjpss/pyoO+q5CX3dB2Y8zaDNeQKgpRko=; h=From:Date:Subject:MIME-Version:Content-Type:Message-Id:References: In-Reply-To:To:Cc; b=cymhj0Dlw2XeC7Y6J9S1+VyeFv3wxBJuvucDKRat3s33w4FclSew32dAScErqEUmoWtF4uG33i0v1zfDhWD8iC3H3Nhr1sHklIsQWOFlXuJRWNhmL7xoAgSbccGnOfAGktqdQ+htB09LACp6X6Qc4gs8kRuInolW9n/3gXZATJA= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=oss.qualcomm.com; spf=pass smtp.mailfrom=oss.qualcomm.com; dkim=pass (2048-bit key) header.d=qualcomm.com header.i=@qualcomm.com header.b=B0f1vgOH; dkim=pass (2048-bit key) header.d=oss.qualcomm.com header.i=@oss.qualcomm.com header.b=ZL3CuhP3; arc=none smtp.client-ip=205.220.180.131 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=oss.qualcomm.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=oss.qualcomm.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=qualcomm.com header.i=@qualcomm.com header.b="B0f1vgOH"; dkim=pass (2048-bit key) header.d=oss.qualcomm.com header.i=@oss.qualcomm.com header.b="ZL3CuhP3" Received: from pps.filterd (m0279870.ppops.net [127.0.0.1]) by mx0a-0031df01.pphosted.com (8.18.1.11/8.18.1.11) with ESMTP id 67FGT0fB1044850 for ; Sat, 15 Aug 2026 19:22:38 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=qualcomm.com; h= cc:content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to; s=qcppdkim1; bh= aejAWTZQGMCUNU/vOXOAf0fZ9MM/qgsuEKwucqN4Dbk=; b=B0f1vgOHNGOctFIY ZgSSw76prsQmb6pjB0cvzL/H44R5RJqosmhKlJI7wwFOBXW9NxztL/YieRgu8m+J xV/hLVHF53BwjkLMP/s4KiIA0CHHrztR4xKuHgU77TpgRwPvimOtsCbsy/JrARL+ aq+ny2nCqlqj+ZhJQfs0r/oJeEimYOhA6rcsW8xyDP0Z/N6Bz61gYln7DcluH/PB nfIlKK8Vpa/f7VEYLgnPszguZ/vYEGBhie+ZOlJ56yaSwRvrDv2oxRFkzY9q9fd5 kXuZR634m3i8e7GVwurya/fiHlo1olioe3Glw20VL2ya7R111M1m6B0J+m7ZoOHD x/PPLA== Received: from mail-pl1-f199.google.com (mail-pl1-f199.google.com [209.85.214.199]) by mx0a-0031df01.pphosted.com (PPS) with ESMTPS id 4g2ghehuqx-1 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NOT) for ; Sat, 15 Aug 2026 19:22:38 +0000 (GMT) Received: by mail-pl1-f199.google.com with SMTP id d9443c01a7336-2cf2308ef97so3093035ad.0 for ; Sat, 15 Aug 2026 12:22:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oss.qualcomm.com; s=google; t=1786821757; x=1787426557; darn=vger.kernel.org; h=cc:to:in-reply-to:references:message-id:content-transfer-encoding :content-type:mime-version:subject:date:from:from:to:cc:subject:date :message-id:reply-to:content-type; bh=aejAWTZQGMCUNU/vOXOAf0fZ9MM/qgsuEKwucqN4Dbk=; b=ZL3CuhP3TkZ65XHwRreR0/7nqeQiimySL6lXE6jd6WjGVar/ffZyILTqH6uuCmnAmx 6keMW6Z9ShvdN/FPvCc+GmMta6D34wZH5MvvyQMa4G5pHNXuXC+CNnaoY6BoN/ajYYjS /2XamFcrQVMp8x2PJlZnF6lerIbmu7i7oWDsb9A5hHdt6vK8zA7grIqB4Xjn1STm7sGW kTSQ4PEG1V4CFL8dmpwErWL9k4z1SIcG7Jdflpu2aPo0sgKIsy/L7OXuhK0BFApymvtD eDWdaFmHeDrXdYahPrPmgIpbAtci8U9jHBQjnooyCbntKaT2NvR8eHlekrfDqGg8uNrT bjaw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1786821757; x=1787426557; h=cc:to:in-reply-to:references:message-id:content-transfer-encoding :content-type:mime-version:subject:date:from:x-gm-gg :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to :content-type; bh=aejAWTZQGMCUNU/vOXOAf0fZ9MM/qgsuEKwucqN4Dbk=; b=ENfN7mveHfc0iiOVsHErCJCMuCotBVbc7IdlZcwaZY7xuWEQnEDpoXJ+eNR1Q+bhwe Z0e9/pdArDtlm+udqHUKY5l8pkyQFkZRfkSB1E7vDB8l5JF7wHkEEiyiHBA/vqe75TK+ pLTv89ovJThXy+N0ui1eOFfKnsi7ng3DLPSPJaHtxSvx9tEbIXObcP1BptNIozgXcAte TllUjc4AEAQDehRs8wQPYSSSibsR8qWViiXy3CyHRq6I92bme1cHYwf6reLfNgVcOUi+ FFSvNEkoZMs1nqm5ur5f/mCx8OnsKR+yTa0TycurZ1eSNiHBOTe/AjnqJ3UfcttesQHT QmoA== X-Forwarded-Encrypted: i=1; AHgh+Rri+TyX9gsh2w34NUbZ91+DPm2h48IgjryjqoaVP4xS78xvz3wYIb8ixfXz4pP/oMmYag7xfMDTJV1Lfts=@vger.kernel.org X-Gm-Message-State: AOJu0YyFa4fSpi1yvNGTXCestgjydK4YcsZ2ZQCRLu8mYxxR0loDZ84K gKp5zPKRyof/6Z3lUkVA6pkmghE487zx3JHMMQx098iNgtpJgbJUAEt9RoqhbuuaPOGf16w+mUK kdMMMDvA7GKtfZF4xUbpYEhvk0GkRYXt4Iyndz+V6t4d9tpQ7kUCtyviZYhwsjo6cZZw= X-Gm-Gg: AR+sD10/O52ObbAxMfgRQNOA/WGhbRG2vaCQ8AwUuP/PuSWezgRN5G0aeCIAHj+Z4aJ 3fE9XVAZe1CgjP/vY0xwYwWCvDA/lt0mnyB1h2q/j9vA1CZmMNROYlsEpeXEfTXcGG7TOyY0qzc MFl4P8v/V802UPlk1D6QDoU63d0ClgkkLb+iuMexGCtjpmEUUgFKvvthTDdhGivktSdzYBxj5he Tagl44t+raPnaBi8F9wgg2k3AXL/BNEAQESzPOw/qsN24Jy7ziYTidj0Vssw0z9+7w9EERViNSO iL0sVFpBED8tTXgGZzmAColfL74am5XI5pGhvKnKR1R/NV4BFR9mqiGO1sntkflvvFknffjS6+M 7L/F07KCRDtznpciAb3AGLtIJLkUV4/TDJ6vDNWiJgdNXYwVOWP9brYsj8LeN X-Received: by 2002:a05:6a20:729e:b0:3c3:8f7a:c0a2 with SMTP id adf61e73a8af0-3cc71d4b7fdmr11154838637.4.1786821757409; Sat, 15 Aug 2026 12:22:37 -0700 (PDT) X-Received: by 2002:a05:6a20:729e:b0:3c3:8f7a:c0a2 with SMTP id adf61e73a8af0-3cc71d4b7fdmr11154816637.4.1786821756904; Sat, 15 Aug 2026 12:22:36 -0700 (PDT) Received: from gu-dmadival-lv.qualcomm.com (Global_NAT1.qualcomm.com. [129.46.96.20]) by smtp.gmail.com with ESMTPSA id 5a478bee46e88-320d61e1cccsm15889350eec.8.2026.08.15.12.22.35 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 15 Aug 2026 12:22:36 -0700 (PDT) From: Deepa Guthyappa Madivalara Date: Sat, 15 Aug 2026 12:22:28 -0700 Subject: [PATCH v5 5/5] media: iris: Add BUF_ROIMB_DELTAQP metadata buffer for ROI delta QP Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Message-Id: <20260815-enc_roi_enable-v5-5-ded944f0fc7f@oss.qualcomm.com> References: <20260815-enc_roi_enable-v5-0-ded944f0fc7f@oss.qualcomm.com> In-Reply-To: <20260815-enc_roi_enable-v5-0-ded944f0fc7f@oss.qualcomm.com> To: Mauro Carvalho Chehab , Vikash Garodia , Dikshita Agarwal , Abhinav Kumar , Bryan O'Donoghue Cc: linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, linux-arm-msm@vger.kernel.org, Deepa Guthyappa Madivalara , kernel test robot X-Mailer: b4 0.14.2 X-Developer-Signature: v=1; a=ed25519-sha256; t=1786821750; l=12592; i=deepa.madivalara@oss.qualcomm.com; s=20250814; h=from:subject:message-id; bh=XnTtuJ1JAiWjpss/pyoO+q5CX3dB2Y8zaDNeQKgpRko=; b=cmdEJ+67ViKe2MS82nFXIzTRxMrYGcplPBDlTCvyNoN41bDDLHxF8CSoxGxI3UfQGRObeexRX r/oAcHMfwt0AUjjfVfedZbdauaNzlWjMMHbLw61yMG31cQvqg3gKXzx X-Developer-Key: i=deepa.madivalara@oss.qualcomm.com; a=ed25519; pk=MOEXgyokievn+bgpHdS6Ixh/KQYyS90z2mqIbQ822FQ= X-Authority-Analysis: v=2.4 cv=EKc2FVZC c=1 sm=1 tr=0 ts=6a80bc7e cx=c_pps a=JL+w9abYAAE89/QcEU+0QA==:117 a=ouPCqIW2jiPt+lZRy3xVPw==:17 a=IkcTkHD0fZMA:10 a=Sv0fKeRqtYgA:10 a=s4-Qcg_JpJYA:10 a=VkNPw1HP01LnGYTKEx00:22 a=u7WPNUs3qKkmUXheDGA7:22 a=gowsoOTTUOVcmtlkKump:22 a=EUspDBNiAAAA:8 a=Vdc_kfWn7EEFBlVKJCUA:9 a=QEXdDO2ut3YA:10 a=324X-CrmTo6CU4MGRt3R:22 X-Proofpoint-Spam-Info: AW1haW4tMjYwODE1MDE0NiBTYWx0ZWRfX9rOkXCREkfDe /EzyA5xC4eGVsQ9sbQM6PF4gIYYa5EOEAl9thk9rwsMRYTcF3KgF19p+zJ4MNjSvnoscnbEtN6b UGkdq0BwnFmo8nzEAjQ4sKc4Z7i1VvM= X-Proofpoint-Spam-Details-Enc: AW1haW4tMjYwODE1MDE0NiBTYWx0ZWRfX5ArMow3WUOO2 Rs9EhuHgQ75f7B2zj/Z7+GCyu5/GS8pkMrqgd80tmhosCEYAkINDnPvTPustfEEYNcYBjUsf5lp TobwABraVQmbXe11r7XcrGGxeb3u+rsmqAyBCrJPdbcYGDHCNEdz0hVX8JsQta/fl3XdnF9T9PH ora3IReCP7POUrbnZGHODQu/fZFymWLaBz6JAfQFhKEJfSbOMFWvczKU73iL3bTPLYR7N97Ec8P T5wOBEDSMpTeK4MK0HbBwyA8Bw5vjDDUDvMsGjpAWiyrr2HrwNKgYw8e3LmsJNZ9zXd4L1BJMJr JAwCv8nuNh6BepiKbKKYYREEp0vsJNFoEhquSlB2iutSUIeLedGM2HSWGbip6XtMYzqcHMxrr9m 8dnn7FKL0Af0/F/MYpfnSNdNtwKX0vAc6BM0mjwDrJ4TZjkDNAjIXMWX+q5phuD1899G9Z/Sds+ uqzodjZBe/yLdUTcoUg== X-Proofpoint-GUID: wkCLkSZdNOKtHMTL6rbZhvwYjXmqILII X-Proofpoint-ORIG-GUID: wkCLkSZdNOKtHMTL6rbZhvwYjXmqILII X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.293,Aquarius:18.0.1176,Hydra:6.1.134,FMLib:17.12.100.49 definitions=2026-08-15_05,2026-08-12_01,2025-10-01_01 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 phishscore=0 spamscore=0 clxscore=1015 impostorscore=0 lowpriorityscore=0 malwarescore=0 adultscore=0 bulkscore=0 priorityscore=1501 suspectscore=0 classifier=typeunknown authscore=0 authtc= authcc= route=outbound adjust=0 reason=mlx scancount=1 engine=8.22.0-2606150000 definitions=main-2608150146 - Introduce BUF_ROIMB_DELTAQP as a new internal buffer type to carry per-macroblock ROI delta QP data to the firmware. This buffer is allocated on demand when the application sets ROI parameters via V4L2_CID_MPEG_VIDEO_ROI_MB_DELTA_QP, and is queued alongside each raw input buffer as an HFI_BUFFER_METADATA packet on HFI_PORT_RAW. - The metadata buffer layout follows the firmware-defined metabuf_header and metapayload_header structures. The s8 per-MB delta QP values supplied by userspace are widened to s16 as required by the firmware. Signed-off-by: Deepa Guthyappa Madivalara --- drivers/media/platform/qcom/iris/iris_buffer.c | 98 ++++++++++++++++++++++ drivers/media/platform/qcom/iris/iris_buffer.h | 4 + drivers/media/platform/qcom/iris/iris_ctrls.c | 19 +++++ drivers/media/platform/qcom/iris/iris_ctrls.h | 1 + drivers/media/platform/qcom/iris/iris_hfi_gen2.c | 1 + .../platform/qcom/iris/iris_hfi_gen2_command.c | 24 ++++++ .../platform/qcom/iris/iris_hfi_gen2_response.c | 2 + drivers/media/platform/qcom/iris/iris_vidc.c | 2 + 8 files changed, 151 insertions(+) diff --git a/drivers/media/platform/qcom/iris/iris_buffer.c b/drivers/media/platform/qcom/iris/iris_buffer.c index eb8de60c1177f5e1ab83b90a3c8c80e0b4d1f02e..e7283a5054f685741bb55d5545a6c11188861b5d 100644 --- a/drivers/media/platform/qcom/iris/iris_buffer.c +++ b/drivers/media/platform/qcom/iris/iris_buffer.c @@ -5,11 +5,13 @@ #include #include +#include #include "iris_buffer.h" #include "iris_instance.h" #include "iris_power.h" #include "iris_vpu_buffer.h" +#include "iris_hfi_gen2_defines.h" #define PIXELS_4K 4096 #define MAX_WIDTH 4096 @@ -705,6 +707,19 @@ int iris_destroy_dequeued_internal_buffers(struct iris_inst *inst, u32 plane) return iris_destroy_internal_buffers(inst, plane, false); } +int iris_destroy_roi_metadata_buffers(struct iris_inst *inst) +{ + struct iris_buffer *buf, *next; + struct iris_buffers *buffers; + + if (inst->domain == ENCODER) { + buffers = &inst->buffers[BUF_ROIMB_DELTAQP]; + list_for_each_entry_safe(buf, next, &buffers->list, list) + iris_destroy_internal_buffer(inst, buf); + } + + return 0; +} static int iris_release_internal_buffers(struct iris_inst *inst, enum iris_buffer_type buffer_type) { @@ -928,3 +943,86 @@ int iris_vb2_buffer_done(struct iris_inst *inst, struct iris_buffer *buf) return 0; } + +static int iris_fill_roi_data(struct iris_inst *inst, struct iris_buffer *buffer) +{ + s8 *p_array = (s8 *)inst->fw_caps[ROI_PARAMS].p_array; + u32 array_size = inst->fw_caps[ROI_PARAMS].elems; + struct metabuf_header *mbuf_hdr = buffer->kvaddr; + struct metapayload_header *mbuf_payload_hdr; + s16 *p_16; + u32 payload_offset; + + memset(mbuf_hdr, 0, sizeof(struct metabuf_header)); + mbuf_hdr->count = 1; + mbuf_hdr->size = sizeof(struct metabuf_header) + + sizeof(struct metapayload_header); + mbuf_hdr->version = BIT(16); + mbuf_hdr++; + mbuf_payload_hdr = (struct metapayload_header *)(mbuf_hdr); + payload_offset = sizeof(struct metabuf_header) + + sizeof(struct metapayload_header); + + memset(mbuf_payload_hdr, 0, sizeof(struct metapayload_header)); + mbuf_payload_hdr->type = HFI_PROP_ROI_INFO; + mbuf_payload_hdr->size = array_size * sizeof(s16); + mbuf_payload_hdr->version = 1 << 16; + mbuf_payload_hdr->offset = ALIGN(payload_offset, (u32)256); + mbuf_payload_hdr->flags = 0; + + /* Firmware expects 2bytes of delta_Qp, int16_t */ + p_16 = buffer->kvaddr + mbuf_payload_hdr->offset; + for (int i = 0; i < array_size; i++) + p_16[i] = p_array[i]; + + return 0; +} + +int iris_hfi_gen2_session_alloc_roi_metadata_buffer(struct iris_inst *inst) +{ + struct iris_buffers *buffers = &inst->buffers[BUF_ROIMB_DELTAQP]; + struct iris_core *core = inst->core; + struct iris_buffer *buffer, *first_buffer, *next; + bool found = false; + int ret = 0; + + if (!buffers->size) + return 0; + + list_for_each_entry_safe(buffer, next, &buffers->list, list) { + if (buffer->attr & BUF_ATTR_DEQUEUED) { + buffer->attr &= ~BUF_ATTR_DEQUEUED; + list_move(&buffer->list, &buffers->list); + found = true; + break; + } + } + if (!found) { + buffer = kzalloc_obj(*buffer); + if (!buffer) + return -ENOMEM; + + INIT_LIST_HEAD(&buffer->list); + buffer->type = BUF_ROIMB_DELTAQP; + buffer->index++; + buffer->buffer_size = buffers->size; + buffer->dma_attrs = DMA_ATTR_WRITE_COMBINE; + + buffer->kvaddr = dma_alloc_attrs(core->dev, buffer->buffer_size, + &buffer->device_addr, GFP_KERNEL, + buffer->dma_attrs); + + if (!buffer->kvaddr) { + kfree(buffer); + return -ENOMEM; + } + list_add(&buffer->list, &buffers->list); + } + + first_buffer = list_first_entry(&buffers->list, struct iris_buffer, list); + ret = iris_fill_roi_data(inst, first_buffer); + if (ret) + return ret; + + return ret; +} diff --git a/drivers/media/platform/qcom/iris/iris_buffer.h b/drivers/media/platform/qcom/iris/iris_buffer.h index ee2d24bb69c57220b0a735d9b4aae4434a33daf6..df9d018493f3ec37fd5e6b0ba049dba0b5ae76e9 100644 --- a/drivers/media/platform/qcom/iris/iris_buffer.h +++ b/drivers/media/platform/qcom/iris/iris_buffer.h @@ -28,6 +28,7 @@ struct iris_inst; * @BUF_SCRATCH_2: buffer to store encoding context data for HW * @BUF_VPSS: buffer to store VPSS context data for HW * @BUF_PARTIAL: buffer for AV1 IBC data + * @BUF_ROIMB_DELTAQP: metadata buffer for ROI MB DeltaQp * @BUF_TYPE_MAX: max buffer types */ enum iris_buffer_type { @@ -44,6 +45,7 @@ enum iris_buffer_type { BUF_SCRATCH_2, BUF_VPSS, BUF_PARTIAL, + BUF_ROIMB_DELTAQP, BUF_TYPE_MAX, }; @@ -139,5 +141,7 @@ int iris_queue_buffer(struct iris_inst *inst, struct iris_buffer *buf); int iris_queue_deferred_buffers(struct iris_inst *inst, enum iris_buffer_type buf_type); int iris_vb2_buffer_done(struct iris_inst *inst, struct iris_buffer *buf); void iris_vb2_queue_error(struct iris_inst *inst); +int iris_hfi_gen2_session_alloc_roi_metadata_buffer(struct iris_inst *inst); +int iris_destroy_roi_metadata_buffers(struct iris_inst *inst); #endif diff --git a/drivers/media/platform/qcom/iris/iris_ctrls.c b/drivers/media/platform/qcom/iris/iris_ctrls.c index e6838e67cbfcd4b9baf53c008e33999e31f2ed76..dd7f576cf9c5680aeff332e5424c126f613dcd3b 100644 --- a/drivers/media/platform/qcom/iris/iris_ctrls.c +++ b/drivers/media/platform/qcom/iris/iris_ctrls.c @@ -1623,3 +1623,22 @@ int iris_set_metadata_delivery(struct iris_inst *inst, u32 plane) return ret; } + +int iris_set_roi_params(struct iris_inst *inst, u32 plane) +{ + struct iris_buffers *buffers = &inst->buffers[BUF_ROIMB_DELTAQP]; + u32 metadata_header_bytes = 256; + u32 size = 0; + int ret = 0; + + if (!inst->fw_caps[ROI_PARAMS].p_array) + return -EINVAL; + + size = inst->fw_caps[ROI_PARAMS].elems * 2 + metadata_header_bytes; + buffers->size = ALIGN(size, 4096); + ret = iris_hfi_gen2_session_alloc_roi_metadata_buffer(inst); + if (ret) + return ret; + + return 0; +} diff --git a/drivers/media/platform/qcom/iris/iris_ctrls.h b/drivers/media/platform/qcom/iris/iris_ctrls.h index 9957b69366f50310338a0c1470d9744592655c33..7587dfec052a320863889eb15203416b9c527a40 100644 --- a/drivers/media/platform/qcom/iris/iris_ctrls.h +++ b/drivers/media/platform/qcom/iris/iris_ctrls.h @@ -51,5 +51,6 @@ int iris_set_req_sync_frame(struct iris_inst *inst, enum platform_inst_fw_cap_ty int iris_set_time_delta_based_rc(struct iris_inst *inst, enum platform_inst_fw_cap_type cap_id); int iris_set_properties(struct iris_inst *inst, u32 plane); int iris_set_metadata_delivery(struct iris_inst *inst, u32 plane); +int iris_set_roi_params(struct iris_inst *inst, u32 plane); #endif diff --git a/drivers/media/platform/qcom/iris/iris_hfi_gen2.c b/drivers/media/platform/qcom/iris/iris_hfi_gen2.c index d628bc6748438b19dac01cd11cb9f8da0b8500af..4d40d6733e5877a302ce63fb0b4a61b8f284e6dc 100644 --- a/drivers/media/platform/qcom/iris/iris_hfi_gen2.c +++ b/drivers/media/platform/qcom/iris/iris_hfi_gen2.c @@ -1789,6 +1789,7 @@ static const struct platform_inst_fw_cap inst_fw_cap_sm8550_enc[] = { .hfi_id = HFI_PROP_ROI_INFO, .flags = CAP_FLAG_INPUT_PORT | CAP_FLAG_CUSTOM | CAP_FLAG_DYNAMIC_ALLOWED, + .set = iris_set_roi_params, }, { .cap_id = MB_SIZE, diff --git a/drivers/media/platform/qcom/iris/iris_hfi_gen2_command.c b/drivers/media/platform/qcom/iris/iris_hfi_gen2_command.c index cf88dbe11e8e9faef826e661d8e9909fd7f16b94..1bb35ae86b6f1d1f40fa44085998fb452d9f9a21 100644 --- a/drivers/media/platform/qcom/iris/iris_hfi_gen2_command.c +++ b/drivers/media/platform/qcom/iris/iris_hfi_gen2_command.c @@ -134,6 +134,7 @@ static u32 iris_hfi_gen2_get_port_from_buf_type(struct iris_inst *inst, switch (buffer_type) { case BUF_INPUT: case BUF_VPSS: + case BUF_ROIMB_DELTAQP: return HFI_PORT_RAW; case BUF_OUTPUT: case BUF_BIN: @@ -1267,6 +1268,8 @@ static u32 iris_hfi_gen2_buf_type_from_driver(u32 domain, enum iris_buffer_type return HFI_BUFFER_VPSS; case BUF_PARTIAL: return HFI_BUFFER_PARTIAL_DATA; + case BUF_ROIMB_DELTAQP: + return HFI_BUFFER_METADATA; default: return 0; } @@ -1328,6 +1331,7 @@ static struct iris_buffer *iris_queue_metadata_buffers(struct iris_inst *inst, static int iris_hfi_gen2_session_queue_buffer(struct iris_inst *inst, struct iris_buffer *buffer) { struct iris_inst_hfi_gen2 *inst_hfi_gen2 = to_iris_inst_hfi_gen2(inst); + struct iris_hfi_buffer hfi_meta_buffer; struct iris_hfi_buffer hfi_buffer; u32 port; int ret; @@ -1349,6 +1353,26 @@ static int iris_hfi_gen2_session_queue_buffer(struct iris_inst *inst, struct iri &hfi_buffer, sizeof(hfi_buffer)); + /* check if any metadata buffer is available not queued, queueit */ + if (port == HFI_PORT_RAW) { + buffer = iris_queue_metadata_buffers(inst, BUF_ROIMB_DELTAQP, buffer->index); + if (buffer) { + iris_hfi_gen2_get_buffer(inst->domain, buffer, &hfi_meta_buffer); + port = iris_hfi_gen2_get_port_from_buf_type(inst, buffer->type); + iris_hfi_gen2_create_packet(inst_hfi_gen2->packet, + HFI_CMD_BUFFER, + HFI_HOST_FLAGS_INTR_REQUIRED, + HFI_PAYLOAD_STRUCTURE, + port, + inst->core->packet_id++, + &hfi_meta_buffer, + sizeof(hfi_meta_buffer)); + + buffer->attr |= BUF_ATTR_QUEUED; + buffer->attr &= ~BUF_ATTR_DEQUEUED; + } + } + return iris_hfi_queue_cmd_write(inst->core, inst_hfi_gen2->packet, inst_hfi_gen2->packet->size); } diff --git a/drivers/media/platform/qcom/iris/iris_hfi_gen2_response.c b/drivers/media/platform/qcom/iris/iris_hfi_gen2_response.c index 84b629b957442c024dccc18b354ac9a7e541abaa..f63e0a7723e8583da818c2b004e367c1dd3d94f7 100644 --- a/drivers/media/platform/qcom/iris/iris_hfi_gen2_response.c +++ b/drivers/media/platform/qcom/iris/iris_hfi_gen2_response.c @@ -58,6 +58,8 @@ static u32 iris_hfi_gen2_buf_type_to_driver(struct iris_inst *inst, return BUF_PARTIAL; case HFI_BUFFER_VPSS: return BUF_VPSS; + case HFI_BUFFER_METADATA: + return BUF_ROIMB_DELTAQP; default: return 0; } diff --git a/drivers/media/platform/qcom/iris/iris_vidc.c b/drivers/media/platform/qcom/iris/iris_vidc.c index fcbc60016beec693f2ce27927a09a2d51494bc38..fae3d113a9dc990f06167ee0b7fb8fab24a0552c 100644 --- a/drivers/media/platform/qcom/iris/iris_vidc.c +++ b/drivers/media/platform/qcom/iris/iris_vidc.c @@ -180,6 +180,7 @@ int iris_open(struct file *filp) INIT_LIST_HEAD(&inst->buffers[BUF_SCRATCH_2].list); INIT_LIST_HEAD(&inst->buffers[BUF_VPSS].list); INIT_LIST_HEAD(&inst->buffers[BUF_PARTIAL].list); + INIT_LIST_HEAD(&inst->buffers[BUF_ROIMB_DELTAQP].list); init_completion(&inst->completion); init_completion(&inst->flush_completion); @@ -299,6 +300,7 @@ int iris_close(struct file *filp) iris_destroy_all_internal_buffers(inst, V4L2_BUF_TYPE_VIDEO_CAPTURE_MPLANE); iris_check_num_queued_internal_buffers(inst, V4L2_BUF_TYPE_VIDEO_OUTPUT_MPLANE); iris_check_num_queued_internal_buffers(inst, V4L2_BUF_TYPE_VIDEO_CAPTURE_MPLANE); + iris_destroy_roi_metadata_buffers(inst); iris_remove_session(inst); mutex_unlock(&inst->lock); mutex_destroy(&inst->ctx_q_lock); -- 2.34.1