Edge Software Device Qualification

Test Report

The Intel® Edge Software Device Qualification is a Command Line Interface (CLI) tool that enables customers to test and qualify their platform for a specific Intel® Edge Software package.

Tool Suite Information

Package Name esdq
Package Version 11.1.0
Package CLI Version 11.1.0

1. metro-device-qualification

Test Module Information

Module Name Metro Device Qualification Test
Module Version 2.0

Test Case Execution Summary

Total Test Cases 8
Total Test Cases Passed 8
Total Test Cases Failed 0
Total Test Cases with Unknown Result 0
Pass Percentage (%) 100.00
Verdict PASSED

Test Module Components

Category Name Version Status
generic Docker CE 28.4.0 Installed
Docker Images metro2.0/media_performance_benchmark_runner 2.0 Installed
Docker Images metro2.0/ai_frequency_measure_runner 2.0 Installed
Docker Images metro2.0/proxy_pipeline_benchmark_runner 2.0 Installed
Docker Images metro2.0/openvino_benchmark_runner 2.0 Installed
Docker Images metro2.0/stream_memory_benchmark 2.0 Installed

Additional Data

System Info

Section Field Value
HARDWARE INFO Device Manufacturer O.E.M.
HARDWARE INFO Hardware Architecture x86_64
HARDWARE INFO Processor Intel(R) Core(TM) Ultra 5 125U
HARDWARE INFO GPU PCI ID 7d45 (Intel® Graphics)
HARDWARE INFO GPU Memory Size 16M (Intel® Graphics)
HARDWARE INFO GPU Memory Size 256M (Intel® Graphics)
HARDWARE INFO Memory Size 30Gi
HARDWARE INFO Monitor Monitors: 1
HARDWARE INFO Monitor 0: +*DP-2 1920/520x1080/290+0+0 DP-2
HDD Configurations Model TS256GSS D472K-I (scsi)
HDD Configurations Disk /dev/sda 256GB
HDD Configurations Sector size (logical/physical) 512B/512B
HDD Configurations Partition Table gpt
HDD Configurations Disk Flags Number Start End Size File system Name Flags
HDD Configurations Disk Flags 1 1049kB 1128MB 1127MB fat32 boot, esp
HDD Configurations Disk Flags 2 1128MB 256GB 255GB ext4
BIOS Configuration

bios_config.txt

CPU Power Configuration

cpu_power_config.txt

Software Info

Section Field Value
SOFTWARE INFO OS Version Ubuntu 24.04.2 LTS
SOFTWARE INFO Kernel Version 6.14.0-29-generic
SOFTWARE INFO OpenVINO Version (Base) 2025.2.0
SOFTWARE INFO OpenVINO Version (for DLStreamer) 2025.2.0
SOFTWARE INFO OpenVINO Version (for OpenCV/FFMpeg) 2025.2.0
SOFTWARE INFO Docker CE Version 28.4.0
SOFTWARE INFO Docker Compose Version 2.39.2
SOFTWARE INFO Intel Level Zero for GPU NA
SOFTWARE INFO Intel Graphics Compiler for OpenCL 25.05.32567.19-1099
SOFTWARE INFO Libva / VAAPI Driver NA
SOFTWARE INFO Media-driver Version 25.2.4-1146~24.04
SOFTWARE INFO Intel OneVPL 1:2.15.0.0-1140
SOFTWARE INFO Mesa NA
SOFTWARE INFO OpenCV Version 4.11.0.86
SOFTWARE INFO DLStreamer Version 1.26.4
SOFTWARE INFO FFmpeg Version 6.1.1-3ubuntu5
SOFTWARE INFO NPU Version 1.19.0.20250707-16111289554
SOFTWARE INFO Current System Time 2025-09-23 20:08:06

Test Case Results

performance

Category Name Value Type Logic Type Expected Value Value Parameters Status
generic OpenVINO Benchmark Test text eq No Error No Error na PASSED
generic Memory Benchmark Test text eq No Error No Error na PASSED
generic Media Performance Test text eq No Error No Error na PASSED
generic GPU Freq Performance Test text eq No Error No Error na PASSED
generic Smart NVR Proxy Pipeline Benchmark Test text eq No Error No Error na PASSED
generic Headed Visual AI Proxy Pipeline Benchmark Test text eq No Error No Error na PASSED
generic VSaaS Gateway with Storage Proxy Pipeline Benchmark Test text eq No Error No Error na PASSED
generic License Plate Recognition(LPR) AI Proxy Pipeline Benchmark text eq No Error No Error na PASSED

Additional Data

resnet-50-tf OV Benchmark Result

Model Precision Device Throughput
(fps)		 Latency
(ms)		 Reference Platform Reference Throughput (fps) Reference GPU Freq (GHz) CPU Avg Freq
(GHz)		 CPU Util (norm)
(%)		 Memory Util
(%)		 GPU Freq
(GHz)		 GPU EU Util
(%)		 GPU VDBox Util
(%)		 GPU Power Util
(W)		 Package Power
(W)		 Result
resnet-50-tf INT8 GPU.0 441.45 578.84 MTL 165H (32G Mem) 675.8 0.9 1.46 8.86 2.53 0.78 86.98 0.0 8.05 14.74 No Error
resnet-50-tf INT8 NPU 611.31 6.48 MTL 165H (32G Mem) 717.62 1.02 2.08 1.83 1.02 11.5 No Error
resnet-50-tf OV Benchmark Result Chart

resnet-50-tf OV Benchmark Result Chart
efficientnet-b0 OV Benchmark Result

Model Precision Device Throughput
(fps)		 Latency
(ms)		 Reference Platform Reference Throughput (fps) Reference GPU Freq (GHz) CPU Avg Freq
(GHz)		 CPU Util (norm)
(%)		 Memory Util
(%)		 GPU Freq
(GHz)		 GPU EU Util
(%)		 GPU VDBox Util
(%)		 GPU Power Util
(W)		 Package Power
(W)		 Result
efficientnet-b0 INT8 GPU.0 638.74 200.16 MTL 165H (32G Mem) 1253.92 0.17 1.8 11.28 3.02 0.8 85.27 0.0 4.8 13.4 No Error
efficientnet-b0 INT8 NPU 455.98 8.70 MTL 165H (32G Mem) 485.84 1.23 1.91 1.6 0.84 9.06 No Error
efficientnet-b0 OV Benchmark Result Chart

efficientnet-b0 OV Benchmark Result Chart
ssdlite_mobilenet_v2 OV Benchmark Result

Model Precision Device Throughput
(fps)		 Latency
(ms)		 Reference Platform Reference Throughput (fps) Reference GPU Freq (GHz) CPU Avg Freq
(GHz)		 CPU Util (norm)
(%)		 Memory Util
(%)		 GPU Freq
(GHz)		 GPU EU Util
(%)		 GPU VDBox Util
(%)		 GPU Power Util
(W)		 Package Power
(W)		 Result
ssdlite_mobilenet_v2 INT8 GPU.0 490.11 8.09 MTL 165H (32G Mem) 480.35 0.9 1.98 15.33 1.77 0.76 93.55 0.0 4.47 15.78 No Error
ssdlite_mobilenet_v2 INT8 NPU 778.16 5.07 MTL 165H (32G Mem) 817.27 0.96 2.14 1.9 0.82 10.52 No Error
ssdlite_mobilenet_v2 OV Benchmark Result Chart

ssdlite_mobilenet_v2 OV Benchmark Result Chart
mobilenet-v2-pytorch OV Benchmark Result

Model Precision Device Throughput
(fps)		 Latency
(ms)		 Reference Platform Reference Throughput (fps) Reference GPU Freq (GHz) CPU Avg Freq
(GHz)		 CPU Util (norm)
(%)		 Memory Util
(%)		 GPU Freq
(GHz)		 GPU EU Util
(%)		 GPU VDBox Util
(%)		 GPU Power Util
(W)		 Package Power
(W)		 Result
mobilenet-v2-pytorch INT8 GPU.0 1530.21 83.49 MTL 165H (32G Mem) 3102.01 0.9 1.83 13.16 2.17 0.76 86.13 0.0 5.08 15.11 No Error
mobilenet-v2-pytorch INT8 NPU 1918.43 2.03 MTL 165H (32G Mem) 2007.79 0.96 2.14 2.08 0.79 12.11 No Error
mobilenet-v2-pytorch OV Benchmark Result Chart

mobilenet-v2-pytorch OV Benchmark Result Chart
yolo-v5s OV Benchmark Result

Model Precision Device Throughput
(fps)		 Latency
(ms)		 Reference Platform Reference Throughput (fps) Reference GPU Freq (GHz) CPU Avg Freq
(GHz)		 CPU Util (norm)
(%)		 Memory Util
(%)		 GPU Freq
(GHz)		 GPU EU Util
(%)		 GPU VDBox Util
(%)		 GPU Power Util
(W)		 Package Power
(W)		 Result
yolo-v5s INT8 GPU.0 174.04 367.22 MTL 165H (32G Mem) 285.99 0.88 1.45 9.8 2.29 0.76 83.15 0.0 7.32 14.7 No Error
yolo-v5s INT8 NPU 108.58 36.76 MTL 165H (32G Mem) 111.83 0.79 1.67 1.06 0.86 9.52 No Error
yolo-v5s OV Benchmark Result Chart

yolo-v5s OV Benchmark Result Chart
yolo-v8s OV Benchmark Result

Model Precision Device Throughput
(fps)		 Latency
(ms)		 Reference Platform Reference Throughput (fps) Reference GPU Freq (GHz) CPU Avg Freq
(GHz)		 CPU Util (norm)
(%)		 Memory Util
(%)		 GPU Freq
(GHz)		 GPU EU Util
(%)		 GPU VDBox Util
(%)		 GPU Power Util
(W)		 Package Power
(W)		 Result
yolo-v8s INT8 GPU.0 70.74 56.46 MTL 165H (32G Mem) 116.1 0.66 1.72 15.11 1.74 0.74 93.32 0.0 5.41 15.73 No Error
yolo-v8s OV Benchmark Result Chart

yolo-v8s OV Benchmark Result Chart
clip-vit-base-patch16 OV Benchmark Result

Model Precision Device Throughput
(fps)		 Latency
(ms)		 Reference Platform Reference Throughput (fps) Reference GPU Freq (GHz) CPU Avg Freq
(GHz)		 CPU Util (norm)
(%)		 Memory Util
(%)		 GPU Freq
(GHz)		 GPU EU Util
(%)		 GPU VDBox Util
(%)		 GPU Power Util
(W)		 Package Power
(W)		 Result
clip-vit-base-patch16 INT8 GPU.0 9.71 411.40 MTL 165H (32G Mem) 0 0 1.59 11.3 2.41 0.83 82.85 0.0 6.21 15.03 No Error
clip-vit-base-patch16 OV Benchmark Result Chart

clip-vit-base-patch16 OV Benchmark Result Chart
Memory Benchmark Test Result

This test runs a memory benchmark based on STREAM to ensure sufficient memory bandwidth for media processing.

memory_benchmark_runner_test Function Best Rate MB/s Avg time Min time Max time Result
Memory_Benchmark_Test Copy 29847.5 0.066148 0.064327 0.067450 No Error
Memory_Benchmark_Test Scale 23081.1 0.087352 0.083185 0.090029 No Error
Memory_Benchmark_Test Add 24381.6 0.119655 0.118122 0.121218 No Error
Memory_Benchmark_Test Triad 24459.5 0.119759 0.117746 0.121525 No Error
Media Performance Test Result

Media Encode and Decode Performance tests.

Media Performance Benchmark Device Used Codec Bitrate Resolution Number of Monitors Max Channels Reference Platform Reference Value AVG CPU Freq(MHz) AVG CPU Util(%) AVG Memory Util(%) AVG GPU Freq(MHz) AVG GPU EU(RCS) Util(%) AVG GPU VDBox(VCS) Util(%) Avg SoC Power (W) AVG GPU power(W) Duration(s) Result
Media Encode Benchmark iGPU h264 4Mbps 1080p@30 N/A 19 MTL 165H (32G Mem) 25 2827.58 92.96 0.80 623.07 2.08 97.82 14.84 0.14 471.45 No Error
Media Encode Benchmark iGPU h264 16Mbps 4K@30 N/A 4 MTL 165H (32G Mem) 5 2195.28 21.24 0.20 628.32 2.09 99.72 11.01 0.12 323.77 No Error
Media Encode Benchmark iGPU h265 2Mbps 1080p@30 N/A 12 MTL 165H (32G Mem) 18 2503.25 54.85 1.80 615.39 2.11 0.00 14.23 0.12 586.63 No Error
Media Encode Benchmark iGPU h265 8Mbps 4K@30 N/A 2 MTL 165H (32G Mem) 3 2164.23 14.06 1.10 625.60 2.08 0.00 11.56 0.15 220.51 No Error
Media Performance Test Result

Media Encode and Decode Performance tests.

Media Performance Test Result
Media Performance Test Result

Media Encode and Decode Performance tests.

Media Performance Benchmark Device Used Input Codec Input Bitrate Input Resolution Number of Monitors Max Channels Reference Platform Reference Value AVG CPU Freq(MHz) AVG CPU Util(%) AVG Memory Util(%) AVG GPU Freq(MHz) AVG GPU EU(RCS) Util(%) AVG GPU VDBox(VCS) Util(%) Avg SoC Power (W) AVG GPU power(W) Duration(s) Result
Media Decode Benchmark iGPU h264 4Mbps 1080p@30 N/A 54 MTL 165H (32G Mem) 77 2888.67 113.07 0.60 629.68 1.79 0.00 14.12 0.14 694.78 No Error
Media Decode Benchmark iGPU h264 16Mbps 4K@30 N/A 14 MTL 165H (32G Mem) 23 2344.30 22.28 0.30 624.96 1.76 0.00 9.67 0.14 610.64 No Error
Media Decode Benchmark iGPU h265 2Mbps 1080p@30 N/A 80 MTL 165H (32G Mem) 107 2873.05 162.93 0.88 567.63 2.09 0.00 15.03 0.13 779.31 No Error
Media Decode Benchmark iGPU h265 8Mbps 4K@30 N/A 23 MTL 165H (32G Mem) 28 2614.16 31.93 0.39 619.40 2.16 0.00 10.93 0.16 581.65 No Error
Media Decode + 6*6 Compose Benchmark to 1080p@30FPS iGPU h264 4Mbps 1080p@30 1 14 MTL 165H (32G Mem) 17 3060.47 139.18 0.40 729.00 15.34 0.00 14.95 0.32 235.49 No Error
Media Decode + 6*6 Compose Benchmark to 4K@30FPS iGPU h264 16Mbps 4K@30 1 8 MTL 165H (32G Mem) 4 2871.83 39.65 0.30 725.15 8.74 0.00 11.00 0.25 695.82 No Error
Media Decode + 6*6 Compose Benchmark to 1080p@30FPS iGPU h265 2Mbps 1080p@30 1 26 MTL 165H (32G Mem) 17 2964.89 174.22 0.70 675.10 13.35 0.00 15.06 0.34 1381.67 No Error
Media Decode + 6*6 Compose Benchmark to 4K@30FPS iGPU h265 8Mbps 4K@30 1 7 MTL 165H (32G Mem) 4 2998.72 36.79 0.30 724.58 9.46 0.00 11.45 0.28 548.15 No Error
Media Performance Test Result

Media Encode and Decode Performance tests.

Media Performance Test Result
Details of Media Performance Test

media_performance_benchmark.tar.gz

GPU Freq Performance Test Result

This test uses the OpenVINO benchmark app to exercise the GPU for an extended period and while tracking its frequency.

GPU Freq Performance Test Result
Smart NVR Proxy Pipeline Benchmark Test Introduction

Benchmark Specification: Input: 1080p@30 H.264 4Mbps (video with 10 objects); Storage: 1080p@30 H.264 4Mbps; Output: VideoWall, 4K@30 H264 16Mbps; Benchmark metric: Number of video channels with inference.

Smart NVR Proxy Pipeline Benchmark Test Introduction
Smart NVR Proxy Pipeline Benchmark Test Result

Benchmark Specification: Input: 1080p@30 H.264 4Mbps (video with 10 objects); Storage: 1080p@30 H.264 4Mbps; Output: VideoWall, 4K@30 H264 16Mbps; Benchmark metric: Number of video channels with inference.

Pipeline_Test Device Used Input Codec Input Resolution Input Channels Model Compose Number of Monitors AI Channels Reference Platform Reference Value AVG CPU Freq(MHz) AVG CPU Util(%) AVG Memory Util(%) AVG GPU Freq(MHz) AVG GPU EU(RCS) Util(%) AVG GPU VDBox(VCS) Util(%) AVG package power(W) AVG GPU power(W) Duration(s) Result
Smart NVR Pipeline iGPU H264 (4Mbps) 1080p@20 25 yolov5s-416 5x5 1 8 MTL 165H (32G Mem) 23 2196.25 380.85 2.65 871.32 8.99 0.00 14.88 2.11 1106.31 No Error
Smart NVR Pipeline iGPU H264 (4Mbps) 1080p@20 25 yolov5m-416 5x5 1 4 MTL 165H (32G Mem) 12 2208.43 379.01 2.55 985.86 10.64 0.00 15.07 2.78 803.11 No Error
Smart NVR Pipeline iGPU H264 (4Mbps) 1080p@20 25 yolov5m-416+efficientnet-b0 5x5 1 1 MTL 165H (32G Mem) 3 2455.81 306.97 2.57 802.34 12.72 0.00 15.03 1.11 370.14 No Error
Smart NVR Proxy Pipeline Benchmark Test Result

Benchmark Specification: Input: 1080p@30 H.264 4Mbps (video with 10 objects); Storage: 1080p@30 H.264 4Mbps; Output: VideoWall, 4K@30 H264 16Mbps; Benchmark metric: Number of video channels with inference.

Smart NVR Proxy Pipeline Benchmark Test Result
Headed Visual AI Proxy Pipeline Benchmark Test Introduction

Benchmark Specification: Input: 1080p@30 H.264 4Mbps (video with 10 objects); Output: VideoWall, 4K@30 H264 16Mbps; Benchmark metric: Number of video channels.

Headed Visual AI Proxy Pipeline Benchmark Test Introduction
Headed Visual AI Proxy Pipeline Benchmark Test Result

Benchmark Specification: Input: 1080p@30 H.264 4Mbps (video with 10 objects); Output: VideoWall, 4K@30 H264 16Mbps; Benchmark metric: Number of video channels.

Pipeline_Test Device Used Input Codec Input Resolution Input Channels Model Compose Number of Monitors AI Channels Reference Platform Reference Value AVG CPU Freq(MHz) AVG CPU Util(%) AVG Memory Util(%) AVG GPU Freq(MHz) AVG GPU EU(RCS) Util(%) AVG GPU VDBox(VCS) Util(%) AVG package power(W) AVG GPU power(W) Duration(s) Result
Headed Visual AI Pipeline iGPU H264 (4Mbps) 1080p@30 8 yolov5s-416 4x4 1 8 MTL 165H (32G Mem) 16 2202.80 288.51 3.30 810.48 7.98 0.00 14.85 2.41 881.19 No Error
Headed Visual AI Pipeline iGPU H264 (4Mbps) 1080p@30 2 yolov5m-416 4x4 1 2 MTL 165H (32G Mem) 14 2185.33 243.68 1.09 802.12 10.75 0.00 15.06 3.43 449.75 No Error
Headed Visual AI Pipeline iGPU H264 (4Mbps) 1080p@30 2 yolov5m-416+efficientnet-b0 4x4 1 2 MTL 165H (32G Mem) 4 2475.79 121.54 2.17 731.19 8.18 0.00 15.08 1.93 349.37 No Error
Headed Visual AI Proxy Pipeline Benchmark Test Result

Benchmark Specification: Input: 1080p@30 H.264 4Mbps (video with 10 objects); Output: VideoWall, 4K@30 H264 16Mbps; Benchmark metric: Number of video channels.

Headed Visual AI Proxy Pipeline Benchmark Test Result
Details of Headed Visual AI Proxy Pipeline Benchmark Test

headed_visual_ai_proxy_pipeline_runner.tar.gz

VSaaS Gateway with Storage Proxy Pipeline Benchmark Test Introduction

Benchmark Specification: Input: 1080p@30 H.264 4Mbps (video with 10 objects); Storage: 1080p@30 H.265 2Mbps; Output: 1080p@30 H.265 2Mbps; Benchmark metric: Number of video channels.

VSaaS Gateway with Storage Proxy Pipeline Benchmark Test Introduction
VSaaS Gateway with Storage Proxy Pipeline Benchmark Test Result

Benchmark Specification: Input: 1080p@30 H.264 4Mbps (video with 10 objects); Storage: 1080p@30 H.265 2Mbps; Output: 1080p@30 H.265 2Mbps; Benchmark metric: Number of video channels.

Pipeline_Test Device Used Input Codec Input Resolution Input Channels Model Compose Number of Monitors AI Channels Reference Platform Reference Value AVG CPU Freq(MHz) AVG CPU Util(%) AVG Memory Util(%) AVG GPU Freq(MHz) AVG GPU EU(RCS) Util(%) AVG GPU VDBox(VCS) Util(%) AVG package power(W) AVG GPU power(W) Duration(s) Result
AI VSaaS Gateway Pipeline iGPU H264 (4Mbps) 1080p@30 12 yolov5s-416 N/A N/A 12 MTL 165H (32G Mem) 27 2228.43 232.22 2.39 1097.52 1.58 0.00 15.04 3.21 848.26 No Error
AI VSaaS Gateway Pipeline iGPU H264 (4Mbps) 1080p@30 6 yolov5m-416 N/A N/A 6 MTL 165H (32G Mem) 16 2082.53 212.36 1.60 826.59 1.38 0.00 15.04 3.90 581.71 No Error
AI VSaaS Gateway Pipeline iGPU H264 (4Mbps) 1080p@30 2 yolov5m-416+efficientnet-b0 N/A N/A 2 MTL 165H (32G Mem) 4 2466.14 86.72 1.80 598.77 1.71 0.00 14.96 1.91 327.01 No Error
VSaaS Gateway with Storage Proxy Pipeline Benchmark Test Result

Benchmark Specification: Input: 1080p@30 H.264 4Mbps (video with 10 objects); Storage: 1080p@30 H.265 2Mbps; Output: 1080p@30 H.265 2Mbps; Benchmark metric: Number of video channels.

VSaaS Gateway with Storage Proxy Pipeline Benchmark Test Result
Details of VSaaS Gateway with Storage Proxy Pipeline Benchmark Test

ai_vsaas_proxy_pipeline_runner.tar.gz

License Plate Recognition(LPR) AI Proxy Pipeline Benchmark Introduction

License Plate Recognition(LPR) Pipeline Benchmark

License Plate Recognition(LPR) AI Proxy Pipeline Benchmark Introduction
License Plate Recognition(LPR) AI Proxy Pipeline Benchmark Result

License Plate Recognition(LPR) Pipeline Benchmark

Pipeline Test Model Mode Devices Used AI Channels Avg FPS Reference Platform Reference Value AVG CPU Freq(MHz) AVG CPU Util(%) AVG Memory Util(%) AVG GPU Freq(MHz) AVG GPU EU(RCS) Util(%) AVG GPU VDBox(VCS) Util(%) AVG package power(W) AVG GPU power(W) Duration(s) Result
LPR Pipeline yolov8_license_plate_detector+ch_PP-OCRv4_rec_infer Mode 2 iGPU(Dec)/iGPU(Det)/iGPU(Cls) 6 35.43 MTL 165H (32G Mem) 14 2247.12 122.83 1.21 1001.37 1.25 0.00 15.30 5.17 272.10 No Error
LPR Pipeline yolov8_license_plate_detector+ch_PP-OCRv4_rec_infer Mode 3 iGPU(Dec)/iGPU(Det)/NPU(Cls) 7 32.76 MTL 165H (32G Mem) 14 2378.32 109.19 1.74 957.17 1.40 0.00 15.18 4.77 353.47 No Error
LPR Pipeline yolov8_license_plate_detector+ch_PP-OCRv4_rec_infer Mode 4 iGPU(Dec)/NPU(Det)/NPU(Cls) 9 32.34 MTL 165H (32G Mem) 14 2900.62 142.48 1.60 286.59 2.06 0.00 15.24 0.16 304.24 No Error
License Plate Recognition(LPR) AI Proxy Pipeline Benchmark Result

License Plate Recognition(LPR) Pipeline Benchmark

License Plate Recognition(LPR) AI Proxy Pipeline Benchmark Result
Details of License Plate Recognition(LPR) AI Proxy Pipeline Benchmark

lpr_proxy_pipeline_runner.tar.gz

Back to Top

Edge Software Device Qualification