Performance measurement
1. Product Information
Product versions to be tested:
MetaDefender Kiosk 4.7.9.4229
MetaDefender Managed File Transfer 3.9.3.0
MetaDefender Core 5.15.1
Engines:
Metascan:
- 20 AV engines package + Crowdstrike when testing with CAB file
 - MAX AV engines package when testing with mixed dataset
 - 8 AV engines package when testing with mixed dataset
 
Deep CDR: 7.5.1
Proactive DLP: 3.0.0
Archive: 7.5.1
FileType: 7.5.2
File-Based Vulnerability Assessment: 4.2.416.0
2. Environment
MetaDefender Kiosk devices
Using the KIOSK devices in the local test environment. MetaDefender Core is installed on the same system as MetaDefender Kiosk.
| Model | CPU | Memory (GB) | Disk type | OS | 
|---|---|---|---|---|
| K1001 (Dell 7410) | Intel Core i9-13900 Cores: 24 Logical processors: 32 Base speed: 2.00 GHz  | 32 | SSD | Windows 10 IoT Enterprise LTSC Version: 21H2  | 
| K1001 (Dell 7420) | Intel Core i9-14900 Cores: 24 Logical processors: 32 Base speed: 2.00 GHz  | 32 | SSD | Windows 10 IoT Enterprise LTSC Version: 21H2  | 
| K2100 | Intel Core i7-1260U Cores: 10 Logical processors: 12 Base speed: 1.10 GHz  | 32 | SSD | Windows 10 IoT Enterprise LTSC Version: 21H2  | 
| K3001 | Intel Core i9-12900 Cores: 16 Logical processors: 24 Base speed: 2.40 GHz  | 32 | SSD | Windows 10 IoT Enterprise LTSC Version: 21H2  | 
Storage Device
Using to store the dataset and connect to the Kiosk device: 128GB SanDisk USB 3.2 Gen 1
MFT Server
In case the MD Kiosk sends files to MD MFT after scanning, MD MFT is a virtual machine with the following specifications:
| OS | vCPU | Memory (GB) | Disk type | Network bandwidth (Gbps) | 
|---|---|---|---|---|
| Windows Server 2022 | 8 | 16 | SSD | 10 Gb Ethernet | 
Client
Using to run the Python script. The Client is a virtual machine with the following specifications:
| OS | vCPU | Memory (GB) | Disk type | Network bandwidth (Gbps) | 
|---|---|---|---|---|
| CentOS Linux 7.9 | 8 | 16 | SSD | 10 Gb Ethernet | 
3. Test flows
- Flow 1: MD Kiosk sends CAB file to MD Core (21 AV engines) for scanning.
 - Flow 2: MD Kiosk sends Mixed dataset to MD Core (MAX AV engines) for scanning.
 - Flow 3: MD Kiosk sends Mixed dataset to MD Core (8 AV engines) for scanning.
 - Flow 4: MD Kiosk sends Mixed dataset to MD Core for scanning, and Allowed files are copied to MD MFT.
 
4. Dataset
CAB file:
- Extracted files: 849 479
 - Total size of extracted files: 26.5 GB
 
Mixed dataset:
Summary (compressed):
- Number of files: 5000
 - Total size: 7728.5 MB
 - Average file size: 1.55 MB
 
Summary (extracted):
- Number of files: 5260
 - Total size: 7759.5 MB
 - Average file size: 1.48 MB
 
Largest file size: 24.7 MB
Smallest file size: 5 KB
| File category | File type | Number of files | Total size (MB) | Average file size (MB) | 
|---|---|---|---|---|
| Adobe | 370 | 385 MB | 1.0 MB | |
| Executable | EXE | 45 | 309.5 MB | 6.9 MB | 
| MSI | 15 | 45.75 MB | 3.1 MB | |
| Image | BMP | 80 | 515 MB | 6.4 MB | 
| JPG | 420 | 237.5 MB | 0.6 MB | |
| PNG | 345 | 169 MB | 0.5 MB | |
| Media | MP3 | 135 | 865 MB | 6.4 MB | 
| MP4 | 50 | 500 MB | 10.0 MB | |
| Office | DOCX | 235 | 190 MB | 0.8 MB | 
| DOC | 225 | 486 MB | 2.2 MB | |
| PPTX | 365 | 860 MB | 2.4 MB | |
| PPT | 355 | 1950 MB | 5.5 MB | |
| XLSX | 340 | 283.5 MB | 0.8 MB | |
| XLS | 335 | 284.5 MB | 0.8 MB | |
| Text | CSV | 100 | 236 MB | 2.4 MB | 
| HTML | 1075 | 76 MB | 0.1 MB | |
| TXT | 500 | 210 MB | 0.4 MB | |
| Archive | ZIP | Compressed files: 10 Extracted files: 270  | Compressed size: 125.5 MB Extracted size: 156.5 MB  | Avg compressed size: 12.6 MB Avg extracted size: 0.6 MB  | 
5. MetaDefender Core settings
General settings
- Turn off data retention
 - Turn off the engine update
 - Max size:
- File scan: 9999999999999 MB
 - URL file download: 9999999999999 MB
 
 
Metascan
- Enable engines depend on the testing package
 - Per AV engine scan: 1 min
 - Global scan: 10 mins
 - File download: 5 mins
 
Deep CDR
- Enable engine
 - 135 file types
 
Proactive DLP
- Enable engine
 
Archive Extraction
- Enable engine
 - Max recursive level: 99999999
 - Max number of files extracted: 99999999
 - Max total size of extracted files: 99999999
 - Timeout: 90 mins
 
Archive Compression
- Enable engine
 
FileType
- Enable engine
 - Timeout: 5 mins
 
File-Based Vulnerability Assessment
- Enable engine
 
6. Test Summary
Flow 1: MD Kiosk sends CAB file to MD Core (21 AV engines) for scanning.
| Device | Duration | Avg. CPU Usage | Avg. Memory Usage | Avg. Disk Speed (KB/s) | Throughput (objects/hour) | Throughput (files/hour) | 
|---|---|---|---|---|---|---|
| Kiosk Desktop (Dell Pro 24) | 3 hours 7 minutes | 57.1% | 62.5% | Read 3,113.1 Write 17,313.7 | 272,630.1 | 0.3 | 
| Kiosk Desktop (Dell 7420) | 3 hours and 56 minutes | 51.2% | 63.6% | Read 2,546.5 Write 13,581.8 | 216,132.2 | 0.3 | 
| Kiosk Mobile/Mini (Dell 7230) | 10 hours 23 minutes | 95% | 61.5% | Read 978.6 Write 5,980.7 | 81,829 | 0.1 | 
| Kiosk Tower (Dell 17S XE4) | 3 hours 59 minutes | 61.9% | 61.4% | Read 1,796.9 Write 12,266.6 | 213,043.9 | 0.3 | 
| Kiosk Tower (Dell 18S XE5) | 3 hours 3 minutes | 57.7% | 61.8% | Read 2,298.8 Write 15,459.9 | 278,286.5 | 0.3 | 
Flow 2: MD Kiosk sends Mixed dataset to MD Core (MAX AV engines) for scanning.
| Device | Duration | Avg. CPU Usage | Avg. Memory Usage | Avg. Disk Speed (KB/s) | Throughput (objects/hour) | Throughput (files/hour) | 
|---|---|---|---|---|---|---|
| Kiosk Desktop (Dell Pro 24) | 2 hours and 16 minutes | 45.3% | 71.3% | Read 5,223.5 Write 7,096.8 | 57,442.9 | 2,206.7 | 
| Kiosk Desktop (Dell 7420) | 2 hours and 25 minutes | 48.8% | 81.0% | Read 4,973.2 Write 7,812.6 | 54,025.1 | 2,075.4 | 
| Kiosk Mobile/Mini (Dell 7230) | 5 hours 12 minutes | 95.6% | 74.5% | Read 3,185.5 Write 4,352.2 | 25,051.5 | 962.4 | 
| Kiosk Tower (Dell 17S XE4) | 2 hours 30 minutes | 62.5% | 76.1% | Read 5,235.8 - Write 7,327 | 52,199.8 | 2,005.1 | 
| Kiosk Tower (Dell 18S XE5) | 2 hours and 25 minutes | 41.1 | 76.5 | Read 4,988.9 Write 9,399.4 | 53,925.3 | 2,071.8 | 
Flow 3: MD Kiosk sends Mixed dataset to MD Core (8 AV engines) for scanning.
| Device | Duration | Avg. CPU Usage | Avg. Memory Usage | Avg. Disk Speed (KB/s) | Throughput (objects/hour) | Throughput (files/hour) | 
|---|---|---|---|---|---|---|
| Kiosk Desktop (Dell Pro 24) | 52 minutes | 23.4% | 43.6% | Read 7,590.2 Write 9,631.8 | 150,280.9 | 5,772.9 | 
| Kiosk Desktop (Dell 7420) | 53 minutes | 27.7% | 43.0% | Read 7,761.6 Write 8,864.5 | 147,280.3 | 5,656.8 | 
| Kiosk Mobile/Mini (Dell 7230) | 1 hour 32 minutes | 73.3% | 42.3% | Read 4,100.5 Write 6,444.1 | 85,643.2 | 3,249.7 | 
| Kiosk Tower (Dell 17S XE4) | 1 hour 1 minutes | 37.4% | 42.8% | Read 6,545.4 Write 9,593.2 | 129,960 | 4,927.5 | 
| Kiosk Tower (Dell 18S XE5) | 1 hour 5 minutes | 18.3% | 41.7% | Read 6,722.8 Write 8,156.8 | 119,901.6 | 4,605.9 | 
Flow 4: MD Kiosk sends Mixed dataset to MD Core for scanning, and Allowed files are copied to MD MFT.
| Device | Duration | Avg. CPU Usage | Avg. Memory Usage | Avg. Disk Speed (KB/s) | Avg. Network Speed (KB/s) | Throughput (objects/hour) | Throughput (files/hour) | 
|---|---|---|---|---|---|---|---|
| Kiosk Desktop (Dell Pro 24) | 1 hour and 45 minutes | 6% | 34.7% | Read 3,950.4 Write 3,558.5 | Receive 20.3 Send 1,049.5 | 151,845.4 | 2,600 | 
| Kiosk Desktop (Dell 7420) | |||||||
| Kiosk Mobile/Mini (Dell 7230) | 1 hour 22 minutes | 36.1% | 30.5% | Read 4,684.2 Write 5,756.4 | Receive 30.8 Send 1,705.6 | 114,606.1 | 3,643.7 | 
| Kiosk Tower (Dell 17S XE4) | 1 hour 7 minutes | 13.6% | 32.0% | Read 5,561.1 Write 7,621.6 | Receive 96.8 Send 2,130.4 | 143,510.7 | 4,447.7 | 
| Kiosk Tower (Dell 18S XE5) | 57 minutes | 12.6% | 32.8% | Read 7,316.2 Write 7,062.7 | Receive 114.8 Send 2,443.3 | 173,595.9 | 5,260.1 | 
