Performance measurement
1. Product Information
Product versions to be tested:
MetaDefender Kiosk 4.7.5
MetaDefender Managed File Transfer 3.8.0
MetaDefender Core 5.14.0
Engines:
Metascan:
- 20 AV engines package + Crowdstrike when testing with CAB file
- MAX AV engines package when testing with mixed dataset
- 8 AV engines package when testing with mixed dataset
Deep CDR: 7.4.0
Proactive DLP: 2.22.1
Archive: 7.4.0
FileType: 7.4.0
File-Based Vulnerability Assessment: 4.2.416.0
2. Environment
MetaDefender Kiosk devices
Using the KIOSK devices in the local test environment. MetaDefender Core is installed on the same system as MetaDefender Kiosk.
Model | CPU | Memory (GB) | Disk type | OS |
---|---|---|---|---|
K1001 (Dell 7410) | Intel Core i9-13900 Cores: 24 Logical processors: 32 Base speed: 2.00 GHz | 32 | SSD | Windows 10 IoT Enterprise LTSC Version: 21H2 |
K1001 (Dell 7420) | Intel Core i9-14900 Cores: 24 Logical processors: 32 Base speed: 2.00 GHz | 32 | SSD | Windows 10 IoT Enterprise LTSC Version: 21H2 |
K2100 | Intel Core i7-1260U Cores: 10 Logical processors: 12 Base speed: 1.10 GHz | 32 | SSD | Windows 10 IoT Enterprise LTSC Version: 21H2 |
K3001 | Intel Core i9-12900 Cores: 16 Logical processors: 24 Base speed: 2.40 GHz | 32 | SSD | Windows 10 IoT Enterprise LTSC Version: 21H2 |
Storage Device
Using to store the dataset and connect to the Kiosk device: 128GB SanDisk USB 3.2 Gen 1
MFT Server
In case the MD Kiosk sends files to MD MFT after scanning, MD MFT is a virtual machine with the following specifications:
OS | vCPU | Memory (GB) | Disk type | Network bandwidth (Gbps) |
---|---|---|---|---|
Windows Server 2022 | 8 | 16 | SSD | 10 Gb Ethernet |
Client
Using to run the Python script. The Client is a virtual machine with the following specifications:
OS | vCPU | Memory (GB) | Disk type | Network bandwidth (Gbps) |
---|---|---|---|---|
CentOS Linux 7.9 | 8 | 16 | SSD | 10 Gb Ethernet |
3. Test flows
- Flow 1: MD Kiosk sends CAB file to MD Core (21 AV engines) for scanning.
- Flow 2: MD Kiosk sends Mixed dataset to MD Core (MAX AV engines) for scanning.
- Flow 3: MD Kiosk sends Mixed dataset to MD Core (8 AV engines) for scanning.
- Flow 4: MD Kiosk sends Mixed dataset to MD Core for scanning, and Allowed files are copied to MD MFT.
4. Dataset
CAB file:
- Extracted files: 849 479
- Total size of extracted files: 26.5 GB
Mixed dataset:
Summary (compressed):
- Number of files: 5000
- Total size: 7728.5 MB
- Average file size: 1.55 MB
Summary (extracted):
- Number of files: 5260
- Total size: 7759.5 MB
- Average file size: 1.48 MB
Largest file size: 24.7 MB
Smallest file size: 5 KB
File category | File type | Number of files | Total size (MB) | Average file size (MB) |
---|---|---|---|---|
Adobe | 370 | 385 MB | 1.0 MB | |
Executable | EXE | 45 | 309.5 MB | 6.9 MB |
MSI | 15 | 45.75 MB | 3.1 MB | |
Image | BMP | 80 | 515 MB | 6.4 MB |
JPG | 420 | 237.5 MB | 0.6 MB | |
PNG | 345 | 169 MB | 0.5 MB | |
Media | MP3 | 135 | 865 MB | 6.4 MB |
MP4 | 50 | 500 MB | 10.0 MB | |
Office | DOCX | 235 | 190 MB | 0.8 MB |
DOC | 225 | 486 MB | 2.2 MB | |
PPTX | 365 | 860 MB | 2.4 MB | |
PPT | 355 | 1950 MB | 5.5 MB | |
XLSX | 340 | 283.5 MB | 0.8 MB | |
XLS | 335 | 284.5 MB | 0.8 MB | |
Text | CSV | 100 | 236 MB | 2.4 MB |
HTML | 1075 | 76 MB | 0.1 MB | |
TXT | 500 | 210 MB | 0.4 MB | |
Archive | ZIP | Compressed files: 10 Extracted files: 270 | Compressed size: 125.5 MB Extracted size: 156.5 MB | Avg compressed size: 12.6 MB Avg extracted size: 0.6 MB |
5. MetaDefender Core settings
General settings
- Turn off data retention
- Turn off the engine update
- Max size:
- File scan: 9999999999999 MB
- URL file download: 9999999999999 MB
Metascan
- Enable engines depend on the testing package
- Per AV engine scan: 1 min
- Global scan: 10 mins
- File download: 5 mins
Deep CDR
- Enable engine
- 135 file types
Proactive DLP
- Enable engine
Archive Extraction
- Enable engine
- Max recursive level: 99999999
- Max number of files extracted: 99999999
- Max total size of extracted files: 99999999
- Timeout: 90 mins
Archive Compression
- Enable engine
FileType
- Enable engine
- Timeout: 5 mins
File-Based Vulnerability Assessment
- Enable engine
6. Test Summary
Due to a technical issue, the scan results for K1002 (Dell 7420) will be based on the previous results obtained with Core 5.13.0 and Kiosk 4.7.3.
Flow 1: MD Kiosk sends CAB file to MD Core (21 AV engines) for scanning.
Device | Duration | Avg. CPU Usage | Avg. Memory Usage | Avg. Disk Speed (KB/s) | Throughput (objects/hour) | Throughput (objects/hour) |
---|---|---|---|---|---|---|
K1001 (Dell 7410) | ||||||
K1002 (Dell 7420) | 3 hours 27 minutes | 50.4%% | 57.6% | Read: 2,451.8 Write: 17,118.4 | 246,659 | 0.3 |
K2100 | 7 hours 24 minutes | 91.9% | 50.8% | Read 1,256.4 Write 7,865.7 | 114,714.3 | 0.1 |
K3001 | 4 hours 14 minutes | 67.8% | 52.8% | Read 2,186.1 Write 11,357.2 | 200,527.4 | 0.2 |
Flow 2: MD Kiosk sends Mixed dataset to MD Core (MAX AV engines) for scanning.
Device | Duration | Avg. CPU Usage | Avg. Memory Usage | Avg. Disk Speed (KB/s) | Throughput (objects/hour) | Throughput (files/hour) |
---|---|---|---|---|---|---|
K1001 (Dell 7410) | ||||||
K1001 (Dell 7420) | 2 hours 21 minutes | 53.2% | 69.6% | Read: 5,759.6 Write: 10,892.1 | 54,182.7 | 2,129.9 |
K2100 | 5 hours 3 minutes | 88.4% | 55.2% | Read 3,070 Write 6,393.1 | 25,187.7 | 990.3 |
K3001 | 2 hours 50 minutes | 69.3% | 73.9% | Read 7,396.2 Write 13,534.7 | 44,764.5 | 1,759.9 |
Flow 3: MD Kiosk sends Mixed dataset to MD Core (8 AV engines) for scanning.
Device | Duration | Avg. CPU Usage | Avg. Memory Usage | Avg. Disk Speed (KB/s) | Throughput (objects/hour) | Throughput (files/hour) |
---|---|---|---|---|---|---|
K1001 (Dell 7410) | 36 minutes | 36.3% | 42.4% | Read 9,627.8 Write 16,248.2 | 210,572.5 | 8,268.3 |
K1001 (Dell 7420) | 34 minutes | 34.3% | 39.6% | Read 9,663.6 Write 11,680.4 | 224,683.2 | 8,832.2 |
K2100 | 1 hour 13 minutes | 79.6% | 41.5% | Read 4,323.4 Write 6,826 | 104,058.8 | 4,090.9 |
K3001 | 48 minutes | 53.4% | 44.0% | Read 8,067.8 Write 11,564.3 | 157,808.21 | 6,204.8 |
Flow 4: MD Kiosk sends Mixed dataset to MD Core for scanning, and Allowed files are copied to MD MFT.
Device | Duration | Avg. CPU Usage | Avg. Memory Usage | Avg. Disk Speed (KB/s) | Avg. Network Speed (KB/s) | Throughput (objects/hour) | Throughput (files/hour) |
---|---|---|---|---|---|---|---|
K1001 (Dell 7410) | |||||||
K1001 (Dell 7420) | 20 minutes | 59.6% | 36.7% | Read 28,855.8 Write 45,143.1 | Receive 40.3 Send 6,737.9 | 534,171.1 | 15,000 |
K2100 | 36 minutes | 49.7% | 38.5% | Read 8,928 Write 10,438.8 | Receive 27.5 Send 4,597.5 | 248,804.4 | 8,356.5 |
K3001 | 25 minutes | 34.7% | 36.8% | Read 13,645.2 Write 12,335.3 | Receive 7.2 - Send 1.2 | 302,825.3 | 11,889 |