These results should be viewed as guidelines and not performance guarantees, since there are many variables that affect performance (file set, network configurations, hardware characteristics, etc.). If throughput is important to your implementation, OPSWAT recommends site-specific benchmarking before implementing a production solution.
Environment
Using AWS environment with the specification below:
MetaDefender Core
| OS | AWS instance type | vCPU | Memory (GB) | Network bandwidth (Gbps) | Disk type | Benchmark |
|---|---|---|---|---|---|---|
| Windows Server 2022 | c5.4xlarge | 16 | 32 | Up to 10 | SSD | Amazon EC2 c5.4xlarge - Geekbench |
Client tool
A simple tool written in Python to collect files in a designated folder and submit requests to MetaDefender Core.
This client tool is running on CentOS 7
x
files_to_scan = list of files to scanscan_futures = [asyncio.create_task(self.scan_file(file_path)) for file_path in files_to_scan]async def scan_file(self, file_path): api_url = f'{self.core_url}/file' with open(file_path, 'rb') as file: file_content = file.read() headers = {'Content-Type': 'application/octet-stream', 'filename': file_path} max_retries = 20 # Maximum number of retry attempts retry_delay = 120 # Delay in seconds before retrying for attempt in range(max_retries + 1): try: response = requests.post(api_url, data=file_content, headers=headers) status_code = response.status_code if status_code == 200: response_json = response.json() data_id = response_json.get('data_id') return status_code, response_json, data_id if status_code == 503: print(f"Received status code {status_code}. Retrying in {retry_delay} seconds...") await asyncio.sleep(retry_delay) else: return None, None, None except requests.RequestException as e: return None, None, None return None, None, None| OS | AWS instance type | vCPU | Memory (GB) | Network bandwidth (Gbps) | Disk type |
|---|---|---|---|---|---|
| CentOS 7 | c5.2xlarge | 8 | 16 | Up to 10 | SSD |
Dataset
Detailed information of dataset below will be used for testing:
| File category | File type | Number of files | Total size (MB) | Average file size (MB) |
|---|---|---|---|---|
| Adobe | 370 | 385 MB | 1.0 MB | |
| Executable | EXE | 45 | 309.5 MB | 6.9 MB |
| MSI | 15 | 45.75 MB | 3.1 MB | |
| Image | BMP | 80 | 515 MB | 6.4 MB |
| JPG | 420 | 237.5 MB | 0.6 MB | |
| PNG | 345 | 169 MB | 0.5 MB | |
| Media | MP3 | 135 | 865 MB | 6.4 MB |
| MP4 | 50 | 500 MB | 10.0 MB | |
| Office | DOCX | 235 | 190 MB | 0.8 MB |
| DOC | 225 | 486 MB | 2.2 MB | |
| PPTX | 365 | 860 MB | 2.4 MB | |
| PPT | 355 | 1950 MB | 5.5 MB | |
| XLSX | 340 | 283.5 MB | 0.8 MB | |
| XLS | 335 | 284.5 MB | 0.8 MB | |
| Text | CSV | 100 | 236 MB | 2.4 MB |
| HTML | 1075 | 76 MB | 0.1 MB | |
| TXT | 500 | 210 MB | 0.4 MB | |
| Archive | ZIP | Compressed files: 10 Extracted files: 270 | Compressed size: 125.5 MB Extracted size: 156.5 MB | Avg compressed size: 12.6 MB Avg extracted size: 0.6 MB |
| Summary (compressed) | 5000 | 7728.5 MB | 1.55 MB average file size | |
| Summary (extracted) | 5260 | 7759.5 MB | 1.48 MB average file size |
Product Information
Product versions:
- MetaDefender Core 5.17.0
- Engines:
- Metascan 8: Ahnlab, Avira, ClamAV, ESET, Bitdefender, K7, Quick Heal, VirIT Explorer
- Metascan 12: Metascan 8, Varist, Ikarus, Emsisoft, Tachyon
- Metascan 16: Metascan 12, NANOAV, Comodo, VirusBlokAda, Zillya!
- Deep CDR: 7.7.0
- Proactive DLP: 3.1.0
- Archive: 7.7.0
- File type analysis: 7.7.0
- File-based vulnerability assessment: 4.2.416.0
MetaDefender Core settings
General settings
- Turn off data retention
- Turn off engine update
Archive extraction settings
- Max recursion level: 99999999
- Max number of extracted files: 99999999
- Max total size of extracted files: 99999999
- Timeout: 10 minutes
- Handle archive extraction task as Failed: true
- Extracted partially: true
Metascan AV settings
- Max file size: 99999999
- Scan timeout: 10 minutes
- Per engine scan timeout: 1 minutes
Performance test results
Summary
MetaDefender Core with single engine (technology):
| Use case | Scan duration (minutes) |
Throughput (processed objects/hour) |
Avg. processing time (seconds/object) |
Avg./Max CPU usage (%) |
Avg./Max RAM usage (%) |
Avg. Network speed (KB/s) |
|---|---|---|---|---|---|---|
| Metascan 8 | 18.8 | 415,884 | 0.009 | 81.3/99.6 | 42.1/43.7 | 6,352 |
| Metascan 12 | 32.8 | 237,729 | 0.015 | 87.4/99.9 | 48.7/53.2 | 3,674 |
| Metascan 16 | 39.5 | 197,756 | 0.018 | 86.9/99.7 | 51.8/56.9 | 5,044 |
| Deep CDR | 16.0 | 489,381 | 0.007 | 85.0/99.5 | 46.9/54.1 | 8,029 |
| Proactive DLP | 13.2 | 591,179 | 0.006 | 60.0/99.1 | 45.2/49.0 | 8,952 |
| Vulnerability | 11.1 | 706,464 | 0.005 | 72.4/99.4 | 42.4/44.8 | 15,294 |
| Embedded Sandbox | 331.1 | 23,584 | 0.153 | 44.0/99.2 | 46.6/54.7 | 2,313 |
MetaDefender Core with common engine packages:
| Use case | Scan duration (minutes) |
Throughput (processed objects/hour) |
Avg. processing time (seconds/object) |
Avg./Max CPU usage (%) |
Avg./Max RAM usage (%) |
Avg. Network speed (KB/s) |
|---|---|---|---|---|---|---|
| Metascan 8 + Deep CDR |
26.1 | 299,343 | 0.012 | 91.8/99.9 | 47.3/54.6 | 5,129 |
| Metascan 8 + Deep CDR + Proactive DLP |
26.4 | 296,213 | 0.012 | 94.4/99.9 | 47.5/53.9 | 5,532 |
| Metascan 8 + Deep CDR + Proactive DLP + Vulnerability |
29.2 | 267,028 | 0.013 | 92.1/99.9 | 47.0/53.7 | 4,209 |
| Metascan 8 + Deep CDR + Proactive DLP + Vulnerability + Embedded Sandbox |
341.9 | 22,836 | 0.158 | 52.0/99.4 | 52.1/62.6 | 2,159 |
| Metascan 12 + Deep CDR |
38.5 | 202,688 | 0.018 | 90.0/99.9 | 50.7/56.4 | 3,459 |
| Metascan 12 + Deep CDR + Proactive DLP |
39.0 | 200,349 | 0.018 | 90.2/99.9 | 50.5/56.3 | 3,083 |
| Metascan 12 + Deep CDR + Proactive DLP + Vulnerability |
41.0 | 190,496 | 0.019 | 90.8/99.9 | 49.3/58.4 | 2,873 |
| Metascan 12 + Deep CDR + Proactive DLP + Vulnerability + Embedded Sandbox |
348.6 | 22,399 | 0.161 | 54.7/99.5 | 54.8/65.3 | 2,270 |
| Metascan 16 + Deep CDR |
46.2 | 169,098 | 0.021 | 90.2/99.9 | 56.9/67.4 | 2,456 |
| Metascan 16 + Deep CDR + Proactive DLP |
50.3 | 155,105 | 0.023 | 81.9/99.6 | 56.4/61.8 | 3,166 |
| Metascan 16 + Deep CDR + Proactive DLP + Vulnerability |
51.3 | 152,265 | 0.024 | 85.3/99.7 | 55.9/64.8 | 2,799 |
| Metascan 16 + Deep CDR + Proactive DLP + Vulnerability + Embedded Sandbox |
358.2 | 21,802 | 0.165 | 56.6/99.3 | 56.3/66.2 | 2,221 |
System resource utilization charts
MetaDefender Core with Metascan 8:
| Utilization charts | |
|---|---|
| CPU usage |  |
| Memory usage |  |
| Network usage |   |
| Disk usage |   |
MetaDefender Core with Metascan 8 + Deep CDR + Proactive DLP + Vulnerability:
| Utilization charts | |
|---|---|
| CPU usage |  |
| Memory usage |  |
| Network usage |
|
| Disk usage |
|
MetaDefender Core with Metascan 16 + Deep CDR + Proactive DLP + Vulnerability:
| Utilization charts | |
|---|---|
| CPU usage |  |
| Memory usage |  |
| Network usage |
|
| Disk usage |
|
Was this page helpful?
