Standalone DB - Linux
These results should be viewed as guidelines and not performance guarantees, since there are many variables that affect performance (file set, network configurations, hardware characteristics, etc.). If throughput is important to your implementation, OPSWAT recommends site-specific benchmarking before implementing a production solution.
Environment
Using AWS environment with the specification below:
MetaDefender Core
| OS | AWS instance type | vCPU | Memory (GB) | Network bandwidth (Gbps) | Disk type | Benchmark |
|---|---|---|---|---|---|---|
| Ubuntu 24.04 | c5.4xlarge | 16 | 32 | Up to 10 | SSD | Amazon EC2 c5.4xlarge - Geekbench |
Client tool
A simple tool written in Python to collect files in a designated folder and submit requests to MetaDefender Core.
This client tool is running on CentOS 7
x
files_to_scan = list of files to scanscan_futures = [asyncio.create_task(self.scan_file(file_path)) for file_path in files_to_scan]async def scan_file(self, file_path): api_url = f'{self.core_url}/file' with open(file_path, 'rb') as file: file_content = file.read() headers = {'Content-Type': 'application/octet-stream', 'filename': file_path} max_retries = 20 # Maximum number of retry attempts retry_delay = 120 # Delay in seconds before retrying for attempt in range(max_retries + 1): try: response = requests.post(api_url, data=file_content, headers=headers) status_code = response.status_code if status_code == 200: response_json = response.json() data_id = response_json.get('data_id') return status_code, response_json, data_id if status_code == 503: print(f"Received status code {status_code}. Retrying in {retry_delay} seconds...") await asyncio.sleep(retry_delay) else: return None, None, None except requests.RequestException as e: return None, None, None return None, None, None| OS | AWS instance type | vCPU | Memory (GB) | Network bandwidth (Gbps) | Disk type |
|---|---|---|---|---|---|
| CentOS 7 | c5.4xlarge | 16 | 32 | Up to 10 | SSD |
Dataset
Detailed information of dataset below will be used for testing:
| File category | File type | Number of files | Total size (MB) | Average file size (MB) |
|---|---|---|---|---|
| Adobe | 370 | 385 MB | 1.0 MB | |
| Executable | EXE | 45 | 309.5 MB | 6.9 MB |
| MSI | 15 | 45.75 MB | 3.1 MB | |
| Image | BMP | 80 | 515 MB | 6.4 MB |
| JPG | 420 | 237.5 MB | 0.6 MB | |
| PNG | 345 | 169 MB | 0.5 MB | |
| Media | MP3 | 135 | 865 MB | 6.4 MB |
| MP4 | 50 | 500 MB | 10.0 MB | |
| Office | DOCX | 235 | 190 MB | 0.8 MB |
| DOC | 225 | 486 MB | 2.2 MB | |
| PPTX | 365 | 860 MB | 2.4 MB | |
| PPT | 355 | 1950 MB | 5.5 MB | |
| XLSX | 340 | 283.5 MB | 0.8 MB | |
| XLS | 335 | 284.5 MB | 0.8 MB | |
| Text | CSV | 100 | 236 MB | 2.4 MB |
| HTML | 1075 | 76 MB | 0.1 MB | |
| TXT | 500 | 210 MB | 0.4 MB | |
| Archive | ZIP | Compressed files: 10 Extracted files: 270 | Compressed size: 125.5 MB Extracted size: 156.5 MB | Avg compressed size: 12.6 MB Avg extracted size: 0.6 MB |
| Summary (compressed) | 5000 | 7728.5 MB | 1.55 MB average file size | |
| Summary (extracted) | 5260 | 7759.5 MB | 1.48 MB average file size |
Product Information
Product versions:
- MetaDefender Core version 5.16.0
- Engines:
- Metascan 5: Ahnlab, Bitdefender, ClamAV, ESET, K7
- Metascan 10: Metascan 5 + Avira, Varist, IKARUS, Quick Heal, TACHYON
- Metascan MAX: Metascan 10 + Lionic, CMC, CrowdStrike Falcon ML, Aurora, Trellix, NANOV, RocketCyber, Sophos, Webroot SMD, Xvirus Anti-Malware
- Deep CDR: 7.6.0
- Proactive DLP: 3.0.0
- Archive: 7.6.0
- File type analysis: 7.6.0
- File-based vulnerability assessment: 4.57-236
MetaDefender Core settings
General settings
- Turn off data retention
- Turn off engine update
Archive extraction
- Max recursion level: 99999999
- Max number of extracted files: 99999999
- Max total size of extracted files: 99999999
- Timeout: 10 minutes
- Handle archive extraction task as Failed: true
- Extracted partially: true
Metascan
- Max file size: 99999999
- Scan timeout: 10 minutes
- Per engine scan timeout: 1 minutes
Performance test results
Summary
MetaDefender Core with single engine (technology):
| Use case | Scan duration (minutes) |
Throughput (objects/hour) |
Avg. processing time (seconds/object) |
Avg./Max CPU usage (%) |
Avg./Max RAM usage (%) |
Avg. Network speed (KB/s) |
|---|---|---|---|---|---|---|
| Metascan 5 | 14.3 | 533,601 | 0.007 | 83.3/96.5 | 26.1/34.2 | 13,311 |
| Metascan 10 | 23.4 | 326,695 | 0.011 | 85.9/97.8 | 34.6/36.5 | 7,802 |
| Metascan MAX | 38.3 | 199,110 | 0.018 | 90.0/99.3 | 52.9/63.1 | 8,828 |
| Deep CDR | 19.1 | 399,424 | 0.009 | 72.3/93.5 | 43.5/47.3 | 13,230 |
| Proactive DLP | 15.8 | 482,848 | 0.007 | 71.9/91.8 | 33.2/38.3 | 10,737 |
| Vulnerability | 11.6 | 657,672 | 0.005 | 78.0/95.2 | 28.7/29.6 | 11,488 |
MetaDefender Core with common engine packages:
| Use case | Scan duration (minutes) |
Throughput (objects/hour) |
Avg. processing time (seconds/object) |
Avg./Max CPU usage (%) |
Avg./Max RAM usage (%) |
Avg. Network speed (KB/s) |
|---|---|---|---|---|---|---|
| Metascan 5 + Deep CDR |
24.1 | 316,618 | 0.011 | 78.4/96.2 | 38.8/50.7 | 9,144 |
| Metascan 5 + Deep CDR + Proactive DLP |
29.6 | 257,787 | 0.014 | 83.2/98.4 | 42.1/54.8 | 8,911 |
| Metascan 5 + Deep CDR + Proactive DLP + Vulnerability |
31.2 | 244,210 | 0.015 | 87.8/99.3 | 46.8/59.4 | 8,551 |
| Metascan 10 + Deep CDR |
32.8 | 232,718 | 0.015 | 98.1/99.9 | 49.3/60.3 | 7,944 |
| Metascan 10 + Deep CDR + Proactive DLP |
36.6 | 208,640 | 0.017 | 97.4/99.9 | 50.6/58.8 | 6,936 |
| Metascan 10 + Deep CDR + Proactive DLP + Vulnerability |
39.0 | 195,880 | 0.018 | 97.6/99.9 | 52.1/60.9 | 7,248 |
| Metascan MAX + Deep CDR |
57.4 | 132,935 | 0.027 | 91.0/98.9 | 72.1/83.6 | 9,437 |
| Metascan MAX + Deep CDR + Proactive DLP |
59.8 | 127,600 | 0.028 | 93.2/99.8 | 76.1/85.4 | 9,215 |
| Metascan MAX + Deep CDR + Proactive DLP + Vulnerability |
60.4 | 126,415 | 0.028 | 95.6/99.9 | 78.2/87.2 | 8,333 |
System resource utilization charts
MetaDefender Core with Metascan 10 + Deep CDR + Proactive DLP + Vulnerability:
| Utilization charts | |
|---|---|
| CPU usage |  |
| Memory usage |  |
| Network usage |
|
| Disk usage |   |
MetaDefender Core with Metascan MAX + Deep CDR + Proactive DLP + Vulnerability:
| Utilization charts | |
|---|---|
| CPU usage |  |
| Memory usage |  |
| Network usage |
|
| Disk usage |   |
Was this page helpful?
