Standalone DB - Linux

Environment

Using AWS environment with the specification below:

MetaDefender Core

Client tool

A simple tool written in Python to collect files in a designated folder and submit requests to MetaDefender Core.

This client tool is running on CentOS 7

xxxxxxxxxx

files_to_scan = list of files to scan

scan_futures = [asyncio.create_task(self.scan_file(file_path)) for file_path in files_to_scan]

async def scan_file(self, file_path):

    api_url = f'{self.core_url}/file'

    with open(file_path, 'rb') as file:

        file_content = file.read()

    headers = {'Content-Type': 'application/octet-stream', 'filename': file_path}

    max_retries = 20  # Maximum number of retry attempts

    retry_delay = 120  # Delay in seconds before retrying

    for attempt in range(max_retries + 1):

        try:

            response = requests.post(api_url, data=file_content, headers=headers)

            status_code = response.status_code

            if status_code == 200:

                response_json = response.json()

                data_id = response_json.get('data_id')

                return status_code, response_json, data_id

            if status_code == 503:

                print(f"Received status code {status_code}. Retrying in {retry_delay} seconds...")

                await asyncio.sleep(retry_delay)

            else:

                return None, None, None

        except requests.RequestException as e:

            return None, None, None

    return None, None, None

Dataset

Detailed information of dataset below will be used for testing:

Product Information

Product versions:

• MetaDefender Core version 5.18.0
• Engines:
  • Metascan 5: Ahnlab, Bitdefender, ClamAV, ESET, K7
  • Metascan 10: Metascan 5 + Avira, Varist, IKARUS, Quick Heal, TACHYON
  • Metascan MAX: Metascan 10 + Lionic, CMC, CrowdStrike Falcon ML, Aurora, Trellix, NANOV, RocketCyber, Sophos, Webroot SMD, Xvirus Anti-Malware
  • Deep CDR: 7.8.0
  • Proactive DLP: 3.2.0
  • Archive: 7.8.0
  • File type analysis: 7.8.0
  • File-based vulnerability assessment: 4.57-236
  • Adaptive Sandbox: 3.0.0

MetaDefender Core settings

General settings

• Turn off data retention
• Turn off engine update
• Max file size: 99999999

Archive extraction

• Max recursion level: 99999999
• Max number of extracted files: 99999999
• Max total size of extracted files: 99999999
• Timeout: 10 minutes
• Handle archive extraction task as Failed: true
  • Extracted partially: true

Metascan

• Scan timeout: 10 minutes
• Per engine scan timeout: 1 minutes

Adaptive Sandbox

• Max file size: 18446744073709 MB (max)
• Timeout: 86400 (max)

Performance test results

Summary

MetaDefender Core with single engine (technology):

MetaDefender Core with common engine packages:

System resource utilization charts

MetaDefender Core with Metascan 10 + Deep CDR + Proactive DLP + Vulnerability:

	Utilization charts
CPU usage
Memory usage
Network usage
Disk usage

MetaDefender Core with Metascan MAX + Deep CDR + Proactive DLP + Vulnerability:

	Utilization charts
CPU usage
Memory usage
Network usage
Disk usage