Abstract:Metrics and frameworks to quantifiably assess security measures have arisen from needs of three distinct research communities - statistical measures from the intrusion detection and prevention literature, evaluation of cyber exercises, e.g.,red-team and capture-the-flag competitions, and economic analyses addressing cost-versus-security tradeoffs. In this paper we provide two primary contributions to the security evaluation literature - a representative survey, and a novel framework for evaluating security that is flexible, applicable to all three use cases, and readily interpretable. In our survey of the literature we identify the distinct themes from each community's evaluation procedures side by side and flesh out the drawbacks and benefits of each. The evaluation framework we propose includes comprehensively modeling the resource, labor, and attack costs in dollars incurred based on expected resource usage, accuracy metrics, and time. This framework provides a unified approach in that it incorporates the accuracy and performance metrics, which dominate intrusion detection evaluation, the time to detection and impact to data and resources of an attack, favored by educational competitions' metrics, and the monetary cost of many essential security components used in financial analysis. Moreover, it is flexible enough to accommodate each use case, easily interpretable and comparable, and comprehensive in terms of costs <a class="link-external link-http" href="http://considered.Finally" rel="external noopener nofollow">this http URL</a>, we provide two examples of the framework applied to real-world use cases. Overall, we provide a survey and a grounded, flexible framework with multiple concrete examples for evaluating security which can address the needs of three currently distinct communities.

Performance Evaluation of Security Protocols

Researches on Performance Evaluation of Biometric Authentication Systems

SoK: Modular and Efficient Private Decision Tree Evaluation.

IPsec Security Policy Oriented VPN Performance Evaluation Model

Hybrid Performance Modeling And Analyzing Of Parallel Systems

Performance Evaluation for Sdn Deployment: an Approach Based on Stochastic Network Calculus

A Framework to Evaluate and Predict Performances in Virtual Machines Environment

Modeling and performance evaluation of computer systems security operation

Power Evaluation Methods for Data Encryption Algorithms

Performance Evaluation of Parallel Algorithms

Toward Efficient Evaluation of Logic Encryption Schemes: Models and Metrics

Efficiency Evaluation of Cryptographic Protocols for Boardroom Voting

An Approach to Performance Assessment of Interoperability Protocols

Quantifiable & Comparable Evaluations of Cyber Defensive Capabilities: A Survey & Novel, Unified Approach

Heuristic Methods for Security Protocols

Performance Evaluation of Cryptographic Ciphers on IoT Devices

Performance Evaluation of Cryptographic Algorithms over IoT Platforms and Operating Systems

Study of Security Metrics of Software System for Comparative Evaluation

Advancing Security Protocol Verification: A Comparative Study of Scyther, Tamarin

Performance Evaluation of Python Parallel Programming Models: Charm4Py and mpi4py

Performance analysis of encryption algorithms for Information Security