Abstract:This paper focuses on the performance evaluation of complex man-made systems, such as assembly lines, electric power grid, traffic systems, and various paper processing bureaucracies, etc. For such problems, applying the traditional optimization tool of mathematical programming and gradient descent procedures of continuous variables optimization are often inappropriate or infeasible, as the design variables are usually discrete and the accurate evaluation of the system performance via a simulation model can take too much calculation. General search type and heuristic methods are the only two methods to tackle the problems. However, the "goodness" of heuristic methods is generally difficult to quantify while search methods often involve extensive evaluation of systems at many design choices in a large search space using a simulation model resulting in an infeasible computation burden. The purpose of this paper is to address these difficulties simultaneously by extending the recently developed methodology of Ordinal Optimization (OO). Uniform samples are taken out from the whole search space and evaluated with a crude but computationally easy model when applying OO. And, we argue, after ordering via the crude performance estimates, that the lined-up uniform samples can be seen as an approximate ruler. By comparing the heuristic design with such a ruler, we can quantify the heuristic design, just as we measure the length of an object with a ruler. In a previous paper we showed how to quantify a heuristic design for a special case but we did not have the OO ruler idea at that time. In this paper we propose the OO ruler idea and extend the quantifying method to the general case and the multiple independent results case. Experimental results of applying the ruler are also given to illustrate the utility of this approach.

Quantifying the Deign Quality of Object Oriented System The metric based rules and heuristic

Factors Modulating Software Design Quality

A Methodology for Empirical Quality Assessment of Object-Oriented Design

Design Patterns as Quality Influencing Factor in Object Oriented Design Approach

Measuring Object-Oriented Design Principles

Significance of Coupling and Cohesion on Design Quality

Study on Quality Evaluation in DFQ

Evaluation of the Design Metric to Reduce the Number of Defects in Software Development

Design Level Metrics to Measure the Complexity Across Versions of AO Software

Assessment of maintainability metrics for object-oriented software system

Metrics for Assessing The Design of Software Interfaces

IMPROVING ON OBJECT ORIENTED SOFTWARE COUPLING METRIC

Analysing the Quality of Object-Oriented Models from Novice Modellers

Object Oriented Software Quality Evaluation Technology

Quality quantification in Systems Engineering from the Qualimetry Eye

Toward Software Measurement and Quality Analysis of MARF and GIPSY Case Studies a Team 13 SOEN6611-S14 Project Report

Designite - A Software Design Quality Assessment Tool

Design-o-meter: Towards Evaluating and Refining Graphic Designs

Do Design Metrics Capture Developers Perception of Quality? An Empirical Study on Self-Affirmed Refactoring Activities

Software Metrics Evaluation Based on Entropy

Ordinal Optimization and Quantification of Heuristic Designs