ASSESSING THE SIMILARITIES OF 3D SIMULATION MODEL OUTCOMES
Keywords: 3D Kappa, 3D Accuracy, 3D Agent-Based Model, 3D Simulation Outcome Comparisons, 3D Map Comparison
Abstract. The recent advancement of simulation modeling to represent phenomena in three spatial dimensions (3D) requires the development of techniques that will allow comparison of the modeling outputs in multiple dimensions. However, many existing techniques for map comparison in two spatial dimensions (2D) have been developed from non-spatial method such Cohen’s Kappa. These techniques are not yet fully extended to deal with 3D map data or simulation outcomes. Therefore, the main objective of this study is to investigate the use of the 3D Accuracy and 3D Cohen’s Kappa coefficients to compare simulation model outputs in 3D. An existing agent-based model (ABM) of forest-fire smoke propagation was used to generate multiple scenarios for the purpose of comparing 3D simulation outputs. The results for 3D Accuracy and 3D Cohen’s Kappa produces meaningful values when comparing several scenarios with different 3D ABM outputs. This study emphasizes the need for the development of more advanced simulation output comparison techniques that operate in 3D and potentially over time (4D).