Design of Benchmark Imagery for Validating Facility Annotation Algorithms

Randy S. Roberts,Paul A. Pope,Raju R. Vatsavai,Ming Jiang,Lloyd F. Arrowood,Timothy G. Trucano,Shaun Gleason,Anil Cheriyadat,Alex Sorokine,Aggelos K. Katsaggelos,Thrasyvoulos N. Pappas,Lucinda R. Gaines,Lawrence K. Chilton
DOI: https://doi.org/10.1109/igarss.2011.6049340
2011-01-01
Abstract:The design of benchmark imagery for validation of image annotation algorithms is considered. Emphasis is placed on imagery that contains industrial facilities, such as chemical refineries. An application-level facility ontology is used as a means to define salient objects in the benchmark imagery. In-strinsic and extrinsic scene factors important for comprehensive validation are listed, and variability in the benchmarks discussed. Finally, the pros and cons of three forms of benchmark imagery: real, composite and synthetic, are delineated.
What problem does this paper attempt to address?