Semantic Segmentation Benchmark Dataset for Coastal Ecosystem Monitoring Based on Unmanned Aerial Vehicle （UAV）
Wang Shengke,Wang Xiandong,Qu Liang,Yao Fengqin,Liu Yingying,Li Conghui,Wang Yuzhen,Zhong Guoqiang
DOI: https://doi.org/10.11834/jig.230670
2024-01-01
Journal of Image and Graphics
Abstract:Objective The coastal ecosystem is a natural system composed of biological communities and their interactions with the environment,including typical coastal ecosystems such as mangroves,salt marshes,coral reefs,seagrass beds,oyster reefs,sandy shores,as well as complex ecosystems like estuaries and bays.These ecosystems play a crucial role in maintaining high-quality ecological environments and fostering rich marine biodiversity.A healthy coastal ecosystem is not only a crucial support for the sustainable economic development of China but also an essential component of the ecological security of the country.The application of semantic segmentation techniques in remote sensing imagery has provided an effective means for the precise monitoring of coastal ecosystems,which offers scientists,ecologists,and decision makers clear and highly comprehensive information to understand the current state and changing trends of coastal ecosystems.How-ever,a significant challenge persists,that is,a specialized,comprehensive,and fine-grained data support system for coastal ecosystems is lacking,which causes difficulty in accurately understanding the distribution,area,and changes in ecosystems such as salt marshes,seagrass beds,and reed beds.This challenge has become a pressing issue in the current national marine ecological conservation efforts.Currently,the monitoring of coastal ecosystems relies primarily on satellite remote sensing and traditional surveying methods.Satellite remote sensing,with its unique advantages of all-weather,all-day,large-scale,and long-time observation,is widely used for monitoring marine ecology and resources through the analy-sis of satellite data.However,the spatial resolution of satellite remote sensing images has limitations,which introduces errors in cases that require fine-scale monitoring.For example,in narrow rivers,small wetland areas,or islands,the lim-ited spatial resolution may result in unclear visibility of small features in the images.Traditional surveying methods often require professionals to conduct field surveys,which poses safety hazards in complex and risky environments.In addition,these methods are susceptible to human and natural factors,which leads to challenges in precise positioning and depiction,coupled with extended and inefficient monitoring cycles.Field surveys and mapping work for coastal ecosystems face sig-nificant challenges using traditional methods.Method This study utilized unmanned aerial vehicles(UAVs)to capture,collect,and annotate data from typical coastal ecosystems in real time for addressing urgent issues in marine ecological con-servation.This effort led to the establishment of the OUC-UAV-SEG dataset,which includes various typical vegetation types found in coastal ecosystems,such as reed,seagrass beds,spartin,and crucially,addresses a key marine event-oil spills.Result In contrast to previous research that predominantly focused on individual dataset scenarios,such as spartin or oil spills,using traditional remote sensing methods for data analysis,this study stands out by using statistical methods to conduct a detailed quantitative analysis of OUC-UAV-SEG,which covers various categories and their respective quantities.In discussing the challenges posed by the dataset,including the discrete clustered morphology of eelgrass,interlaced spiderweb-like oil spills,fragile tubular Sargassum,and mottled tufted seagrass beds,existing segmentation algorithms exhibited suboptimal performance in handling these distinctive features.Finally,classical visual semantic segmentation algorithms were applied to evaluate OUC-UAV-SEG by conducting benchmark tests to assess the performance of currently available semantic segmentation algorithms on this dataset and revealing their limitations.Conclusion The establishment of the OUC-UAV-SEG dataset marks a significant step forward in providing a novel resource for monitoring coastal ecosys-tems.This dataset empowers scientists,ecologists,and decision makers with a more comprehensive understanding of the current conditions and evolving trends in coastal ecosystems.These insights are crucial for furnishing more accurate informa-tion to support marine ecological conservation and management efforts,which holds positive significance.Future efforts will focus on expanding the diversity of the dataset by collecting data on marine ecological environments under more extensive geographic and meteorological conditions to comprehensively reflect ecosystem diversity.Furthermore,by regularly organiz-ing workshops and challenges,the aim is to advance cutting-edge research in the field of coastal ecosystem monitoring.Finally,active use of social media and other channels will be employed to engage with the public for raising awareness of marine environmental issues and inspiring more people to participate in the monitoring and protection of coastal ecosystems.For comprehensive details about this dataset,please refer to the project link:.