GALET: A deep learning image segmentation model for drone-based grain size analysis of gravel bars

In this study, we present the deep learning image segmentation model for drone-based grain size analysis of gravel bars called GALET. The objectives are to quantify the performance of the code and to test its applicability in river research and management. GALET is built with the Mask R CNN convolution neural network code. It performs instance segmentation based on a combination of the two pre-existing models Faster R CNN, which is used for object detection and Feature Pyramid Network (FCN), which classify images at pixel level. GALET is based on the open source Matterport implementation (standard for 3D space capture) and the pre-trained convolutional neural network ResNet101 and is implemented in the QGIS environment. To be effective, deep learning models need a large amount of training data. In the case of segmentation models, sample images must be annotated individually, which is particularly difficult for individual pebble detection. Our approach is based on the automation of image creation. River bars from three different gravel rivers in the French and Swiss Alpine region, with different morphological and flow regime characteristics, were sampled by line count and individual grain size measurements. At the Sarine residual flow reach, a subsurface sample from a natural gravel bar was also analysed in the laboratory by sieve analysis. Orthographic photos at all sites were taken by drone under varying environmental conditions and at different flight heights. In individual pebble detection, the model GALET detects the B-axis length with a relative absolute error of 0.29. In the comparison of grain size distributions between GALET and analog measurements, the median difference of relative occurrences ranges from -13% to 9%, depending on the size class and resolution of the ortho image. In application, GALET provided important insights in the investigations of a sediment augmentation measure and the spatial distribution of the armor layer on a natural gravel bar in a residual flow reach. The lack of technology and skill for high resolution mapping of spatial and temporal granulometric distributions of gravel bars has left a missing link for better understanding of sediment transport processes. GALET presents a promising tool to fill this gap and contribute to a better understanding of morphological and water processes from snow to the sea.