Paved and Unpaved Road Segmentation Using Deep Neural Network

Semantic segmentation is essential for autonomous driving, which classifies roads and other objects in the image and provides pixel-level information. For high quality autonomous driving, it is necessary to consider the driving environment of the vehicle, and the vehicle speed should be controlled according to types of road. For this purpose, the semantic segmentation module has to classify types of road. However, current public datasets do not provide annotation data for these road types. In this paper, we propose a method to train the semantic segmentation model for classifying road types. We analyzed the problems that can occur when using a public dataset like KITTI or Cityscapes for training, and used Mapillary Vistas data as training data to get generalized performance. In addition, we use focal loss and over-sampling techniques to alleviate the class imbalance problem caused by relatively small class data.