Robotic Auxiliary Losses for continuous reinforcement learning

Recent advancements in computation power and artificial intelligence have allowed the creation of advanced reinforcement learning models which could revolutionize, between others, the field of robotics. As model and environment complexity increase, however, training solely through the feedback of environment reward becomes more difficult. From the work on robotic priors byR.Jonschkowski et al. we present robotic auxiliary losses for continuous reinforcement learning models. These function as additional feedback based on physics principles such as Newton’s laws of motion, to be utilized by the reinforcement learning model during training in robotic environments. We furthermore explore the issues of concurrent optimization on several losses and present a continuous loss normalization method for the balancing of training effort between main and auxiliary losses. In all continuous robotic environments tested, individual robotic auxiliary losses show consistent improvement over the base reinforcement learning model. The joint application of all losses during training however did not always guarantee performance improvements, as the concurrent optimization of several losses of different nature proved to be difficult.Mechanical Engineering | Biomechanical Design - BioRobotic

Automated chart filing on panoramic radiographs using deep learning

Item does not contain fulltex

Mask-MCNet: Tooth instance segmentation in 3D point clouds of intra-oral scans

Computational dentistry uses computerized methods and mathematical models for dental image analysis. One of the fundamental problems in computational dentistry is accurate tooth instance segmentation in high-resolution mesh data of intra-oral scans (IOS). This paper presents a new computational model based on deep neural networks, called Mask-MCNet, for end-to-end learning of tooth instance segmentation in 3D point cloud data of IOS. The proposed Mask-MCNet localizes each tooth instance by predicting its 3D bounding box and simultaneously segments the points that belong to each individual tooth instance. The proposed model processes the input raw 3D point cloud in its original spatial resolution without employing a voxelization or down-sampling technique. Such a characteristic preserves the finely detailed context in data like fine curvatures in the border between adjacent teeth and leads to a highly accurate segmentation as required for clinical practice (e.g. orthodontic planning). The experiments show that the Mask-MCNet outperforms state-of-the-art models by achieving 98% Intersection over Union (IoU) score on tooth instance segmentation which is very close to human expert performance

Deep learning approach to semantic segmentation in 3D point cloud intra-oral scans of teeth

Accurate segmentation of data, derived from intra-oral scans (IOS), is a crucial step in a computer-aided design (CAD) system for many clinical tasks, such as implantology and orthodontics in modern dentistry. In order to reach the highest possible quality, a segmentation model may process a point cloud derived from an IOS in its highest available spatial resolution, especially for performing a valid analysis in finely detailed regions such as the curvatures in border lines between two teeth. In this paper, we propose an end-to-end deep learning framework for semantic segmentation of individual teeth as well as the gingiva from point clouds representing IOS. By introducing a non-uniform resampling technique, our proposed model is trained and deployed on the highest available spatial resolution where it learns the local fine details along with the global coarse structure of IOS. Furthermore, the point-wise cross-entropy loss for semantic segmentation of a point cloud is an ill-posed problem, since the relative geometrical structures between the instances (e.g. the teeth) are not formulated. By training a secondary simple network as a discriminator in an adversarial setting and penalizing unrealistic arrangements of assigned labels to the teeth on the dental arch, we improve the segmentation results considerably. Hence, a heavy post-processing stage for relational and dependency modeling (e.g. iterative energy minimization of a constructed graph) is not required anymore. Our experiments show that the proposed approach improves the performance of our baseline network and outperforms the state-of-the-art networks by achieving 0.94 IOU score

Mask-MCNet: instance segmentation in 3D point cloud of intra-oral scans

Accurate segmentation of teeth in dental imaging is a principal element in computer-aided design (CAD) in modern dentistry. In this paper, we present a new framework based on deep learning models for segmenting tooth instances in 3D point cloud data of an intra-oral scan (IOS). At high level, the proposed framework, called Mask-MCNet, has analogy to the Mask R-CNN, which gives high performance on 2D images. However, the proposed framework is designed for the challenging task of instance segmentation of point cloud data from surface meshes. By employing the Monte Carlo Convolutional Network (MCCNet), the Mask-MCNet distributes the information from the processed 3D surface points into the entire void space (e.g. inside the objects). Consequently, the model is able to localize each object instance by predicting its 3D bounding box and simultaneously segmenting all the points inside each box. The experiments show that our Mask-MCNet outperforms state-of-the-art for IOS segmentation by achieving 98% IoU score

Mask-MCNet: instance segmentation in 3D point cloud of intra-oral scans

Accurate segmentation of teeth in dental imaging is a principal element in computer-aided design (CAD) in modern dentistry. In this paper, we present a new framework based on deep learning models for segmenting tooth instances in 3D point cloud data of an intra-oral scan (IOS). At high level, the proposed framework, called Mask-MCNet, has analogy to the Mask R-CNN, which gives high performance on 2D images. However, the proposed framework is designed for the challenging task of instance segmentation of point cloud data from surface meshes. By employing the Monte Carlo Convolutional Network (MCCNet), the Mask-MCNet distributes the information from the processed 3D surface points into the entire void space (e.g. inside the objects). Consequently, the model is able to localize each object instance by predicting its 3D bounding box and simultaneously segmenting all the points inside each box. The experiments show that our Mask-MCNet outperforms state-of-the-art for IOS segmentation by achieving 98% IoU score