Automated HW/SW co-design for edge AI : State, challenges and steps ahead

Gigantic rates of data production in the era of Big Data, Internet of Thing (IoT), and Smart Cyber Physical Systems (CPS) pose incessantly escalating demands for massive data processing, storage, and transmission while continuously interacting with the physical world using edge sensors and actuators. For IoT systems, there is now a strong trend to move the intelligence from the cloud to the edge or the extreme edge (known as TinyML). Yet, this shift to edge AI systems requires to design powerful machine learning systems under very strict resource constraints. This poses a difficult design task that needs to take the complete system stack from machine learning algorithm, to model optimization and compression, to software implementation, to hardware platform and ML accelerator design into account. This paper discusses the open research challenges to achieve such a holistic Design Space Exploration for a HW/SW Co-design for Edge AI Systems and discusses the current state with three currently developed flows: one design flow for systems with tightly-coupled accelerator architectures based on RISC-V, one approach using loosely-coupled, application-specific accelerators as well as one framework that integrates software and hardware optimization techniques to built efficient Deep Neural Network (DNN) systems.publishedVersionPeer reviewe

GrassPlot - a database of multi-scale plant diversity in Palaearctic grasslands

GrassPlot is a collaborative vegetation-plot database organised by the Eurasian Dry Grassland Group (EDGG) and listed in the Global Index of Vegetation-Plot Databases (GIVD ID EU-00-003). GrassPlot collects plot records (releves) from grasslands and other open habitats of the Palaearctic biogeographic realm. It focuses on precisely delimited plots of eight standard grain sizes (0.0001; 0.001;... 1,000 m(2)) and on nested-plot series with at least four different grain sizes. The usage of GrassPlot is regulated through Bylaws that intend to balance the interests of data contributors and data users. The current version (v. 1.00) contains data for approximately 170,000 plots of different sizes and 2,800 nested-plot series. The key components are richness data and metadata. However, most included datasets also encompass compositional data. About 14,000 plots have near-complete records of terricolous bryophytes and lichens in addition to vascular plants. At present, GrassPlot contains data from 36 countries throughout the Palaearctic, spread across elevational gradients and major grassland types. GrassPlot with its multi-scale and multi-taxon focus complements the larger international vegetationplot databases, such as the European Vegetation Archive (EVA) and the global database " sPlot". Its main aim is to facilitate studies on the scale-and taxon-dependency of biodiversity patterns and drivers along macroecological gradients. GrassPlot is a dynamic database and will expand through new data collection coordinated by the elected Governing Board. We invite researchers with suitable data to join GrassPlot. Researchers with project ideas addressable with GrassPlot data are welcome to submit proposals to the Governing Board

Evaluation of Constant Thickness Cartilage Models vs. Patient Specific Cartilage Models for an Optimized Computer-Assisted Planning of Periacetabular Osteotomy

Modern computerized planning tools for periacetabular osteotomy (PAO) use either morphology-based or biomechanics-based methods. The latter relies on estimation of peak contact pressures and contact areas using either patient specific or constant thickness cartilage models. We performed a finite element analysis investigating the optimal reorientation of the acetabulum in PAO surgery based on simulated joint contact pressures and contact areas using patient specific cartilage model. Furthermore we investigated the influences of using patient specific cartilage model or constant thickness cartilage model on the biomechanical simulation results. Ten specimens with hip dysplasia were used in this study. Image data were available from CT arthrography studies. Bone models were reconstructed. Mesh models for the patient specific cartilage were defined and subsequently loaded under previously reported boundary and loading conditions. Peak contact pressures and contact areas were estimated in the original position. Afterwards we used a validated preoperative planning software to change the acetabular inclination by an increment of 5° and measured the lateral center edge angle (LCE) at each reorientation position. The position with the largest contact area and the lowest peak contact pressure was defined as the optimal position. In order to investigate the influence of using patient specific cartilage model or constant thickness cartilage model on the biomechanical simulation results, the same procedure was repeated with the same bone models but with a cartilage mesh of constant thickness. Comparison of the peak contact pressures and the contact areas between these two different cartilage models showed that good correlation between these two cartilage models for peak contact pressures (r = 0.634 ∈ [0.6, 0.8], p < 0.001) and contact areas (r = 0.872 > 0.8, p < 0.001). For both cartilage models, the largest contact areas and the lowest peak pressures were found at the same position. Our study is the first study comparing peak contact pressures and contact areas between patient specific and constant thickness cartilage models during PAO planning. Good correlation for these two models was detected. Computer assisted planning with FE modeling using constant thickness cartilage models might be a promising PAO planning tool when a conventional CT is available

Lavage prior to vertebral augmentation reduces the risk for cement leakage

PURPOSE This study aimed at assessing the cement leakage rate and the filling pattern in patients treated with vertebroplasty, kyphoplasty and stentoplasty with and without a newly developed lavage technique. STUDY DESIGN Retrospective clinical case-control study. METHODS A newly developed bipedicular lavage technique prior to cement application was applied in 64 patients (45.1 %) with 116 vertebrae, ("lavage" group). A conventional bipedicular cement injection technique was used in 78 patients (54.9 %) with 99 levels ("controls"). The outcome measures were filling patterns and leakage rates. RESULTS The overall leakage rate (venous, cortical defect, intradiscal) was 37.9 % in the lavage and 83.8 % in the control group (p < 0.001). Venous leakage (lavage 12.9 % vs. controls 31.3 %; p = 0.001) and cortical defect leakage (lavage 17.2 % vs. controls 63.3 %; p < 0.001) were significantly lower in the lavage group compared to "controls," whereas intradiscal leakages were similar in both groups (lavage 12.1 % vs. controls 15.2 %; p = 0.51). For venous leakage multivariate logistic regression analysis showed lavage to be the only independent predictor. Lavage was associated with 0.33-times (95 % CI 0.16-0.65; p = 0.001) lower likelihood for leakage in compared to controls. CONCLUSIONS Vertebral body lavage prior to cement augmentation is a safe technique to reduce cement leakage in a clinical setting and has the potential to prevent pulmonary fat embolism. Moreover, a better filling pattern can be achieved

Optimization of Acetabulum Reorientation in a Periacetabular Osteotomy by Finite Element Simulation: A Preliminary Study

Periacetabular osteotomy (PAO) is an effective approach for surgical treatment of hip dysplasia in young patients. The aim of PAO is to increase acetabular coverage of the femoral head and to reduce contact pressures by reorienting the acetabulum fragment after PAO. The success of PAO significantly depends on the surgeon’s experience. Previously, we have developed a computer-assisted planning and navigation system for PAO, which allows for not only quantifying the 3D hip morphology with geometric parameters such as acetabular orientation (expressed as inclination and anteversion angles), lateral center edge (LCE) angle, and femoral head coverage for a computer-assisted diagnosis of hip dysplasia but also virtual PAO surgical planning and simulation. In this paper, based on this previously developed PAO planning and navigation system, we developed a patient-specific 3D finite element (FE) model to investigate the optimal acetabulum reorientation after PAO. Our experimental results showed that an optimal position of the acetabulum can be achieved that maximizes contact area and at the same time minimizes peak contact pressure in pelvic and femoral cartilages. In conclusion, our computer-assisted planning and navigation system with FE modeling can be a promising tool to determine the optimal PAO planning strategy

Percutaneous screw fixation of the iliosacral joint: A case-based preoperative planning approach reduces operating time and radiation exposure.

INTRODUCTION A preoperative planning approach for percutaneous screw fixation of the iliosacral joint provides specific entry points (EPs) and aiming points (APs) of intraosseous screw pathways (as defined by CT scans) for lateral fluoroscopic projections used intraoperatively. The potential to achieve the recommended EPs and APs, to obtain an ideal screw position (perpendicular to the iliosacral joint), to avoid occurrence of extraosseous screw misplacement, to reduce the operating time and the radiation exposure by utilizing this planning approach have not been described yet. METHODS On preoperative CT scans of eight human cadaveric specimen individual EPs and APs were identified and transferred to the lateral fluoroscopic projection using a coordinate system with the zero-point in the center of the posterior cortex of the S1 vertebral body (x-axis parallel to upper S1 endplate). Distances were expressed in relation to the anteroposterior distance of the S1 upper endplate (in%). In each specimen on one side a screw was placed with provided EP and AP (New Technique) whereas at the contralateral side a screw was placed without given EP and AP (Conventional Technique). Both techniques were compared using postoperative CT scans to assess distances between predefined EPs and APs and the actually obtained EPs and APs, screw angulations in relation to the iliosacral joint in coronal and axial planes and the occurrence of any extraosseous screw misplacement. The "operating time (OT)" and the "time under fluoroscopy (TUF)" were recorded. Statistical analysis was performed by the Wilcoxon signed-rank test. RESULTS EPs were realized significantly more accurate using the new technique in vertical direction. The screw positions in relation to the iliosacral joint showed no significant difference between both techniques. Both techniques had one aberrantly placed screw outside the safe corridor. The (mean±SD) "OT" and the (mean±SD) "TUF" were significantly decreased using the new technique compared to the conventional technique (OT: 7.6±2min versus 13.1±5.8min, p=0.012; TUF: 1.5±0.8min versus 2.2±1.1min). CONCLUSION The presented preoperative planning approach increases the accuracy in percutaneous screw fixation of the iliosacral joint, reduces operating time and minimizes radiation exposure to patient and staff

A Cost-Effective Navigation System for Peri-acetabular Osteotomy Surgery

Purpose. To develop and evaluate a low-cost, surgical navigation solution for periacetabular osteotomy (PAO) surgery. Methods. A commercially available low-cost miniature computer is used together with a camera board (Raspberry Pi 2 Model B, Camera Module PiNoir) to track planar markers (Aruco markers). The overall setup of the tracking unit is small enough to be attached directly to the patient’s pelvis. The patient’s pelvis is registered by estimating the pose of a planar marker which is attached to an anterior pelvic plane (APP) digitization device. Next, one marker is attached to the acetabular fragment and the initial orientation of the fragment is recorded. The estimated orientation of the fragment is transmitted to the host computer for visualization. Results. A plastic bone study (eight hip joints) was performed to validate the proposed system. The comparison with a previously developed optical tracking-based system showed no statistical significant difference between measurements obtained from the two systems. In all eight hip joints the mean absolute difference was below 2 degrees. for both anteversion and inclination and a very strong correlation was observed. Conclusions. We show that with our proof-of-principle system, we are able to compute the acetabular orientation accurately

Augmented marker tracking for peri-acetabular osteotomy surgery.

OBJECTIVE To develop a hybrid augmented marker-based navigation system for acetabular reorientation during peri-acetabular osteotomy (PAO). METHODS The system consists of a tracking unit attached to the patient's pelvis, augmented marker attached to the acetabular fragment and a host computer to do all the computations and visualization. The augmented marker is comprised of an external planar Aruco marker facing toward the tracking unit and an internal inertial measurement unit (IMU) to measure its orientation. The orientation output from the IMU is sent to the host computer. The tracking unit streams a live video of the augmented marker to the host computer, where the planar marker is detected and its pose is estimated. A Kalman filter-based sensor fusion combines the output from marker tracking and the IMU. We validated the proposed system using a plastic bone study and a cadaver study. Every time, we compared the inclination and anteversion values measured by the proposed system to those from a previously developed optical tracking-based navigation system. RESULTS Mean absolute differences for inclination and anteversion were 1.34 ([Formula: see text]) and 1.21 ([Formula: see text])[Formula: see text], respectively, for the cadaver study. Mean absolute differences were 1.63 ([Formula: see text]) and 1.55 ([Formula: see text])[Formula: see text] for inclination and anteversion for the plastic bone study. In both validation studies, very strong correlations were observed. CONCLUSION We successfully demonstrated the feasibility of our system to measure the acetabular orientation during PAO

The schematic workflow of computer assisted planning of PAO with biomechanical optimization.

<p>(A) Computer assisted morphology based PAO planning. Virtual osteotomy operation is done with a sphere, whose radius and position can be interactively adjusted, and virtual reorientation operation is done by interactively adjusting anteversion and inclination angle of the acetabulum fragment. (B) Biomechanical optimization. (C) the pre-operative planning output.</p

Contact pressure distribution obtained by using two different cartilage models at different acetabular reorientation position.

<p>Contact pressure distribution obtained by using two different cartilage models at different acetabular reorientation position.</p