11 research outputs found
DeepEn2023: Energy Datasets for Edge Artificial Intelligence
Climate change poses one of the most significant challenges to humanity. As a
result of these climatic changes, the frequency of weather, climate, and
water-related disasters has multiplied fivefold over the past 50 years,
resulting in over 2 million deaths and losses exceeding $3.64 trillion USD.
Leveraging AI-powered technologies for sustainable development and combating
climate change is a promising avenue. Numerous significant publications are
dedicated to using AI to improve renewable energy forecasting, enhance waste
management, and monitor environmental changes in real time. However, very few
research studies focus on making AI itself environmentally sustainable. This
oversight regarding the sustainability of AI within the field might be
attributed to a mindset gap and the absence of comprehensive energy datasets.
In addition, with the ubiquity of edge AI systems and applications, especially
on-device learning, there is a pressing need to measure, analyze, and optimize
their environmental sustainability, such as energy efficiency. To this end, in
this paper, we propose large-scale energy datasets for edge AI, named
DeepEn2023, covering a wide range of kernels, state-of-the-art deep neural
network models, and popular edge AI applications. We anticipate that DeepEn2023
will improve transparency in sustainability in on-device deep learning across a
range of edge AI systems and applications. For more information, including
access to the dataset and code, please visit
https://amai-gsu.github.io/DeepEn2023.Comment: arXiv admin note: text overlap with arXiv:2310.1832
Oral-3Dv2: 3D Oral Reconstruction from Panoramic X-Ray Imaging with Implicit Neural Representation
3D reconstruction of medical imaging from 2D images has become an
increasingly interesting topic with the development of deep learning models in
recent years. Previous studies in 3D reconstruction from limited X-ray images
mainly rely on learning from paired 2D and 3D images, where the reconstruction
quality relies on the scale and variation of collected data. This has brought
significant challenges in the collection of training data, as only a tiny
fraction of patients take two types of radiation examinations in the same
period. Although simulation from higher-dimension images could solve this
problem, the variance between real and simulated data could bring great
uncertainty at the same time. In oral reconstruction, the situation becomes
more challenging as only a single panoramic X-ray image is available, where
models need to infer the curved shape by prior individual knowledge. To
overcome these limitations, we propose Oral-3Dv2 to solve this cross-dimension
translation problem in dental healthcare by learning solely on projection
information, i.e., the projection image and trajectory of the X-ray tube. Our
model learns to represent the 3D oral structure in an implicit way by mapping
2D coordinates into density values of voxels in the 3D space. To improve
efficiency and effectiveness, we utilize a multi-head model that predicts a
bunch of voxel values in 3D space simultaneously from a 2D coordinate in the
axial plane and the dynamic sampling strategy to refine details of the density
distribution in the reconstruction result. Extensive experiments in simulated
and real data show that our model significantly outperforms existing
state-of-the-art models without learning from paired images or prior individual
knowledge. To the best of our knowledge, this is the first work of a
non-adversarial-learning-based model in 3D radiology reconstruction from a
single panoramic X-ray image
Unveiling Energy Efficiency in Deep Learning: Measurement, Prediction, and Scoring across Edge Devices
Today, deep learning optimization is primarily driven by research focused on
achieving high inference accuracy and reducing latency. However, the energy
efficiency aspect is often overlooked, possibly due to a lack of sustainability
mindset in the field and the absence of a holistic energy dataset. In this
paper, we conduct a threefold study, including energy measurement, prediction,
and efficiency scoring, with an objective to foster transparency in power and
energy consumption within deep learning across various edge devices. Firstly,
we present a detailed, first-of-its-kind measurement study that uncovers the
energy consumption characteristics of on-device deep learning. This study
results in the creation of three extensive energy datasets for edge devices,
covering a wide range of kernels, state-of-the-art DNN models, and popular AI
applications. Secondly, we design and implement the first kernel-level energy
predictors for edge devices based on our kernel-level energy dataset.
Evaluation results demonstrate the ability of our predictors to provide
consistent and accurate energy estimations on unseen DNN models. Lastly, we
introduce two scoring metrics, PCS and IECS, developed to convert complex power
and energy consumption data of an edge device into an easily understandable
manner for edge device end-users. We hope our work can help shift the mindset
of both end-users and the research community towards sustainability in edge
computing, a principle that drives our research. Find data, code, and more
up-to-date information at https://amai-gsu.github.io/DeepEn2023.Comment: This paper has been accepted by ACM/IEEE Symposium on Edge Computing
(SEC '23
Machine Learning in the Development of Adsorbents for Clean Energy Application and Greenhouse Gas Capture
Abstract Addressing climate change challenges by reducing greenhouse gas levels requires innovative adsorbent materials for clean energy applications. Recent progress in machine learning has stimulated technological breakthroughs in the discovery, design, and deployment of materials with potential for highâperformance and lowâcost clean energy applications. This review summarizes basic machine learning methodsâdata collection, featurization, model generation, and model evaluationâand reviews their use in the development of robust adsorbent materials. Key case studies are provided where these methods are used to accelerate adsorbent materials design and discovery, optimize synthesis conditions, and understand complex featureâproperty relationships. The review provides a concise resource for researchers wishing to use machine learning methods to rapidly develop effective adsorbent materials with a positive impact on the environment