50 research outputs found
Unsupervised Hebbian Learning on Point Sets in StarCraft II
Learning the evolution of real-time strategy (RTS) game is a challenging
problem in artificial intelligent (AI) system. In this paper, we present a
novel Hebbian learning method to extract the global feature of point sets in
StarCraft II game units, and its application to predict the movement of the
points. Our model includes encoder, LSTM, and decoder, and we train the encoder
with the unsupervised learning method. We introduce the concept of neuron
activity aware learning combined with k-Winner-Takes-All. The optimal value of
neuron activity is mathematically derived, and experiments support the
effectiveness of the concept over the downstream task. Our Hebbian learning
rule benefits the prediction with lower loss compared to self-supervised
learning. Also, our model significantly saves the computational cost such as
activations and FLOPs compared to a frame-based approach.Comment: Accepted in International Joint Conference on Neural Networks (IJCNN)
202
Intriguing Properties of Quantization at Scale
Emergent properties have been widely adopted as a term to describe behavior
not present in smaller models but observed in larger models. Recent work
suggests that the trade-off incurred by quantization is also an emergent
property, with sharp drops in performance in models over 6B parameters. In this
work, we ask "are quantization cliffs in performance solely a factor of scale?"
Against a backdrop of increased research focus on why certain emergent
properties surface at scale, this work provides a useful counter-example. We
posit that it is possible to optimize for a quantization friendly training
recipe that suppresses large activation magnitude outliers. Here, we find that
outlier dimensions are not an inherent product of scale, but rather sensitive
to the optimization conditions present during pre-training. This both opens up
directions for more efficient quantization, and poses the question of whether
other emergent properties are inherent or can be altered and conditioned by
optimization and architecture design choices. We successfully quantize models
ranging in size from 410M to 52B with minimal degradation in performance.Comment: 32 pages, 14 figure
A sectorial scheme of gate-all-around field effect transistor with improved electrical characteristics
Reliability and controllability for a new scheme of gate-all-around field effect transistor (GAA-FET) with a silicon channel utilizing a sectorial cross section is evaluated in terms of Ion/Ioff current ratio, transconductance, subthreshold slope, threshold voltage roll-off, and drain induced barrier lowering (DIBL). In addition, the scaling behavior of electronic figures of merit is comprehensively studied with the aid of physical simulations. The electrical characteristic of proposed structure is compared with a circular GAA-FET, which is previously calibrated with an IBM sample at the 22 nm channel length using 3D-TCAD simulations. Our simulation results show that sectorial cross section GAA-FET is a superior structure for controlling short channel effects (SCEs) and to obtain better performance compared to conventional circular cross section counterpart
Evaluation of GPT-3.5 and GPT-4 for supporting real-world information needs in healthcare delivery
Despite growing interest in using large language models (LLMs) in healthcare,
current explorations do not assess the real-world utility and safety of LLMs in
clinical settings. Our objective was to determine whether two LLMs can serve
information needs submitted by physicians as questions to an informatics
consultation service in a safe and concordant manner. Sixty six questions from
an informatics consult service were submitted to GPT-3.5 and GPT-4 via simple
prompts. 12 physicians assessed the LLM responses' possibility of patient harm
and concordance with existing reports from an informatics consultation service.
Physician assessments were summarized based on majority vote. For no questions
did a majority of physicians deem either LLM response as harmful. For GPT-3.5,
responses to 8 questions were concordant with the informatics consult report,
20 discordant, and 9 were unable to be assessed. There were 29 responses with
no majority on "Agree", "Disagree", and "Unable to assess". For GPT-4,
responses to 13 questions were concordant, 15 discordant, and 3 were unable to
be assessed. There were 35 responses with no majority. Responses from both LLMs
were largely devoid of overt harm, but less than 20% of the responses agreed
with an answer from an informatics consultation service, responses contained
hallucinated references, and physicians were divided on what constitutes harm.
These results suggest that while general purpose LLMs are able to provide safe
and credible responses, they often do not meet the specific information need of
a given question. A definitive evaluation of the usefulness of LLMs in
healthcare settings will likely require additional research on prompt
engineering, calibration, and custom-tailoring of general purpose models.Comment: 27 pages including supplemental informatio
Comparative study on structural, electronic, optical and mechanical properties of normal and high pressure phases titanium dioxide using DFT
In this paper, a Self-consistent Orthogonalized linear combination of atomic orbitals (OLCAO) technique with a generalized gradient approximation such as Perdew–Burke–Ernzerhof Solid (GGA-PBE SOL) has been used to scrutinize the structural, optical, electronic and mechanical properties of normal pressure phase (Anatase and Rutile) and high pressure phase i.e., cubic (Fluorite and Pyrite) TiO _2 . Electronic and optical properties of normal pressure phases of TiO _2 are also investigated using (Meta) MGGA-Tran and Blaha (TB09) and obtained results are a close approximation of experimental data. It is seen that the virtually synthesized structural parameter for cubic and tetragonal phases of TiO _2 are consistent with experimental and theoretical data. From the effective mass of charge carriers (m*), it can be observed that pyrite TiO _2 is having lower effective mass than the fluorite and hence shows higher photocatalytic activity than fluorite. Furthermore, it is seen that fluorite is more dense than anatase, rutile and pyrite TiO _2 . From the theoretical calculations on the optical properties, it can be concluded that optical absorption occursin the near UV region for high and normal pressue phases of TiO _2 . Again from the reflectivity characteristics R( ω ), it can be concluded that TiO _2 can be used as a coating material. Elastic constants, elastic compliance constants, mechanical properties are obtained for anatase, rutile, fluorite and pyrite TiO _2 . A comparison of the results with previously reported theoretical and experimental data shows that the calculated properties are in better agreement with the previously reported experimental and theoretical results
AN OBSERVATIONAL STUDY TO STANDARDIZE THE DERMOSCOPIC FINDINGS OF NORMAL SCALP AND HAIRS IN MALE
Background: Trichoscopy is a recent innovation in the field of dermatology and alternative to more time consuming and cumbersome procedures such as Pull test, Pluck test, Daily hair count, scalp biopsy, microscopic examination of hair by conventional methods by microscope which needs removal of hairs which is painful and unacceptable to patients, to replace these old modality with newer one to diagnose hair and scalp disorders by dermatoscope is known as trichoscopy. It is easy non-invasive, less time consuming, and well acceptable to patients. After years of use of this modality for examination of hair and scalp disorders, there is no relevant data regarding trichoscopic variables of hairs and scalp in normal population were found.
Objectives: The objectives of the study are to standardize trichoscopic findings of normal hairs and scalp in male.
Methodology: This study was conducted over 1-year period with effect from 24th January 2020 to 23th January 2021 among 360 male subjects presenting in outpatient Department of Dermatology, Venereology and Leprosy, M.G.M. Medical College and M.Y. Hospital, Indore (M.P.). Examination to rule out any local dermatological disorder of scalp was done. Trichoscopic photographs were taken from frontal, right temporal, occipital, and vertex area with the help of Heine Delta 20T digital dermatoscope.
Results: Anisotrichosis shows significant age-wise difference in temporal and occipital area. Whereas maximum numbers of subjects with anisotrichosis were present in frontal area followed by vertex scalp, maximum numbers of subjects with white dots are present in more than 50-year age group in vertex (83.3%). Overall, maximum numbers are present in vertex area (68.6%) and rest of the areas has nearly equal numbers (56%).
Conclusion: Comparison with standardize findings is necessary before labeling it as pathological finding, also some variables such as black dots, yellow dots, red dots, scarring, and hair shaft abnormality other than diameter variability are considered as absolute pathological finding and not found in healthy subjects, when present on trichoscopy they signify some hair or scalp abnormality
Determination of different optical properties for cubic titanium dioxide: an AB-INITIO approach
This paper presents an analysis of optical properties of cubic titanium dioxide (TiO2) using Orthogonalized Linear Combinations of Atomic Orbitals (OLCAO) basis set under the framework of Density Functional Theory (DFT). Many optical properties such as refractive index, extinction coefficient, reflectivity, absorption coefficient, photoconductivity, and loss coefficient have been studied and analyzed thoroughly. From the analysis of optical properties, it is seen that, cubic TiO2 supports interband transition between states. Reflectivity of pyrite structure TiO2 lies within IRvisible – UV region due to which it qualifies for coating industry. Furthermore, the results are compared with previous theoretical as well as with experimental results. It is found that DFT based simulation produces results which are close approximation to experimental results