50 research outputs found

    Unsupervised Hebbian Learning on Point Sets in StarCraft II

    Full text link
    Learning the evolution of real-time strategy (RTS) game is a challenging problem in artificial intelligent (AI) system. In this paper, we present a novel Hebbian learning method to extract the global feature of point sets in StarCraft II game units, and its application to predict the movement of the points. Our model includes encoder, LSTM, and decoder, and we train the encoder with the unsupervised learning method. We introduce the concept of neuron activity aware learning combined with k-Winner-Takes-All. The optimal value of neuron activity is mathematically derived, and experiments support the effectiveness of the concept over the downstream task. Our Hebbian learning rule benefits the prediction with lower loss compared to self-supervised learning. Also, our model significantly saves the computational cost such as activations and FLOPs compared to a frame-based approach.Comment: Accepted in International Joint Conference on Neural Networks (IJCNN) 202

    Intriguing Properties of Quantization at Scale

    Full text link
    Emergent properties have been widely adopted as a term to describe behavior not present in smaller models but observed in larger models. Recent work suggests that the trade-off incurred by quantization is also an emergent property, with sharp drops in performance in models over 6B parameters. In this work, we ask "are quantization cliffs in performance solely a factor of scale?" Against a backdrop of increased research focus on why certain emergent properties surface at scale, this work provides a useful counter-example. We posit that it is possible to optimize for a quantization friendly training recipe that suppresses large activation magnitude outliers. Here, we find that outlier dimensions are not an inherent product of scale, but rather sensitive to the optimization conditions present during pre-training. This both opens up directions for more efficient quantization, and poses the question of whether other emergent properties are inherent or can be altered and conditioned by optimization and architecture design choices. We successfully quantize models ranging in size from 410M to 52B with minimal degradation in performance.Comment: 32 pages, 14 figure

    A sectorial scheme of gate-all-around field effect transistor with improved electrical characteristics

    No full text
    Reliability and controllability for a new scheme of gate-all-around field effect transistor (GAA-FET) with a silicon channel utilizing a sectorial cross section is evaluated in terms of Ion/Ioff current ratio, transconductance, subthreshold slope, threshold voltage roll-off, and drain induced barrier lowering (DIBL). In addition, the scaling behavior of electronic figures of merit is comprehensively studied with the aid of physical simulations. The electrical characteristic of proposed structure is compared with a circular GAA-FET, which is previously calibrated with an IBM sample at the 22 nm channel length using 3D-TCAD simulations. Our simulation results show that sectorial cross section GAA-FET is a superior structure for controlling short channel effects (SCEs) and to obtain better performance compared to conventional circular cross section counterpart

    Evaluation of GPT-3.5 and GPT-4 for supporting real-world information needs in healthcare delivery

    Full text link
    Despite growing interest in using large language models (LLMs) in healthcare, current explorations do not assess the real-world utility and safety of LLMs in clinical settings. Our objective was to determine whether two LLMs can serve information needs submitted by physicians as questions to an informatics consultation service in a safe and concordant manner. Sixty six questions from an informatics consult service were submitted to GPT-3.5 and GPT-4 via simple prompts. 12 physicians assessed the LLM responses' possibility of patient harm and concordance with existing reports from an informatics consultation service. Physician assessments were summarized based on majority vote. For no questions did a majority of physicians deem either LLM response as harmful. For GPT-3.5, responses to 8 questions were concordant with the informatics consult report, 20 discordant, and 9 were unable to be assessed. There were 29 responses with no majority on "Agree", "Disagree", and "Unable to assess". For GPT-4, responses to 13 questions were concordant, 15 discordant, and 3 were unable to be assessed. There were 35 responses with no majority. Responses from both LLMs were largely devoid of overt harm, but less than 20% of the responses agreed with an answer from an informatics consultation service, responses contained hallucinated references, and physicians were divided on what constitutes harm. These results suggest that while general purpose LLMs are able to provide safe and credible responses, they often do not meet the specific information need of a given question. A definitive evaluation of the usefulness of LLMs in healthcare settings will likely require additional research on prompt engineering, calibration, and custom-tailoring of general purpose models.Comment: 27 pages including supplemental informatio

    Comparative study on structural, electronic, optical and mechanical properties of normal and high pressure phases titanium dioxide using DFT

    No full text
    In this paper, a Self-consistent Orthogonalized linear combination of atomic orbitals (OLCAO) technique with a generalized gradient approximation such as Perdew–Burke–Ernzerhof Solid (GGA-PBE SOL) has been used to scrutinize the structural, optical, electronic and mechanical properties of normal pressure phase (Anatase and Rutile) and high pressure phase i.e., cubic (Fluorite and Pyrite) TiO _2 . Electronic and optical properties of normal pressure phases of TiO _2 are also investigated using (Meta) MGGA-Tran and Blaha (TB09) and obtained results are a close approximation of experimental data. It is seen that the virtually synthesized structural parameter for cubic and tetragonal phases of TiO _2 are consistent with experimental and theoretical data. From the effective mass of charge carriers (m*), it can be observed that pyrite TiO _2 is having lower effective mass than the fluorite and hence shows higher photocatalytic activity than fluorite. Furthermore, it is seen that fluorite is more dense than anatase, rutile and pyrite TiO _2 . From the theoretical calculations on the optical properties, it can be concluded that optical absorption occursin the near UV region for high and normal pressue phases of TiO _2 . Again from the reflectivity characteristics R( ω ), it can be concluded that TiO _2 can be used as a coating material. Elastic constants, elastic compliance constants, mechanical properties are obtained for anatase, rutile, fluorite and pyrite TiO _2 . A comparison of the results with previously reported theoretical and experimental data shows that the calculated properties are in better agreement with the previously reported experimental and theoretical results

    Approach to suppress ambipolar conduction in Tunnel FET using dielectric pocket

    No full text

    AN OBSERVATIONAL STUDY TO STANDARDIZE THE DERMOSCOPIC FINDINGS OF NORMAL SCALP AND HAIRS IN MALE

    No full text
    Background: Trichoscopy is a recent innovation in the field of dermatology and alternative to more time consuming and cumbersome procedures such as Pull test, Pluck test, Daily hair count, scalp biopsy, microscopic examination of hair by conventional methods by microscope which needs removal of hairs which is painful and unacceptable to patients, to replace these old modality with newer one to diagnose hair and scalp disorders by dermatoscope is known as trichoscopy. It is easy non-invasive, less time consuming, and well acceptable to patients. After years of use of this modality for examination of hair and scalp disorders, there is no relevant data regarding trichoscopic variables of hairs and scalp in normal population were found. Objectives: The objectives of the study are to standardize trichoscopic findings of normal hairs and scalp in male. Methodology: This study was conducted over 1-year period with effect from 24th January 2020 to 23th January 2021 among 360 male subjects presenting in outpatient Department of Dermatology, Venereology and Leprosy, M.G.M. Medical College and M.Y. Hospital, Indore (M.P.). Examination to rule out any local dermatological disorder of scalp was done. Trichoscopic photographs were taken from frontal, right temporal, occipital, and vertex area with the help of Heine Delta 20T digital dermatoscope. Results: Anisotrichosis shows significant age-wise difference in temporal and occipital area. Whereas maximum numbers of subjects with anisotrichosis were present in frontal area followed by vertex scalp, maximum numbers of subjects with white dots are present in more than 50-year age group in vertex (83.3%). Overall, maximum numbers are present in vertex area (68.6%) and rest of the areas has nearly equal numbers (56%). Conclusion: Comparison with standardize findings is necessary before labeling it as pathological finding, also some variables such as black dots, yellow dots, red dots, scarring, and hair shaft abnormality other than diameter variability are considered as absolute pathological finding and not found in healthy subjects, when present on trichoscopy they signify some hair or scalp abnormality

    Determination of different optical properties for cubic titanium dioxide: an AB-INITIO approach

    No full text
    This paper presents an analysis of optical properties of cubic titanium dioxide (TiO2) using Orthogonalized Linear Combinations of Atomic Orbitals (OLCAO) basis set under the framework of Density Functional Theory (DFT). Many optical properties such as refractive index, extinction coefficient, reflectivity, absorption coefficient, photoconductivity, and loss coefficient have been studied and analyzed thoroughly. From the analysis of optical properties, it is seen that, cubic TiO2 supports interband transition between states. Reflectivity of pyrite structure TiO2 lies within IRvisible – UV region due to which it qualifies for coating industry. Furthermore, the results are compared with previous theoretical as well as with experimental results. It is found that DFT based simulation produces results which are close approximation to experimental results
    corecore