Actuarial Applications of Natural Language Processing Using Transformers: Case Studies for Using Text Features in an Actuarial Context

This tutorial demonstrates workflows to incorporate text data into actuarial classification and regression tasks. The main focus is on methods employing transformer-based models. A dataset of car accident descriptions with an average length of 400 words, available in English and German, and a dataset with short property insurance claims descriptions are used to demonstrate these techniques. The case studies tackle challenges related to a multi-lingual setting and long input sequences. They also show ways to interpret model output, to assess and improve model performance, by fine-tuning the models to the domain of application or to a specific prediction task. Finally, the tutorial provides practical approaches to handle classification tasks in situations with no or only few labeled data, including but not limited to ChatGPT. The results achieved by using the language-understanding skills of off-the-shelf natural language processing (NLP) models with only minimal pre-processing and fine-tuning clearly demonstrate the power of transfer learning for practical applications.Comment: 47 pages, 33 figures. v3: Added new Section 10 on the use of ChatGPT for unsupervised information extractio

Low back pain and postural control, effects of task difficulty on centre of pressure and spinal kinematics

Association of low back pain and standing postural control (PC) deficits are reported inconsistently. Demands on PC adaptation strategies are increased by restraining the input of visual or somatosensory senses. The objectives of the current study are, to investigate whether PC adaptations of the spine, hip and the centre of pressure (COP) differ between patients reporting non-specific low back pain (NSLBP) and asymptomatic controls. The PC adaption strategies of the thoracic and lumbar spine, the hip and the COP were measured in fifty-seven NSLBP patients and 22 asymptomatic controls. We tested three "feet together" conditions with increasing demands on PC strategies, using inertial measurement units (IMUs) on the spine and a Wii balance board for centre of pressure (COP) parameters. The differences between NSLBP patients and controls were most apparent when the participants were blindfolded, but remaining on a firm surface. While NSLBP patients had larger thoracic and lumbar spine mean absolute deviations of position (MADpos) in the frontal plane, the same parameters decreased in control subjects (relative change (RC): 0.23, 95% confidence interval: 0.03 to 0.45 and 0.03 to 0.48). The Mean absolute deviation of velocity (MADvel) of the thoracic spine in the frontal plane showed a similar and significant effect (RC: 0.12 95% CI: 0.01 to 0.25). Gender, age and pain during the measurements affected some parameters significantly. PC adaptions differ between NSLBP patients and asymptomatic controls. The differences are most apparent for the thoracic and lumbar parameters of MADpos, in the frontal plane and while the visual condition was removed

GLMMLasso: An Algorithm for High-Dimensional Generalized Linear Mixed Models Using L1-Penalization

We propose an L1-penalized algorithm for fitting high-dimensional generalized linear mixed models. Generalized linear mixed models (GLMMs) can be viewed as an extension of generalized linear models for clustered observations. This Lasso-type approach for GLMMs should be mainly used as variable screening method to reduce the number of variables below the sample size. We then suggest a refitting by maximum likelihood based on the selected variables only. This is an effective correction to overcome problems stemming from the variable screening procedure which are more severe with GLMMs. We illustrate the performance of our algorithm on simulated as well as on real data examples. Supplemental materials are available online and the algorithm is implemented in the R package glmmixedlasso

ODS steel as structral material for high temperature nuclear reactors

Oxide dispersed strengthened (ODS) ferritic-martensitic steels are investigated as possible structural material for the future generation of High Temperature Gas Cooled Nuclear Reactors. The Ni based austenitic ODS superalloys are not considered, because of the Ni presence, which is unfavorable under neutron irradiation. ODS-steels are considered to replace other high temperature materials for tubing or structural parts. Interestingly, ODS is also considered as material being used in future fusion applications. The oxide particles serve for interfacial pinning of moving dislocations. Therefore the creep resistance is improved. In case of the usage of these materials in reactor, the behavior under irradiation must be further clarified. In this paper the effects induced by He implantation are investigated. The induced swelling is measured and the mechanical behavior of the irradiated surface is investigated. These first tests are performed at room temperature, where a clear swelling and hardening could be observed.Окисно дисперговані зміцнені (ОДЗ) феритно-мартенситні сталі досліджуються як можливі конструкційні матеріали для нового покоління високотемпературних ядерних реакторів з газовим охолодженням. Аустенітні ОДЗ-сплави на основі никелю не вивчаються завдяки никелю, присутність якого під дією опромінення небажана. ОДЗ-сталі разглядаються як можливі кандидати на заміну інших високотемпературних матеріалів для вигoтовлення трубопроводів або інших конструкційних вузлів. Цікаво, що ОДЗ-матеріали розглядаються також з точки зору їх можливого використання для майбутнього застосування в термоядерних пристроях. Окисні частки служать як міжфазні пастки для закріплення дислокацій, що рухаються. У разі використання ціх материалів в реакторі їх поведінка під опроміненням повинна вивчатись більш ретельно. В роботі досліджуються ефекти, зумовлені проникненням Не. Вимірюється зумовлене розпухання та механічні характеристики опроміненої поверхні. Ці перші дослідження були виконані при кімнатній температурі, коли можно чітко спостерігати розпухання та зміцнення.Окисно диспергированные упрочненные (ОДУ) ферритно-мартенситные стали изучались как возможные конструкционные материалы для нового поколения высокотемпературных ядерных реакторов с газовым охлаждением. Аустенитные ОДУ-суперсплавы на базе никеля не рассматривались из-за присутствия никеля, который нежелателен при нейтронном облучении. ОДУ-стали рассматривались как возможные заменители других высокотемпературных материалов для изготовления трубопроводов или других композиционных узлов. Интересно, что ОДУ рассматривается так же, как возможный кандидат для использования в термоядерных устройствах. Окисные частицы служат как межфазные ловушки для закрепления движущихся дислокаций. Поэтому сопротивление ползучести увеличивается. В случае использования этих материалов в реакторе их поведение под облучением должно изучаться более тщательно. В предлагаемой работе исследуются эффекты, обусловленные внедрением Не. Измеряется обусловленное распухание и механические характеристики облученной поверхности. Эти первые испытания были выполнены при комнатной температуре, когда можно явно наблюдать распухание и упрочнение

Diffuse reflection of ultracold neutrons from low-roughness surfaces

We report a measurement of the reflection of ultracold neutrons from flat, large-area plates of different Fermi potential materials with low surface roughness. The results were used to test two diffuse reflection models, the well-known Lambert model and the micro-roughness model which is based on wave scattering. The Lambert model fails to reproduce the diffuse reflection data. The surface roughness b and correlation length w , obtained by fitting the micro-roughness model to the data are in the range 1$\le$ b $\le$3 nm and 10$\le$ w $\le$120 nm, in qualitative agreement with independent measurements using atomic force microscop

Extension and flexion in the upper cervical spine in neck pain patients

Neck pain is a common problem in the general population with high risk of ongoing complaints or relapses. Range of motion (ROM) assessment is scientifically established in the clinical process of diagnosis, prognosis and outcome evaluation in neck pain. Anatomically, the cervical spine (CS) has been considered in two regions, the upper and lower CS. Disorders like cervicogenic headache have been clinically associated with dysfunctions of the upper CS (UCS), yet ROM tests and measurements are typically conducted on the whole CS. A cross-sectional study assessing 19 subjects with non-specific neck pain was undertaken to examine UCS extension-flexion ROM in relation to self-reported disability and pain (via the Neck Disability Index (NDI)). Two measurement devices (goniometer and electromagnetic tracking) were employed and compared. Correlations between ROM and the NDI were stronger for the UCS compared to the CS, with the strongest correlation between UCS flexion and the NDI-headache (r = -0.62). Correlations between UCS and CS ROM were fair to moderate, with the strongest correlation between UCS flexion and CS extension ROM (r = -0.49). UCS flexion restriction is related to headache frequency and intensity. Consistency and agreement between both measurement systems and for all tests was high. The results demonstrate that separate UCS ROM assessments for extension and flexion are useful in patients with neck pain