Exploring Cognitive States: Methods for Detecting Physiological Temporal Fingerprints

Cognitive state detection and its relationship to observable physiologically telemetry has been utilized for many human-machine and human-cybernetic applications. This paper aims at understanding and addressing if there are unique psychophysiological patterns over time, a physiological temporal fingerprint, that is associated with specific cognitive states. This preliminary work involves commercial airline pilots completing experimental benchmark task inductions of three cognitive states: 1) Channelized Attention (CA); 2) High Workload (HW); and 3) Low Workload (LW). We approach this objective by modeling these "fingerprints" through the use of Hidden Markov Models and Entropy analysis to evaluate if the transitions over time are complex or rhythmic/predictable by nature. Our results indicate that cognitive states do have unique complexity of physiological sequences that are statistically different from other cognitive states. More specifically, CA has a significantly higher temporal psychophysiological complexity than HW and LW in EEG and ECG telemetry signals. With regards to respiration telemetry, CA has a lower temporal psychophysiological complexity than HW and LW. Through our preliminary work, addressing this unique underpinning can inform whether these underlying dynamics can be utilized to understand how humans transition between cognitive states and for improved detection of cognitive states

Towards a method for the objective assessment of cognitive workload: A pilot study in vessel traffic service (VTS) of maritime domain

The complexity of traffic control systems, as well as the growing volume of traffic, interconnected missions types and mission demands on the operators, indicates that critical attention should still be paid to the problem of operator's cognitive workload (WL). On the other hand, the development of traffic control towards on-line measurement of cooperative aspects between humans and machines, is part of the more general need to measure the human agents “situation awareness” in industrial environment. The University of Modena and Reggio Emilia was partner of the European Artemis project “Designing Dynamic Distributed Cooperative Human-Machine Systems” (D3CoS 2011–2014) [1] to define affordable methods, techniques and tools addressing the specification, development and evaluation of cooperative systems where human and machine agents are in charge of common tasks, assigned to the system as a whole. One of the basic keys to reach an optimal human-machine cooperation is the measure of the human operator workload. In order to setup a possible method for the objective evaluation of cognitive workload we had to investigate aspects of the functional status of human operators interacting with a simulator in maritime domains. We recorded objective psycho-physiological measures: eye blinks, respiration rate and amplitude, electrodermal activity, heart rate variability, and blood pressure. They were analyzed and correlated with subjective self-assessed responses from two questionnaires: NASA-TLX and Rating Scale Mental Effort (RSME), with the aim to realize a mathematical model for classifying the operators' mental workload. The purpose of this paper is to present the methods, applied on a pilot study, that we carried out to discriminate the WL intensity, based on psycho-physiological signals alone

Automatic Pain Assessment by Learning from Multiple Biopotentials

Kivun täsmällinen arviointi on tärkeää kivunhallinnassa, erityisesti sairaan- hoitoa vaativille ipupotilaille. Kipu on subjektiivista, sillä se ei ole pelkästään aistituntemus, vaan siihen saattaa liittyä myös tunnekokemuksia. Tällöin itsearviointiin perustuvat kipuasteikot ovat tärkein työkalu, niin auan kun potilas pystyy kokemuksensa arvioimaan. Arviointi on kuitenkin haasteellista potilailla, jotka eivät itse pysty kertomaan kivustaan. Kliinisessä hoito- työssä kipua pyritään objektiivisesti arvioimaan esimerkiksi havainnoimalla fysiologisia muuttujia kuten sykettä ja käyttäytymistä esimerkiksi potilaan kasvonilmeiden perusteella. Tutkimuksen päätavoitteena on automatisoida arviointiprosessi hyödyntämällä koneoppimismenetelmiä yhdessä biosignaalien prosessointnin kanssa. Tavoitteen saavuttamiseksi mitattiin autonomista keskushermoston toimintaa kuvastavia biopotentiaaleja: sydänsähkökäyrää, galvaanista ihoreaktiota ja kasvolihasliikkeitä mittaavaa lihassähkökäyrää. Mittaukset tehtiin terveillä vapaaehtoisilla, joille aiheutettiin kokeellista kipuärsykettä. Järestelmän kehittämiseen tarvittavaa tietokantaa varten rakennettiin biopotentiaaleja keräävä Internet of Things -pohjainen tallennusjärjestelmä. Koostetun tietokannan avulla kehitettiin biosignaaleille prosessointimenetelmä jatku- vaan kivun arviointiin. Signaaleista eroteltiin piirteitä sekuntitasoon mukautetuilla aikaikkunoilla. Piirteet visualisoitiin ja tarkasteltiin eri luokittelijoilla kivun ja kiputason tunnistamiseksi. Parhailla luokittelumenetelmillä saavutettiin kivuntunnistukseen 90% herkkyyskyky (sensitivity) ja 84% erottelukyky (specificity) ja kivun voimakkuuden arviointiin 62,5% tarkkuus (accuracy). Tulokset vahvistavat kyseisen käsittelytavan käyttökelpoisuuden erityis- esti tunnistettaessa kipua yksittäisessä arviointi-ikkunassa. Tutkimus vahvistaa biopotentiaalien avulla kehitettävän automatisoidun kivun arvioinnin toteutettavuuden kokeellisella kivulla, rohkaisten etenemään todellisen kivun tutkimiseen samoilla menetelmillä. Menetelmää kehitettäessä suoritettiin lisäksi vertailua ja yhteenvetoa automaattiseen kivuntunnistukseen kehitettyjen eri tutkimusten välisistä samankaltaisuuksista ja eroista. Tarkastelussa löytyi signaalien eroavaisuuksien lisäksi tutkimusmuotojen aiheuttamaa eroa arviointitavoitteisiin, mikä hankaloitti tutkimusten vertailua. Lisäksi pohdit- tiin mitkä perinteisten prosessointitapojen osiot rajoittavat tai edistävät ennustekykyä ja miten, sekä tuoko optimointi läpimurtoa järjestelmän näkökulmasta.Accurate pain assessment plays an important role in proper pain management, especially among hospitalized people experience acute pain. Pain is subjective in nature which is not only a sensory feeling but could also combine affective factors. Therefore self-report pain scales are the main assessment tools as long as patients are able to self-report. However, it remains a challenge to assess the pain from the patients who cannot self-report. In clinical practice, physiological parameters like heart rate and pain behaviors including facial expressions are observed as empirical references to infer pain objectively. The main aim of this study is to automate such process by leveraging machine learning methods and biosignal processing. To achieve this goal, biopotentials reflecting autonomic nervous system activities including electrocardiogram and galvanic skin response, and facial expressions measured with facial electromyograms were recorded from healthy volunteers undergoing experimental pain stimulus. IoT-enabled biopotential acquisition systems were developed to build the database aiming at providing compact and wearable solutions. Using the database, a biosignal processing flow was developed for continuous pain estimation. Signal features were extracted with customized time window lengths and updated every second. The extracted features were visualized and fed into multiple classifiers trained to estimate the presence of pain and pain intensity separately. Among the tested classifiers, the best pain presence estimating sensitivity achieved was 90% (specificity 84%) and the best pain intensity estimation accuracy achieved was 62.5%. The results show the validity of the proposed processing flow, especially in pain presence estimation at window level. This study adds one more piece of evidence on the feasibility of developing an automatic pain assessment tool from biopotentials, thus providing the confidence to move forward to real pain cases. In addition to the method development, the similarities and differences between automatic pain assessment studies were compared and summarized. It was found that in addition to the diversity of signals, the estimation goals also differed as a result of different study designs which made cross dataset comparison challenging. We also tried to discuss which parts in the classical processing flow would limit or boost the prediction performance and whether optimization can bring a breakthrough from the system’s perspective

Continuous electronic data capture of physiology, behavior and experience in real life: towards ecological momentary assessment of emotion

Emotions powerfully influence our physiology, behavior, and experience. A comprehensive assessment of affective states in health and disease would include responses from each of these domains in real life. Since no single physiologic parameter can index emotional states unambiguously, a broad assessment of physiologic responses is desirable. We present a recently developed system, the LifeShirt, which allows reliable ambulatory monitoring of a wide variety of cardiovascular, respiratory, metabolic, motor-behavioral, and experiential responses. The system consists of a garment with embedded inductive plethysmography and other sensors for physiologic data recording and a handheld computer for input of experiential data via touch screen. Parameters are extracted offline using sophisticated analysis and display software. The device is currently used in clinical studies and to monitor effects of physical and emotional stress in naturalistic settings. Further development of signal processing and pattern recognition algorithms will enhance computerized identification of type and extent of physical and emotional activatio

Imaging photoplethysmography: towards effective physiological measurements

Since its conception decades ago, Photoplethysmography (PPG) the non-invasive opto-electronic technique that measures arterial pulsations in-vivo has proven its worth by achieving and maintaining its rank as a compulsory standard of patient monitoring. However successful, conventional contact monitoring mode is not suitable in certain clinical and biomedical situations, e.g., in the case of skin damage, or when unconstrained movement is required. With the advance of computer and photonics technologies, there has been a resurgence of interest in PPG and one potential route to overcome the abovementioned issues has been increasingly explored, i.e., imaging photoplethysmography (iPPG). The emerging field of iPPG offers some nascent opportunities in effective and comprehensive interpretation of the physiological phenomena, indicating a promising alternative to conventional PPG. Heart and respiration rate, perfusion mapping, and pulse rate variability have been accessed using iPPG. To effectively and remotely access physiological information through this emerging technique, a number of key issues are still to be addressed. The engineering issues of iPPG, particularly the influence of motion artefacts on signal quality, are addressed in this thesis, where an engineering model based on the revised Beer-Lambert law was developed and used to describe opto-physiological phenomena relevant to iPPG. An iPPG setup consisting of both hardware and software elements was developed to investigate its reliability and reproducibility in the context of effective remote physiological assessment. Specifically, a first study was conducted for the acquisition of vital physiological signs under various exercise conditions, i.e. resting, light and heavy cardiovascular exercise, in ten healthy subjects. The physiological parameters derived from the images captured by the iPPG system exhibited functional characteristics comparable to conventional contact PPG, i.e., maximum heart rate difference was <3 bpm and a significant (p < 0.05) correlation between both measurements were also revealed. Using a method for attenuation of motion artefacts, the heart rate and respiration rate information was successfully assessed from different anatomical locations even in high-intensity physical exercise situations. This study thereby leads to a new avenue for noncontact sensing of vital signs and remote physiological assessment, showing clear and promising applications in clinical triage and sports training. A second study was conducted to remotely assess pulse rate variability (PRV), which has been considered a valuable indicator of autonomic nervous system (ANS) status. The PRV information was obtained using the iPPG setup to appraise the ANS in ten normal subjects. The performance of the iPPG system in accessing PRV was evaluated via comparison with the readings from a contact PPG sensor. Strong correlation and good agreement between these two techniques verify the effectiveness of iPPG in the remote monitoring of PRV, thereby promoting iPPG as a potential alternative to the interpretation of physiological dynamics related to the ANS. The outcomes revealed in the thesis could present the trend of a robust non-contact technique for cardiovascular monitoring and evaluation

Protocol of the SOMNIA project : an observational study to create a neurophysiological database for advanced clinical sleep monitoring

Introduction Polysomnography (PSG) is the primary tool for sleep monitoring and the diagnosis of sleep disorders. Recent advances in signal analysis make it possible to reveal more information from this rich data source. Furthermore, many innovative sleep monitoring techniques are being developed that are less obtrusive, easier to use over long time periods and in the home situation. Here, we describe the methods of the Sleep and Obstructive Sleep Apnoea Monitoring with Non-Invasive Applications (SOMNIA) project, yielding a database combining clinical PSG with advanced unobtrusive sleep monitoring modalities in a large cohort of patients with various sleep disorders. The SOMNIA database will facilitate the validation and assessment of the diagnostic value of the new techniques, as well as the development of additional indices and biomarkers derived from new and/or traditional sleep monitoring methods. Methods and analysis We aim to include at least 2100 subjects (both adults and children) with a variety of sleep disorders who undergo a PSG as part of standard clinical care in a dedicated sleep centre. Full-video PSG will be performed according to the standards of the American Academy of Sleep Medicine. Each recording will be supplemented with one or more new monitoring systems, including wrist-worn photoplethysmography and actigraphy, pressure sensing mattresses, multimicrophone recording of respiratory sounds including snoring, suprasternal pressure monitoring and multielectrode electromyography of the diaphragm