Improving Brain–Machine Interface Performance by Decoding Intended Future Movements

Objective. A brain–machine interface (BMI) records neural signals in real time from a subject\u27s brain, interprets them as motor commands, and reroutes them to a device such as a robotic arm, so as to restore lost motor function. Our objective here is to improve BMI performance by minimizing the deleterious effects of delay in the BMI control loop. We mitigate the effects of delay by decoding the subject\u27s intended movements a short time lead in the future. Approach. We use the decoded, intended future movements of the subject as the control signal that drives the movement of our BMI. This should allow the user\u27s intended trajectory to be implemented more quickly by the BMI, reducing the amount of delay in the system. In our experiment, a monkey (Macaca mulatta) uses a future prediction BMI to control a simulated arm to hit targets on a screen. Main Results. Results from experiments with BMIs possessing different system delays (100, 200 and 300 ms) show that the monkey can make significantly straighter, faster and smoother movements when the decoder predicts the user\u27s future intent. We also characterize how BMI performance changes as a function of delay, and explore offline how the accuracy of future prediction decoders varies at different time leads. Significance. This study is the first to characterize the effects of control delays in a BMI and to show that decoding the user\u27s future intent can compensate for the negative effect of control delay on BMI performance

A Cross-Modal Approach to Silent Speech with LLM-Enhanced Recognition

Silent Speech Interfaces (SSIs) offer a noninvasive alternative to brain-computer interfaces for soundless verbal communication. We introduce Multimodal Orofacial Neural Audio (MONA), a system that leverages cross-modal alignment through novel loss functions--cross-contrast (crossCon) and supervised temporal contrast (supTcon)--to train a multimodal model with a shared latent representation. This architecture enables the use of audio-only datasets like LibriSpeech to improve silent speech recognition. Additionally, our introduction of Large Language Model (LLM) Integrated Scoring Adjustment (LISA) significantly improves recognition accuracy. Together, MONA LISA reduces the state-of-the-art word error rate (WER) from 28.8% to 12.2% in the Gaddy (2020) benchmark dataset for silent speech on an open vocabulary. For vocal EMG recordings, our method improves the state-of-the-art from 23.3% to 3.7% WER. In the Brain-to-Text 2024 competition, LISA performs best, improving the top WER from 9.8% to 8.9%. To the best of our knowledge, this work represents the first instance where noninvasive silent speech recognition on an open vocabulary has cleared the threshold of 15% WER, demonstrating that SSIs can be a viable alternative to automatic speech recognition (ASR). Our work not only narrows the performance gap between silent and vocalized speech but also opens new possibilities in human-computer interaction, demonstrating the potential of cross-modal approaches in noisy and data-limited regimes

A high-performance speech neuroprosthesis

Speech brain-computer interfaces (BCIs) have the potential to restore rapid communication to people with paralysis by decoding neural activity evoked by attempted speech into tex

An Accurate and Rapidly Calibrating Speech Neuroprosthesis

BackgroundBrain-computer interfaces can enable communication for people with paralysis by transforming cortical activity associated with attempted speech into text on a computer screen. Communication with brain-computer interfaces has been restricted by extensive training requirements and limited accuracy.MethodsA 45-year-old man with amyotrophic lateral sclerosis (ALS) with tetraparesis and severe dysarthria underwent surgical implantation of four microelectrode arrays into his left ventral precentral gyrus 5 years after the onset of the illness; these arrays recorded neural activity from 256 intracortical electrodes. We report the results of decoding his cortical neural activity as he attempted to speak in both prompted and unstructured conversational contexts. Decoded words were displayed on a screen and then vocalized with the use of text-to-speech software designed to sound like his pre-ALS voice.ResultsOn the first day of use (25 days after surgery), the neuroprosthesis achieved 99.6% accuracy with a 50-word vocabulary. Calibration of the neuroprosthesis required 30 minutes of cortical recordings while the participant attempted to speak, followed by subsequent processing. On the second day, after 1.4 additional hours of system training, the neuroprosthesis achieved 90.2% accuracy using a 125,000-word vocabulary. With further training data, the neuroprosthesis sustained 97.5% accuracy over a period of 8.4 months after surgical implantation, and the participant used it to communicate in self-paced conversations at a rate of approximately 32 words per minute for more than 248 cumulative hours.ConclusionsIn a person with ALS and severe dysarthria, an intracortical speech neuroprosthesis reached a level of performance suitable to restore conversational communication after brief training. (Funded by the Office of the Assistant Secretary of Defense for Health Affairs and others; BrainGate2 ClinicalTrials.gov number, NCT00912041.)

The state of the Martian climate

60°N was +2.0°C, relative to the 1981–2010 average value (Fig. 5.1). This marks a new high for the record. The average annual surface air temperature (SAT) anomaly for 2016 for land stations north of starting in 1900, and is a significant increase over the previous highest value of +1.2°C, which was observed in 2007, 2011, and 2015. Average global annual temperatures also showed record values in 2015 and 2016. Currently, the Arctic is warming at more than twice the rate of lower latitudes

Dietary factors impact on the association between CTSS variants and obesity related traits.

Cathepsin S, a protein coded by the CTSS gene, is implicated in adipose tissue biology--this protein enhances adipose tissue development. Our hypothesis is that common variants in CTSS play a role in body weight regulation and in the development of obesity and that these effects are influenced by dietary factors--increased by high protein, glycemic index and energy diets

State of the climate in 2013

In 2013, the vast majority of the monitored climate variables reported here maintained trends established in recent decades. ENSO was in a neutral state during the entire year, remaining mostly on the cool side of neutral with modest impacts on regional weather patterns around the world. This follows several years dominated by the effects of either La Niña or El Niño events. According to several independent analyses, 2013 was again among the 10 warmest years on record at the global scale, both at the Earths surface and through the troposphere. Some regions in the Southern Hemisphere had record or near-record high temperatures for the year. Australia observed its hottest year on record, while Argentina and New Zealand reported their second and third hottest years, respectively. In Antarctica, Amundsen-Scott South Pole Station reported its highest annual temperature since records began in 1957. At the opposite pole, the Arctic observed its seventh warmest year since records began in the early 20th century. At 20-m depth, record high temperatures were measured at some permafrost stations on the North Slope of Alaska and in the Brooks Range. In the Northern Hemisphere extratropics, anomalous meridional atmospheric circulation occurred throughout much of the year, leading to marked regional extremes of both temperature and precipitation. Cold temperature anomalies during winter across Eurasia were followed by warm spring temperature anomalies, which were linked to a new record low Eurasian snow cover extent in May. Minimum sea ice extent in the Arctic was the sixth lowest since satellite observations began in 1979. Including 2013, all seven lowest extents on record have occurred in the past seven years. Antarctica, on the other hand, had above-average sea ice extent throughout 2013, with 116 days of new daily high extent records, including a new daily maximum sea ice area of 19.57 million km2 reached on 1 October. ENSO-neutral conditions in the eastern central Pacific Ocean and a negative Pacific decadal oscillation pattern in the North Pacific had the largest impacts on the global sea surface temperature in 2013. The North Pacific reached a historic high temperature in 2013 and on balance the globally-averaged sea surface temperature was among the 10 highest on record. Overall, the salt content in nearsurface ocean waters increased while in intermediate waters it decreased. Global mean sea level continued to rise during 2013, on pace with a trend of 3.2 mm yr-1 over the past two decades. A portion of this trend (0.5 mm yr-1) has been attributed to natural variability associated with the Pacific decadal oscillation as well as to ongoing contributions from the melting of glaciers and ice sheets and ocean warming. Global tropical cyclone frequency during 2013 was slightly above average with a total of 94 storms, although the North Atlantic Basin had its quietest hurricane season since 1994. In the Western North Pacific Basin, Super Typhoon Haiyan, the deadliest tropical cyclone of 2013, had 1-minute sustained winds estimated to be 170 kt (87.5 m s-1) on 7 November, the highest wind speed ever assigned to a tropical cyclone. High storm surge was also associated with Haiyan as it made landfall over the central Philippines, an area where sea level is currently at historic highs, increasing by 200 mm since 1970. In the atmosphere, carbon dioxide, methane, and nitrous oxide all continued to increase in 2013. As in previous years, each of these major greenhouse gases once again reached historic high concentrations. In the Arctic, carbon dioxide and methane increased at the same rate as the global increase. These increases are likely due to export from lower latitudes rather than a consequence of increases in Arctic sources, such as thawing permafrost. At Mauna Loa, Hawaii, for the first time since measurements began in 1958, the daily average mixing ratio of carbon dioxide exceeded 400 ppm on 9 May. The state of these variables, along with dozens of others, and the 2013 climate conditions of regions around the world are discussed in further detail in this 24th edition of the State of the Climate series. © 2014, American Meteorological Society. All rights reserved

A many-analysts approach to the relation between religiosity and well-being

The relation between religiosity and well-being is one of the most researched topics in the psychology of religion, yet the directionality and robustness of the effect remains debated. Here, we adopted a many-analysts approach to assess the robustness of this relation based on a new cross-cultural dataset (N=10,535 participants from 24 countries). We recruited 120 analysis teams to investigate (1) whether religious people self-report higher well-being, and (2) whether the relation between religiosity and self-reported well-being depends on perceived cultural norms of religion (i.e., whether it is considered normal and desirable to be religious in a given country). In a two-stage procedure, the teams first created an analysis plan and then executed their planned analysis on the data. For the first research question, all but 3 teams reported positive effect sizes with credible/confidence intervals excluding zero (median reported β=0.120). For the second research question, this was the case for 65% of the teams (median reported β=0.039). While most teams applied (multilevel) linear regression models, there was considerable variability in the choice of items used to construct the independent variables, the dependent variable, and the included covariates

A Many-analysts Approach to the Relation Between Religiosity and Well-being

The relation between religiosity and well-being is one of the most researched topics in the psychology of religion, yet the directionality and robustness of the effect remains debated. Here, we adopted a many-analysts approach to assess the robustness of this relation based on a new cross-cultural dataset (N = 10, 535 participants from 24 countries). We recruited 120 analysis teams to investigate (1) whether religious people self-report higher well-being, and (2) whether the relation between religiosity and self-reported well-being depends on perceived cultural norms of religion (i.e., whether it is considered normal and desirable to be religious in a given country). In a two-stage procedure, the teams first created an analysis plan and then executed their planned analysis on the data. For the first research question, all but 3 teams reported positive effect sizes with credible/confidence intervals excluding zero (median reported β = 0.120). For the second research question, this was the case for 65% of the teams (median reported β = 0.039). While most teams applied (multilevel) linear regression models, there was considerable variability in the choice of items used to construct the independent variables, the dependent variable, and the included covariates

Hyperoxemia and excess oxygen use in early acute respiratory distress syndrome : Insights from the LUNG SAFE study

Publisher Copyright: © 2020 The Author(s). Copyright: Copyright 2020 Elsevier B.V., All rights reserved.Background: Concerns exist regarding the prevalence and impact of unnecessary oxygen use in patients with acute respiratory distress syndrome (ARDS). We examined this issue in patients with ARDS enrolled in the Large observational study to UNderstand the Global impact of Severe Acute respiratory FailurE (LUNG SAFE) study. Methods: In this secondary analysis of the LUNG SAFE study, we wished to determine the prevalence and the outcomes associated with hyperoxemia on day 1, sustained hyperoxemia, and excessive oxygen use in patients with early ARDS. Patients who fulfilled criteria of ARDS on day 1 and day 2 of acute hypoxemic respiratory failure were categorized based on the presence of hyperoxemia (PaO2 > 100 mmHg) on day 1, sustained (i.e., present on day 1 and day 2) hyperoxemia, or excessive oxygen use (FIO2 ≥ 0.60 during hyperoxemia). Results: Of 2005 patients that met the inclusion criteria, 131 (6.5%) were hypoxemic (PaO2 < 55 mmHg), 607 (30%) had hyperoxemia on day 1, and 250 (12%) had sustained hyperoxemia. Excess FIO2 use occurred in 400 (66%) out of 607 patients with hyperoxemia. Excess FIO2 use decreased from day 1 to day 2 of ARDS, with most hyperoxemic patients on day 2 receiving relatively low FIO2. Multivariate analyses found no independent relationship between day 1 hyperoxemia, sustained hyperoxemia, or excess FIO2 use and adverse clinical outcomes. Mortality was 42% in patients with excess FIO2 use, compared to 39% in a propensity-matched sample of normoxemic (PaO2 55-100 mmHg) patients (P = 0.47). Conclusions: Hyperoxemia and excess oxygen use are both prevalent in early ARDS but are most often non-sustained. No relationship was found between hyperoxemia or excessive oxygen use and patient outcome in this cohort. Trial registration: LUNG-SAFE is registered with ClinicalTrials.gov, NCT02010073publishersversionPeer reviewe