1,371 research outputs found
On chip interconnects for multiprocessor turbo decoding architectures
International audienc
“Angular resolution expected from iCHORD orientation maps through a revisited ion channeling model”
International audienceCrystalline orientation maps are obtained in a Focused Ion Beam (FIB) microscope using the ion CHanneling ORientation Determination (iCHORD) method, which relies on the channeling phenomenon observed in ion-induced secondary electron images. The current paper focuses on the angular resolution that can be expected from such orientation maps, obtained using a revisited ion channeling model. A specific procedure was developed to evaluate the angular resolution, based on the distribution of orientation errors when evaluating controlled sample disorientation. The main advantage is that no external reference is required. An angular resolution of 1° is obtained on a nickel based sample using standard acquisition conditions. This value fulfills most of the needs in terms of microstructural characterization usually carried out by Electron Back Scattered Diffraction
Combined paclitaxel and gemcitabine as first-line treatment in metastatic non-small cell lung cancer: a multicentre phase II study
The efficacy and toxicity of combined paclitaxel and gemcitabine was evaluated in 54 chemotherapy-naive patients with metastatic non-small cell lung cancer (NSCLC). Gemcitabine i.v. 1000 mg/m2was administered on days 1 and 8 and paclitaxel 200 mg/m2as a continuous 3-hour infusion on day 1. Treatment was repeated every 21 days. Patients had a median age of 53 years. ECOG performance status was 0 or 1 in 48 patients. 41 patients (75.9%) had initial stage IV disease; histology was mainly adenocarcinoma (46.3%). 2 patients (4.3%) achieved a complete response and 15 (31.9%) achieved a partial response giving an overall response rate of 36.2% (95% CI: 22.4–49.9%); 19 patients (40.4%) had stable disease and 10 (21.3%) had progressive disease. The median survival time was 51 weeks (95% CI: 46.5–59.3), with a 1-year survival probability of 0.48 (95% CI: 0.34–0.63). Grade 3/4 neutropenia and febrile neutropenia occurred in 15.2% and 2.2% of courses, respectively. Grade 3/4 thrombocytopenia was rare (1.8% of courses). Peripheral neurotoxicity developed in 25 patients (47.2%), mostly grade 1/2. Arthalgia/myalgia was observed in 30 patients (56.6%), generally grade 1 or 2. Grade 3 abnormal levels of serum glutamate pyruvate transaminase (SGPT) and serum glutamate oxaloacetate transaminase (SGOT) occurred in 5 patients (9.4%) and 1 patient (1.9%), respectively. Combined paclitaxel and gemcitabine is an active and well-tolerated regimen for the treatment of advanced NSCLC, and warrants further investigation in comparative, randomized trials. © 2001 Cancer Research Campaign http://www.bjcancer.co
Asynchronous Local-SGD Training for Language Modeling
Local stochastic gradient descent (Local-SGD), also referred to as federated
averaging, is an approach to distributed optimization where each device
performs more than one SGD update per communication. This work presents an
empirical study of {\it asynchronous} Local-SGD for training language models;
that is, each worker updates the global parameters as soon as it has finished
its SGD steps. We conduct a comprehensive investigation by examining how worker
hardware heterogeneity, model size, number of workers, and optimizer could
impact the learning performance. We find that with naive implementations,
asynchronous Local-SGD takes more iterations to converge than its synchronous
counterpart despite updating the (global) model parameters more frequently. We
identify momentum acceleration on the global parameters when worker gradients
are stale as a key challenge. We propose a novel method that utilizes a delayed
Nesterov momentum update and adjusts the workers' local training steps based on
their computation speed. This approach, evaluated with models up to 150M
parameters on the C4 dataset, matches the performance of synchronous Local-SGD
in terms of perplexity per update step, and significantly surpasses it in terms
of wall clock time
DiLoCo: Distributed Low-Communication Training of Language Models
Large language models (LLM) have become a critical component in many
applications of machine learning. However, standard approaches to training LLM
require a large number of tightly interconnected accelerators, with devices
exchanging gradients and other intermediate states at each optimization step.
While it is difficult to build and maintain a single computing cluster hosting
many accelerators, it might be easier to find several computing clusters each
hosting a smaller number of devices. In this work, we propose a distributed
optimization algorithm, Distributed Low-Communication (DiLoCo), that enables
training of language models on islands of devices that are poorly connected.
The approach is a variant of federated averaging, where the number of inner
steps is large, the inner optimizer is AdamW, and the outer optimizer is
Nesterov momentum. On the widely used C4 dataset, we show that DiLoCo on 8
workers performs as well as fully synchronous optimization while communicating
500 times less. DiLoCo exhibits great robustness to the data distribution of
each worker. It is also robust to resources becoming unavailable over time, and
vice versa, it can seamlessly leverage resources that become available during
training
ESMO recommendations on microsatellite instability testing for immunotherapy in cancer, and its relationship with PD-1/PD-L1 expression and tumour mutational burden: a systematic review-based approach
Abstract Background Cancers with a defective DNA mismatch repair (dMMR) system contain thousands of mutations most frequently located in monomorphic microsatellites and are thereby defined as having microsatellite instability (MSI). Therefore, MSI is a marker of dMMR. MSI/dMMR can be identified using immunohistochemistry to detect loss of MMR proteins and/or molecular tests to show microsatellite alterations. Together with tumour mutational burden (TMB) and PD-1/PD-L1 expression, it plays a role as a predictive biomarker for immunotherapy. Methods To define best practices to implement the detection of dMMR tumours in clinical practice, the ESMO Translational Research and Precision Medicine Working Group launched a collaborative project, based on a systematic review-approach, to generate consensus recommendations on the: (i) definitions related to the concept of MSI/dMMR; (ii) methods of MSI/dMMR testing and (iii) relationships between MSI, TMB and PD-1/PD-L1 expression. Results The MSI-related definitions, for which a consensus frame-work was used to establish definitions, included: 'microsatellites', 'MSI', 'DNA mismatch repair' and 'features of MSI tumour'. This consensus also provides recommendations on MSI testing; immunohistochemistry for the mismatch repair proteins MLH1, MSH2, MSH6 and PMS2 represents the first action to assess MSI/dMMR (consensus with strong agreement); the second method of MSI/dMMR testing is represented by polymerase chain reaction (PCR)-based assessment of microsatellite alterations using five microsatellite markers including at least BAT-25 and BAT-26 (strong agreement). Next-generation sequencing, coupling MSI and TMB analysis, may represent a decisive tool for selecting patients for immunotherapy, for common or rare cancers not belonging to the spectrum of Lynch syndrome (very strong agreement). The relationships between MSI, TMB and PD-1/PD-L1 expression are complex, and differ according to tumour types. Conclusions This ESMO initiative is a response to the urgent questions raised by the growing success of immunotherapy and provides also important insights on the relationships between MSI, TMB and PD-1/PD-L1
The HP0256 gene product is involved in motility and cell envelope architecture of Helicobacter pylori
Background: Helicobacter pylori is the causative agent for gastritis, and peptic and duodenal ulcers. The bacterium
displays 5-6 polar sheathed flagella that are essential for colonisation and persistence in the gastric mucosa. The
biochemistry and genetics of flagellar biogenesis in H. pylori has not been fully elucidated. Bioinformatics analysis suggested that the gene HP0256, annotated as hypothetical, was a FliJ homologue. In Salmonella, FliJ is a chaperone escort protein for FlgN and FliT, two proteins that themselves display chaperone activity for components of the hook, the rod and the filament.
Results: Ablation of the HP0256 gene in H. pylori significantly reduced motility. However, flagellin and hook protein synthesis was not affected in the HP0256 mutant. Transmission electron transmission microscopy revealed that the HP0256 mutant cells displayed a normal flagellum configuration, suggesting that HP0256 was not essential for
assembly and polar localisation of the flagella in the cell. Interestingly, whole genome microarrays of an HP0256
mutant revealed transcriptional changes in a number of genes associated with the flagellar regulon and the cell
envelope, such as outer membrane proteins and adhesins. Consistent with the array data, lack of the HP0256 gene
significantly reduced adhesion and the inflammatory response in host cells.
Conclusions: We conclude that HP0256 is not a functional counterpart of FliJ in H. pylori. However, it is required for full motility and it is involved, possibly indirectly, in expression of outer membrane proteins and adhesins involved in pathogenesis and adhesion
- …