BASS: Batched Attention-optimized Speculative Sampling

Speculative decoding has emerged as a powerful method to improve latency and throughput in hosting large language models. However, most existing implementations focus on generating a single sequence. Real-world generative AI applications often require multiple responses and how to perform speculative decoding in a batched setting while preserving its latency benefits poses non-trivial challenges. This paper describes a system of batched speculative decoding that sets a new state of the art in multi-sequence generation latency and that demonstrates superior GPU utilization as well as quality of generations within a time budget. For example, for a 7.8B-size model on a single A100 GPU and with a batch size of 8, each sequence is generated at an average speed of 5.8ms per token, the overall throughput being 1.1K tokens per second. These results represent state-of-the-art latency and a 2.15X speed-up over optimized regular decoding. Within a time budget that regular decoding does not finish, our system is able to generate sequences with HumanEval Pass@First of 43% and Pass@All of 61%, far exceeding what's feasible with single-sequence speculative decoding. Our peak GPU utilization during decoding reaches as high as 15.8%, more than 3X the highest of that of regular decoding and around 10X of single-sequence speculative decoding

Laparoscopy in management of appendicitis in high-, middle-, and low-income countries: a multicenter, prospective, cohort study.

BACKGROUND: Appendicitis is the most common abdominal surgical emergency worldwide. Differences between high- and low-income settings in the availability of laparoscopic appendectomy, alternative management choices, and outcomes are poorly described. The aim was to identify variation in surgical management and outcomes of appendicitis within low-, middle-, and high-Human Development Index (HDI) countries worldwide. METHODS: This is a multicenter, international prospective cohort study. Consecutive sampling of patients undergoing emergency appendectomy over 6 months was conducted. Follow-up lasted 30 days. RESULTS: 4546 patients from 52 countries underwent appendectomy (2499 high-, 1540 middle-, and 507 low-HDI groups). Surgical site infection (SSI) rates were higher in low-HDI (OR 2.57, 95% CI 1.33-4.99, p = 0.005) but not middle-HDI countries (OR 1.38, 95% CI 0.76-2.52, p = 0.291), compared with high-HDI countries after adjustment. A laparoscopic approach was common in high-HDI countries (1693/2499, 67.7%), but infrequent in low-HDI (41/507, 8.1%) and middle-HDI (132/1540, 8.6%) groups. After accounting for case-mix, laparoscopy was still associated with fewer overall complications (OR 0.55, 95% CI 0.42-0.71, p < 0.001) and SSIs (OR 0.22, 95% CI 0.14-0.33, p < 0.001). In propensity-score matched groups within low-/middle-HDI countries, laparoscopy was still associated with fewer overall complications (OR 0.23 95% CI 0.11-0.44) and SSI (OR 0.21 95% CI 0.09-0.45). CONCLUSION: A laparoscopic approach is associated with better outcomes and availability appears to differ by country HDI. Despite the profound clinical, operational, and financial barriers to its widespread introduction, laparoscopy could significantly improve outcomes for patients in low-resource environments. TRIAL REGISTRATION: NCT02179112

Rapid Degradation of Phenanthrene by Using Sphingomonas sp. GY2B Immobilized in Calcium Alginate Gel Beads

The strain Sphingomonas sp. GY2B is a high efficient phenanthrene-degrading strain isolated from crude oil contaminated soils that displays a broad-spectrum degradation ability towards PAHs and related aromatic compounds. This paper reports embedding immobilization of strain GY2B in calcium alginate gel beads and the rapid degradation of phenanthrene by the embedded strains. Results showed that embedded immobilized strains had high degradation percentages both in mineral salts medium (MSM) and 80% artificial seawater (AS) media, and had higher phenanthrene degradation efficiency than the free strains. More than 90% phenanthrene (100 mg·L−1) was degraded within 36 h, and the phenanthrene degradation percentages were >99.8% after 72 h for immobilized strains. 80% AS had significant negative effect on the phenanthrene degradation rate (PDR) of strain GY2B during the linear-decreasing stage of incubation and preadsorption of cells onto rice straw could improve the PDR of embedded strain GY2B. The immobilization of strain GY2B possesses a good potential for application in the treatment of industrial wastewater containing phenanthrene and other related aromatic compounds

Ligand-induced sequestering of branchpoint sequence allows conditional control of splicing

<p>Abstract</p> <p>Background</p> <p>Despite tremendous progress in understanding the mechanisms of constitutive and alternative splicing, an important and widespread step along the gene expression pathway, our ability to deliberately regulate gene expression at this step remains rudimentary. The present study was performed to investigate whether a theophylline-dependent "splice switch" that sequesters the branchpoint sequence (BPS) within RNA-theophylline complex can regulate alternative splicing.</p> <p>Results</p> <p>We constructed a series of pre-mRNAs in which the BPS was inserted within theophylline aptamer. We show that theophylline-induced sequestering of BPS inhibits pre-mRNA splicing both in vitro and in vivo in a dose-dependent manner. Several lines of evidence suggest that theophylline-dependent inhibition of splicing is highly specific, and thermodynamic stability of RNA-theophylline complex as well as the location of BPS within this complex affects the efficiency of splicing inhibition. Finally, we have constructed an alternative splicing model pre-mRNA substrate in which theophylline caused exon skipping both in vitro and in vivo, suggesting that a small molecule-RNA interaction can modulate alternative splicing.</p> <p>Conclusion</p> <p>These findings provide the ability to control splicing pattern at will and should have important implications for basic, biotechnological, and biomedical research.</p

Neglected Tropical Diseases of the Middle East and North Africa: Review of Their Prevalence, Distribution, and Opportunities for Control

The neglected tropical diseases (NTDs) are highly endemic but patchily distributed among the 20 countries and almost 400 million people of the Middle East and North Africa (MENA) region, and disproportionately affect an estimated 65 million people living on less than US$2 per day. Egypt has the largest number of people living in poverty of any MENA nation, while Yemen has the highest prevalence of people living in poverty. These two nations stand out for having suffered the highest rates of many NTDs, including the soil-transmitted nematode infections, filarial infections, schistosomiasis, fascioliasis, leprosy, and trachoma, although they should be recognized for recent measures aimed at NTD control. Leishmaniasis, especially cutaneous leishmaniasis, is endemic in Syria, Iran, Iraq, Libya, Morocco, and elsewhere in the region. Both zoonotic (Leishmania major) and anthroponotic (Leishmania tropica) forms are endemic in MENA in rural arid regions and urban regions, respectively. Other endemic zoonotic NTDs include cystic echinococcosis, fascioliasis, and brucellosis. Dengue is endemic in Saudi Arabia, where Rift Valley fever and Alkhurma hemorrhagic fever have also emerged. Great strides have been made towards elimination of several endemic NTDs, including lymphatic filariasis in Egypt and Yemen; schistosomiasis in Iran, Morocco, and Oman; and trachoma in Morocco, Algeria, Iran, Libya, Oman, Saudi Arabia, Tunisia, and the United Arab Emirates. A particularly noteworthy achievement is the long battle waged against schistosomiasis in Egypt, where prevalence has been brought down by regular praziquantel treatment. Conflict and human and animal migrations are key social determinants in preventing the control or elimination of NTDs in the MENA, while local political will, strengthened international and intersectoral cooperative efforts for surveillance, mass drug administration, and vaccination are essential for elimination

Pooled analysis of who surgical safety checklist use and mortality after emergency laparotomy

Background: The World Health Organization (WHO) Surgical Safety Checklist has fostered safe practice for 10 years, yet its place in emergency surgery has not been assessed on a global scale. The aim of this study was to evaluate reported checklist use in emergency settings and examine the relationship with perioperative mortality in patients who had emergency laparotomy. Methods: In two multinational cohort studies, adults undergoing emergency laparotomy were compared with those having elective gastrointestinal surgery. Relationships between reported checklist use and mortality were determined using multivariable logistic regression and bootstrapped simulation. Results: Of 12 296 patients included from 76 countries, 4843 underwent emergency laparotomy. After adjusting for patient and disease factors, checklist use before emergency laparotomy was more common in countries with a high Human Development Index (HDI) (2455 of 2741, 89⋅6 per cent) compared with that in countries with a middle (753 of 1242, 60⋅6 per cent; odds ratio (OR) 0⋅17, 95 per cent c.i. 0⋅14 to 0⋅21, P &lt; 0⋅001) or low (363 of 860, 42⋅2 percent; OR 0⋅08, 0⋅07 to 0⋅10, P &lt; 0⋅001) HDI. Checklist use was less common in elective surgery than for emergency laparotomy in high-HDI countries (risk difference −9⋅4 (95 per cent c.i. −11⋅9 to −6⋅9) per cent; P &lt; 0⋅001), but the relationship was reversed in low-HDI countries (+12⋅1 (+7⋅0 to +17⋅3) per cent; P &lt; 0⋅001). In multivariable models, checklist use was associated with a lower 30-day perioperative mortality (OR 0⋅60, 0⋅50 to 0⋅73; P &lt; 0⋅001). The greatest absolute benefit was seen for emergency surgery in low-and middle-HDI countries. Conclusion: Checklist use in emergency laparotomy was associated with a significantly lower perioperative mortality rate. Checklist use in low-HDI countries was half that in high-HDI countries