117 research outputs found
Spatiotemporal Calibration of Atmospheric Nitrogen Dioxide Concentration Estimates From an Air Quality Model for Connecticut
A spatiotemporal calibration and resolution refinement model was fitted to
calibrate nitrogen dioxide (NO) concentration estimates from the Community
Multiscale Air Quality (CMAQ) model, using two sources of observed data on
NO that differed in their spatial and temporal resolutions. To refine the
spatial resolution of the CMAQ model estimates, we leveraged information using
additional local covariates including total traffic volume within 2 km,
population density, elevation, and land use characteristics. Predictions from
this model greatly improved the bias in the CMAQ estimates, as observed by the
much lower mean squared error (MSE) at the NO monitor sites. The final
model was used to predict the daily concentration of ambient NO over the
entire state of Connecticut on a grid with pixels of size 300 x 300 m. A
comparison of the prediction map with a similar map for the CMAQ estimates
showed marked improvement in the spatial resolution. The effect of local
covariates was evident in the finer spatial resolution map, where the
contribution of traffic on major highways to ambient NO concentration
stands out. An animation was also provided to show the change in the
concentration of ambient NO over space and time for 1994 and 1995.Comment: 23 pages, 8 figures, supplementary materia
On the Convergence of Encoder-only Shallow Transformers
In this paper, we aim to build the global convergence theory of encoder-only
shallow Transformers under a realistic setting from the perspective of
architectures, initialization, and scaling under a finite width regime. The
difficulty lies in how to tackle the softmax in self-attention mechanism, the
core ingredient of Transformer. In particular, we diagnose the scaling scheme,
carefully tackle the input/output of softmax, and prove that quadratic
overparameterization is sufficient for global convergence of our shallow
Transformers under commonly-used He/LeCun initialization in practice. Besides,
neural tangent kernel (NTK) based analysis is also given, which facilitates a
comprehensive comparison. Our theory demonstrates the separation on the
importance of different scaling schemes and initialization. We believe our
results can pave the way for a better understanding of modern Transformers,
particularly on training dynamics
Recommended from our members
Estimating the contribution of strong daily export events to total pollutant export from the United States in summer
While the export of pollutants from the United States exhibits notable variability from day to day and is often considered to be “episodic,” the contribution of strong daily export events to total export has not been quantified. We use carbon monoxide (CO) as a tracer of anthropogenic pollutants in the Model of OZone And Related Tracers (MOZART) to estimate this contribution. We first identify the major export pathway from the United States to be through the northeast boundary (24–48°N along 67.5°W and 80–67.5°W along 48°N), and then analyze 15 summers of daily CO export fluxes through this boundary. These daily CO export fluxes have a nearly Gaussian distribution with a mean of 1100 Gg CO day−1 and a standard deviation of 490 Gg CO day−1. To focus on the synoptic variability, we define a “synoptic background” export flux equal to the 15 day moving average export flux and classify strong export days according to their fluxes relative to this background. As expected from Gaussian statistics, 16% of summer days are “strong export days,” classified as those days when the CO export flux exceeds the synoptic background by one standard deviation or more. Strong export days contributes 25% to the total export, a value determined by the relative standard deviation of the CO flux distribution. Regressing the anomalies of the CO export flux through the northeast U.S. boundary relative to the synoptic background on the daily anomalies in the surface pressure field (also relative to a 15 day running mean) suggests that strong daily export fluxes are correlated with passages of midlatitude cyclones over the Gulf of Saint Lawrence. The associated cyclonic circulation and Warm Conveyor Belts (WCBs) that lift surface pollutants over the northeastern United States have been shown previously to be associated with long-range transport events. Comparison with observations from the 2004 INTEX-NA field campaign confirms that our model captures the observed enhancements in CO outflow and resolves the processes associated with cyclone passages on strong export days. “Moderate export days,” defined as days when the CO flux through the northeast boundary exceeds the 15 day running mean by less than one standard deviation, represent an additional 34% of summer days and 40% of total export. These days are also associated with migratory midlatitude cyclones. The remaining 35% of total export occurs on “weak export days” (50% of summer days) when high pressure anomalies occur over the Gulf of Saint Lawrence. Our findings for summer also apply to spring, when the U.S. pollutant export is typically strongest, with similar contributions to total export and associated meteorology on strong, moderate and weak export days. Although cyclone passages are the primary driver for strong daily export events, export during days without cyclone passages also makes a considerable contribution to the total export and thereby to the global pollutant budget
Nonlinear Response of Ozone to Emissions: Source Apportionment and Sensitivity Analysis
For secondary air pollutants, precursor emissions may impact concentrations in nonlinear and interdependent manners. We explore the nonlinear responses of one such pollutant, ozone, to emissions of its precursors, nitrogen oxides (NOx) and volatile organic compounds. Modeling is conducted for a high ozone episode in the southeastern United States, applying a second-order direct sensitivity method in a regional air quality model. As applied here, the sensitivity method neglects most aerosol and aqueous chemistry processes. Inclusion of second-order sensitivities is shown to enable accurate characterization of response to large perturbations in emissions. An index is introduced to characterize the nonlinearity of ozone response to NO_x emitted from each source region. Nonlinearity is found to increase with the tonnage and emission density of the source region. Interactions among the impacts of emission sources are shown to lead to discrepancies between source contribution attributed to an ensemble of emitters and the sum of the contributions attributed to each component. A method is introduced for applying these “cross-sensitivity” interactions to assess the uncertainty of sensitivity and source apportionment estimates arising from uncertainty in an emissions inventory. For ozone response to NO_x, underestimates in emission rates lead to underprediction of total source contribution but overprediction of per-ton sensitivity
Integrated North Sea grids: The costs, the benefits and their distribution between countries
A large number of offshore wind farms and interconnectors are expected to be constructed in the North Sea region over the coming decades, creating substantial opportunities for the deployment of integrated network solutions. Creating interconnected offshore grids that combine cross-border links and connections of offshore plants to shore offers multiple economic and environmental advantages for Europe's energy system. However, despite evidence that integrated solutions can be more beneficial than traditional radial connection practices, no such projects have been deployed yet. In this paper we quantify costs and benefits of integrated projects and investigate to which extent the cost-benefit sharing mechanism between participating countries can impede or encourage the development of integrated projects. Three concrete interconnection case studies in the North Sea area are analysed in detail using a national-level power system model. Model outputs are used to compute the net benefit of all involved stakeholders under different allocation schemes. Given the asymmetric distribution of costs and benefits, we recommend to consistently apply the Positive Net Benefit Differential mechanism as a starting point for negotiations on the financial closure of investments in integrated offshore infrastructure
Collaborative multidisciplinary management and expertise of cT2-3 locally advanced operable esophageal squamous cell carcinoma:two case reports
Background: The accurate clinical staging of esophageal squamous cell carcinoma (ESCC) is pivotal for guiding treatment strategies. However, the current precision in staging for clinical T (cT)2 and cT3 stages remains unsatisfactory. This article discusses the role of multidisciplinary teams (MDTs) in the clinical staging and formulation of neoadjuvant treatment strategies for locally advanced operable ESCC. These challenges underscore the importance of precise staging in the decision-making process for appropriate therapeutic interventions.Case Description: Through the lens of two patient case studies with locally advanced resectable ESCC, the article showcases the intricate process of treatment planning undertaken by MDTs. It captures a range of expert perspectives from Japan, China, Hong Kong (China), Korea, the USA, and Europe, focusing on the challenges of differentiating between cT2 and cT3 stages of the disease, which is a critical determinant in the management and therapeutic approach for patients.Conclusions: The article concludes that the accurate staging of ESCC is a cornerstone in determining the most suitable treatment strategies. It underscores the vital role that MDTs play in both clinical staging and the decision-making process for treatment. Highlighting the limitations in current diagnostic methods, the article emphasizes the urgent need for advanced research and the refinement of diagnostic tools to improve the precision of staging, particularly between the cT2 and cT3 stages. It suggests that future research should consider whether a reclassification of these stages could be warranted to enhance treatment planning and outcomes for patients with ESCC.<br/
The Rat IgGFcγBP and Muc2 C-Terminal Domains and TFF3 in Two Intestinal Mucus Layers Bind Together by Covalent Interaction
The secreted proteins from goblet cells compose the intestinal mucus. The aims of this study were to determine how they exist in two intestinal mucus layers.The intestinal mucosa was fixed with Carnoy solution and immunostained. Mucus from the loose layer, the firm layer was gently suctioned or scraped, respectively, lysed in SDS sample buffer with or without DTT, then subjected to the western blotting of rTFF3, rIgGFcγBP or rMuc2. The non-reduced or reduced soluble mucus samples in RIPA buffer were co-immunoprecipitated to investigate their possible interactions. Polyclonal antibodies for rTFF3, the rIgGFcγBP C-terminal domain and the rMuc2 C-terminal domain confirmed their localization in the mucus layer and in the mucus collected from the rat intestinal loose layer or firm layer in both western blot and immunoprecipitation experiments. A complex of rTFF3, which was approximately 250 kDa, and a monomer of 6 kDa were present in both layers of the intestinal mucus; rIgGFcγBP was present in the complex (250-280 kDa) under non-reducing conditions, but shifted to 164 kDa under reducing conditions in both of the layers. rMuc2 was found mainly in a complex of 214-270 kDa under non-reducing conditions, but it shifted to 140 kDa under reducing conditions. The co-immunoprecipitation experiments showed that binding occurs among rTFF3, rIgGFcγBP and rMuc2 in the RIPA buffer soluble intestinal mucus. Blocking the covalent interaction by 100 mM DTT in the RIPA buffer soluble intestinal mucus disassociated their binding.Rat goblet cell-secreted TFF3, IgGFcγBP and Muc2, existing in the two intestinal mucus layers, are bound together by covalent interactions in the soluble fraction of intestinal mucus and form heteropolymers to be one of the biochemical mechanisms of composing the net-like structure of mucus
- …