19,475 research outputs found
H-TSP: Hierarchically Solving the Large-Scale Travelling Salesman Problem
We propose an end-to-end learning framework based on hierarchical
reinforcement learning, called H-TSP, for addressing the large-scale Travelling
Salesman Problem (TSP). The proposed H-TSP constructs a solution of a TSP
instance starting from the scratch relying on two components: the upper-level
policy chooses a small subset of nodes (up to 200 in our experiment) from all
nodes that are to be traversed, while the lower-level policy takes the chosen
nodes as input and outputs a tour connecting them to the existing partial route
(initially only containing the depot). After jointly training the upper-level
and lower-level policies, our approach can directly generate solutions for the
given TSP instances without relying on any time-consuming search procedures. To
demonstrate effectiveness of the proposed approach, we have conducted extensive
experiments on randomly generated TSP instances with different numbers of
nodes. We show that H-TSP can achieve comparable results (gap 3.42% vs. 7.32%)
as SOTA search-based approaches, and more importantly, we reduce the time
consumption up to two orders of magnitude (3.32s vs. 395.85s). To the best of
our knowledge, H-TSP is the first end-to-end deep reinforcement learning
approach that can scale to TSP instances of up to 10000 nodes. Although there
are still gaps to SOTA results with respect to solution quality, we believe
that H-TSP will be useful for practical applications, particularly those that
are time-sensitive e.g., on-call routing and ride hailing service.Comment: Accepted by AAAI 2023, February 202
Recommended from our members
Ensuring Access to Safe and Nutritious Food for All Through the Transformation of Food Systems
An exploration of the language within Ofsted reports and their influence on primary school performance in mathematics: a mixed methods critical discourse analysis
This thesis contributes to the understanding of the language of Ofsted reports, their similarity to one another and associations between different terms used within ‘areas for improvement’ sections and subsequent outcomes for pupils. The research responds to concerns from serving headteachers that Ofsted reports are overly similar, do not capture the unique story of their school, and are unhelpful for improvement. In seeking to answer ‘how similar are
Ofsted reports’ the study uses two tools, a plagiarism detection software (Turnitin) and a discourse analysis tool (NVivo) to identify trends within and across a large corpus of reports.
The approach is based on critical discourse analysis (Van Dijk, 2009; Fairclough, 1989) but shaped in the form of practitioner enquiry seeking power in the form of impact on pupils and practitioners, rather than a more traditional, sociological application of the method.
The research found that in 2017, primary school section 5 Ofsted reports had more than half of their content exactly duplicated within other primary school inspection reports published that same year. Discourse analysis showed the quality assurance process overrode variables such as inspector designation, gender, or team size, leading to three distinct patterns of duplication: block duplication, self-referencing, and template writing. The most unique part of a report was found to be the ‘area for improvement’ section, which was tracked to externally verified outcomes for pupils using terms linked to ‘mathematics’. Those
required to improve mathematics in their areas for improvement improved progress and attainment in mathematics significantly more than national rates. These findings indicate that there was a positive correlation between the inspection reporting process and a beneficial impact on pupil outcomes in mathematics, and that the significant similarity of one report to another had no bearing on the usefulness of the report for school improvement purposes
within this corpus
Fast Charging of Lithium-Ion Batteries Using Deep Bayesian Optimization with Recurrent Neural Network
Fast charging has attracted increasing attention from the battery community
for electrical vehicles (EVs) to alleviate range anxiety and reduce charging
time for EVs. However, inappropriate charging strategies would cause severe
degradation of batteries or even hazardous accidents. To optimize fast-charging
strategies under various constraints, particularly safety limits, we propose a
novel deep Bayesian optimization (BO) approach that utilizes Bayesian recurrent
neural network (BRNN) as the surrogate model, given its capability in handling
sequential data. In addition, a combined acquisition function of expected
improvement (EI) and upper confidence bound (UCB) is developed to better
balance the exploitation and exploration. The effectiveness of the proposed
approach is demonstrated on the PETLION, a porous electrode theory-based
battery simulator. Our method is also compared with the state-of-the-art BO
methods that use Gaussian process (GP) and non-recurrent network as surrogate
models. The results verify the superior performance of the proposed fast
charging approaches, which mainly results from that: (i) the BRNN-based
surrogate model provides a more precise prediction of battery lifetime than
that based on GP or non-recurrent network; and (ii) the combined acquisition
function outperforms traditional EI or UCB criteria in exploring the optimal
charging protocol that maintains the longest battery lifetime
Geometry of Rounding: Near Optimal Bounds and a New Neighborhood Sperner's Lemma
A partition of is called a
-secluded partition if, for every ,
the ball intersects at most
members of . A goal in designing such secluded partitions is to
minimize while making as large as possible. This partition
problem has connections to a diverse range of topics, including deterministic
rounding schemes, pseudodeterminism, replicability, as well as Sperner/KKM-type
results.
In this work, we establish near-optimal relationships between and
. We show that, for any bounded measure partitions and for any
, it must be that . Thus, when is
restricted to , it follows that . This bound is tight up to log factors, as it is
known that there exist secluded partitions with and
. We also provide new constructions of secluded
partitions that work for a broad spectrum of and
parameters. Specifically, we prove that, for any
, there is a secluded partition with
and
. These new partitions are optimal up to
factors for various choices of and . Based
on the lower bound result, we establish a new neighborhood version of Sperner's
lemma over hypercubes, which is of independent interest. In addition, we prove
a no-free-lunch theorem about the limitations of rounding schemes in the
context of pseudodeterministic/replicable algorithms
Reinforcement Learning-based User-centric Handover Decision-making in 5G Vehicular Networks
The advancement of 5G technologies and Vehicular Networks open a new paradigm for Intelligent Transportation Systems (ITS) in safety and infotainment services in urban and highway scenarios. Connected vehicles are vital for enabling massive data sharing and supporting such services. Consequently, a stable connection is compulsory to transmit data across the network successfully. The new 5G technology introduces more bandwidth, stability, and reliability, but it faces a low communication range, suffering from more frequent handovers and connection drops. The shift from the base station-centric view to the user-centric view helps to cope with the smaller communication range and ultra-density of 5G networks. In this thesis, we propose a series of strategies to improve connection stability through efficient handover decision-making. First, a modified probabilistic approach, M-FiVH, aimed at reducing 5G handovers and enhancing network stability. Later, an adaptive learning approach employed Connectivity-oriented SARSA Reinforcement Learning (CO-SRL) for user-centric Virtual Cell (VC) management to enable efficient handover (HO) decisions. Following that, a user-centric Factor-distinct SARSA Reinforcement Learning (FD-SRL) approach combines time series data-oriented LSTM and adaptive SRL for VC and HO management by considering both historical and real-time data. The random direction of vehicular movement, high mobility, network load, uncertain road traffic situation, and signal strength from cellular transmission towers vary from time to time and cannot always be predicted. Our proposed approaches maintain stable connections by reducing the number of HOs by selecting the appropriate size of VCs and HO management. A series of improvements demonstrated through realistic simulations showed that M-FiVH, CO-SRL, and FD-SRL were successful in reducing the number of HOs and the average cumulative HO time. We provide an analysis and comparison of several approaches and demonstrate our proposed approaches perform better in terms of network connectivity
Recommended from our members
EEG microstates: Functional significance and short-term test-retest reliability
Appendix A: Supplementary data to this article can be found online at https://doi. org/10.1016/j.ynirp.2022.100089.Copyright /© 2022 The Authors. EEG signal power, may have clinical relevance; however, their functional significance and test-retest reliability remain unclear. To investigate the functional significance of the canonical EEG microstate classes and their pairwise transitions, and to establish their within-session test-retest reliability, we recorded 36-channel EEGs in 20 healthy volunteers during three eyes-closed conditions: mind-wandering, verbalization (silently repeating the word ‘square’ every 2 s), and visualization (visualizing a square every 2 s). Each condition lasted 3 min and the sequence of three conditions was repeated four times (two runs of two sequence repetitions). The participants' alertness and their sense of effort during the experiment were rated using visual-analogue scales. The EEG data were 2–20 Hz bandpass-filtered and analysed into the four canonical microstate classes: A, B, C, and D. EEG microstate classes C and D were persistently more dominant than classes A and B in all conditions. Of the first-order microstate parameters, average microstate duration was most reliable. The duration of class D microstate was longer during mind-wandering (106.8 ms) than verbalization (102.2 ms) or visualization (99.8 ms), with a concomitantly higher coverage (36.4% vs. 34.7% and 35.2%), but otherwise there was no clear association of the four microstate classes to particular mental states. The test-retest reliability was higher at the beginning of each run, together with higher average alpha power and subjective ratings of alertness. Only the transitions between classes C and D (from C to D in particular) were significantly higher than what would be expected from the respective microstates' occurrences. The transition probabilities, however, did not distinguish between conditions, and their test-retest reliability was overall lower than that of the first-order parameters such as duration and coverage. Further studies are needed to establish the functional significance of the canonical EEG microstate classes. This might be more fruitfully achieved by looking at their complex syntax beyond pairwise transitions. To ensure greater test-retest reliability of microstate parameters, study designs should allow for shorter experimental runs with regular breaks, particularly when using EEG microstates as clinical biomarkers.BIAL Foundation (grant number: 183/16)
Learning disentangled speech representations
A variety of informational factors are contained within the speech signal and a single short recording of speech reveals much more than the spoken words. The best method to extract and represent informational factors from the speech signal ultimately depends on which informational factors are desired and how they will be used. In addition, sometimes methods will capture more than one informational factor at the same time such as speaker identity, spoken content, and speaker prosody.
The goal of this dissertation is to explore different ways to deconstruct the speech signal into abstract representations that can be learned and later reused in various speech technology tasks. This task of deconstructing, also known as disentanglement, is a form of distributed representation learning. As a general approach to disentanglement, there are some guiding principles that elaborate what a learned representation should contain as well as how it should function. In particular, learned representations should contain all of the requisite information in a more compact manner, be interpretable, remove nuisance factors of irrelevant information, be useful in downstream tasks, and independent of the task at hand. The learned representations should also be able to answer counter-factual questions.
In some cases, learned speech representations can be re-assembled in different ways according to the requirements of downstream applications. For example, in a voice conversion task, the speech content is retained while the speaker identity is changed. And in a content-privacy task, some targeted content may be concealed without affecting how surrounding words sound. While there is no single-best method to disentangle all types of factors, some end-to-end approaches demonstrate a promising degree of generalization to diverse speech tasks.
This thesis explores a variety of use-cases for disentangled representations including phone recognition, speaker diarization, linguistic code-switching, voice conversion, and content-based privacy masking. Speech representations can also be utilised for automatically assessing the quality and authenticity of speech, such as automatic MOS ratings or detecting deep fakes. The meaning of the term "disentanglement" is not well defined in previous work, and it has acquired several meanings depending on the domain (e.g. image vs. speech). Sometimes the term "disentanglement" is used interchangeably with the term "factorization". This thesis proposes that disentanglement of speech is distinct, and offers a viewpoint of disentanglement that can be considered both theoretically and practically
Estudo da remodelagem reversa miocárdica através da análise proteómica do miocárdio e do líquido pericárdico
Valve replacement remains as the standard therapeutic option for aortic
stenosis patients, aiming at abolishing pressure overload and triggering
myocardial reverse remodeling. However, despite the instant hemodynamic
benefit, not all patients show complete regression of myocardial hypertrophy,
being at higher risk for adverse outcomes, such as heart failure. The current
comprehension of the biological mechanisms underlying an incomplete reverse
remodeling is far from complete. Furthermore, definitive prognostic tools and
ancillary therapies to improve the outcome of the patients undergoing valve
replacement are missing. To help abridge these gaps, a combined myocardial
(phospho)proteomics and pericardial fluid proteomics approach was followed,
taking advantage of human biopsies and pericardial fluid collected during
surgery and whose origin anticipated a wealth of molecular information
contained therein.
From over 1800 and 750 proteins identified, respectively, in the myocardium
and in the pericardial fluid of aortic stenosis patients, a total of 90 dysregulated
proteins were detected. Gene annotation and pathway enrichment analyses,
together with discriminant analysis, are compatible with a scenario of increased
pro-hypertrophic gene expression and protein synthesis, defective ubiquitinproteasome system activity, proclivity to cell death (potentially fed by
complement activity and other extrinsic factors, such as death receptor
activators), acute-phase response, immune system activation and fibrosis.
Specific validation of some targets through immunoblot techniques and
correlation with clinical data pointed to complement C3 β chain, Muscle Ring
Finger protein 1 (MuRF1) and the dual-specificity Tyr-phosphorylation
regulated kinase 1A (DYRK1A) as potential markers of an incomplete
response. In addition, kinase prediction from phosphoproteome data suggests
that the modulation of casein kinase 2, the family of IκB kinases, glycogen
synthase kinase 3 and DYRK1A may help improve the outcome of patients
undergoing valve replacement. Particularly, functional studies with DYRK1A+/-
cardiomyocytes show that this kinase may be an important target to treat
cardiac dysfunction, provided that mutant cells presented a different response
to stretch and reduced ability to develop force (active tension).
This study opens many avenues in post-aortic valve replacement reverse
remodeling research. In the future, gain-of-function and/or loss-of-function
studies with isolated cardiomyocytes or with animal models of aortic bandingdebanding will help disclose the efficacy of targeting the surrogate therapeutic
targets. Besides, clinical studies in larger cohorts will bring definitive proof of
complement C3, MuRF1 and DYRK1A prognostic value.A substituição da válvula aórtica continua a ser a opção terapêutica de
referência para doentes com estenose aórtica e visa a eliminação da
sobrecarga de pressão, desencadeando a remodelagem reversa miocárdica.
Contudo, apesar do benefício hemodinâmico imediato, nem todos os pacientes
apresentam regressão completa da hipertrofia do miocárdio, ficando com maior
risco de eventos adversos, como a insuficiência cardíaca. Atualmente, os
mecanismos biológicos subjacentes a uma remodelagem reversa incompleta
ainda não são claros. Além disso, não dispomos de ferramentas de
prognóstico definitivos nem de terapias auxiliares para melhorar a condição
dos pacientes indicados para substituição da válvula. Para ajudar a resolver
estas lacunas, uma abordagem combinada de (fosfo)proteómica e proteómica
para a caracterização, respetivamente, do miocárdio e do líquido pericárdico
foi seguida, tomando partido de biópsias e líquidos pericárdicos recolhidos em
ambiente cirúrgico.
Das mais de 1800 e 750 proteínas identificadas, respetivamente, no miocárdio
e no líquido pericárdico dos pacientes com estenose aórtica, um total de 90
proteínas desreguladas foram detetadas. As análises de anotação de genes,
de enriquecimento de vias celulares e discriminativa corroboram um cenário de
aumento da expressão de genes pro-hipertróficos e de síntese proteica, um
sistema ubiquitina-proteassoma ineficiente, uma tendência para morte celular
(potencialmente acelerada pela atividade do complemento e por outros fatores
extrínsecos que ativam death receptors), com ativação da resposta de fase
aguda e do sistema imune, assim como da fibrose.
A validação de alguns alvos específicos através de immunoblot e correlação
com dados clínicos apontou para a cadeia β do complemento C3, a Muscle
Ring Finger protein 1 (MuRF1) e a dual-specificity Tyr-phosphoylation
regulated kinase 1A (DYRK1A) como potenciais marcadores de uma resposta
incompleta. Por outro lado, a predição de cinases a partir do fosfoproteoma,
sugere que a modulação da caseína cinase 2, a família de cinases do IκB, a
glicogénio sintase cinase 3 e da DYRK1A pode ajudar a melhorar a condição
dos pacientes indicados para intervenção. Em particular, a avaliação funcional
de cardiomiócitos DYRK1A+/- mostraram que esta cinase pode ser um alvo
importante para tratar a disfunção cardíaca, uma vez que os miócitos mutantes
responderam de forma diferente ao estiramento e mostraram uma menor
capacidade para desenvolver força (tensão ativa).
Este estudo levanta várias hipóteses na investigação da remodelagem reversa.
No futuro, estudos de ganho e/ou perda de função realizados em
cardiomiócitos isolados ou em modelos animais de banding-debanding da
aorta ajudarão a testar a eficácia de modular os potenciais alvos terapêuticos
encontrados. Além disso, estudos clínicos em coortes de maior dimensão
trarão conclusões definitivas quanto ao valor de prognóstico do complemento
C3, MuRF1 e DYRK1A.Programa Doutoral em Biomedicin
- …