Transfer Learning for Speech and Language Processing

Transfer learning is a vital technique that generalizes models trained for one setting or task to other settings or tasks. For example in speech recognition, an acoustic model trained for one language can be used to recognize speech in another language, with little or no re-training data. Transfer learning is closely related to multi-task learning (cross-lingual vs. multilingual), and is traditionally studied in the name of `model adaptation'. Recent advance in deep learning shows that transfer learning becomes much easier and more effective with high-level abstract features learned by deep models, and the `transfer' can be conducted not only between data distributions and data types, but also between model structures (e.g., shallow nets and deep nets) or even model types (e.g., Bayesian models and neural models). This review paper summarizes some recent prominent research towards this direction, particularly for speech and language processing. We also report some results from our group and highlight the potential of this very interesting research field.Comment: 13 pages, APSIPA 201

Carbon Abatement Leaders and Laggards Non Parametric Analyses of Policy Oriented Kuznets Curves

We study the eventual structural differences of climate change leading ‘actors’ such as Northern EU countries, and ‘lagging actors’ - southern EU countries and the ‘Umbrella group’ - with regard to long run (1960-2001) carbon-income relationships. Parametric and semi parametric panel models show that the groups of countries that were in the Kyoto arena less in favour of stringent climate policy, have yet to experience a turning point, though they at least show relative delinking in their monotonic carbon-income relationship. Northern EU instead robustly shows bell shapes across models, which seem to depend on time related (policy) events. Time related effects are more relevant than income effects in explaining the occurrence of robust Kuznets curves. The reaction of northern EU to exogenous policy events such as the 1992 climate change convention that gave earth to the Kyoto era, and even the second oil shock that preceded it in the 80’s are among the causes of the observed structural differences.Carbon Kuznets Curves, Kyoto, Long Run Dynamics, Policy Events, Heterogeneous Panels, Cross-Section Correlation, Semi Parametric Models, Common Time Trends

Analysis framework for the interaction between lean construction and building information modelling

Building with Building Information Modelling (BIM) changes design and production processes. But can BIM be used to support process changes designed according to lean production and lean construction principles? To begin to answer this question we provide a conceptual analysis of the interaction of lean construction and BIM for improving construction. This was investigated by compiling a detailed listing of lean construction principles and BIM functionalities which are relevant from this perspective. These were drawn from a detailed literature survey. A research framework for analysis of the interaction between lean and BIM was then compiled. The goal of the framework is to both guide and stimulate research; as such, the approach adopted up to this point is constructive. Ongoing research has identified 55 such interactions, the majority of which show positive synergy between the two

The determinants of technology transfer efficiency and the role of innovation policies: a survey

The diversity found in the various Technology Transfer Offices (TTOs), besides being a consequence of the capacities and motives of the different stakeholders involved (public research organisations, industry, consulting firms and public authorities) also reflects the specificities of public incentives or policies and their differing degrees of commitment to technology transfer. Notwithstanding the fact that the literature on technology transfer is voluminous, few studies (up to the present date) have investigated the role of innovation policy on TTOs efficiency and the instruments available for governments to improve technology transfer from publicly funded research. The present paper surveys the literature on the determinants of TTOs efficiency, highlighting in particular the role of innovation policy. Additionally, evidence within the context of the European Union on innovation policies for technology transfer improvement is detailed.Technology transfer, innovation policies, technology transfer efficiency