Evaluating the Impact of Data Placement to Spark and SciDB with an Earth Science Use Case

We investigate the impact of data placement for two Big Data technologies, Spark and SciDB, with a use case from Earth Science where data arrays are multidimensional. Simultaneously, this investigation provides an opportunity to evaluate the performance of the technologies involved. Two datastores, HDFS and Cassandra, are used with Spark for our comparison. It is found that Spark with Cassandra performs better than with HDFS, but SciDB performs better yet than Spark with either datastore. The investigation also underscores the value of having data aligned for the most common analysis scenarios in advance on a shared nothing architecture. Otherwise, repartitioning needs to be carried out on the fly, degrading overall performance

FDTL voices : drawing from learning and teaching projects

This publication draws on insights and experiences from individuals and teams within learning and teaching development projects in higher education. It considers lessons learnt from the processes, outcomes and tangible outputs of the projects across the spectrum of the FDTL initiative, with the intention that colleagues can draw on and benefit from this experience. The overriding theme at the heart of every FDTL project has been the desire to achieve some form of positive and meaningful change at the level of the individual, institution or discipline. The continuing legacy of the programme has been to create wider community involvement as projects have engaged with the higher education sector on multiple levels - personal, institutional, practice, and policy. This publication has remained throughout a collaborative endeavour, supported by Academy colleagues. It is based around the four themes emerging from the initiative as a whole: • Sectoral/Organisational Change • Conceptual Change • Professional and Personal Development Partnership and • Project Managemen

Ideas and perspectives: strengthening the biogeosciences in environmental research networks

Many scientific approaches are improving our understanding and management of the rapidly changing environment. Long-term environmental research networks are one approach to advancing local, regional, and global environmental science and education. A remarkable number and wide variety of environmental research networks operate around the world today. These are diverse in funding, infrastructure, motivating questions, scientific strengths, and the sciences that birthed and maintained the networks. Some networks have individual sites that were selected because they had produced invaluable long-term data, while other networks have new sites selected to span ecological gradients. However, all long-term environmental networks share two challenges. Networks must keep pace with scientific advances and interact with both the scientific community and society at large. If networks fall short of successfully addressing these challenges, they risk becoming irrelevant. The objective of this paper is to assert that the biogeosciences offer environmental research networks a number of opportunities to expand scientific impact and public engagement. We explore some of these opportunities with four networks: the International Long Term Ecological Research programs (ILTERs), the Critical Zone Observatories (CZOs), the Earth and Ecological Observatory networks (EONs), and the FLUXNET program of eddy flux sites. While these networks were founded and grown by interdisciplinary scientists, the preponderance of expertise and funding have gravitated activities of ILTERs and EONs toward ecology and biology, CZOs toward the Earth sciences and geology, and FLUXNET toward ecophysiology and micrometeorology. Our point is not to homogenize networks, nor to diminish disciplinary science. Rather, we argue that by more fully incorporating the integration of biology and geology in long-term environmental research networks, scientists can better leverage network assets, keep pace with the ever-changing science of the environment, and engage with larger scientific and public audiences

2nd Symposium on Management of Future motorway and urban Traffic Systems (MFTS 2018): Booklet of abstracts: Ispra, 11-12 June 2018

The Symposium focuses on future traffic management systems, covering the subjects of traffic control, estimation, and modelling of motorway and urban networks, with particular emphasis on the presence of advanced vehicle communication and automation technologies. As connectivity and automation are being progressively introduced in our transport and mobility systems, there is indeed a growing need to understand the implications and opportunities for an enhanced traffic management as well as to identify innovative ways and tools to optimise traffic efficiency. In particular the debate on centralised versus decentralised traffic management in the presence of connected and automated vehicles has started attracting the attention of the research community. In this context, the Symposium provides a remarkable opportunity to share novel ideas and discuss future research directions.JRC.C.4-Sustainable Transpor

Catalog Denison University 2014-2015

Denison University Course Catalog 2014-2015https://digitalcommons.denison.edu/denisoncatalogs/1186/thumbnail.jp

Catalog Denison University 2016-2017

Denison University Course 2016-2017https://digitalcommons.denison.edu/denisoncatalogs/1188/thumbnail.jp

Course Catalog 2014-15

https://repository.wellesley.edu/catalogs/1142/thumbnail.jp

Efficient Algorithms for Coastal Geographic Problems

The increasing performance of computers has made it possible to solve algorithmically problems for which manual and possibly inaccurate methods have been previously used. Nevertheless, one must still pay attention to the performance of an algorithm if huge datasets are used or if the problem iscomputationally difficult. Two geographic problems are studied in the articles included in this thesis. In the first problem the goal is to determine distances from points, called study points, to shorelines in predefined directions. Together with other in-formation, mainly related to wind, these distances can be used to estimate wave exposure at different areas. In the second problem the input consists of a set of sites where water quality observations have been made and of the results of the measurements at the different sites. The goal is to select a subset of the observational sites in such a manner that water quality is still measured in a sufficient accuracy when monitoring at the other sites is stopped to reduce economic cost. Most of the thesis concentrates on the first problem, known as the fetch length problem. The main challenge is that the two-dimensional map is represented as a set of polygons with millions of vertices in total and the distances may also be computed for millions of study points in several directions. Efficient algorithms are developed for the problem, one of them approximate and the others exact except for rounding errors. The solutions also differ in that three of them are targeted for serial operation or for a small number of CPU cores whereas one, together with its further developments, is suitable also for parallel machines such as GPUs.Tietokoneiden suorituskyvyn kasvaminen on tehnyt mahdolliseksi ratkaista algoritmisesti ongelmia, joita on aiemmin tarkasteltu paljon ihmistyötä vaativilla, mahdollisesti epätarkoilla, menetelmillä. Algoritmien suorituskykyyn on kuitenkin toisinaan edelleen kiinnitettävä huomiota lähtömateriaalin suuren määrän tai ongelman laskennallisen vaikeuden takia. Väitöskirjaansisältyvissäartikkeleissatarkastellaankahtamaantieteellistä ongelmaa. Ensimmäisessä näistä on määritettävä etäisyyksiä merellä olevista pisteistä lähimpään rantaviivaan ennalta määrätyissä suunnissa. Etäisyyksiä ja tuulen voimakkuutta koskevien tietojen avulla on mahdollista arvioida esimerkiksi aallokon voimakkuutta. Toisessa ongelmista annettuna on joukko tarkkailuasemia ja niiltä aiemmin kerättyä tietoa erilaisista vedenlaatua kuvaavista parametreista kuten sameudesta ja ravinteiden määristä. Tehtävänä on valita asemajoukosta sellainen osa joukko, että vedenlaatua voidaan edelleen tarkkailla riittävällä tarkkuudella, kun mittausten tekeminen muilla havaintopaikoilla lopetetaan kustannusten säästämiseksi. Väitöskirja keskittyy pääosin ensimmäisen ongelman, suunnattujen etäisyyksien, ratkaisemiseen. Haasteena on se, että tarkasteltava kaksiulotteinen kartta kuvaa rantaviivan tyypillisesti miljoonista kärkipisteistä koostuvana joukkonapolygonejajaetäisyyksiäonlaskettavamiljoonilletarkastelupisteille kymmenissä eri suunnissa. Ongelmalle kehitetään tehokkaita ratkaisutapoja, joista yksi on likimääräinen, muut pyöristysvirheitä lukuun ottamatta tarkkoja. Ratkaisut eroavat toisistaan myös siinä, että kolme menetelmistä on suunniteltu ajettavaksi sarjamuotoisesti tai pienellä määrällä suoritinytimiä, kun taas yksi menetelmistä ja siihen tehdyt parannukset soveltuvat myös voimakkaasti rinnakkaisille laitteille kuten GPU:lle. Vedenlaatuongelmassa annetulla asemajoukolla on suuri määrä mahdollisia osajoukkoja. Lisäksi tehtävässä käytetään aikaa vaativia operaatioita kuten lineaarista regressiota, mikä entisestään rajoittaa sitä, kuinka monta osajoukkoa voidaan tutkia. Ratkaisussa käytetäänkin heuristiikkoja, jotkaeivät välttämättä tuota optimaalista lopputulosta.Siirretty Doriast

Catalog Denison University 2012-2013

Denison University Course Catalog 2012-2013https://digitalcommons.denison.edu/denisoncatalogs/1109/thumbnail.jp