Comunicación presentada en el Meeting COST 1207 European Brewer Network, celebrado en Delft, los días 11-12 de November 2014

Hernández Cruz, Bentorey

English

Agencia Estatal de Meteorología

Comparative Study between Brewer Spectrophotometer NetworksShort Term Scientific Mission Boulder, COAuthor: Bentorey Hernández Cruz12/11/2014 www.aemet.es 2STSM Boulder: Overview• Overview• Brewer Networks• NeuBrew– David Skaggs Research Center (Boulder, CO)• EuBrewNet– Izaña Atmospheric Research Center (Tenerife, Spain)12/11/2014 www.aemet.es 3STSM Boulder: Index• Introduction• Short Description• Iberonesia• Neubrew• Comparison12/11/2014 www.aemet.es 4STSM Boulder: Introduction• Introduction• Motivation• Eubrewnet• Database• Real time• Different level products• Study of the present solutions• Iberonesia• Neubrew12/11/2014 www.aemet.es 5STSM Boulder: Index• Introduction• Short Description• Iberonesia• Neubrew• Comparison12/11/2014 www.aemet.es 6STSM Boulder: Short description• Iberonesia• Network of Brewer Spectroradiometers• North Macaronesian and Iberian Peninsula• From 30W to 3E• From 28N to 44N12/11/2014 www.aemet.es 7STSM Boulder: Short description• Neubrew• Network of Brewer Spectrophotometers• Western, Central and Eastern (US)• Measurement• Daily Ultraviolet Radiation• Total Column Ozone• Other equipment• Total Surface Radiation Budget• Total Sky Imagers12/11/2014 www.aemet.es 8STSM Boulder: Index• Introduction• Short Description• Iberonesia• Neubrew• Comparison12/11/2014 www.aemet.es 9STSM Boulder: Iberonesia• System Description• Modules• Data Import– File schema and history• Processing– Database automated processing• Error Handling– Interactive process in case of error• Product Generation– Automated or in demandSTSM Boulder: Iberonesia• System Description• Cloud Server• Client – Server communication• OS• Server: Ubuntu server• Client: Python interpreter• Real Time (programmed tasks)12/11/2014 AEMET, Agencia Estatal de Meteorología 1012/11/2014 www.aemet.es 11STSM Boulder: Iberonesia• Web serviceSTSM Boulder: Iberonesia• Data Transmission• Data communication depending on the client• New files that are not stored in the server• Last change in the files• Change in a checksum based in md5• Only new information is sent to the server• Redundance of information• File System• Database12/11/2014 AEMET, Agencia Estatal de Meteorología 12STSM Boulder: Iberonesia• Database• MySQL• Data issues:• Brewer Info• Code Error Messages• Log table• File status• Refresh information• Calibration and configuration• Neighborhood/Satellite Information12/11/2014 AEMET, Agencia Estatal de Meteorología 13STSM Boulder: Iberonesia• Products Generation• Ozone and UV• Still under development• Several scripts in Matlab• Images accesible from the website12/11/2014 AEMET, Agencia Estatal de Meteorología 14STSM Boulder: Iberonesia• Products Generation12/11/2014 AEMET, Agencia Estatal de Meteorología 15STSM Boulder: Iberonesia• Quality Assurance• Real time connection control• Colour based tool– Green– Orange– Red• File status• Comprehensive message of fails:– Dates– Brewer– Type of message12/11/2014 AEMET, Agencia Estatal de Meteorología 16STSM Boulder: Iberonesia• Quality Assurance12/11/2014 AEMET, Agencia Estatal de Meteorología 17STSM Boulder: Iberonesia• Quality Assurance12/11/2014 AEMET, Agencia Estatal de Meteorología 1812/11/2014 www.aemet.es 19STSM Boulder: Index• Introduction• Short Description• Iberonesia• Neubrew• Comparison12/11/2014 www.aemet.es 20STSM Boulder: Neubrew • System Description• Centralized server• Quad core• 16 Gigabytes RAM• Hard Drive: 1.8 Terabytes• Os: Centos (Client and Server)• Backups taken every night• Not oriented to real time12/11/2014 www.aemet.es 21STSM Boulder: Neubrew • Web Service• Java + HTML• Apache Tomcat + Servlets• Data Transmission• Server Request• SSH communications• Sequential mode• One Brewer at a time• Communication problems• Poorly communicated areas12/11/2014 www.aemet.es 22STSM Boulder: Neubrew • Database• PostgreSQL (pgAdmin)• Data Issues:• Station• Very descriptive column names• Use of tables for logic behaviour• Configuration of Communications• Different data levels and product generation• Contacts12/11/2014 www.aemet.es 23STSM Boulder: Neubrew • Products Generation• UV Index and UV Erythema• UV Irradiance• UV Spectral Scans• Ozone Time Series• Tropospheric Ozone time series• Ozone Vertical Profiles12/11/2014 www.aemet.es 24STSM Boulder: Neubrew • Quality Assurance• Data processed by the administrator• No automatic way• Some graphics tools showing receptioninformation• Blanks• Medium size of files• Last six days of Ozone and UV Index and Erythema12/11/2014 www.aemet.es 25STSM Boulder: Neubrew • Quality Assurance• Comprehensive daily report• Experimented administrator• Tables in plain text and messages• ICFs historical from the beginning• Daily backup12/11/2014 www.aemet.es 26STSM Boulder: Neubrew • Diagnostic• More than twenty five different displays• Langley Regression Analysis tool– Step by step• Brewer UV spike detection and correction– Percentage of spikes in UV spectra• Brewer Multi-instrumental Display– From all brewers in a single page• Ozone QC Level Diagnostic– Differences between data levels12/11/2014 www.aemet.es 27STSM Boulder: Index• Introduction• Short Description• Iberonesia• Neubrew• Comparison12/11/2014 www.aemet.es 28STSM Boulder: Comparison• ComparisonNeuBrew IberonesiaNetwork not prepared for solving real time issuesNetwork oriented for receiving and processing data in real timeUse of a physical server placed in a laboratory Use of virtual machines and cloud computingDesigned for running in a centralized server Designed for having the possibility to be distributed.Very extended monitoring system for human operatorsReduced monitoring system based in logs and status messagesGraphical information generated in execution time extracting different data levels from databaseGraphic information stored in file systemUse of a reduced number of different technologiesBig amount of different technologies for solving several issuesData transferred by server requests in a scheduled wayClient oriented data transmission depending on local schedulesNeubrewQuestions and Answers12/11/2014 AEMET, Agencia Estatal de Meteorología 29NeubrewThank you for your attention12/11/2014 AEMET, Agencia Estatal de Meteorología 30

Comparative study between Brewer spectrophotometer networks

https://repositorio.aemet.es/bitstream/20.500.11765/1138/1/Delft%202014%20BHC%20Network%20comparison.pdf

Comparative study between Brewer spectrophotometer networks

Abstract

Similar works

Full text

Available Versions

Agencia Estatal de Meteorología