Presentación realizada para el MC and WG meeting celebrado en Delft (Países Bajos) del 11 al 12 de noviembre de 201

Hernández Cruz, Bentorey

English

Agencia Estatal de Meteorología

IberonesiaDatabase DesignAuthor: Bentorey Hernández Cruz23/07/2014 www.aemet.es 2Iberonesia• Introduction• System Description• Web Service• Data Transmission• Database• Products Generation• Quality Assurance23/07/2014 www.aemet.es 3Iberonesia: Introduction• Introduction• Personal Profile• Bentorey Hernández Cruz• Master in Research Techniques• Computer Science Engineer• University of La Laguna23/07/2014 www.aemet.es 4Iberonesia: Introduction• Introduction• Personal Profile• Researcher: University of La Laguna– Earthcare ground-based spectrometer validation network • Webmaster: Eubrewnet.org• Colaborating: COST 120723/07/2014 www.aemet.es 5Iberonesia: Introduction• Introduction• Network of Brewer Spectroradiometers• North Macaronesian and Iberian Peninsula• From 30W to 3E• From 28N to 44N23/07/2014 www.aemet.es 6Iberonesia: Introduction• Introduction23/07/2014 www.aemet.es 7Iberonesia: System Description• System Description• Modules• Data Import– File schema and history• Processing– Database automated processing• Error Handling– Interactive process in case of error• Product Generation– Automated or in demandIberonesia: System Description• System Description• Cloud Server• Client – Server communication• OS• Server: Ubuntu server• Client: Python interpreter• Real Time (programmed tasks)23/07/2014 AEMET, Agencia Estatal de Meteorología 823/07/2014 www.aemet.es 9Iberonesia: System Description• Web service23/07/2014 www.aemet.es 10Iberonesia: System Description• Web serviceIberonesia: Data Transmission• Data Transmission• Data communication depending on the client• New files that are not stored in the server• Last change in the files• Change in a checksum based in md5• Only new information is sent to the server• Redundance of information• File System• Database23/07/2014 AEMET, Agencia Estatal de Meteorología 11Iberonesia: Database• Database• MySQL• Data issues:• Brewer Info• Code Error Messages• Log table• File status• Refresh information• Calibration and configuration• Neighborhood/Satellite Information23/07/2014 AEMET, Agencia Estatal de Meteorología 12Iberonesia: Database• Database• Brewer Table23/07/2014 AEMET, Agencia Estatal de Meteorología 13TABLE `brewer_t`Fields:`description` (varchar(64)): Id, place, research center`last_online` (datetime): Date of the last reception`lat` and `long`(float): Position of the brewer`active`(tinyint(4)): If the brewer is activeIberonesia: Database• Database• B File Table23/07/2014 AEMET, Agencia Estatal de Meteorología 14TABLE `b_t`Fields:`brewerid`(int(11)): Number of the brewer`date` (date): Corresponding day`latitude` and `longitude` (double): Position extracted from the b file`last` (double): Last value Iberonesia: Database• Database• Config Table23/07/2014 AEMET, Agencia Estatal de Meteorología 15TABLE `config_t`Fields:`brewerid` (int(11)): Corresponding brewer`icf_id` (int(11)): Id of the corresponding icf in database`o3ds`, `o3zs`, `o3fz`, `o3fm`, `no2ds`, `no2zs`, `no2fm`, `o3ds_maxstd`, `o3zs_maxstd`, `o3fz_maxstd`, `o3fm_maxstd`, `no2ds_maxstd`, `no2zs_maxstd`…Iberonesia: Database• Database• File Status Table23/07/2014 AEMET, Agencia Estatal de Meteorología 16TABLE `file_status_t`Fields:`path` (varchar(255)): Absolute path to the file where is stored`text` (text): Message with the status`process_date` (date): When was processed (day)`process_time` (time): When was processed (hour)Iberonesia: Products Generation• Products Generation• Ozone and UV• Still under development• Several scripts in Matlab• Images accesible from the website23/07/2014 AEMET, Agencia Estatal de Meteorología 17Iberonesia: Products Generation• Products Generation23/07/2014 AEMET, Agencia Estatal de Meteorología 18Iberonesia: Quality Assurance• Quality Assurance• Real time connection control• Colour based tool– Green– Orange– Red• File status• Comprehensive message of fails:– Dates– Brewer– Type of message23/07/2014 AEMET, Agencia Estatal de Meteorología 19Iberonesia: Quality Assurance• Quality Assurance23/07/2014 AEMET, Agencia Estatal de Meteorología 20Iberonesia: Quality Assurance• Quality Assurance23/07/2014 AEMET, Agencia Estatal de Meteorología 21IberonesiaQuestions and Answers23/07/2014 AEMET, Agencia Estatal de Meteorología 22IberonesiaThank you for your attention23/07/2014 AEMET, Agencia Estatal de Meteorología 23

Iberonesia

https://repositorio.aemet.es/bitstream/20.500.11765/2600/1/Arosa%202014%20BHC%20Iberonesia.pdf

Iberonesia

Abstract

Similar works

Full text

Available Versions

Agencia Estatal de Meteorología