62 research outputs found

    earthobservations/wetterdienst: Establish black codestyle, fix type casting, add tidy data option

    No full text
    establish code style black setup nox session that can be used to run black via nox -s black for one of the supported Python versions add option for data collection to tidy the DataFrame (properly reshape) with the "tidy_data" keyword and set it to be used as default fix integer type casting for cases with nans in the column/series fix humanizing of column names for tidy dat

    earthobservations/wetterdienst: Fix InfluxDB exports and increase efficiency and performance

    No full text
    InfluxDB export: Fix export in non-tidy format (#230). Thanks, @wetterfrosch! InfluxDB export: Use "quality" column as tag (#234). Thanks, @wetterfrosch! InfluxDB export: Use a batch size of 50000 to handle larger amounts of data (#235). Thanks, @wetterfrosch! Update radar examples to use wradlib>=1.9.0. Thanks, @kmuehlbauer! Change wherever possible column type to category Increase efficiency by downloading only historical files with overlapping dates if start_date and end_date are given Use periods dynamically depending on start and end date Fix inconsistency within 1 minute precipitation data where historical files have more columns Improve DWD PDF parser to extract quality information and select language. Also, add an example at example/dwd_describe_fields.py as well as respective documentation

    earthobservations/wetterdienst: Enhance get_nearby_stations

    No full text
    Enhance the usage of get_nearby_stations Output of get_nearby_stations is a slive of meta_data DataFram

    earthobservations/wetterdienst: Improve MOSMIX subsystem and various refactorings

    No full text
    CLI: Obtain "--tidy" argument from command line Extend MOSMIX support to equal the API of observations DWDObservationSites now filters for those stations which have a file on the server DWDObservationData now also takes an individual parameter independent of the pre-configured DWD datasets by using DWDObservationParameter or similar names e.g. "precipitation_height" Newly introduced coexistence of DWDObservationParameter and DWDObservationParameterSet to address parameter sets as well as individual parameters Imports are changed to submodule thus now one has to import everything from wetterdienst.dwd Renaming of time_resolution to resolution, period_type to period, several other relabel

    earthobservations/wetterdienst: Fox 10minutes fileindex intervals

    No full text
    Fix 10minutes file index interval range by adding timezone informatio

    earthobservations/wetterdienst: Add API for Environment and Climate Change Canada

    No full text
    Use direct mapping to get a parameter set for a parameter Rename DwdObservationParameterSet to DwdObservationDataset as well as corresponding columns Merge metadata access into Request Repair CLI and I/O subsystem Add capability to export to Feather- and Parquet-files to I/O subsystem Deprecate support for Python 3.6 Add --reload parameter to wetterdienst service for supporting development Improve spreadsheet export Increase I/O subsystem test coverage Make all DWD observation field names lowercase Make all DWD forecast (mosmix) field names lowercase Add Environment and Climate Change Canada API Rename humanize_parameters to humanize and tidy_data to tidy Radar: Use OPERA as data source for improved list of radar site

    earthobservations/wetterdienst: Move functionality to core components, use timezones for dates

    No full text
    Move more functionality into core classes Add more attributes to the core e.g. source and timezone Make dates of internal data timezone aware, set start date and end date to UTC Add issue date to Mosmix class that actually refers to the Mosmix run instead of start date and end date Use Result object for every data related return In accordance with typical naming conventions, DWDObservationSites is renamed to DWDObservationStations, the same is applied to DWDMosmixSites The name ELEMENT is removed and replaced by parameter while the acutal parameter set e.g. CLIMATE_SUMMARY is now found under PARAMETER_SET Remove StorageAdapter and its dependencies Methods self.collect_data() and self.collect_safe() are replaced by self.query() and self.all() and will deprecate at some poin

    earthobservations/wetterdienst: Fix date filtering

    No full text
    Fix date filtering of DWD observations, where accidentally an empty dataframe was returne

    earthobservations/wetterdienst: Make use of common resolution and period

    No full text
    Create general Resolution and Period enumerations that can be used anywhere Create a full dataframe even if no values exist at requested time Add further attributes to the class structure Make dates timezone aware Restrict dates to isoforma

    earthobservations/wetterdienst: Enhance documentation, add test for example notebook, fix bug with TimeResolution enumeration

    No full text
    Add test for Jupyter notebook Add function to discover available climate observations (time resolution, parameter, period type) Make the CLI work again and add software tests to prevent future havocs Use Sphinx Material theme for documentation Fix typo in enumeration for TimeResolution.MINUTES_1
    corecore