62 research outputs found
earthobservations/wetterdienst: Establish black codestyle, fix type casting, add tidy data option
establish code style black
setup nox session that can be used to run black via nox -s black for one of the supported Python versions
add option for data collection to tidy the DataFrame (properly reshape) with the "tidy_data" keyword and set it to be used as default
fix integer type casting for cases with nans in the column/series
fix humanizing of column names for tidy dat
earthobservations/wetterdienst: Fix InfluxDB exports and increase efficiency and performance
InfluxDB export: Fix export in non-tidy format (#230). Thanks, @wetterfrosch!
InfluxDB export: Use "quality" column as tag (#234). Thanks, @wetterfrosch!
InfluxDB export: Use a batch size of 50000 to handle larger amounts of data (#235). Thanks, @wetterfrosch!
Update radar examples to use wradlib>=1.9.0. Thanks, @kmuehlbauer!
Change wherever possible column type to category
Increase efficiency by downloading only historical files with overlapping dates if start_date and end_date are given
Use periods dynamically depending on start and end date
Fix inconsistency within 1 minute precipitation data where historical files have more columns
Improve DWD PDF parser to extract quality information and select language.
Also, add an example at example/dwd_describe_fields.py as well as
respective documentation
earthobservations/wetterdienst: Enhance get_nearby_stations
Enhance the usage of get_nearby_stations
Output of get_nearby_stations is a slive of meta_data DataFram
earthobservations/wetterdienst: Improve MOSMIX subsystem and various refactorings
CLI: Obtain "--tidy" argument from command line
Extend MOSMIX support to equal the API of observations
DWDObservationSites now filters for those stations which have a file on the server
DWDObservationData now also takes an individual parameter
independent of the pre-configured DWD datasets by using DWDObservationParameter or
similar names e.g. "precipitation_height"
Newly introduced coexistence of DWDObservationParameter and DWDObservationParameterSet
to address parameter sets as well as individual parameters
Imports are changed to submodule thus now one has to import everything from
wetterdienst.dwd
Renaming of time_resolution to resolution, period_type to period, several other
relabel
earthobservations/wetterdienst: Fox 10minutes fileindex intervals
Fix 10minutes file index interval range by adding timezone informatio
earthobservations/wetterdienst: Add API for Environment and Climate Change Canada
Use direct mapping to get a parameter set for a parameter
Rename DwdObservationParameterSet to DwdObservationDataset as well as corresponding
columns
Merge metadata access into Request
Repair CLI and I/O subsystem
Add capability to export to Feather- and Parquet-files to I/O subsystem
Deprecate support for Python 3.6
Add --reload parameter to wetterdienst service for supporting development
Improve spreadsheet export
Increase I/O subsystem test coverage
Make all DWD observation field names lowercase
Make all DWD forecast (mosmix) field names lowercase
Add Environment and Climate Change Canada API
Rename humanize_parameters to humanize and tidy_data to tidy
Radar: Use OPERA as data source for improved list of radar site
earthobservations/wetterdienst: Move functionality to core components, use timezones for dates
Move more functionality into core classes
Add more attributes to the core e.g. source and timezone
Make dates of internal data timezone aware, set start date and end date to UTC
Add issue date to Mosmix class that actually refers to the Mosmix run instead of start
date and end date
Use Result object for every data related return
In accordance with typical naming conventions, DWDObservationSites is renamed to
DWDObservationStations, the same is applied to DWDMosmixSites
The name ELEMENT is removed and replaced by parameter while the acutal parameter set
e.g. CLIMATE_SUMMARY is now found under PARAMETER_SET
Remove StorageAdapter and its dependencies
Methods self.collect_data() and self.collect_safe() are replaced by self.query() and
self.all() and will deprecate at some poin
earthobservations/wetterdienst: Fix date filtering
Fix date filtering of DWD observations, where accidentally an empty dataframe was
returne
earthobservations/wetterdienst: Make use of common resolution and period
Create general Resolution and Period enumerations that can be used anywhere
Create a full dataframe even if no values exist at requested time
Add further attributes to the class structure
Make dates timezone aware
Restrict dates to isoforma
earthobservations/wetterdienst: Enhance documentation, add test for example notebook, fix bug with TimeResolution enumeration
Add test for Jupyter notebook
Add function to discover available climate observations (time resolution, parameter, period type)
Make the CLI work again and add software tests to prevent future havocs
Use Sphinx Material theme for documentation
Fix typo in enumeration for TimeResolution.MINUTES_1
- …