Retrieving Data

Not all data dependencies are shipped with the git repository, since git is not suited for handling large changing files. Instead we provide separate data bundles which can be obtained using the retrieve* rules.

Rule retrieve_databundle

The data bundle contains common GIS datasets like NUTS3 shapes, EEZ shapes, CORINE Landcover, Natura 2000 and also electricity specific summary statistics like historic per country yearly totals of hydro generation, GDP and population data on NUTS3 levels and energy balances.

This rule downloads the data bundle from zenodo and extracts it in the data sub-directory, such that all files of the bundle are stored in the data/bundle subdirectory.

Rule retrieve_eurostat_data

Retrieve and extract eurostat energy balances data.

Rule retrieve_jrc_idees

Retrieve and extract JRC IDEES 2021 data.

Rule retrieve_eurostat_household_data

Retrieve and extract eurostat household energy balances data.

Rule retrieve_gas_infrastructure_data

Retrieve gas infrastructure data from https://zenodo.org/records/4767098/files/IGGIELGN.zip.

Rule retrieve_osm_data

Retrieve OSM data for the specified country using the overpass API and save it to the specified output files.

Note that overpass requests are based on a fair use policy. retrieve_osm_data is meant to be used in a way that respects this policy by fetching the needed data once, only.

Rule retrieve_cutout

Cutouts are spatio-temporal subsets of the European weather data from the ECMWF ERA5 reanalysis dataset and the CMSAF SARAH-3 solar surface radiation dataset for the year 2013, 2019 or 2023. They have been prepared by and are for use with the atlite tool. You can either generate them yourself using the build_cutouts rule or retrieve them directly from zenodo through the rule retrieve_cutout. The Tutorial: Electricity-Only uses a smaller cutout than required for the full model (30 MB), which is also automatically downloaded.

Note

To download cutouts yourself from the ECMWF ERA5 you need to set up the CDS API.

Relevant Settings

tutorial:
enable:
    build_cutout:

See also

Documentation of the configuration file config/config.yaml at Top-level configuration

Outputs

• cutouts/{cutout}: weather data from either the ERA5 reanalysis weather dataset and/or SARAH-3 satellite-based historic weather data.

See also

For details see build_cutout and read the atlite documentation.

Rule retrieve_electricity_demand

This rule downloads hourly electric load data for each country from the OPSD platform.

Relevant Settings

None.

Outputs

• data/electricity_demand_raw.csv

Rule retrieve_cost_data

This rule downloads techno-economic assumptions from the technology-data repository.

Relevant Settings

enable:
    retrieve_cost_data:

costs:
    year:
    version:

See also

Documentation of the configuration file config/config.yaml at costs

Outputs

• resources/costs.csv

Rule retrieve_ship_raster

This rule downloads data on global shipping traffic density from the World Bank Data Catalogue.

Relevant Settings

None.

Outputs

• data/shipdensity_global.zip