Difference between revisions of "ERA5(T) Rectangular Grid"

From Wiki-WindPRO
Jump to navigation Jump to search
m (Minor)
(17 intermediate revisions by 2 users not shown)
Line 1: Line 1:
[[Category:Online Data]][[Category:Wind Data]][[File:ERA5_WindsAt100m.png|thumb|right|300px|Winds @ 100m]]
+
[[Category:Online Data]][[Category:Wind Data]][[File:GunfleetSands_ERAT.png|thumb|right|600px|ERA5 - most recent data available in windPRO: ERA5 (red, until 2019-10-30) and ERA5(T) (green, until 2019-12-31). Site is Gunfleet Sands Offshore Wind Farm, UK.  Data accessed 2020-01-11.]]
 
== Introduction ==  
 
== Introduction ==  
[[Image:ERA5_RectangularVsGaussianGrid.png|right|650px|thumb]]
+
[[Image:ERA5_RectangularVsGaussianGrid.png|right|600px|thumb]]
"ERA5(T) Rectangular Grid" is the most up-to date ERA5 data in windPRO, provided by a seamless merge of the ERA5 data and the preliminary ERA5(T) data. Both datasets hold a focused climate-data parameter subset of the ERA5 data with each dating back more than 20 years and the data available in windPRO are updated twice a month. For a general introduction to the ERA5 data in windPRO along with validation reports, please refer to our [[ERA5_Gaussian_Grid|ERA5 Gaussian Grid]] wiki-page.<br>
+
"ERA5(T) Rectangular Grid" is the most up-to date ERA5 data available in windPRO, provided by a seamless merge of the ERA5 data and the preliminary ERA5(T) data. The dataset hold a focused climate-data parameter subset of the ERA5 data dating back more than 20 years. Data available in windPRO are updated twice a month. For a general introduction to the ERA5 data in windPRO along with validation reports, please refer to our [[ERA5_Gaussian_Grid|ERA5 Gaussian Grid]] wiki-page.<br>
 
   
 
   
'''Why an additional "ERA5 Rectangular Grid" dataset in windPRO?'''<br>
+
'''Why an additional "ERA5(T) Rectangular Grid" dataset in windPRO?'''<br>
 
The first ERA5-based dataset in windPRO was released in summer 2017 and now named [[ERA5_Gaussian_Grid|ERA5 Gaussian Grid]]. The original ERA5 data is based on model output from a reduced gaussian grid, which has been a recommended first choise for many modellers and analysts. Unfortuantely, the newly released ERA5(T) data from December 2019 (preliminary data, but updated with a shorter delay) is currently unavailable for the reduced gaussian grid. As such, ERA5(T) data is currently only offered by ECMWF on an interpolated, rectangular geographical grid in a 0.25x0.25 degree resolution. From our understanding, it is due to current technical limitations in the data-distribution systems at ECMWF and CDS. The windPRO "ERA5(T) Rectangular Grid" dataset is created in order to provide the most recent and up-to date data in windPRO - with both ERA5 data and ERA5(T) included.
 
The first ERA5-based dataset in windPRO was released in summer 2017 and now named [[ERA5_Gaussian_Grid|ERA5 Gaussian Grid]]. The original ERA5 data is based on model output from a reduced gaussian grid, which has been a recommended first choise for many modellers and analysts. Unfortuantely, the newly released ERA5(T) data from December 2019 (preliminary data, but updated with a shorter delay) is currently unavailable for the reduced gaussian grid. As such, ERA5(T) data is currently only offered by ECMWF on an interpolated, rectangular geographical grid in a 0.25x0.25 degree resolution. From our understanding, it is due to current technical limitations in the data-distribution systems at ECMWF and CDS. The windPRO "ERA5(T) Rectangular Grid" dataset is created in order to provide the most recent and up-to date data in windPRO - with both ERA5 data and ERA5(T) included.
 +
 +
'''From Preliminary ERA5T to Final ERA5 Data'''<br>
 +
ERA5(T) is initial release data with availability 5 days behind real time. ERA5 is final data with availability 2-3 months behind real time. In the "ERA5(T) Rectangular Grid" dataset of windPRO, data from ERA5(T) and ERA5 are seamlessly merged, with ERA5(T) data being the most recent 3 months. Users can easily verify which data is ERA5 or ERA5(T) as the windPRO-data is flagged by the 'era5t' binary parameter - see the table below. In the rather unlikely event that ECMWF detects serious errors or flaws in the ERA5(T) data, the final ERA5 data could be different to the preliminary ERA5(T) data. If corrections are applied then users will be notified by ECMWF (via their mailing list and forum) and by EMD (by wiki and direct email). ECMWF<ref>ECMWF/Copernicus homepage (accessed 2020-01-13)  https://cds.climate.copernicus.eu/cdsapp#!/dataset/reanalysis-era5-single-levels?tab=overview</ref> writes the following on the likelihood of errors detected in the ERA5(T) dataset: "''Based on experience with the production of ERA5 so far (and ERA-Interim in the past), our expectation is that such an event would not occur more than once every few years, if at all.''"
  
 
'''Performance: "ERA5 Gaussian Grid" vs "ERA5(T) Rectangular Grid'''<br>
 
'''Performance: "ERA5 Gaussian Grid" vs "ERA5(T) Rectangular Grid'''<br>
EMD has benchmarked the two datasets: the native "ERA5 Gaussian Grid" and the interpolated "ERA5(T) Rectangular Grid" to investigate any performance differences in the two quite similar datasets. The benchmark is made against high-quality wind-speed data from more than 300 tall meteorological masts with a global distribution. As the evaluation-metrics, we consider the wind-speed corelation (R2) at different averaging times: hourly, daily and monthly. Our benchmark shows, that the two datasets correlate equaly well against the local meteorological mast data, with a slight advantage to the interpolated "ERA5(T) Rectangular Grid" dataset - see the table below. Since small differences are seen, we do not recommend to mix ERA5 data originating from different grids as inconsistencies then might occur.
+
EMD has benchmarked the two datasets: the native "ERA5 Gaussian Grid" and the interpolated "ERA5(T) Rectangular Grid" to investigate any performance differences in the two quite similar datasets. The benchmark is made against high-quality wind-speed data from more than 300 tall meteorological masts with a global distribution. As the evaluation-metrics, we consider the wind-speed corelation (R2) at different averaging times: hourly, daily and monthly. Our benchmark shows, that the two datasets correlate equally well against the local meteorological mast data, with a slight advantage to the interpolated "ERA5(T) Rectangular Grid" dataset - see the table below. Since small differences are seen, we do not recommend to mix ERA5 data originating from different grids as inconsistencies then might occur.
  
 
== Dataset Overview ==
 
== Dataset Overview ==
* '''Content:''': Renewable energy focused data subset of ERA5 and ERA5T. ERA5T data is flagged - see the paramateter list below.   
+
[[File:ERA5_WindsAt100m.png|thumb|right|300px|ERA5 - Wind Speeds @ 100m]]
 +
* '''Content:''': Renewable energy focused data subset of ERA5 and ERA5(T). ERA5(T) data is flagged - see the paramateter list below.   
 
* '''Spatial Resolution:''' The dataset grid derived from an interpolated, regular geographical (lat/lon) grid at 0.25x0.25 resolution (around 27.8 km).  
 
* '''Spatial Resolution:''' The dataset grid derived from an interpolated, regular geographical (lat/lon) grid at 0.25x0.25 resolution (around 27.8 km).  
 
* '''Temporal Resolution:''' Hourly values.  
 
* '''Temporal Resolution:''' Hourly values.  
Line 17: Line 21:
 
* '''Period:''' 30+ years. The EMD databases will hold data back to 1988.
 
* '''Period:''' 30+ years. The EMD databases will hold data back to 1988.
 
* '''Update schedule:'''  
 
* '''Update schedule:'''  
**Currently, EMD plans to update the dataset twice a month - with data being aviailable with a one week delay from real-time. The first update will be around the 8th of a month - here all data from the previous month will be available. The second update will be around the 23rd of a month - here the first half of the month will be available.
+
**Currently, EMD plans to update the dataset twice a month - with data being aviailable with a one week delay from real-time. The first update will be around the 8th of the month - here all data from the previous month will be available. The second update will be around the 23rd of the month - here the first half of the month will be available.
**Once the final ERA5 data becomes available (after 2-3 months) the dataset will be updated with that data. According to ECMWF they do not expect changes to happen very often - and in the event that it does happen - it will be communicated to users. At EMD we will communicate any such changes to the windPRO users as well.
+
**Once the final ERA5 data becomes available (after 2-3 months) the dataset will be updated with those data. According to ECMWF they do not expect changes to happen very often - and in the event that it does happen - it will be communicated to users. At EMD we will communicate any such changes to the windPRO users as well.
  
 
== Data Parameters ==
 
== Data Parameters ==
Line 102: Line 106:
 
== Required Modules/Licenses ==
 
== Required Modules/Licenses ==
 
To access the ERA5 reanalysis data from within windPRO - the following licenses/modules are required in your windPRO setup:
 
To access the ERA5 reanalysis data from within windPRO - the following licenses/modules are required in your windPRO setup:
* Basis
+
* BASIS
 
* METEO
 
* METEO
When the license fee is paid, you then have access to the full dataset without further cost. Downloading of data is unrestricted for licenced users with an active service subscription, however, a "fair use" policy applies. Visit [http://www.emd.dk/windpro/online-ordering/ EMD online ordering] to purchase the needed licences.
+
When the license fee is paid, you then have access to the full dataset without further cost. Downloading of data is unrestricted for licenced users with an active service subscription, however, a "fair use" policy applies. Visit [http://www.emd.dk/windpro/online-ordering/ EMD online ordering] to purchase the necessary licences.
  
 
== Attribution ==
 
== Attribution ==
Line 111: Line 115:
 
Source:  
 
Source:  
 
ERA5(T) Rectangular Grid. Distribution through EMD and windPRO - EMD International A/S, 2020.
 
ERA5(T) Rectangular Grid. Distribution through EMD and windPRO - EMD International A/S, 2020.
This dataset uses ERA5 and ERA5T which is being developed through the Copernicus Climate Change Service (C3S).  
+
This dataset uses ERA5 and ERA5(T) which is being developed through the Copernicus Climate Change Service (C3S).  
 
Data processing and distribution for ERA5 is carried out by ECMWF.
 
Data processing and distribution for ERA5 is carried out by ECMWF.
 
</pre>
 
</pre>
Line 120: Line 124:
 
* ERA5 Page - at the Copernicus Climate Change Service - [https://climate.copernicus.eu/products/climate-reanalysis HERE]
 
* ERA5 Page - at the Copernicus Climate Change Service - [https://climate.copernicus.eu/products/climate-reanalysis HERE]
 
* Release note for ERA5T data - from ECMWF - [https://confluence.ecmwf.int/display/CUSF/Release+of+ERA5T HERE]
 
* Release note for ERA5T data - from ECMWF - [https://confluence.ecmwf.int/display/CUSF/Release+of+ERA5T HERE]
 +
 +
== References ==
 +
<references>

Revision as of 17:49, 13 January 2020

ERA5 - most recent data available in windPRO: ERA5 (red, until 2019-10-30) and ERA5(T) (green, until 2019-12-31). Site is Gunfleet Sands Offshore Wind Farm, UK. Data accessed 2020-01-11.

Introduction

ERA5 RectangularVsGaussianGrid.png

"ERA5(T) Rectangular Grid" is the most up-to date ERA5 data available in windPRO, provided by a seamless merge of the ERA5 data and the preliminary ERA5(T) data. The dataset hold a focused climate-data parameter subset of the ERA5 data dating back more than 20 years. Data available in windPRO are updated twice a month. For a general introduction to the ERA5 data in windPRO along with validation reports, please refer to our ERA5 Gaussian Grid wiki-page.

Why an additional "ERA5(T) Rectangular Grid" dataset in windPRO?
The first ERA5-based dataset in windPRO was released in summer 2017 and now named ERA5 Gaussian Grid. The original ERA5 data is based on model output from a reduced gaussian grid, which has been a recommended first choise for many modellers and analysts. Unfortuantely, the newly released ERA5(T) data from December 2019 (preliminary data, but updated with a shorter delay) is currently unavailable for the reduced gaussian grid. As such, ERA5(T) data is currently only offered by ECMWF on an interpolated, rectangular geographical grid in a 0.25x0.25 degree resolution. From our understanding, it is due to current technical limitations in the data-distribution systems at ECMWF and CDS. The windPRO "ERA5(T) Rectangular Grid" dataset is created in order to provide the most recent and up-to date data in windPRO - with both ERA5 data and ERA5(T) included.

From Preliminary ERA5T to Final ERA5 Data
ERA5(T) is initial release data with availability 5 days behind real time. ERA5 is final data with availability 2-3 months behind real time. In the "ERA5(T) Rectangular Grid" dataset of windPRO, data from ERA5(T) and ERA5 are seamlessly merged, with ERA5(T) data being the most recent 3 months. Users can easily verify which data is ERA5 or ERA5(T) as the windPRO-data is flagged by the 'era5t' binary parameter - see the table below. In the rather unlikely event that ECMWF detects serious errors or flaws in the ERA5(T) data, the final ERA5 data could be different to the preliminary ERA5(T) data. If corrections are applied then users will be notified by ECMWF (via their mailing list and forum) and by EMD (by wiki and direct email). ECMWF[1] writes the following on the likelihood of errors detected in the ERA5(T) dataset: "Based on experience with the production of ERA5 so far (and ERA-Interim in the past), our expectation is that such an event would not occur more than once every few years, if at all."

Performance: "ERA5 Gaussian Grid" vs "ERA5(T) Rectangular Grid
EMD has benchmarked the two datasets: the native "ERA5 Gaussian Grid" and the interpolated "ERA5(T) Rectangular Grid" to investigate any performance differences in the two quite similar datasets. The benchmark is made against high-quality wind-speed data from more than 300 tall meteorological masts with a global distribution. As the evaluation-metrics, we consider the wind-speed corelation (R2) at different averaging times: hourly, daily and monthly. Our benchmark shows, that the two datasets correlate equally well against the local meteorological mast data, with a slight advantage to the interpolated "ERA5(T) Rectangular Grid" dataset - see the table below. Since small differences are seen, we do not recommend to mix ERA5 data originating from different grids as inconsistencies then might occur.

Dataset Overview

ERA5 - Wind Speeds @ 100m
  • Content:: Renewable energy focused data subset of ERA5 and ERA5(T). ERA5(T) data is flagged - see the paramateter list below.
  • Spatial Resolution: The dataset grid derived from an interpolated, regular geographical (lat/lon) grid at 0.25x0.25 resolution (around 27.8 km).
  • Temporal Resolution: Hourly values.
  • Coverage: Coverage is global for land-areas and coastal regions. In windPRO, offshore coverage is at a distance of approximately 300 km from any known coastlines.
  • Period: 30+ years. The EMD databases will hold data back to 1988.
  • Update schedule:
    • Currently, EMD plans to update the dataset twice a month - with data being aviailable with a one week delay from real-time. The first update will be around the 8th of the month - here all data from the previous month will be available. The second update will be around the 23rd of the month - here the first half of the month will be available.
    • Once the final ERA5 data becomes available (after 2-3 months) the dataset will be updated with those data. According to ECMWF they do not expect changes to happen very often - and in the event that it does happen - it will be communicated to users. At EMD we will communicate any such changes to the windPRO users as well.

Data Parameters

EMD extracts a focused subset of climate-parameters from the ERA5 datasets - with special emphasis on renewable energy and wind-energy modelling. When the data have been processed at EMD, then the following parameters are available from within the online-data services within windPRO.

Table: Overview of the windPRO subset of ERA5 parameters.
Parameter Unit Description
time UTC time stamp
wSpeed.10 m/s Wind speed @ 10m
wDir.10 deg Wind direction @ 10m
wSpeed.100 m/s Wind speed @ 100m
wDir.100 deg Wind direction @ 100m
temperature.2 deg.celcius Temperature @ 2m
dewPointTemp.2 deg.celcius Dew point temperature @ 2m
rh.2 % Relative humidity @ 2m
psfc pa Surface pressure
msl pa Mean sea-level pressure
blh m Boundary layer height
tcc % Total cloud cover
heatFlux w/m2 Instantaneous surface sensible heat flux
zust m/s Friction velocity
cbh m Cloud base height
ssrdAcc w/m2 Surface solar radiation downwards
era5t 0/1 Binary variable indicating whether the sample is ERA5T data

Required Modules/Licenses

To access the ERA5 reanalysis data from within windPRO - the following licenses/modules are required in your windPRO setup:

  • BASIS
  • METEO

When the license fee is paid, you then have access to the full dataset without further cost. Downloading of data is unrestricted for licenced users with an active service subscription, however, a "fair use" policy applies. Visit EMD online ordering to purchase the necessary licences.

Attribution

If data from this dataset is used within any private or public disseminations, then EMD and its data providers must be acknowledged.

Source: 
ERA5(T) Rectangular Grid. Distribution through EMD and windPRO - EMD International A/S, 2020.
This dataset uses ERA5 and ERA5(T) which is being developed through the Copernicus Climate Change Service (C3S). 
Data processing and distribution for ERA5 is carried out by ECMWF.

External Links

  • What is ERA5 - at ECMWF - HERE
  • ERA5 Data Documentation - at ECMWF - HERE
  • ERA5 Page - at the Copernicus Climate Change Service - HERE
  • Release note for ERA5T data - from ECMWF - HERE

References

<references>