ERA5 Gaussian Grid: Difference between revisions

From Wiki-WindPRO
Jump to navigation Jump to search
 
(48 intermediate revisions by 2 users not shown)
Line 1: Line 1:
[[Category:Online Data]][[Category:Wind Data]][[File:ERA5_WindsAt100m.png|thumb|right|300px|Winds @ 100m]]
[[Category:Online Data]][[Category:Wind Data]][[File:ERA5_WindsAt100m.png|thumb|right|300px|Windspeeds @ 100m]]
== Introduction ==  
== Introduction ==  
ERA5 is a climate reanalysis dataset developed through the Copernicus Climate Change Service (C3S) with the raw-data processed and delivered by ECMWF. The dataset is the successor to the popular ERA-Interim dataset - which is now discontinued by end-of year 2019. The ERA5 dataset has several improvements compared to ERA-Interim:
ERA5 is a climate reanalysis dataset developed through the Copernicus Climate Change Service (C3S) with the raw-data processed and delivered by ECMWF. The dataset is the successor to the popular ERA-Interim dataset - which was discontinued by end-of year 2019. The ERA5 dataset has several improvements compared to ERA-Interim:


# Newer modelling system
# Newer modelling system
Line 10: Line 10:
More information is available in the windPRO Online Data release note from August 2017. A first comparison to ERA-Interim and MERRA2 is also included in this note -  [http://help.emd.dk/mediawiki/images/8/81/20170829_ERA5_WindPRO_ReleaseNote.pdf see here].
More information is available in the windPRO Online Data release note from August 2017. A first comparison to ERA-Interim and MERRA2 is also included in this note -  [http://help.emd.dk/mediawiki/images/8/81/20170829_ERA5_WindPRO_ReleaseNote.pdf see here].


<b>ERA5 and EMD-WRF Mesoscale Services</b><br>
'''ERA5 and EMD-WRF Mesoscale Services'''<br>
EMD has incorporated the ERA5 data in to its EMD-WRF on-demand setup and its pre-run datasets. Read more here: [https://www.emd.dk/windpro/mesoscale-data/ <here>]. A thorough validation of ERA5 in a EMD-WRF modelling context has been conducted and included in two technical notes covering [http://help.emd.dk/knowledgebase/content/TechNotes/TechnicalNote6_EMD-WRF_On-Demand_20180116.pdf EMD-WRF On-Demand] services and [http://help.emd.dk/knowledgebase/content/TechNotes/TechnicalNote7_EMDWRF_EUROPE_Validation.pdf EMD-WRF Europe+] pre-run mesoscale dataset.
EMD has incorporated the ERA5 data in to its EMD-WRF on-demand setup and its pre-run datasets - read more [https://www.emd.dk/windpro/mesoscale-data/ here]. A thorough validation of ERA5 in a EMD-WRF modelling context has been conducted and included in two technical notes covering [http://help.emd.dk/knowledgebase/content/TechNotes/TechnicalNote6_EMD-WRF_On-Demand_20180116.pdf EMD-WRF On-Demand] services and [http://help.emd.dk/knowledgebase/content/TechNotes/TechnicalNote7_EMDWRF_EUROPE_Validation.pdf EMD-WRF Europe+] pre-run mesoscale dataset.


== Dataset Description: Resolution, Coverage, Period and Update Schedule ==
'''ERA5(T) and ERA5 in the ERA5 Gaussian Grid Dataset'''<br>
* '''Resolution:''' The native model grid is a reduced gaussian grid (T620) which has a lateral resolution of 0.28125° (around 31 km). It holds hourly values. <br>
During early December 2019, ECMWF released the ERA5(T) dataset. ERA5(T) is preliminary ERA5 data, but updated with a shorter five calender day delay. From summer 2022, ECMWF did make the ERA5(T) data available for the native, reduced Gaussian grid. This is a major improvement over the previous release schedule (before summer 2022), where the ERA5 Gaussian grid data came with a 2-3 month delay/lag due to ECMWF releases. Read more about ERA5 and ERA5T on our [[ERA5(T)_Rectangular_Grid|ERA5(T) Rectangular Grid]] dataset-page.
* '''Coverage:''' Coverage is global for land-areas and coastal regions. In windPRO, offshore coverage is covers a distance of approximately 300 km from any known coastline. <br>
 
* '''Period:''' The EMD databases holds data from 1988 until present day. <br>
== Dataset Overview ==
* '''Update Schedule''': Monthly - from December 2017 ECMWF started monthly updates of ERA5 so that onward data from a new month is added every month with a 2-3 month delay. EMD will release ERA5 in windPRO as soon as it is available, but be aware that data is released (from ECMWF) with a delay of about three months. You can always find the ECMWF release plan [https://climate.copernicus.eu/products/climate-reanalysis here].
* '''Content:''': Renewable energy focused data subset of ERA5 - see the paramateter list below. From summer 2022, the ERA5 Gaussian Grid dataset holds both preliminary and final ERA5 data (see more above).
* '''Spatial Resolution:''' The native model grid is a reduced Gaussian grid (T620) which has a lateral resolution of 0.28125° (around 31 km).<br>
* '''Temporal Resolution:''' Hourly.
* '''Coverage:''' Coverage is global for land-areas and coastal regions. In windPRO, offshore coverage is to a distance of approximately 300 km from any known coastline. <br>
* '''Period:''' 30+ years - the EMD databases holds data from 1988 until present day. <br>
* '''Update schedule:'''  
** Currently, EMD is updating this dataset once a month - with data being available with a one week delay from real-time. The monthly update will take place around the 7th or 8th of the month - where all data from the previous month will be available.
**Once the final ERA5 data becomes available (after 2-3 months) the dataset will be updated with those data. According to ECMWF they do not expect changes to happen very often - and in the event that it does happen - it will be communicated to users. At EMD we will communicate any such changes to the windPRO users as well.
**You can always find the ECMWF release plan [https://climate.copernicus.eu/products/climate-reanalysis here]


== Validations ==
== Validations ==
[[File:CorrelationGraph.png|right|300px|thumb|Correlation improvement, ERA5-MERRA2]]'''First ERA5 Data Evaluation:'''<br>The hourly wind speeds from ERA5 and MERRA2 data have been compared to measured wind speeds from 108 tall meteorological masts around the globe. The masts have sensor heights ranging from about 60m to 140m. Correlations have been calculated for all sites - and ERA5 data shows a significant improvement over MERRA2 – the average correlation is increased by 0.07 and the variation is also lower. Further information in the release note,  [http://help.emd.dk/mediawiki/images/8/81/20170829_ERA5_WindPRO_ReleaseNote.pdf here].<br>
[[File:CorrelationGraph.png|right|300px|thumb|Correlation improvement, ERA5-MERRA2]]'''First ERA5 Data Evaluation:'''<br>The hourly wind speeds from ERA5 and MERRA2 data have been compared to measured wind speeds from 108 tall meteorological masts around the globe. The masts have sensor heights ranging from about 60m to 140m. Correlations have been calculated for all sites - and ERA5 data shows a significant improvement over MERRA2 – the average correlation is increased by 0.07 and the variation is also lower. Further information in the release note,  [http://help.emd.dk/mediawiki/images/8/81/20170829_ERA5_WindPRO_ReleaseNote.pdf here].<br>


'''Additional Data Evaluations:'''<br>In connection evaluations of the accuracy of the EMD-WRF mesoscale data products, the raw MERRA2 and raw ERA5 reanalysis data has also been included in the reporting: The results is found in two evaluation reports - one on the EMD-WRF On-Demand product and on on our EMD-WRF Europe+ dataset. ERA5 performance is consistent and high when benchmarking against local meteorological towers. Please consult the reports here for more details:  
'''Additional Data Evaluations:'''<br>In connection to evaluations of the accuracy of the EMD-WRF mesoscale data products, the raw MERRA2 and raw ERA5 reanalysis data were also included in the analysis': The results are found in two evaluation reports - one on the EMD-WRF On-Demand product and one on our EMD-WRF Europe+ dataset. Again, ERA5 performance is fount to be consistent and high-quality when benchmarking against local meteorological towers. Please consult the reports here for further details:  
# [http://help.emd.dk/knowledgebase/content/TechNotes/TechnicalNote6_EMD-WRF_On-Demand_20180116.pdf EMD-WRF On-Demand Validation Report] and  
# [http://help.emd.dk/knowledgebase/content/TechNotes/TechnicalNote6_EMD-WRF_On-Demand_20180116.pdf EMD-WRF On-Demand Validation Report] and  
# [http://help.emd.dk/knowledgebase/content/TechNotes/TechnicalNote7_EMDWRF_EUROPE_Validation.pdf EMD-WRF Europe+ Validation Report]
# [http://help.emd.dk/knowledgebase/content/TechNotes/TechnicalNote7_EMDWRF_EUROPE_Validation.pdf EMD-WRF Europe+ Validation Report]


== Known Issues ==
'''ERA-5 Solar Irradiation Data Evaluation''':<br>We have prepared a small validation note as part of the release of the [[Heliosat_(SARAH)_3.0|SARAH-3]] data. This note is based on data from 18 in-situ measurements in Denmark and are also comparing against the global solar atlas as a reference dataset. This is intended to give hints on bias and uncertainty - and to compare to the other datasets often used: ERA5 and SARAH-2. Read more - [https://help.emd.dk/mediawiki/images/c/cf/20240222_SARAH3_Evaluation.pdf HERE].
'''2018-12-06:'''<br>
 
'''Issue:''' Copernicus support notified users that ERA5 data downloaded throught the climate data store (CDS) was affected by an error in the u- and v components of the pressure level winds (https://confluence.ecmwf.int/pages/viewpage.action?pageId=127305868) <br>
== Known Issues and Usage Notes ==
'''Solution:''' ERA5 data in windPRO are not influenced by this problem: We are (currently) procuring data directly from ECMWF (and not the CDS) - and also distributing physical heights of 10m and 100m.
*'''2024-10-25:'''
** '''Issue:''' Final, validated ERA5 data from Jul-Oct 2024 differs from the preliminary ERA5T.
** '''Solution:''' Read the notification from ECMWF [https://help.emd.dk/mediawiki/images/f/f4/20241024_ERA5T_AlpsSnowIssue.pdf here]. An analysis with recommendation from EMD is available [https://help.emd.dk/mediawiki/images/3/32/20241023_ERA5T_Issue_July-2024.pdf here]. The EMD newsletter with recommendations is available [https://www.emd-international.com/newsletters/windpro/windPRO4.1_ERA5_Update.html here]. A presentation from a wind-energy expert meeting on 2024-11-20 (vindkraftnet) is available [https://help.emd.dk/mediawiki/images/f/ff/20241120_ERA5-ERA5T_SnowDepthIssue_FINAL.pdf here].
*'''2022-07-20:'''
**'''Issue/Solution:''' ERA5T data is now available in the ERA5 Gaussian Grid dataset.
*'''2021-08-12:'''
** '''Issue:''' Diurnal distribution of near-surface temperatures suffers from a mismatch.
** '''Solution:''' This is a known issue by ECMWF. It is possible to check the status of this and other issues (that ECMWF are aware of) from their dedicated wiki-page - [https://confluence.ecmwf.int/pages/viewpage.action?pageId=82870405#ERA5:datadocumentation-Knownissues here].
*'''2020-01-08:'''
**'''Issue:''' ECMWF has released the ERA5(T) data (preliminary data) as a part of its Copernicus Climate Data Store (CDS) offerings, see [https://confluence.ecmwf.int/display/CUSF/Release+of+ERA5T here]. These data are preliminary, can be used to extend the ERA5 data - and are available on a daily basis with a 5-day delay from real time. The ERA5(T) data are currently available only on a 0.25 degree rectangular lat-lon grid, so not directly compatible with the native model (Gaussian) gridded data.
**'''Solution:''' If you need the ERA5(T) data - as of January 2020 - it is also possible to download ERA5 and ERA5(T) data in windPRO on a rectangular, geographical grid. EMD will update/ammend this dataset - ERA5 Gaussian Grid - when the ERA5(T) data become available at the native grid resolution. EMD is in dialog with ECMWF with regards to this issue, and representatives from ECMWF have confirmed that the ERA5 data will be available for the Gaussian grids also.
* '''2018-12-06:'''  
**'''Issue:''' Copernicus support notified users that ERA5 data downloaded throught the climate data store (CDS) was affected by an error in the u- and v- components of the pressure level winds - see error report: [https://confluence.ecmwf.int/pages/viewpage.action?pageId=127305868 here].
**'''Solution:''' ERA5 data in windPRO is not influenced by this problem: We are (currently, as of 2018) procuring data directly from ECMWF (and not the CDS) - and also distributing physical heights of 10m and 100m.<br>


== Data Parameters ==
== Data Parameters ==
Line 43: Line 64:
| time
| time
|  
|  
| UTC time stamp
| UTC time stamp (YYYY-MM-DD HH:MM)
|-
|-
| wSpeed.10
| wSpeed.10
Line 189: Line 210:
== Required Modules/Licenses ==
== Required Modules/Licenses ==
To access the ERA5 reanalysis data from within windPRO - the following licenses/modules are required in your windPRO setup:
To access the ERA5 reanalysis data from within windPRO - the following licenses/modules are required in your windPRO setup:
* Basis
* BASIS
* METEO
* METEO
When the license fee is paid, you then have access to the full dataset without further cost. Downloading of data is unrestricted for licenced users, however, a "fair use" policy applies. Visit [http://www.emd.dk/windpro/online-ordering/ EMD online ordering] to purchase the needed licences.
When the license fee is paid, you then have access to the full dataset without further cost. Downloading of data is unrestricted for licenced users with an active service subscription, however, a "fair use" policy applies. Visit [http://www.emd.dk/windpro/online-ordering/ EMD online ordering] to purchase the necessary licences.


== Attribution ==
== Attribution ==
Line 197: Line 218:
<pre>
<pre>
Source:  
Source:  
ERA5 (Gaussian Grid). Distribution through EMD and windPRO - EMD International A/S, 2020.
ERA5 Gaussian Grid. Distribution through EMD and windPRO - EMD International A/S, 2020.
This dataset uses ERA5 which is being developed through the Copernicus Climate Change Service (C3S).  
This dataset uses ERA5 which is being developed through the Copernicus Climate Change Service (C3S).  
Data processing and distribution for ERA5 is carried out by ECMWF.
Data processing and distribution for ERA5 is carried out by ECMWF.
Line 204: Line 225:
== External Links ==
== External Links ==


* ECMWF - What is ERA5 - [https://software.ecmwf.int/wiki/display/CKB/What+is+ERA5 https://software.ecmwf.int/wiki/display/CKB/What+is+ERA5]
* ECMWF - What is ERA5 - at ECMWF - [https://software.ecmwf.int/wiki/display/CKB/What+is+ERA5 HERE]
* ERA5 Data Documentation at ECMWF - [https://software.ecmwf.int/wiki/display/CKB/ERA5+data+documentation https://software.ecmwf.int/wiki/display/CKB/ERA5+data+documentation]
* ERA5 Data Documentation - at ECMWF - [https://confluence.ecmwf.int/display/CKB/ERA5%3A+data+documentation HERE]
* Copernicus Climate Change Service - ERA5 Page - [https://climate.copernicus.eu/products/climate-reanalysis https://climate.copernicus.eu/products/climate-reanalysis]
* ERA5 Page - at the Copernicus Climate Change Service - [https://climate.copernicus.eu/products/climate-reanalysis HERE]

Latest revision as of 14:57, 21 November 2024

Windspeeds @ 100m

Introduction

ERA5 is a climate reanalysis dataset developed through the Copernicus Climate Change Service (C3S) with the raw-data processed and delivered by ECMWF. The dataset is the successor to the popular ERA-Interim dataset - which was discontinued by end-of year 2019. The ERA5 dataset has several improvements compared to ERA-Interim:

  1. Newer modelling system
  2. More observations used in the assimilation
  3. Higher spatial horizontal resolution (around 31 km compared to 79 km)
  4. Higher spatial vertical resolution

More information is available in the windPRO Online Data release note from August 2017. A first comparison to ERA-Interim and MERRA2 is also included in this note - see here.

ERA5 and EMD-WRF Mesoscale Services
EMD has incorporated the ERA5 data in to its EMD-WRF on-demand setup and its pre-run datasets - read more here. A thorough validation of ERA5 in a EMD-WRF modelling context has been conducted and included in two technical notes covering EMD-WRF On-Demand services and EMD-WRF Europe+ pre-run mesoscale dataset.

ERA5(T) and ERA5 in the ERA5 Gaussian Grid Dataset
During early December 2019, ECMWF released the ERA5(T) dataset. ERA5(T) is preliminary ERA5 data, but updated with a shorter five calender day delay. From summer 2022, ECMWF did make the ERA5(T) data available for the native, reduced Gaussian grid. This is a major improvement over the previous release schedule (before summer 2022), where the ERA5 Gaussian grid data came with a 2-3 month delay/lag due to ECMWF releases. Read more about ERA5 and ERA5T on our ERA5(T) Rectangular Grid dataset-page.

Dataset Overview

  • Content:: Renewable energy focused data subset of ERA5 - see the paramateter list below. From summer 2022, the ERA5 Gaussian Grid dataset holds both preliminary and final ERA5 data (see more above).
  • Spatial Resolution: The native model grid is a reduced Gaussian grid (T620) which has a lateral resolution of 0.28125° (around 31 km).
  • Temporal Resolution: Hourly.
  • Coverage: Coverage is global for land-areas and coastal regions. In windPRO, offshore coverage is to a distance of approximately 300 km from any known coastline.
  • Period: 30+ years - the EMD databases holds data from 1988 until present day.
  • Update schedule:
    • Currently, EMD is updating this dataset once a month - with data being available with a one week delay from real-time. The monthly update will take place around the 7th or 8th of the month - where all data from the previous month will be available.
    • Once the final ERA5 data becomes available (after 2-3 months) the dataset will be updated with those data. According to ECMWF they do not expect changes to happen very often - and in the event that it does happen - it will be communicated to users. At EMD we will communicate any such changes to the windPRO users as well.
    • You can always find the ECMWF release plan here

Validations

Correlation improvement, ERA5-MERRA2

First ERA5 Data Evaluation:
The hourly wind speeds from ERA5 and MERRA2 data have been compared to measured wind speeds from 108 tall meteorological masts around the globe. The masts have sensor heights ranging from about 60m to 140m. Correlations have been calculated for all sites - and ERA5 data shows a significant improvement over MERRA2 – the average correlation is increased by 0.07 and the variation is also lower. Further information in the release note, here.

Additional Data Evaluations:
In connection to evaluations of the accuracy of the EMD-WRF mesoscale data products, the raw MERRA2 and raw ERA5 reanalysis data were also included in the analysis': The results are found in two evaluation reports - one on the EMD-WRF On-Demand product and one on our EMD-WRF Europe+ dataset. Again, ERA5 performance is fount to be consistent and high-quality when benchmarking against local meteorological towers. Please consult the reports here for further details:

  1. EMD-WRF On-Demand Validation Report and
  2. EMD-WRF Europe+ Validation Report

ERA-5 Solar Irradiation Data Evaluation:
We have prepared a small validation note as part of the release of the SARAH-3 data. This note is based on data from 18 in-situ measurements in Denmark and are also comparing against the global solar atlas as a reference dataset. This is intended to give hints on bias and uncertainty - and to compare to the other datasets often used: ERA5 and SARAH-2. Read more - HERE.

Known Issues and Usage Notes

  • 2024-10-25:
    • Issue: Final, validated ERA5 data from Jul-Oct 2024 differs from the preliminary ERA5T.
    • Solution: Read the notification from ECMWF here. An analysis with recommendation from EMD is available here. The EMD newsletter with recommendations is available here. A presentation from a wind-energy expert meeting on 2024-11-20 (vindkraftnet) is available here.
  • 2022-07-20:
    • Issue/Solution: ERA5T data is now available in the ERA5 Gaussian Grid dataset.
  • 2021-08-12:
    • Issue: Diurnal distribution of near-surface temperatures suffers from a mismatch.
    • Solution: This is a known issue by ECMWF. It is possible to check the status of this and other issues (that ECMWF are aware of) from their dedicated wiki-page - here.
  • 2020-01-08:
    • Issue: ECMWF has released the ERA5(T) data (preliminary data) as a part of its Copernicus Climate Data Store (CDS) offerings, see here. These data are preliminary, can be used to extend the ERA5 data - and are available on a daily basis with a 5-day delay from real time. The ERA5(T) data are currently available only on a 0.25 degree rectangular lat-lon grid, so not directly compatible with the native model (Gaussian) gridded data.
    • Solution: If you need the ERA5(T) data - as of January 2020 - it is also possible to download ERA5 and ERA5(T) data in windPRO on a rectangular, geographical grid. EMD will update/ammend this dataset - ERA5 Gaussian Grid - when the ERA5(T) data become available at the native grid resolution. EMD is in dialog with ECMWF with regards to this issue, and representatives from ECMWF have confirmed that the ERA5 data will be available for the Gaussian grids also.
  • 2018-12-06:
    • Issue: Copernicus support notified users that ERA5 data downloaded throught the climate data store (CDS) was affected by an error in the u- and v- components of the pressure level winds - see error report: here.
    • Solution: ERA5 data in windPRO is not influenced by this problem: We are (currently, as of 2018) procuring data directly from ECMWF (and not the CDS) - and also distributing physical heights of 10m and 100m.

Data Parameters

EMD extracts a focused subset of climate-parameters from the ERA5 datasets - this subset focuses on wind-energy modelling. When the data have been processed at EMD, then the following parameters are available from within the online-data services within windPRO.

Table: Overview of the windPRO subset of ERA5 parameters.
Parameter Unit Description
time UTC time stamp (YYYY-MM-DD HH:MM)
wSpeed.10 m/s Wind speed @ 10m
wDir.10 deg Wind direction @ 10m
wSpeed.10n m/s Neutral wind speed @ 10m
wDir.10n deg Neutral wind direction @ 10m
wSpeed.100 m/s Wind speed @ 100m
wDir.100 deg Wind direction @ 100m
temperature.2 deg.celcius Temperature @ 2m
dewPointTemp.2 deg.celcius Dew point temperature @ 2m
rh.2 % Relative humidity @ 2m
psfc pa Surface pressure
msl pa Mean sea-level pressure
sst deg.celcius Sea surface temperature
blh m Boundary layer height
tcc % Total cloud cover
fsr m Forecast surface roughness
tclw kg/m2 Total column liquid water
tciw kg/m2 Total column ice water
charnock ~ Charnock
heatFlux w/m2 Instantaneous surface sensible heat flux
lowCc % Low cloud cover
medCc % Medium cloud cover
hiCc % High cloud cover
eastTss N m**-2 Instantaneous eastward turbulent surface stress
northTss N m**-2 Instantaneous northward turbulent surface stress
zust m/s Friction velocity
cbh m Cloud base height
uvbAcc w/m2 Downward UV radiation at the surface
sshfAcc w/m2 Surface sensible heat flux
ssrdAcc w/m2 Surface solar radiation downwards
ssrAcc w/m2 Surface net solar radiation
ssrcAcc w/m2 Surface net solar radiation, clear sky
tisrAcc w/m2 TOA incident solar radiation
fdirAcc w/m2 Total sky direct solar radiation at surface
cdirAcc w/m2 Clear-sky direct solar radiation at surface
ssrdcAcc w/m2 Surface solar radiation downward clear-sky

Required Modules/Licenses

To access the ERA5 reanalysis data from within windPRO - the following licenses/modules are required in your windPRO setup:

  • BASIS
  • METEO

When the license fee is paid, you then have access to the full dataset without further cost. Downloading of data is unrestricted for licenced users with an active service subscription, however, a "fair use" policy applies. Visit EMD online ordering to purchase the necessary licences.

Attribution

If data from this dataset is used within any private or public disseminations, then EMD and its data providers must be acknowledged.

Source: 
ERA5 Gaussian Grid. Distribution through EMD and windPRO - EMD International A/S, 2020.
This dataset uses ERA5 which is being developed through the Copernicus Climate Change Service (C3S). 
Data processing and distribution for ERA5 is carried out by ECMWF.

External Links

  • ECMWF - What is ERA5 - at ECMWF - HERE
  • ERA5 Data Documentation - at ECMWF - HERE
  • ERA5 Page - at the Copernicus Climate Change Service - HERE