ERA5 Gaussian Grid: Difference between revisions
(33 intermediate revisions by 2 users not shown) | |||
Line 1: | Line 1: | ||
[[Category:Online Data]][[Category:Wind Data]][[File:ERA5_WindsAt100m.png|thumb|right|300px| | [[Category:Online Data]][[Category:Wind Data]][[File:ERA5_WindsAt100m.png|thumb|right|300px|Windspeeds @ 100m]] | ||
== Introduction == | == Introduction == | ||
ERA5 is a climate reanalysis dataset developed through the Copernicus Climate Change Service (C3S) with the raw-data processed and delivered by ECMWF. The dataset is the successor to the popular ERA-Interim dataset - which | ERA5 is a climate reanalysis dataset developed through the Copernicus Climate Change Service (C3S) with the raw-data processed and delivered by ECMWF. The dataset is the successor to the popular ERA-Interim dataset - which was discontinued by end-of year 2019. The ERA5 dataset has several improvements compared to ERA-Interim: | ||
# Newer modelling system | # Newer modelling system | ||
Line 13: | Line 13: | ||
EMD has incorporated the ERA5 data in to its EMD-WRF on-demand setup and its pre-run datasets - read more [https://www.emd.dk/windpro/mesoscale-data/ here]. A thorough validation of ERA5 in a EMD-WRF modelling context has been conducted and included in two technical notes covering [http://help.emd.dk/knowledgebase/content/TechNotes/TechnicalNote6_EMD-WRF_On-Demand_20180116.pdf EMD-WRF On-Demand] services and [http://help.emd.dk/knowledgebase/content/TechNotes/TechnicalNote7_EMDWRF_EUROPE_Validation.pdf EMD-WRF Europe+] pre-run mesoscale dataset. | EMD has incorporated the ERA5 data in to its EMD-WRF on-demand setup and its pre-run datasets - read more [https://www.emd.dk/windpro/mesoscale-data/ here]. A thorough validation of ERA5 in a EMD-WRF modelling context has been conducted and included in two technical notes covering [http://help.emd.dk/knowledgebase/content/TechNotes/TechnicalNote6_EMD-WRF_On-Demand_20180116.pdf EMD-WRF On-Demand] services and [http://help.emd.dk/knowledgebase/content/TechNotes/TechnicalNote7_EMDWRF_EUROPE_Validation.pdf EMD-WRF Europe+] pre-run mesoscale dataset. | ||
''' | '''ERA5(T) and ERA5 in the ERA5 Gaussian Grid Dataset'''<br> | ||
During early | During early December 2019, ECMWF released the ERA5(T) dataset. ERA5(T) is preliminary ERA5 data, but updated with a shorter five calender day delay. From summer 2022, ECMWF did make the ERA5(T) data available for the native, reduced Gaussian grid. This is a major improvement over the previous release schedule (before summer 2022), where the ERA5 Gaussian grid data came with a 2-3 month delay/lag due to ECMWF releases. Read more about ERA5 and ERA5T on our [[ERA5(T)_Rectangular_Grid|ERA5(T) Rectangular Grid]] dataset-page. | ||
== Dataset | == Dataset Overview == | ||
* '''Resolution:''' The native model grid is a reduced | * '''Content:''': Renewable energy focused data subset of ERA5 - see the paramateter list below. From summer 2022, the ERA5 Gaussian Grid dataset holds both preliminary and final ERA5 data (see more above). | ||
* '''Coverage:''' Coverage is global for land-areas and coastal regions. In windPRO, offshore coverage is | * '''Spatial Resolution:''' The native model grid is a reduced Gaussian grid (T620) which has a lateral resolution of 0.28125° (around 31 km).<br> | ||
* '''Period:''' | * '''Temporal Resolution:''' Hourly. | ||
* '''Update | * '''Coverage:''' Coverage is global for land-areas and coastal regions. In windPRO, offshore coverage is to a distance of approximately 300 km from any known coastline. <br> | ||
* '''Period:''' 30+ years - the EMD databases holds data from 1988 until present day. <br> | |||
* '''Update schedule:''' | |||
** Currently, EMD is updating this dataset once a month - with data being available with a one week delay from real-time. The monthly update will take place around the 7th or 8th of the month - where all data from the previous month will be available. | |||
**Once the final ERA5 data becomes available (after 2-3 months) the dataset will be updated with those data. According to ECMWF they do not expect changes to happen very often - and in the event that it does happen - it will be communicated to users. At EMD we will communicate any such changes to the windPRO users as well. | |||
**You can always find the ECMWF release plan [https://climate.copernicus.eu/products/climate-reanalysis here] | |||
== Validations == | == Validations == | ||
[[File:CorrelationGraph.png|right|300px|thumb|Correlation improvement, ERA5-MERRA2]]'''First ERA5 Data Evaluation:'''<br>The hourly wind speeds from ERA5 and MERRA2 data have been compared to measured wind speeds from 108 tall meteorological masts around the globe. The masts have sensor heights ranging from about 60m to 140m. Correlations have been calculated for all sites - and ERA5 data shows a significant improvement over MERRA2 – the average correlation is increased by 0.07 and the variation is also lower. Further information in the release note, [http://help.emd.dk/mediawiki/images/8/81/20170829_ERA5_WindPRO_ReleaseNote.pdf here].<br> | [[File:CorrelationGraph.png|right|300px|thumb|Correlation improvement, ERA5-MERRA2]]'''First ERA5 Data Evaluation:'''<br>The hourly wind speeds from ERA5 and MERRA2 data have been compared to measured wind speeds from 108 tall meteorological masts around the globe. The masts have sensor heights ranging from about 60m to 140m. Correlations have been calculated for all sites - and ERA5 data shows a significant improvement over MERRA2 – the average correlation is increased by 0.07 and the variation is also lower. Further information in the release note, [http://help.emd.dk/mediawiki/images/8/81/20170829_ERA5_WindPRO_ReleaseNote.pdf here].<br> | ||
'''Additional Data Evaluations:'''<br>In connection evaluations of the accuracy of the EMD-WRF mesoscale data products, the raw MERRA2 and raw ERA5 reanalysis data | '''Additional Data Evaluations:'''<br>In connection to evaluations of the accuracy of the EMD-WRF mesoscale data products, the raw MERRA2 and raw ERA5 reanalysis data were also included in the analysis': The results are found in two evaluation reports - one on the EMD-WRF On-Demand product and one on our EMD-WRF Europe+ dataset. Again, ERA5 performance is fount to be consistent and high-quality when benchmarking against local meteorological towers. Please consult the reports here for further details: | ||
# [http://help.emd.dk/knowledgebase/content/TechNotes/TechnicalNote6_EMD-WRF_On-Demand_20180116.pdf EMD-WRF On-Demand Validation Report] and | # [http://help.emd.dk/knowledgebase/content/TechNotes/TechnicalNote6_EMD-WRF_On-Demand_20180116.pdf EMD-WRF On-Demand Validation Report] and | ||
# [http://help.emd.dk/knowledgebase/content/TechNotes/TechnicalNote7_EMDWRF_EUROPE_Validation.pdf EMD-WRF Europe+ Validation Report] | # [http://help.emd.dk/knowledgebase/content/TechNotes/TechnicalNote7_EMDWRF_EUROPE_Validation.pdf EMD-WRF Europe+ Validation Report] | ||
'''ERA-5 Solar Irradiation Data Evaluation''':<br>We have prepared a small validation note as part of the release of the [[Heliosat_(SARAH)_3.0|SARAH-3]] data. This note is based on data from 18 in-situ measurements in Denmark and are also comparing against the global solar atlas as a reference dataset. This is intended to give hints on bias and uncertainty - and to compare to the other datasets often used: ERA5 and SARAH-2. Read more - [https://help.emd.dk/mediawiki/images/c/cf/20240222_SARAH3_Evaluation.pdf HERE]. | |||
== Known Issues and Usage Notes == | == Known Issues and Usage Notes == | ||
*'''2024-10-25:''' | |||
** '''Issue:''' Final, validated ERA5 data from Jul-Oct 2024 differs from the preliminary ERA5T. | |||
** '''Solution:''' Read the notification from ECMWF [https://help.emd.dk/mediawiki/images/f/f4/20241024_ERA5T_AlpsSnowIssue.pdf here]. An analysis with recommendation from EMD is available [https://help.emd.dk/mediawiki/images/3/32/20241023_ERA5T_Issue_July-2024.pdf here]. The EMD newsletter with recommendations is available [https://www.emd-international.com/newsletters/windpro/windPRO4.1_ERA5_Update.html here]. A presentation from a wind-energy expert meeting on 2024-11-20 (vindkraftnet) is available [https://help.emd.dk/mediawiki/images/f/ff/20241120_ERA5-ERA5T_SnowDepthIssue_FINAL.pdf here]. | |||
*'''2022-07-20:''' | |||
**'''Issue/Solution:''' ERA5T data is now available in the ERA5 Gaussian Grid dataset. | |||
*'''2021-08-12:''' | |||
** '''Issue:''' Diurnal distribution of near-surface temperatures suffers from a mismatch. | |||
** '''Solution:''' This is a known issue by ECMWF. It is possible to check the status of this and other issues (that ECMWF are aware of) from their dedicated wiki-page - [https://confluence.ecmwf.int/pages/viewpage.action?pageId=82870405#ERA5:datadocumentation-Knownissues here]. | |||
*'''2020-01-08:''' | |||
**'''Issue:''' ECMWF has released the ERA5(T) data (preliminary data) as a part of its Copernicus Climate Data Store (CDS) offerings, see [https://confluence.ecmwf.int/display/CUSF/Release+of+ERA5T here]. These data are preliminary, can be used to extend the ERA5 data - and are available on a daily basis with a 5-day delay from real time. The ERA5(T) data are currently available only on a 0.25 degree rectangular lat-lon grid, so not directly compatible with the native model (Gaussian) gridded data. | |||
**'''Solution:''' If you need the ERA5(T) data - as of January 2020 - it is also possible to download ERA5 and ERA5(T) data in windPRO on a rectangular, geographical grid. EMD will update/ammend this dataset - ERA5 Gaussian Grid - when the ERA5(T) data become available at the native grid resolution. EMD is in dialog with ECMWF with regards to this issue, and representatives from ECMWF have confirmed that the ERA5 data will be available for the Gaussian grids also. | |||
* '''2018-12-06:''' | * '''2018-12-06:''' | ||
**'''Issue:''' Copernicus support notified users that ERA5 data downloaded throught the climate data store (CDS) was affected by an error in the u- and v components of the pressure level winds - see error report : [https://confluence.ecmwf.int/pages/viewpage.action?pageId=127305868 here]. | **'''Issue:''' Copernicus support notified users that ERA5 data downloaded throught the climate data store (CDS) was affected by an error in the u- and v- components of the pressure level winds - see error report: [https://confluence.ecmwf.int/pages/viewpage.action?pageId=127305868 here]. | ||
**'''Solution:''' ERA5 data in windPRO | **'''Solution:''' ERA5 data in windPRO is not influenced by this problem: We are (currently, as of 2018) procuring data directly from ECMWF (and not the CDS) - and also distributing physical heights of 10m and 100m.<br> | ||
== Data Parameters == | == Data Parameters == | ||
Line 49: | Line 64: | ||
| time | | time | ||
| | | | ||
| UTC time stamp | | UTC time stamp (YYYY-MM-DD HH:MM) | ||
|- | |- | ||
| wSpeed.10 | | wSpeed.10 | ||
Line 195: | Line 210: | ||
== Required Modules/Licenses == | == Required Modules/Licenses == | ||
To access the ERA5 reanalysis data from within windPRO - the following licenses/modules are required in your windPRO setup: | To access the ERA5 reanalysis data from within windPRO - the following licenses/modules are required in your windPRO setup: | ||
* | * BASIS | ||
* METEO | * METEO | ||
When the license fee is paid, you then have access to the full dataset without further cost. Downloading of data is unrestricted for licenced users, however, a "fair use" policy applies. Visit [http://www.emd.dk/windpro/online-ordering/ EMD online ordering] to purchase the | When the license fee is paid, you then have access to the full dataset without further cost. Downloading of data is unrestricted for licenced users with an active service subscription, however, a "fair use" policy applies. Visit [http://www.emd.dk/windpro/online-ordering/ EMD online ordering] to purchase the necessary licences. | ||
== Attribution == | == Attribution == | ||
Line 203: | Line 218: | ||
<pre> | <pre> | ||
Source: | Source: | ||
ERA5 | ERA5 Gaussian Grid. Distribution through EMD and windPRO - EMD International A/S, 2020. | ||
This dataset uses ERA5 which is being developed through the Copernicus Climate Change Service (C3S). | This dataset uses ERA5 which is being developed through the Copernicus Climate Change Service (C3S). | ||
Data processing and distribution for ERA5 is carried out by ECMWF. | Data processing and distribution for ERA5 is carried out by ECMWF. | ||
Line 210: | Line 225: | ||
== External Links == | == External Links == | ||
* ECMWF - What is ERA5 - [https://software.ecmwf.int/wiki/display/CKB/What+is+ERA5 | * ECMWF - What is ERA5 - at ECMWF - [https://software.ecmwf.int/wiki/display/CKB/What+is+ERA5 HERE] | ||
* ERA5 Data Documentation at ECMWF - [https:// | * ERA5 Data Documentation - at ECMWF - [https://confluence.ecmwf.int/display/CKB/ERA5%3A+data+documentation HERE] | ||
* Copernicus Climate Change Service | * ERA5 Page - at the Copernicus Climate Change Service - [https://climate.copernicus.eu/products/climate-reanalysis HERE] |
Latest revision as of 14:57, 21 November 2024
Introduction
ERA5 is a climate reanalysis dataset developed through the Copernicus Climate Change Service (C3S) with the raw-data processed and delivered by ECMWF. The dataset is the successor to the popular ERA-Interim dataset - which was discontinued by end-of year 2019. The ERA5 dataset has several improvements compared to ERA-Interim:
- Newer modelling system
- More observations used in the assimilation
- Higher spatial horizontal resolution (around 31 km compared to 79 km)
- Higher spatial vertical resolution
More information is available in the windPRO Online Data release note from August 2017. A first comparison to ERA-Interim and MERRA2 is also included in this note - see here.
ERA5 and EMD-WRF Mesoscale Services
EMD has incorporated the ERA5 data in to its EMD-WRF on-demand setup and its pre-run datasets - read more here. A thorough validation of ERA5 in a EMD-WRF modelling context has been conducted and included in two technical notes covering EMD-WRF On-Demand services and EMD-WRF Europe+ pre-run mesoscale dataset.
ERA5(T) and ERA5 in the ERA5 Gaussian Grid Dataset
During early December 2019, ECMWF released the ERA5(T) dataset. ERA5(T) is preliminary ERA5 data, but updated with a shorter five calender day delay. From summer 2022, ECMWF did make the ERA5(T) data available for the native, reduced Gaussian grid. This is a major improvement over the previous release schedule (before summer 2022), where the ERA5 Gaussian grid data came with a 2-3 month delay/lag due to ECMWF releases. Read more about ERA5 and ERA5T on our ERA5(T) Rectangular Grid dataset-page.
Dataset Overview
- Content:: Renewable energy focused data subset of ERA5 - see the paramateter list below. From summer 2022, the ERA5 Gaussian Grid dataset holds both preliminary and final ERA5 data (see more above).
- Spatial Resolution: The native model grid is a reduced Gaussian grid (T620) which has a lateral resolution of 0.28125° (around 31 km).
- Temporal Resolution: Hourly.
- Coverage: Coverage is global for land-areas and coastal regions. In windPRO, offshore coverage is to a distance of approximately 300 km from any known coastline.
- Period: 30+ years - the EMD databases holds data from 1988 until present day.
- Update schedule:
- Currently, EMD is updating this dataset once a month - with data being available with a one week delay from real-time. The monthly update will take place around the 7th or 8th of the month - where all data from the previous month will be available.
- Once the final ERA5 data becomes available (after 2-3 months) the dataset will be updated with those data. According to ECMWF they do not expect changes to happen very often - and in the event that it does happen - it will be communicated to users. At EMD we will communicate any such changes to the windPRO users as well.
- You can always find the ECMWF release plan here
Validations
First ERA5 Data Evaluation:
The hourly wind speeds from ERA5 and MERRA2 data have been compared to measured wind speeds from 108 tall meteorological masts around the globe. The masts have sensor heights ranging from about 60m to 140m. Correlations have been calculated for all sites - and ERA5 data shows a significant improvement over MERRA2 – the average correlation is increased by 0.07 and the variation is also lower. Further information in the release note, here.
Additional Data Evaluations:
In connection to evaluations of the accuracy of the EMD-WRF mesoscale data products, the raw MERRA2 and raw ERA5 reanalysis data were also included in the analysis': The results are found in two evaluation reports - one on the EMD-WRF On-Demand product and one on our EMD-WRF Europe+ dataset. Again, ERA5 performance is fount to be consistent and high-quality when benchmarking against local meteorological towers. Please consult the reports here for further details:
ERA-5 Solar Irradiation Data Evaluation:
We have prepared a small validation note as part of the release of the SARAH-3 data. This note is based on data from 18 in-situ measurements in Denmark and are also comparing against the global solar atlas as a reference dataset. This is intended to give hints on bias and uncertainty - and to compare to the other datasets often used: ERA5 and SARAH-2. Read more - HERE.
Known Issues and Usage Notes
- 2024-10-25:
- Issue: Final, validated ERA5 data from Jul-Oct 2024 differs from the preliminary ERA5T.
- Solution: Read the notification from ECMWF here. An analysis with recommendation from EMD is available here. The EMD newsletter with recommendations is available here. A presentation from a wind-energy expert meeting on 2024-11-20 (vindkraftnet) is available here.
- 2022-07-20:
- Issue/Solution: ERA5T data is now available in the ERA5 Gaussian Grid dataset.
- 2021-08-12:
- Issue: Diurnal distribution of near-surface temperatures suffers from a mismatch.
- Solution: This is a known issue by ECMWF. It is possible to check the status of this and other issues (that ECMWF are aware of) from their dedicated wiki-page - here.
- 2020-01-08:
- Issue: ECMWF has released the ERA5(T) data (preliminary data) as a part of its Copernicus Climate Data Store (CDS) offerings, see here. These data are preliminary, can be used to extend the ERA5 data - and are available on a daily basis with a 5-day delay from real time. The ERA5(T) data are currently available only on a 0.25 degree rectangular lat-lon grid, so not directly compatible with the native model (Gaussian) gridded data.
- Solution: If you need the ERA5(T) data - as of January 2020 - it is also possible to download ERA5 and ERA5(T) data in windPRO on a rectangular, geographical grid. EMD will update/ammend this dataset - ERA5 Gaussian Grid - when the ERA5(T) data become available at the native grid resolution. EMD is in dialog with ECMWF with regards to this issue, and representatives from ECMWF have confirmed that the ERA5 data will be available for the Gaussian grids also.
- 2018-12-06:
- Issue: Copernicus support notified users that ERA5 data downloaded throught the climate data store (CDS) was affected by an error in the u- and v- components of the pressure level winds - see error report: here.
- Solution: ERA5 data in windPRO is not influenced by this problem: We are (currently, as of 2018) procuring data directly from ECMWF (and not the CDS) - and also distributing physical heights of 10m and 100m.
Data Parameters
EMD extracts a focused subset of climate-parameters from the ERA5 datasets - this subset focuses on wind-energy modelling. When the data have been processed at EMD, then the following parameters are available from within the online-data services within windPRO.
Parameter | Unit | Description |
---|---|---|
time | UTC time stamp (YYYY-MM-DD HH:MM) | |
wSpeed.10 | m/s | Wind speed @ 10m |
wDir.10 | deg | Wind direction @ 10m |
wSpeed.10n | m/s | Neutral wind speed @ 10m |
wDir.10n | deg | Neutral wind direction @ 10m |
wSpeed.100 | m/s | Wind speed @ 100m |
wDir.100 | deg | Wind direction @ 100m |
temperature.2 | deg.celcius | Temperature @ 2m |
dewPointTemp.2 | deg.celcius | Dew point temperature @ 2m |
rh.2 | % | Relative humidity @ 2m |
psfc | pa | Surface pressure |
msl | pa | Mean sea-level pressure |
sst | deg.celcius | Sea surface temperature |
blh | m | Boundary layer height |
tcc | % | Total cloud cover |
fsr | m | Forecast surface roughness |
tclw | kg/m2 | Total column liquid water |
tciw | kg/m2 | Total column ice water |
charnock | ~ | Charnock |
heatFlux | w/m2 | Instantaneous surface sensible heat flux |
lowCc | % | Low cloud cover |
medCc | % | Medium cloud cover |
hiCc | % | High cloud cover |
eastTss | N m**-2 | Instantaneous eastward turbulent surface stress |
northTss | N m**-2 | Instantaneous northward turbulent surface stress |
zust | m/s | Friction velocity |
cbh | m | Cloud base height |
uvbAcc | w/m2 | Downward UV radiation at the surface |
sshfAcc | w/m2 | Surface sensible heat flux |
ssrdAcc | w/m2 | Surface solar radiation downwards |
ssrAcc | w/m2 | Surface net solar radiation |
ssrcAcc | w/m2 | Surface net solar radiation, clear sky |
tisrAcc | w/m2 | TOA incident solar radiation |
fdirAcc | w/m2 | Total sky direct solar radiation at surface |
cdirAcc | w/m2 | Clear-sky direct solar radiation at surface |
ssrdcAcc | w/m2 | Surface solar radiation downward clear-sky |
Required Modules/Licenses
To access the ERA5 reanalysis data from within windPRO - the following licenses/modules are required in your windPRO setup:
- BASIS
- METEO
When the license fee is paid, you then have access to the full dataset without further cost. Downloading of data is unrestricted for licenced users with an active service subscription, however, a "fair use" policy applies. Visit EMD online ordering to purchase the necessary licences.
Attribution
If data from this dataset is used within any private or public disseminations, then EMD and its data providers must be acknowledged.
Source: ERA5 Gaussian Grid. Distribution through EMD and windPRO - EMD International A/S, 2020. This dataset uses ERA5 which is being developed through the Copernicus Climate Change Service (C3S). Data processing and distribution for ERA5 is carried out by ECMWF.