You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Squashed commit of the following:
commit c590476
Author: Rahul Mahajan <aerorahul@users.noreply.github.com>
Date: Fri Jan 12 19:21:02 2024 -0500
Update hash to ufs-weather-model. The noahmptable.tbl was reorganized, so update link_workflow.sh to use the same one used in UFSWM RT (NOAA-EMC#2219)
commit c041968
Author: Kate Friedman <kate.friedman@noaa.gov>
Date: Fri Jan 12 12:09:35 2024 -0500
Add ocean resolution to setup_expt invocation and retire/reduce COMROT/ROTDIR usage (NOAA-EMC#2214)
Two series of updates:
1) Update setup scripts to now allow users to provide ocean resolution
2) Housekeeping to retire the `COMROT` variable, replacing it with other variables
as needed, and reduce the `ROTDIR` variable usage.
Both updates change options for the workflow setup API.
Refs NOAA-EMC#2061
commit 997f978
Author: AndrewEichmann-NOAA <58948505+AndrewEichmann-NOAA@users.noreply.github.com>
Date: Fri Jan 12 10:46:36 2024 -0500
Allow use of ocean obs prep in WCDA cycling and remove R2D2 (NOAA-EMC#2215)
Enables use of ocean obs prep task in WCDA cycling and removes R2D2 from same.
Runs task gdasprepoceanobs before gdasocnanalprep -- obtains ocean data nc4 files from DMPDIR, processes them into IODA format and copies them to COM_OBS.
Replaces the current R2D2 processing.
commit 12a5bb1
Merge: 4cb58026492c2d
Author: David Huber <69919478+DavidHuber-NOAA@users.noreply.github.com>
Date: Fri Jan 12 09:26:27 2024 -0500
Merge pull request NOAA-EMC#2217 from DavidHuber-NOAA/update/versions
Update and clean up version and module files
commit 6492c2d
Author: David Huber <david.huber@noaa.gov>
Date: Thu Jan 11 11:49:08 2024 -0600
Update orion module/version files for met/metplus NOAA-EMC#2123
commit 94c9937
Author: DavidHuber <david.huber@noaa.gov>
Date: Thu Jan 11 17:42:53 2024 +0000
Comment met/metplus out from Hera modulefile. NOAA-EMC#2123
commit 8c32f8b
Merge: a65e4c64cb5802
Author: David Huber <david.huber@noaa.gov>
Date: Thu Jan 11 11:34:44 2024 -0600
Merge branch 'develop' of github.com:noaa-emc/global-workflow into develop
commit a65e4c6
Author: David Huber <david.huber@noaa.gov>
Date: Thu Jan 11 11:34:19 2024 -0600
Initial update of version/module files NOAA-EMC#2123
commit 4cb5802
Author: souopgui <souopgui@users.noreply.github.com>
Date: Wed Jan 10 08:30:22 2024 -0600
Fix OpenMP over-allocation of resources in exglobal_atmos_products.sh when running MPMD tasks (NOAA-EMC#2212)
Fix OpenMP over-allocation of resources running MPMD tasks
Co-authored-by: Innocent Souopgui <isouopgui@redlineperf.com>
commit b056b53
Author: TerrenceMcGuinness-NOAA <terrence.mcguinness@cox.net>
Date: Mon Jan 8 17:28:05 2024 -0500
Add Hercules as valid machine in CI scripts (NOAA-EMC#2207)
Few updates to CI scripts to include names for hercules that where missed
the first time.
commit 6574d29
Author: Rahul Mahajan <aerorahul@users.noreply.github.com>
Date: Mon Jan 8 17:25:47 2024 -0500
Fix invalid GH action and restart file name (NOAA-EMC#2210)
Resolves a typo that leads to an invalid workflow yaml and fixes the restart filename in restart detection.
ResolvesNOAA-EMC#2205
commit 69605ea
Author: Rahul Mahajan <aerorahul@users.noreply.github.com>
Date: Mon Jan 8 17:00:28 2024 -0500
Stop attempting to comment link to RTD for non-PRs (NOAA-EMC#2209)
Adds a check so comments with a link to documentation are only generated
for PRs.
commit 4e160a8
Author: Rahul Mahajan <aerorahul@users.noreply.github.com>
Date: Mon Jan 8 13:10:15 2024 -0500
Enable UPP for GOES processing (NOAA-EMC#2203)
Wnables the creation of special master grib2 files from UPP for
GOES processing
commit c15875b
Author: David Huber <69919478+DavidHuber-NOAA@users.noreply.github.com>
Date: Mon Jan 8 09:56:06 2024 -0500
Port cycling to Hercules (NOAA-EMC#2196)
Adds cycled support for Hercules (excluding gsi-monitor).
Partially resolvesNOAA-EMC#1588
GSI monitoring is disabled on Hercules due to missing Perl modules. That will be enabled in a later PR.
commit ef6827d
Author: Walter Kolczynski - NOAA <Walter.Kolczynski@noaa.gov>
Date: Mon Jan 8 09:43:12 2024 -0500
Refactor rocoto task XML creation (NOAA-EMC#2189)
Refactors the rocoto task generation to be recursive.
This will allow nested metatasks to loop over multiple variables, which is needed for GEFS product generation.
As part of this refactor, there is no longer separate arguments to designate metatasks.
Instead, task dicts can include a nested 'task_dict' as well as a 'var_dict' containing the variables to loop over.
The nested task dict can then either have another layer, or be the innermost task.
To accommodate the new recursive nature, some defaults that were previously defined in create_wf_task() had to be pushed down into the function that creates the innermost task.
Also, former keywords have been absorbed by the task dict.
Refs NOAA-EMC#823
Refs NOAA-EMC#827
commit 2b81cfa
Author: Walter Kolczynski - NOAA <Walter.Kolczynski@noaa.gov>
Date: Mon Jan 8 09:41:03 2024 -0500
Update fix versions (NOAA-EMC#2198)
Updates fix versions for a few components:
- Update cice and mom6 versions to support C96/1p00 marine
- Update wave to change betamax setting for glo_025 waves
ResolvesNOAA-EMC#2004ResolvesNOAA-EMC#2107
Copy file name to clipboardexpand all lines: docs/doxygen/mainpage.h
+10-8
Original file line number
Diff line number
Diff line change
@@ -12,7 +12,7 @@
12
12
With the FV3GFS system, a Rocoto driven workflow is being used. This workflow builds on the experiences and work of Kate.Howard and Terry.McGuinness for the GSM, but strips down a lot of complications arising from the use of a cumbersome <b>\c para_config</b>. The <b>\c para_config</b> no longer exists in the workflow and instead a number of <b> \c config </b> files are added, one each for an individual task e.g. <b>\p config.anal</b> contains the analysis specific information. A base config called as <b>\c config.base</b> contains
13
13
information related to the machine, super-structure, etc. The idea behind splitting the <b>\p para_config</b> into individual, smaller and managable configs is to provide a means to run any chosen task without the overhead of the full cycling framework. All the configs are located under <b>\c fv3gfs/config</b>
14
14
15
-
Additionally, the structure of the <b>\c COMROT</b> directory is now modified to look like operations. This enables the use of the workflow much closer to the operational environment, with the exception of the workflow manager.
15
+
Additionally, the structure of the <b>\c ROTDIR</b> directory is now modified to look like operations. This enables the use of the workflow much closer to the operational environment, with the exception of the workflow manager.
16
16
17
17
This is a very much a work in progress and any issues should be reported back and are greatly appreciated.
18
18
@@ -23,12 +23,12 @@ To setup an experiment, a python script <b>\c setup_expt.py</b> (located in <b>\
--resdet resolution of the deterministic model forecast
43
+
--resdetatmos atmosphere resolution of the deterministic model forecast
44
44
(default: 384)
45
-
--resens resolution of the ensemble model forecast
45
+
--resdetocean ocean resolution of the deterministic model forecast
46
+
(default: 0. [determined automatically based on atmosphere resolution])
47
+
--resensatmos resolution of the ensemble model forecast
46
48
(default: 192)
47
-
--comrotfull path to COMROT
49
+
--comroot full path to COMROOT, where ROTDIR (COMROOT+PSLOT) will be created
48
50
(default: None)
49
51
--expdir full path to EXPDIR
50
52
(default: None)
@@ -53,7 +55,7 @@ To setup an experiment, a python script <b>\c setup_expt.py</b> (located in <b>\
53
55
--cdump CDUMP to start the experiment
54
56
(default: gdas)
55
57
56
-
The above script creates directories <b>\c EXPDIR</b> and <b>\c COMROT</b>. It will make links for initial conditions from a location provided via the <b>\c --icsdir</b> argument for a chosen resolution for the control <b>\c --resdet</b> and the ensemble <b>\c --resens</b>. Experiment name is controlled by the input argument <b>\c --pslot</b>. The script will ask user input in case any of the directories already exist. It will copy experiment configuration files into the <b>\c EXPDIR</b> from <b>\c CONFIGDIR</b>.
58
+
The above script creates directories <b>\c EXPDIR</b> and <b>\c ROTDIR</b>. It will make links for initial conditions from a location provided via the <b>\c --icsdir</b> argument for a chosen resolution for the control <b>\c --resdetatmos</b> and the ensemble <b>\c --resensatmos</b>. Experiment name is controlled by the input argument <b>\c --pslot</b>. The script will ask user input in case any of the directories already exist. It will copy experiment configuration files into the <b>\c EXPDIR</b> from <b>\c CONFIGDIR</b>.
57
59
58
60
Sample initial conditions for a few resolutions are available at:<br>
**Issue:** The EnKF COMROT folders were renamed during the GFS v15 development process to remove the period between "enkf" and "gdas": enkf.gdas.$PDY → enkfgdas.$PDY
42
+
**Issue:** The EnKF ROTDIR folders were renamed during the GFS v15 development process to remove the period between "enkf" and "gdas": enkf.gdas.$PDY → enkfgdas.$PDY
43
43
44
44
**Fix:** Older tarballs on HPSS will have the older directory name with the period between 'enkf' and 'gdas'. Make sure to rename folder to 'enkfgdas.$PDY' after obtaining. Only an issue for the initial cycle.
Copy file name to clipboardexpand all lines: docs/source/init.rst
+5-5
Original file line number
Diff line number
Diff line change
@@ -391,7 +391,7 @@ The chgres jobs will have a dependency on the data-pull jobs and will wait to ru
391
391
392
392
5. Check output:
393
393
394
-
In the config you will have defined an output folder called ``$OUTDIR``. The converted output will be found there, including the needed abias and radstat initial condition files (if CDUMP=gdas). The files will be in the needed directory structure for the global-workflow system, therefore a user can move the contents of their ``$OUTDIR`` directly into their ``$ROTDIR/$COMROT``.
394
+
In the config you will have defined an output folder called ``$OUTDIR``. The converted output will be found there, including the needed abias and radstat initial condition files (if CDUMP=gdas). The files will be in the needed directory structure for the global-workflow system, therefore a user can move the contents of their ``$OUTDIR`` directly into their ``$ROTDIR``.
395
395
396
396
Please report bugs to George Gayno (george.gayno@noaa.gov) and Kate Friedman (kate.friedman@noaa.gov).
397
397
@@ -449,7 +449,7 @@ The warm starts and other output from production are at C768 deterministic and C
449
449
What files should you pull for starting a new experiment with warm starts from production?
That depends on what mode you want to run -- forecast-only or cycled. Whichever mode, navigate to the top of your ``COMROT`` and pull the entirety of the tarball(s) listed below for your mode. The files within the tarball are already in the ``$CDUMP.$PDY/$CYC/$ATMOS`` folder format expected by the system.
452
+
That depends on what mode you want to run -- forecast-only or cycled. Whichever mode, navigate to the top of your ``ROTDIR`` and pull the entirety of the tarball(s) listed below for your mode. The files within the tarball are already in the ``$CDUMP.$PDY/$CYC/$ATMOS`` folder format expected by the system.
Go to the top of your ``COMROT/ROTDIR`` and pull the contents of all tarballs there. The tarballs already contain the needed directory structure.
492
+
Go to the top of your ``ROTDIR`` and pull the contents of all tarballs there. The tarballs already contain the needed directory structure.
493
493
494
494
.. _warmstarts-preprod-parallels:
495
495
@@ -514,7 +514,7 @@ Recent pre-implementation parallel series was for GFS v16 (implemented March 202
514
514
+ ../$GDATE/gdas_restartb.tar
515
515
+ ../$GDATE/enkfgdas_restartb_grp##.tar (where ## is 01 through 08) (note, older tarballs may include a period between enkf and gdas: "enkf.gdas")
516
516
517
-
* **Where do I put the warm-start initial conditions?** Extraction should occur right inside your COMROT. You may need to rename the enkf folder (enkf.gdas.$PDY -> enkfgdas.$PDY).
517
+
* **Where do I put the warm-start initial conditions?** Extraction should occur right inside your ROTDIR. You may need to rename the enkf folder (enkf.gdas.$PDY -> enkfgdas.$PDY).
518
518
519
519
Due to a recent change in the dycore, you may also need an additional offline step to fix the checksum of the NetCDF files for warm start. See the :ref:`Fix netcdf checksum section <gfsv17-checksum>`.
520
520
@@ -602,5 +602,5 @@ And then on all platforms:
602
602
603
603
::
604
604
605
-
cd $COMROT
605
+
cd $ROTDIR
606
606
for f in $(find ./ -name *tile*.nc); do echo $f; ncatted -a checksum,,d,, $f; done
0 commit comments