Skip to content

test_gdasapp_C96_gcafs_cycled_gcdas_fcst_202112201200 failure #2020

@RussTreadon-NOAA

Description

@RussTreadon-NOAA

test_gdasapp_C96_gcafs_cycled_gcdas_fcst_202112201200 failed during stable-nightly testing on Dogwood and Hera with the following error (taken from Dogwood):

nid003676.dogwood.wcoss2.ncep.noaa.gov 9: nf90_open: returned error code (2) opening ChemInput/NEXUS_DIAG.20211220.nc [No such file or directory]
pe=00009 FAIL at line=00293    NetCDF4_FileFormatter.F90                <status=2>
pe=00009 FAIL at line=00100    DataCollection.F90                       <status=2>
pe=00009 FAIL at line=02710    ExtDataGridCompMod.F90                   <status=2>
pe=00009 FAIL at line=02437    ExtDataGridCompMod.F90                   <status=2>
pe=00009 FAIL at line=01323    ExtDataGridCompMod.F90                   <status=2>
pe=00009 FAIL at line=01862    MAPL_Generic.F90                         <status=2>
pe=00009 FAIL at line=01130    MAPL_CapGridComp.F90                     <status=2>
pe=00009 FAIL at line=01094    MAPL_CapGridComp.F90                     <status=2>
pe=00009 FAIL at line=01056    MAPL_CapGridComp.F90                     <status=2>
pe=00009 FAIL at line=00744    MAPL_CapGridComp.F90                     <status=2>
pe=00009 FAIL at line=00873    MAPL_CapGridComp.F90                     <status=2>
nid003676.dogwood.wcoss2.ncep.noaa.gov 9: MPICH ERROR [Rank 9] [job id b9dd80d5-f166-499c-a8ed-a3e958b16b4b] [Sat Dec 27 12:08:33 2025] [nid003676] - Abort(1) (rank 9 in comm 496): application called MPI_Abort(comm=0x84000001, 1) - process 9
Image              PC                Routine            Line        Source
libpnetcdf.so.4.0  000014CDCE24D2EC  for__signal_handl     Unknown  Unknown
libpthread-2.31.s  000014CDCDAD4910  Unknown               Unknown  Unknown
gcafs_model.x      00000000032BB22A  Unknown               Unknown  Unknown
gcafs_model.x      00000000038B9AB0  module_mp_thompso        4267  module_mp_thompson.F90
gcafs_model.x      0000000003891BC6  module_mp_thompso        1465  module_mp_thompson.F90
gcafs_model.x      00000000038E1827  mp_thompson_mp_mp         823  mp_thompson.F90
gcafs_model.x      000000000360D999  ccpp_fv3_gfs_v17_        1365  ccpp_fv3_gfs_v17_p8_ugwpv1_phys_ts_cap.F90
gcafs_model.x      00000000033C2BE5  ccpp_static_api_m         590  ccpp_static_api.F90
gcafs_model.x      00000000033BF29B  ccpp_driver_mp_cc         247  CCPP_driver.F90
libiomp5.so        000014CDCD3303F3  __kmp_invoke_micr     Unknown  Unknown

The 20211220 12Z cycle is the first half cycle of the C96_gcafs_cycled case. A check of gcdas_fcst dependencies in C96_gcafs_cycled.xml shows

<dependency>
        <and>
          <or>
            <and>
              <taskdep task="gcdas_sfcanl"/>
              <taskdep task="gcdas_aeroanlfinal"/>
            </and>
            <taskdep task="gcdas_stage_ic"/>
          </or>
            <taskdep task="gcdas_prep_emissions"/>
        </and>
</dependency>

The first half cycle gcdas_fcst depends on gcdas_stage_ic and gcdas_prep_emissions. GDASApp tests/gw-ci/CMakeLists.txt only includes the gcdas_prep_emissions dependency for the full cycle gcdas_fcst. This dependency needs to be added to the half cycle gcdas_fcst.

This issue is opened to document this problem and its resolution.

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions