SSEC forums

discussion forums for the Space Science & Engineering Center at UW-Madison
https://forums.ssec.wisc.edu/

$ADL_HOME/script/runMsd.pl not able to convert msd files

https://forums.ssec.wisc.edu/viewtopic.php?t=634

Page 1 of 1

$ADL_HOME/script/runMsd.pl not able to convert msd files

Posted: Tue Oct 27, 2015 10:40 am
by jhuang
Dear Helpdesk,
I am having problems with converting NCEP and NAAPS data to internal format in ADL4.2:
I am able to load my MSD files to $ADL_HOME/data/MSD_LZ/ANC/

Code: Select all

[jhuang@rhw9103 jhuang]$ ls -l $ADL_HOME/data/MSD_LZ/*
/data/data003/ADL4.2/ADL/data/MSD_LZ/ANC:
total 24
lrwxrwxrwx. 1 jhuang vaod 128 Oct 27 11:33 off_NAAPS-06HR-ANC_NAAPS_FNMOC_006f_20150519_201505191200Z_20150519151500Z_ee20150519210000Z_np.msd -> /data/data003/jhuang/anc_msd/off_NAAPS-06HR-ANC_NAAPS_FNMOC_006f_20150519_201505191200Z_20150519151500Z_ee20150519210000Z_np.msd
lrwxrwxrwx. 1 jhuang vaod 141 Oct 27 11:33 off_NAAPS-06HR-ANC_NAAPS_FNMOC_006f_20150519_201505191200Z_20150519151500Z_ee20150519210000Z_np.msd.CMP_FILENAME -> /data/data003/jhuang/anc_msd/off_NAAPS-06HR-ANC_NAAPS_FNMOC_006f_20150519_201505191200Z_20150519151500Z_ee20150519210000Z_np.msd.CMP_FILENAME
lrwxrwxrwx. 1 jhuang vaod 128 Oct 27 11:33 off_NCEP-GFS-06HR-ANC_GFS_NCEP_006f_20150519_201505191200Z_20150519153014Z_ee20150519210000Z_np.msd -> /data/data003/jhuang/anc_msd/off_NCEP-GFS-06HR-ANC_GFS_NCEP_006f_20150519_201505191200Z_20150519153014Z_ee20150519210000Z_np.msd
lrwxrwxrwx. 1 jhuang vaod 141 Oct 27 11:33 off_NCEP-GFS-06HR-ANC_GFS_NCEP_006f_20150519_201505191200Z_20150519153014Z_ee20150519210000Z_np.msd.CMP_FILENAME -> /data/data003/jhuang/anc_msd/off_NCEP-GFS-06HR-ANC_GFS_NCEP_006f_20150519_201505191200Z_20150519153014Z_ee20150519210000Z_np.msd.CMP_FILENAME
lrwxrwxrwx. 1 jhuang vaod 136 Oct 27 11:33 off_USNO-PolarWander-UT1-ANC_Ser7_USNO_000f_20150515_201505150000Z_20150515003003Z_ee20150522120000Z_np.msd -> /data/data003/jhuang/anc_msd/off_USNO-PolarWander-UT1-ANC_Ser7_USNO_000f_20150515_201505150000Z_20150515003003Z_ee20150522120000Z_np.msd
lrwxrwxrwx. 1 jhuang vaod 149 Oct 27 11:33 off_USNO-PolarWander-UT1-ANC_Ser7_USNO_000f_20150515_201505150000Z_20150515003003Z_ee20150522120000Z_np.msd.CMP_FILENAME -> /data/data003/jhuang/anc_msd/off_USNO-PolarWander-UT1-ANC_Ser7_USNO_000f_20150515_201505150000Z_20150515003003Z_ee20150522120000Z_np.msd.CMP_FILENAME
but when I tried to run the runMsd.pl

Code: Select all

[jhuang@rhw9103 jhuang]$ $ADL_HOME/script/runMsd.pl -m
Running ING MSD...
ING MSD completed successfully
6 not converted
Number of newly converted output files: 0
Running ING MSD only. Skipping TI check...
It did not generate the internal format files at all. Any ideas why this happens?
The package used is ADL4.2 for Mx8.10. Thanks!


Thanks a lot!
Jingfeng

Re: $ADL_HOME/script/runMsd.pl not able to convert msd files

Posted: Tue Oct 27, 2015 4:04 pm
by kbisanz
There should be a log file in $ADL_HOME/log/. Does it say anything?

Do you have any other NCEP and NAAPS files already in your output directory? Some versions of Ingest will not ingest files if newer versions already exist. That behavior has changed over time and I don't remember when the switch was made.

If you don't figure anything out, please post a log file where the debug level was set to LOW.

Re: $ADL_HOME/script/runMsd.pl not able to convert msd files

Posted: Wed Oct 28, 2015 12:42 pm
by jhuangadl

Code: Select all

/data/data003/ADL4.2/ADL/log/IngMsd.exe_20151028_133837_24302/message.log

Status Type:INF_STATUSTYPE_CMD_COMPL,Timestamp:2015-10-28 17:38:37.922335Z,ID1:,ID2:,Name1:Start Process,Name2:,Name3:,Quality:-1,Severity:INF_SEVERITYLEVEL_NOT_SET,Logging Level:INF_LOGLEVEL_NOT_SET,Display Flag:INF_DISPLAYFLAG_NOT_SET,Description:Start Process completed on /data/data003/ADL4.2/ADL/tools/bin/IngMsd.exe,Process WID:0,Subject WID:0
Status Type:INF_STATUSTYPE_PROC_START,Timestamp:2015-10-28 17:38:37.922469Z,ID1:,ID2:,Name1:,Name2:,Name3:,Quality:-1,Severity:INF_SEVERITYLEVEL_NOT_SET,Logging Level:INF_LOGLEVEL_NOT_SET,Display Flag:INF_DISPLAYFLAG_NOT_SET,Description:/data/data003/ADL4.2/ADL/tools/bin/IngMsd.exe started,Process WID:0,Subject WID:0
Detail Type:INF_DETAILTYPE_INF_INFO,Timestamp2015-10-28 17:38:37.922596Z,Process ID:,Routine Name:InfTk_InitData,Severity:INF_SEVERITYLEVEL_NOT_SET,Level:INF_LOGLEVEL_NOT_SET,Display Flag:INF_DISPLAYFLAG_NOT_SET,Description:Tk Initialization complete!
Status Type:INF_STATUSTYPE_ING_ERR,Timestamp:2015-10-28 17:38:37.924392Z,ID1:,ID2:,Name1:,Name2:,Name3:,Quality:-1,Severity:INF_SEVERITYLEVEL_WARNING,Logging Level:INF_LOGLEVEL_OPS,Display Flag:INF_DISPLAYFLAG_ACKNOWLEDG,Description:Unable to access DMS instance at location <DPE_DMS_INST_PATH UNDEFINED>,Process WID:0,Subject WID:0
Detail Type:INF_DETAILTYPE_ING_INFO,Timestamp2015-10-28 17:38:37.924504Z,Process ID:ING_MSD,Routine Name:IngMsdCommon_Master::shutdown,Severity:INF_SEVERITYLEVEL_NORMAL,Level:INF_LOGLEVEL_DETAIL,Display Flag:INF_DISPLAYFLAG_NORMAL,Description:MSD Master is shutting down
Status Type:INF_STATUSTYPE_PROC_FAIL,Timestamp:2015-10-28 17:38:37.924604Z,ID1:,ID2:,Name1:,Name2:,Name3:,Quality:-1,Severity:INF_SEVERITYLEVEL_NOT_SET,Logging Level:INF_LOGLEVEL_NOT_SET,Display Flag:INF_DISPLAYFLAG_NOT_SET,Description:Process failed,Process WID:0,Subject WID:0

Re: $ADL_HOME/script/runMsd.pl not able to convert msd files

Posted: Wed Oct 28, 2015 12:44 pm
by jhuangadl
$DCONFIG/dynamic/withMetadata/IngMsdLwFile.xml

Code: Select all

<InfTkConfig>
  <idpProcessName>ING_LW</idpProcessName>
  <siSoftwareId></siSoftwareId>
  <isRestart>FALSE</isRestart>
  <useExtSiWriter>FALSE</useExtSiWriter>
  <debugLogLevel>NORMAL</debugLogLevel>
  <debugLevel>DBG_LOW</debugLevel>
   <dbgDest>D_FILE</dbgDest>
   <dbgPath>${ADL_HOME}/log</dbgPath>
  <perfPath>${ADL_HOME}/log</perfPath>
  <inputPath>${ADL_INGEST_OUTPUT_DIR}</inputPath>
  <outputPath>${ADL_INGEST_OUTPUT_DIR}</outputPath>
  <enablePerf>FALSE</enablePerf>
  <configGuideName>IngMsd_GuideList.cfg</configGuideName>
  <initData>
     <domain>dev</domain>
     <subDomain>SUBDOMAIN</subDomain>
     <startMode>INF_STARTMODE_COLD</startMode>
     <executionMode>INF_EXEMODE_PRIMARY</executionMode>
     <healthTimeoutPeriod>28</healthTimeoutPeriod>
  </initData>
  <lockinMem>FALSE</lockinMem>
  <rootDir>${ADL_HOME}/log</rootDir>

  <task>
    <taskType>SMD</taskType>
    <taskDetails1></taskDetails1>
    <taskDetails2></taskDetails2>
    <taskDetails3></taskDetails3>
    <taskDetails4></taskDetails4>
  </task>

</InfTkConfig>

Re: $ADL_HOME/script/runMsd.pl not able to convert msd files

Posted: Wed Oct 28, 2015 1:13 pm
by jhuangadl
Sorry, my bad, I should have changed the output directory for runMsd.pl

Change:
$DCONFIG/dynamic/withMetadata/IngMsdLwFile.xml
53,54c53,54
< <inputPath>${ADL_INGEST_OUTPUT_DIR}</inputPath>
< <outputPath>${ADL_INGEST_OUTPUT_DIR}</outputPath>
---
> <inputPath>${ADL_HOME}/data/output/withMetadata/IngMsdOutputs</inputPath>
> <outputPath>${ADL_HOME}/data/output/withMetadata/IngMsdOutputs</outputPath>

But still even after I got the ancellary data converted, my ADL still did not run successfully. It seems the ANC granulization module does not work :(

Re: $ADL_HOME/script/runMsd.pl not able to convert msd files

Posted: Wed Oct 28, 2015 1:19 pm
by jhuangadl
Good news. I think I found the issue.
I did not get the correct location of the Tile-Eco-ANC tile inputs.
Now, both the IngMsd and Anc Gran modules are working properly, so the aerosol algorithm.
Thanks a lot!!! :)
All times are UTC-05:00
Page 1 of 1

Powered by phpBB® Forum Software © phpBB Limited