Skip to content

Refine PB2NC logic to reduce memory usage #3439

Description

@JohnHalleyGotway

Describe the Enhancement

Issues running version 12.2.1 of the MET PB2NC tool operationally on WCOSS were observed in July 2026 and again in September 2026. The PB2NC jobs failed due to large memory consumption. The short term patch for this issue is to set the METplus PB2NC_OBS_WINDOW configuration option to define a smaller point observation retention time window. Retaining fewer observations consumes less memory and make the issue less like to recur with the current EVS configurations of METplus. However, a better longterm fix would improve PB2NC by reducing its memory consumption.

For this issue, recommend the following:

  • Inspect the logs and sample data stored in seneca:/d1/projects/METplus/discussions/OMD_PB2NC_failure_202060909.
  • As needed, refer to the EVS configurations found the NOAA-EMC/EVS repository.
  • Analyze the PB2NC tool and look for opportunities to reduce it's memory consumption.
  • Recommend running sample cases through a profiler to quantify improvements in memory consumption.
  • Any code changes should not modify the output generated by PB2NC.

Time Estimate

Up to 3 days?

Sub-Issues

Consider breaking the enhancement down into sub-issues.

Relevant Deadlines

List relevant project deadlines here or state NONE.

Funding Source

FY27 NOAA DTC METplus funding

Define the Metadata

Assignee

  • Select engineer(s) or no engineer required
  • Select scientist(s) or no scientist required
    • Recommend that @malloryprow review/advise on any pull requests.

Labels

  • Review default alert labels
  • Select component(s)
  • Select priority
  • Select requestor(s)

Milestone and Projects

  • Select Milestone as a MET-X.Y.Z version, Consider for Next Release, or Backlog of Development Ideas
  • For a MET-X.Y.Z version, select the MET-X.Y Development project

Define Related Issue(s)

Consider the impact to the other METplus components.

Enhancement Checklist

See the METplus Workflow for details.

  • Complete the issue definition above, including the Time Estimate and Funding Source.
  • Fork this repository or create a branch of develop.
    Branch name: feature_<Issue Number>_<Description>
  • Complete the development and test your changes.
  • Add/update log messages for easier debugging.
  • Add/update unit tests.
  • Add/update documentation.
  • Push local changes to GitHub.
  • Submit a pull request to merge into develop.
    Pull request: feature <Issue Number> <Description>
  • Define the pull request metadata, as permissions allow.
    Select: Reviewer(s) and Development issue
    Select: Milestone as the next official version
    Select: MET-X.Y Development project for development toward the next coordinated release
  • Iterate until the reviewer(s) accept and merge your changes.
  • Delete your fork or branch.
  • Close this issue.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Type

No type

Projects

Relationships

None yet

Development

No branches or pull requests

Issue actions