Exploring the Explainability of a Machine Learning Tool to Improve Severe Thunderstorm Wind Reports

Output from a machine learning tool that assigns a probability that a severe thunderstorm wind report was caused by severe intensity wind was evaluated to understand counterintuitive cases where reports that had a high (low) wind speed received a low (high) diagnosed probability. Meteorological data...

Full description

Saved in:
Bibliographic Details
Main Authors: Elizabeth Tirone, William A. Gallus, Alexander J. Hamilton
Format: Article
Language:English
Published: MDPI AG 2025-07-01
Series:Atmosphere
Subjects:
Online Access:https://www.mdpi.com/2073-4433/16/7/881
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Output from a machine learning tool that assigns a probability that a severe thunderstorm wind report was caused by severe intensity wind was evaluated to understand counterintuitive cases where reports that had a high (low) wind speed received a low (high) diagnosed probability. Meteorological data for these cases was compared to that for valid cases where the machine learning probability seemed consistent with the observed severity of the winds. The comparison revealed that the cases with high winds but low probabilities occurred in less conducive environments for severe wind production (less instability, greater low-level relative humidity, weaker lapse rates) than in the cases where high winds occurred with high probabilities. Cases with a low speed but a high probability had environmental characteristics that were more conducive to producing severe wind. These results suggest that the machine learning model is assigning probabilities based on storm modes that more often have measured severe wind speeds (i.e., clusters of cells and bow echoes), and counterintuitive values may reflect events where storm interactions or other smaller-scale features play a bigger role. In addition, some evidence suggests improper reporting may be common for some of these counterintuitive cases.
ISSN:2073-4433