Migrate functionality from CLI to plugin layer

[cpelley]

Being able to run plugins without going through the CLI layer offers greater flexibility for execution. It is also a reasonable design principle. To that end, this issue is to capture efforts to achieve this goal.

Tasks

• Plugin discoverability #2005

Those marked with strikethrough don't require changes as they contain no logic within their CLI layer.
Those marked with 👈 represent a subset of CLI which are used by EPP.

• improver/cli/aggregate_reliability_tables.py
• improver/cli/apply_bias_correction.py - Migrate CLI functionality: simple_bias_correction #2018
  • Basic logic migration.
• improver/cli/apply_dz_rescaling.py
• improver/cli/apply_emos_coefficients.py
  • New ApplyEmosCoefficients meta-plugin.
• improver/cli/apply_height_adjustment.py
  • MOBT-689 (Pt 1): Move functionality out of the spot-extract CLI into a plugin #1996
  • MOBT-689 (Pt2): Spot forecast subsetting using a neighbour cube #2002
• improver/cli/apply_lapse_rate.py
• improver/cli/apply_night_mask.py
• improver/cli/apply_rainforests_calibration.py
• improver/cli/apply_reliability_calibration.py
• improver/cli/between_thresholds.py
• improver/cli/blend_adjacent_points.py
• improver/cli/blend_cycles_and_realizations.py
• improver/cli/blend_with_vicinity_and_rename.py
• improver/cli/calculate_forecast_bias.py
• improver/cli/categorical_modes.py
• improver/cli/categorical.py 👈
  • Migrate CLI functionality to plugin layer subset 1 #2000
• improver/cli/clip.py
• improver/cli/cloud_condensation_level.py 👈
  • Migrate CLI functionality to plugin layer subset 1 #2000
• improver/cli/cloud_top_temperature.py 👈
  • Migrate CLI functionality to plugin layer subset 1 #2000
• improver/cli/collapse_realizations.py
• improver/cli/combine.py 👈
  • Migrate CLI functionality to plugin layer subset 1 #2000 an empty CubeList)
• improver/cli/compare.py
• improver/cli/construct_reliability_tables.py
• improver/cli/convection_ratio.py
• improver/cli/copy_attributes.py 👈
  • Migrate CLI functionality to plugin layer subset 1 #2000
• improver/cli/create_grid_with_halo.py
• improver/cli/enforce_consistent_forecasts.py
• improver/cli/estimate_dz_rescaling.py
• improver/cli/estimate_emos_coefficients_from_table.py
• improver/cli/estimate_emos_coefficients.py
• improver/cli/expected_value.py
• improver/cli/extend_radar_mask.py
• improver/cli/extract.py 👈
• Migrate CLI functionality to plugin layer subset 2 #2003
• improver/cli/feels_like_temp.py
• improver/cli/field_texture.py
• improver/cli/fill_radar_holes.py
• improver/cli/freezing_rain.py 👈
• Migrate CLI functionality to plugin layer subset 2 #2003
• improver/cli/generate_clearsky_solar_radiation.py
• improver/cli/generate_landmask_ancillary.py
• improver/cli/generate_metadata_cube.py
• improver/cli/generate_orographic_smoothing_coefficients.py
• improver/cli/generate_percentiles.py
• improver/cli/generate_realizations.py
• improver/cli/generate_solar_time.py
• improver/cli/generate_topography_bands_mask.py
• improver/cli/generate_topography_bands_weights.py
• improver/cli/hail_fraction.py 👈
• Migrate CLI functionality to plugin layer subset 2 #2003
• improver/cli/hail_size.py 👈
• Migrate CLI functionality to plugin layer subset 2 #2003
• improver/cli/interpolate_using_difference.py 👈
• Migrate CLI functionality to plugin layer subset 2 #2003
• improver/cli/interpret_metadata.py
• improver/cli/lightning_from_cape_and_precip.py 👈
• Migrate CLI functionality to plugin layer subset 2 #2003
• improver/cli/lightning_multivariate_probability_usaf2024.py
• improver/cli/manipulate_reliability_table.py
• improver/cli/max_in_height.py 👈
• Migrate CLI functionality to plugin layer subset 2 #2003
• improver/cli/max_in_time_window.py
• improver/cli/merge.py
• improver/cli/nbhood_iterate_with_mask.py
• improver/cli/nbhood_land_and_sea.py
• improver/cli/nbhood.py 👈
• Migrate CLI functionality to plugin layer subset 2 #2003
• improver/cli/neighbour_finding.py
• improver/cli/normalise_to_reference.py
• improver/cli/nowcast_accumulate.py
• improver/cli/nowcast_extrapolate.py
• improver/cli/nowcast_optical_flow_from_winds.py
• improver/cli/nowcast_optical_flow.py
• improver/cli/orographic_enhancement.py
• improver/cli/phase_change_level.py 👈
• Migrate CLI functionality to plugin layer subset 2 #2003
• improver/cli/phase_mask.py
• improver/cli/phase_probability.py 👈
• Migrate CLI functionality to plugin layer subset 2 #2003
• improver/cli/recursive_filter.py
• improver/cli/regrid.py
• improver/cli/relabel_to_period.py
• improver/cli/remake_as_shower_condition.py
• improver/cli/resolve_wind_components.py
• improver/cli/shower_condition_probability.py
• improver/cli/sleet_probability.py
• improver/cli/snow_fraction.py
• improver/cli/snow_splitter.py 👈
• Migrate CLI functionality to plugin layer subset 2 #2003
• improver/cli/spot_extract.py
  • MOBT-689 (Pt 1): Move functionality out of the spot-extract CLI into a plugin #1996
  • MOBT-689 (Pt2): Spot forecast subsetting using a neighbour cube #2002
• improver/cli/standardise.py 👈
  • Migrate CLI functionality to plugin layer subset 1 #2000
• improver/cli/temp_lapse_rate.py
• improver/cli/temporal_interpolate.py
• improver/cli/threshold.py
• improver/cli/time_lagged_ensembles.py
• improver/cli/uv_index.py
• improver/cli/vertical_updraught.py 👈
• Migrate CLI functionality to plugin layer subset 2 #2003
• improver/cli/vicinity.py
• improver/cli/visibility_combine_cloud_base.py
• improver/cli/weighted_blending.py
• improver/cli/wet_bulb_freezing_level.py 👈
• Migrate CLI functionality to plugin layer subset 2 #2003
• improver/cli/wet_bulb_temperature_integral.py 👈
• Migrate CLI functionality to plugin layer subset 2 #2003
• improver/cli/wet_bulb_temperature.py 👈
• Migrate CLI functionality to plugin layer subset 2 #2003
• improver/cli/wind_direction.py
• improver/cli/wind_downscaling.py
• improver/cli/wind_gust_diagnostic.py

Issues

• https://github.com/MetOffice/improver_suite/issues/2079

[cpelley]

@bayliffe, just to keep you in the loop.

[bayliffe]

Work completed.