sup3r.preprocessing.derivers.base.Deriver

class Deriver(data: Sup3rX | Sup3rDataset, features, time_roll=0, time_shift=None, hr_spatial_coarsen=1, nan_method_kwargs=None, FeatureRegistry=None, interp_kwargs=None)

Bases: BaseDeriver

Extends base BaseDeriver class with time_roll and hr_spatial_coarsen args.

Parameters:

• data (Union[Sup3rX, Sup3rDataset]) – Data used for derivations

• features (list) – List of features to derive

• time_roll (int) – Number of steps to roll along the time axis. Passed to xr.Dataset.roll()

• time_shift (int | None) – Number of minutes to shift time axis. This can be used, for example, to shift the time index for daily data so that the time stamp for a given day starts at the zeroth minute instead of at noon, as is the case for most GCM data.

• hr_spatial_coarsen (int) – Spatial coarsening factor. Passed to xr.Dataset.coarsen()

• nan_method_kwargs (str | dict | None) – Keyword arguments for nan handling. If ‘mask’, time steps with nans will be dropped. Otherwise this should be a dict of kwargs which will be passed to Sup3rX.interpolate_na().

• FeatureRegistry (dict) – Dictionary of DerivedFeature objects used for derivations

• interp_kwargs (dict | None) – Dictionary of kwargs for level interpolation. Can include “method” and “run_level_check” keys. Method specifies how to perform height interpolation. e.g. Deriving u_20m from u_10m and u_100m. Options are “linear” and “log”. See sup3r.preprocessing.derivers.Deriver.do_level_interpolation()

Methods

check_registry(feature)	Get compute method from the registry if available.
collect_input_attrs(feature[, inputs])	Collect attributes from the input features for the given feature.
derive(feature)	Routine to derive requested features.
do_level_interpolation(feature[, interp_kwargs])	Interpolate over height or pressure to derive the given feature.
get_inputs(feature)	Get inputs for the given feature and inputs for those inputs.
get_multi_level_data(feature)	Get data stored in multi-level arrays, like u stored on pressure levels.
get_single_level_data(feature)	When doing level interpolation we should include the single level data available.
has_interp_variables(feature)	Check if the given feature can be interpolated from values at nearby heights or from pressure level data.
map_new_name(feature, pattern)	If the search for a derivation method first finds an alternative name for the feature we want to derive, by matching a wildcard pattern, we need to replace the wildcard with the specific height or pressure we want and continue the search for a derivation method with this new name.
no_overlap(feature)	Check if any of the nested inputs for 'feature' contain 'feature'
post_init_log([args_dict])	Log additional arguments after initialization.
wrap(data)	Return a Sup3rDataset object or tuple of such.

Attributes

FEATURE_REGISTRY
data	Return underlying data.
shape	Get shape of underlying data.

check_registry(feature) → ndarray | Array | str | None

Get compute method from the registry if available. Will check for pattern feature match in feature registry. e.g. if u_100m matches a feature registry entry of u_(.*)m

collect_input_attrs(feature, inputs=None)

Collect attributes from the input features for the given feature.

derive(feature) → ndarray | Array

Routine to derive requested features. Employs a little recursion to locate differently named features with a name map in the feature registry. i.e. if FEATURE_REGISTRY contains a key, value pair like “windspeed”: “wind_speed” then requesting “windspeed” will ultimately return a compute method (or fetch from raw data) for “wind_speed

Note

Features are all saved as lower case names and __contains__ checks will use feature.lower()

do_level_interpolation(feature, interp_kwargs=None) → DataArray

Interpolate over height or pressure to derive the given feature.

get_inputs(feature)

Get inputs for the given feature and inputs for those inputs.

get_multi_level_data(feature)

Get data stored in multi-level arrays, like u stored on pressure levels.

get_single_level_data(feature)

When doing level interpolation we should include the single level data available. e.g. If we have u_100m already and want to interpolate u_40m from multi-level data U we should add u_100m at height 100m before doing interpolation, since 100 could be a closer level to 40m than those available in U.

has_interp_variables(feature)

Check if the given feature can be interpolated from values at nearby heights or from pressure level data. e.g. If u_10m and u_50m exist then u_30m can be interpolated from these. If a pressure level array u is available this can also be used, in conjunction with height data.

map_new_name(feature, pattern)

If the search for a derivation method first finds an alternative name for the feature we want to derive, by matching a wildcard pattern, we need to replace the wildcard with the specific height or pressure we want and continue the search for a derivation method with this new name.

no_overlap(feature)

Check if any of the nested inputs for ‘feature’ contain ‘feature’

post_init_log(args_dict=None)

Log additional arguments after initialization.

property shape

Get shape of underlying data.

wrap(data)

Return a Sup3rDataset object or tuple of such. This is a tuple when the .data attribute belongs to a Collection object like BatchHandler. Otherwise this is Sup3rDataset object, which is either a wrapped 3-tuple, 2-tuple, or 1-tuple (e.g. len(data) == 3, len(data) == 2 or len(data) == 1). This is a 3-tuple when .data belongs to a container object like DualSamplerWithObs, a 2-tuple when .data belongs to a dual container object like DualSampler, and a 1-tuple otherwise.

property data

Return underlying data.

Returns:

Sup3rDataset

See also

wrap()