Calulate actual results for every pair of models
calculate_actual_wins( results, decreasing_metric = TRUE, compare_in_split, aggregate = TRUE )
results | raw results |
---|---|
decreasing_metric | if used metric is decreasing |
compare_in_split | if compare models and parameters only in fhe same fold |
aggregate | if results should be aggregated for every pair of models and hyperparameters. Otherwise output will have many rows with binary response (acccording to amount of splitsin crossvalidation) for every pair of models |