EDA: add table or so that show on which instances all algos are equal

[berndbischl]

Specifically: Where all algos failed.

Think about how this is presented best.

[kerschke]

How about a barplot, where each bar represents the number of algorithms that could not be solved (0 to number of algos)?

plotMissings = function(astask, measure) {
  checkArg(astask, "ASTask")
  measure = checkMeasure(measure, astask$desc)
  data = convertAlgoPerfToWideFormat(astask$desc, astask$algo.runs, measure)
  data = dropNamed(data, c("instance_id", "repetition"))
  s = apply(data, 1, function(x) sum(is.na(x)))
  tab = 100 * table(s) / sum(table(s))
  ## assure that all posible categories are shown
  if (length(tab) < 1L + ncol(data)) {
    cns = names(tab)
    new.cns = setdiff(0:ncol(data), cns)
    tab = c(rep(0, length(new.cns)), tab)
    names(tab) = c(new.cns, cns)
    tab = tab[order(as.integer(names(tab)))]
  }
  par(mar = c(4.5, 4.1, 1, 0))
  barplot(tab, las = 2, ylim = c(0, max(tab)) * 1.15,
    xlab = "Number of Unsuccessful Algorithms",
    ylab = "Percentage of Instances", 
    col = "lightblue")
  x.pos = cumsum(0.2 + rep_len(1, length(tab))) - 0.5
  y.pos = tab + max(tab) * 0.08
  text(x.pos, y.pos, sprintf("%.1f", tab), srt = 90)
}