Running 'testthat.R' [36s]
Running the tests in 'tests/testthat.R' failed.
Complete output:
  > # This file is part of the standard setup for testthat.
  > # It is recommended that you do not modify it.
  > #
  > # Where should you do additional test configuration?
  > # Learn more about the roles of various files in:
  > # * https://r-pkgs.org/tests.html
  > # * https://testthat.r-lib.org/reference/test_package.html#special-files
  > 
  > library(testthat)
  > library(mlr3inferr)
  Loading required package: mlr3
  > 
  > test_check("mlr3inferr")
  Saving _problems/test_MeasureAbstractCi-2.R
  Saving _problems/test_MeasureAbstractCi-8.R
  Saving _problems/test_MeasureAbstractCi-14.R
  Saving _problems/test_MeasureAbstractCi-22.R
  Saving _problems/test_MeasureAbstractCi-37.R
  Saving _problems/test_MeasureAbstractCi-53.R
  Saving _problems/test_MeasureAbstractCi-60.R
  Saving _problems/test_MeasureAbstractCi-77.R
  Saving _problems/test_MeasureAbstractCi-83.R
  Saving _problems/test_MeasureCi-2.R
  Saving _problems/test_MeasureCiConZ-3.R
  Saving _problems/test_MeasureCiConZ-8.R
  Saving _problems/test_MeasureCiCorT-2.R
  Saving _problems/test_MeasureCiCorT-7.R
  Saving _problems/test_MeasureCiHoldout-2.R
  Saving _problems/test_MeasureCiHoldout-7.R
  Saving _problems/test_MeasureCiNestedCV-7.R
  Saving _problems/test_MeasureCiNestedCV-13.R
  Saving _problems/test_MeasureCiWaldCV-2.R
  Saving _problems/test_MeasureCiWaldCV-10.R
  Saving _problems/test_ResamplingNestedCV-31.R
  Saving _problems/test_ResamplingPairedSubsampling-27.R
  [ FAIL 22 | WARN 0 | SKIP 0 | PASS 121 ]
  
  ══ Failed tests ════════════════════════════════════════════════════════════════
  ── Error ('test_MeasureAbstractCi.R:2:3'): score throws error ──────────────────
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3::resample(tsk("iris"), lrn("classif.featureless"), rsmp("holdout")) at test_MeasureAbstractCi.R:2:3
   2.   └─ResultData$new(data, data_extra, store_backends = store_backends)
   3.     └─mlr3 (local) initialize(...)
   4.       └─mlr3:::.__ResultData__initialize(...)
   5.         ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   6.         └─data.table:::`[.data.table`(...)
  ── Error ('test_MeasureAbstractCi.R:8:3'): resampling method is verified ───────
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3::resample(tsk("iris"), lrn("classif.featureless"), rsmp("insample")) at test_MeasureAbstractCi.R:8:3
   2.   └─ResultData$new(data, data_extra, store_backends = store_backends)
   3.     └─mlr3 (local) initialize(...)
   4.       └─mlr3:::.__ResultData__initialize(...)
   5.         ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   6.         └─data.table:::`[.data.table`(...)
  ── Error ('test_MeasureAbstractCi.R:14:3'): construction measure checks ────────
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3::resample(tsk("iris"), lrn("classif.featureless"), rsmp("insample")) at test_MeasureAbstractCi.R:14:3
   2.   └─ResultData$new(data, data_extra, store_backends = store_backends)
   3.     └─mlr3 (local) initialize(...)
   4.       └─mlr3:::.__ResultData__initialize(...)
   5.         ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   6.         └─data.table:::`[.data.table`(...)
  ── Error ('test_MeasureAbstractCi.R:22:3'): aggregation works ──────────────────
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3::benchmark(...) at test_MeasureAbstractCi.R:22:3
   2.   └─ResultData$new(grid, data_extra, store_backends = store_backends)
   3.     └─mlr3 (local) initialize(...)
   4.       └─mlr3:::.__ResultData__initialize(...)
   5.         ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   6.         └─data.table:::`[.data.table`(...)
  ── Error ('test_MeasureAbstractCi.R:37:3'): ci can be used with other measure ──
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3::resample(task, learner, resampling) at test_MeasureAbstractCi.R:37:3
   2.   └─ResultData$new(data, data_extra, store_backends = store_backends)
   3.     └─mlr3 (local) initialize(...)
   4.       └─mlr3:::.__ResultData__initialize(...)
   5.         ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   6.         └─data.table:::`[.data.table`(...)
  ── Error ('test_MeasureAbstractCi.R:53:3'): wrapped measure must evaluate test ──
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3::resample(...) at test_MeasureAbstractCi.R:53:3
   2.   └─ResultData$new(data, data_extra, store_backends = store_backends)
   3.     └─mlr3 (local) initialize(...)
   4.       └─mlr3:::.__ResultData__initialize(...)
   5.         ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   6.         └─data.table:::`[.data.table`(...)
  ── Error ('test_MeasureAbstractCi.R:60:3'): also works when CI measure and passed measure have different IDs ──
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3::resample(tsk("sonar"), lrn("classif.featureless"), rsmp("holdout")) at test_MeasureAbstractCi.R:60:3
   2.   └─ResultData$new(data, data_extra, store_backends = store_backends)
   3.     └─mlr3 (local) initialize(...)
   4.       └─mlr3:::.__ResultData__initialize(...)
   5.         ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   6.         └─data.table:::`[.data.table`(...)
  ── Error ('test_MeasureAbstractCi.R:77:3'): grouping is not allowed ────────────
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3::resample(task, lrn("regr.featureless"), rsmp("holdout")) at test_MeasureAbstractCi.R:77:3
   2.   └─ResultData$new(data, data_extra, store_backends = store_backends)
   3.     └─mlr3 (local) initialize(...)
   4.       └─mlr3:::.__ResultData__initialize(...)
   5.         ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   6.         └─data.table:::`[.data.table`(...)
  ── Error ('test_MeasureAbstractCi.R:83:3'): within_range works ─────────────────
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3::resample(tsk("mtcars"), lrn("regr.featureless"), rsmp("holdout")) at test_MeasureAbstractCi.R:83:3
   2.   └─ResultData$new(data, data_extra, store_backends = store_backends)
   3.     └─mlr3 (local) initialize(...)
   4.       └─mlr3:::.__ResultData__initialize(...)
   5.         ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   6.         └─data.table:::`[.data.table`(...)
  ── Error ('test_MeasureCi.R:2:3'): basic ───────────────────────────────────────
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3::resample(tsk("iris"), lrn("classif.featureless"), rsmp("holdout")) at test_MeasureCi.R:2:3
   2.   └─ResultData$new(data, data_extra, store_backends = store_backends)
   3.     └─mlr3 (local) initialize(...)
   4.       └─mlr3:::.__ResultData__initialize(...)
   5.         ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   6.         └─data.table:::`[.data.table`(...)
  ── Error ('test_MeasureCiConZ.R:3:3'): basic ───────────────────────────────────
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3inferr:::expect_ci_measure(...) at test_MeasureCiConZ.R:3:3
   2.   └─mlr3::resample(task, lrn("regr.featureless"), resampling) at ./helpers.R:29:3
   3.     └─ResultData$new(data, data_extra, store_backends = store_backends)
   4.       └─mlr3 (local) initialize(...)
   5.         └─mlr3:::.__ResultData__initialize(...)
   6.           ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   7.           └─data.table:::`[.data.table`(...)
  ── Error ('test_MeasureCiConZ.R:8:3'): aggr and CI point estimate agree ────────
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3::resample(...) at test_MeasureCiConZ.R:8:3
   2.   └─ResultData$new(data, data_extra, store_backends = store_backends)
   3.     └─mlr3 (local) initialize(...)
   4.       └─mlr3:::.__ResultData__initialize(...)
   5.         ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   6.         └─data.table:::`[.data.table`(...)
  ── Error ('test_MeasureCiCorT.R:2:3'): simple ──────────────────────────────────
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3inferr:::expect_ci_measure(...) at test_MeasureCiCorT.R:2:3
   2.   └─mlr3::resample(task, lrn("regr.featureless"), resampling) at ./helpers.R:29:3
   3.     └─ResultData$new(data, data_extra, store_backends = store_backends)
   4.       └─mlr3 (local) initialize(...)
   5.         └─mlr3:::.__ResultData__initialize(...)
   6.           ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   7.           └─data.table:::`[.data.table`(...)
  ── Error ('test_MeasureCiCorT.R:7:3'): aggr and CI point estimate agree ────────
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3::resample(...) at test_MeasureCiCorT.R:7:3
   2.   └─ResultData$new(data, data_extra, store_backends = store_backends)
   3.     └─mlr3 (local) initialize(...)
   4.       └─mlr3:::.__ResultData__initialize(...)
   5.         ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   6.         └─data.table:::`[.data.table`(...)
  ── Error ('test_MeasureCiHoldout.R:2:3'): simple ───────────────────────────────
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3inferr:::expect_ci_measure("ci.holdout", rsmp("holdout")) at test_MeasureCiHoldout.R:2:3
   2.   └─mlr3::resample(task, lrn("regr.featureless"), resampling) at ./helpers.R:29:3
   3.     └─ResultData$new(data, data_extra, store_backends = store_backends)
   4.       └─mlr3 (local) initialize(...)
   5.         └─mlr3:::.__ResultData__initialize(...)
   6.           ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   7.           └─data.table:::`[.data.table`(...)
  ── Error ('test_MeasureCiHoldout.R:7:3'): aggr and CI point estimate agree ─────
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3::resample(task, lrn("classif.featureless"), rsmp("holdout")) at test_MeasureCiHoldout.R:7:3
   2.   └─ResultData$new(data, data_extra, store_backends = store_backends)
   3.     └─mlr3 (local) initialize(...)
   4.       └─mlr3:::.__ResultData__initialize(...)
   5.         ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   6.         └─data.table:::`[.data.table`(...)
  ── Error ('test_MeasureCiNestedCV.R:3:3'): basic ───────────────────────────────
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3inferr:::expect_ci_measure(...) at test_MeasureCiNestedCV.R:3:3
   2.   └─mlr3::resample(task, lrn("regr.featureless"), resampling) at ./helpers.R:29:3
   3.     └─ResultData$new(data, data_extra, store_backends = store_backends)
   4.       └─mlr3 (local) initialize(...)
   5.         └─mlr3:::.__ResultData__initialize(...)
   6.           ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   7.           └─data.table:::`[.data.table`(...)
  ── Error ('test_MeasureCiNestedCV.R:13:3'): aggr and CI point estimate agree ───
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3::resample(...) at test_MeasureCiNestedCV.R:13:3
   2.   └─ResultData$new(data, data_extra, store_backends = store_backends)
   3.     └─mlr3 (local) initialize(...)
   4.       └─mlr3:::.__ResultData__initialize(...)
   5.         ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   6.         └─data.table:::`[.data.table`(...)
  ── Error ('test_MeasureCiWaldCV.R:2:3'): basic ─────────────────────────────────
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3inferr:::expect_ci_measure("ci.wald_cv", rsmp("cv"), variance = "all-pairs") at test_MeasureCiWaldCV.R:2:3
   2.   └─mlr3::resample(task, lrn("regr.featureless"), resampling) at ./helpers.R:29:3
   3.     └─ResultData$new(data, data_extra, store_backends = store_backends)
   4.       └─mlr3 (local) initialize(...)
   5.         └─mlr3:::.__ResultData__initialize(...)
   6.           ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   7.           └─data.table:::`[.data.table`(...)
  ── Error ('test_MeasureCiWaldCV.R:10:3'): aggr and CI point estimate agree ─────
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3::resample(task, lrn("classif.featureless"), rsmp("cv", folds = 3)) at test_MeasureCiWaldCV.R:10:3
   2.   └─ResultData$new(data, data_extra, store_backends = store_backends)
   3.     └─mlr3 (local) initialize(...)
   4.       └─mlr3:::.__ResultData__initialize(...)
   5.         ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   6.         └─data.table:::`[.data.table`(...)
  ── Error ('test_ResamplingNestedCV.R:31:3'): ResamplingNestedCV works ──────────
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3::resample(task, lrn("classif.debug"), res) at test_ResamplingNestedCV.R:31:3
   2.   └─ResultData$new(data, data_extra, store_backends = store_backends)
   3.     └─mlr3 (local) initialize(...)
   4.       └─mlr3:::.__ResultData__initialize(...)
   5.         ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   6.         └─data.table:::`[.data.table`(...)
  ── Error ('test_ResamplingPairedSubsampling.R:23:3'): basic ────────────────────
  Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
  Backtrace:
      ▆
   1. └─mlr3::resample(task, lrn("classif.featureless"), r) at test_ResamplingPairedSubsampling.R:23:3
   2.   └─ResultData$new(data, data_extra, store_backends = store_backends)
   3.     └─mlr3 (local) initialize(...)
   4.       └─mlr3:::.__ResultData__initialize(...)
   5.         ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
   6.         └─data.table:::`[.data.table`(...)
  
  [ FAIL 22 | WARN 0 | SKIP 0 | PASS 121 ]
  Error:
  ! Test failures.
  Execution halted