- using R Under development (unstable) (2025-12-18 r89199)
- using platform: x86_64-pc-linux-gnu
- R was compiled by
gcc-15 (Debian 15.2.0-11) 15.2.0
GNU Fortran (Debian 15.2.0-11) 15.2.0
- running under: Debian GNU/Linux forky/sid
- using session charset: UTF-8
- checking for file ‘mlr3benchmark/DESCRIPTION’ ... OK
- this is package ‘mlr3benchmark’ version ‘0.1.7’
- package encoding: UTF-8
- checking CRAN incoming feasibility ... [1s/1s] OK
- checking package namespace information ... OK
- checking package dependencies ... OK
- checking if this is a source package ... OK
- checking if there is a namespace ... OK
- checking for executable files ... OK
- checking for hidden files and directories ... OK
- checking for portable file names ... OK
- checking for sufficient/correct file permissions ... OK
- checking serialization versions ... OK
- checking whether package ‘mlr3benchmark’ can be installed ... OK
See the install log for details.
- checking package directory ... OK
- checking for future file timestamps ... OK
- checking DESCRIPTION meta-information ... OK
- checking top-level files ... OK
- checking for left-over files ... OK
- checking index information ... OK
- checking package subdirectories ... OK
- checking code files for non-ASCII characters ... OK
- checking R files for syntax errors ... OK
- checking whether the package can be loaded ... [1s/2s] OK
- checking whether the package can be loaded with stated dependencies ... [1s/2s] OK
- checking whether the package can be unloaded cleanly ... [1s/1s] OK
- checking whether the namespace can be loaded with stated dependencies ... [1s/2s] OK
- checking whether the namespace can be unloaded cleanly ... [1s/2s] OK
- checking loading without being on the library search path ... [1s/2s] OK
- checking use of S3 registration ... OK
- checking dependencies in R code ... OK
- checking S3 generic/method consistency ... OK
- checking replacement functions ... OK
- checking foreign function calls ... OK
- checking R code for possible problems ... [8s/11s] OK
- checking Rd files ... [0s/1s] OK
- checking Rd metadata ... OK
- checking Rd line widths ... OK
- checking Rd cross-references ... OK
- checking for missing documentation entries ... OK
- checking for code/documentation mismatches ... OK
- checking Rd \usage sections ... OK
- checking Rd contents ... OK
- checking for unstated dependencies in examples ... OK
- checking examples ... [4s/4s] ERROR
Running examples in ‘mlr3benchmark-Ex.R’ failed
The error most likely occurred in:
> base::assign(".ptime", proc.time(), pos = "CheckExEnv")
> ### Name: BenchmarkAggr
> ### Title: Aggregated Benchmark Result Object
> ### Aliases: BenchmarkAggr
>
> ### ** Examples
>
> # Not restricted to mlr3 objects
> df = data.frame(tasks = factor(rep(c("A", "B"), each = 5),
+ levels = c("A", "B")),
+ learners = factor(paste0("L", 1:5)),
+ RMSE = runif(10), MAE = runif(10))
> as_benchmark_aggr(df, task_id = "tasks", learner_id = "learners")
<BenchmarkAggr> of 10 rows with 2 tasks, 5 learners and 2 measures
tasks learners RMSE MAE
<fctr> <fctr> <num> <num>
1: A L1 0.26550866 0.2059746
2: A L2 0.37212390 0.1765568
3: A L3 0.57285336 0.6870228
4: A L4 0.90820779 0.3841037
5: A L5 0.20168193 0.7698414
6: B L1 0.89838968 0.4976992
7: B L2 0.94467527 0.7176185
8: B L3 0.66079779 0.9919061
9: B L4 0.62911404 0.3800352
10: B L5 0.06178627 0.7774452
>
> if (requireNamespaces(c("mlr3", "rpart"))) {
+ library(mlr3)
+ task = tsks(c("pima", "spam"))
+ learns = lrns(c("classif.featureless", "classif.rpart"))
+ bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 2)))
+
+ # coercion
+ as_benchmark_aggr(bm)
+ }
INFO [17:13:03.108] [mlr3] Running benchmark with 8 resampling iterations
INFO [17:13:03.309] [mlr3] Applying learner 'classif.featureless' on task 'pima' (iter 1/2)
INFO [17:13:03.496] [mlr3] Applying learner 'classif.featureless' on task 'pima' (iter 2/2)
INFO [17:13:03.539] [mlr3] Applying learner 'classif.rpart' on task 'pima' (iter 1/2)
INFO [17:13:03.629] [mlr3] Applying learner 'classif.rpart' on task 'pima' (iter 2/2)
INFO [17:13:03.656] [mlr3] Applying learner 'classif.featureless' on task 'spam' (iter 1/2)
INFO [17:13:03.776] [mlr3] Applying learner 'classif.featureless' on task 'spam' (iter 2/2)
INFO [17:13:03.914] [mlr3] Applying learner 'classif.rpart' on task 'spam' (iter 1/2)
INFO [17:13:04.035] [mlr3] Applying learner 'classif.rpart' on task 'spam' (iter 2/2)
INFO [17:13:04.408] [mlr3] Finished benchmark
Error in `[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash") :
attempt access index 9/9 in VECTOR_ELT
Calls: benchmark ... initialize -> .__ResultData__initialize -> [ -> [.data.table
Execution halted
- checking for unstated dependencies in ‘tests’ ... OK
- checking tests ... [6s/8s] ERROR
Running ‘testthat.R’ [5s/7s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate") # for more expect_*() functions
+ library("mlr3benchmark")
+ test_check("mlr3benchmark")
+ }
INFO [17:13:08.955] [mlr3] Running benchmark with 4 resampling iterations
INFO [17:13:09.094] [mlr3] Applying learner 'classif.featureless' on task 'pima' (iter 1/1)
INFO [17:13:09.175] [mlr3] Applying learner 'classif.rpart' on task 'pima' (iter 1/1)
INFO [17:13:09.235] [mlr3] Applying learner 'classif.featureless' on task 'spam' (iter 1/1)
INFO [17:13:09.321] [mlr3] Applying learner 'classif.rpart' on task 'spam' (iter 1/1)
INFO [17:13:09.594] [mlr3] Finished benchmark
Saving _problems/test_BenchmarkAggr-101.R
INFO [17:13:10.669] [mlr3] Running benchmark with 18 resampling iterations
INFO [17:13:10.825] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3)
INFO [17:13:10.854] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3)
INFO [17:13:10.903] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3)
INFO [17:13:10.958] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3)
INFO [17:13:10.992] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3)
INFO [17:13:11.026] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3)
INFO [17:13:11.063] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3)
INFO [17:13:11.103] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3)
INFO [17:13:11.153] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3)
INFO [17:13:11.216] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3)
INFO [17:13:11.261] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3)
INFO [17:13:11.335] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3)
INFO [17:13:11.501] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3)
INFO [17:13:11.644] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3)
INFO [17:13:11.736] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3)
INFO [17:13:11.785] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3)
INFO [17:13:11.833] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3)
INFO [17:13:11.871] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3)
INFO [17:13:11.934] [mlr3] Finished benchmark
Saving _problems/test_autoplot_BenchmarkAggr-48.R
[ FAIL 2 | WARN 1 | SKIP 0 | PASS 47 ]
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_BenchmarkAggr.R:101:3'): mlr3 coercions ────────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3::benchmark(benchmark_grid(task, learns, rsmp("holdout"))) at test_BenchmarkAggr.R:101:3
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
── Error ('test_autoplot_BenchmarkAggr.R:48:3'): autoplot with BenchmarkAggr from mlr3::benchmark() ──
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3::benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3))) at test_autoplot_BenchmarkAggr.R:48:3
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
[ FAIL 2 | WARN 1 | SKIP 0 | PASS 47 ]
Error:
! Test failures.
Execution halted
- checking PDF version of manual ... [4s/7s] OK
- checking HTML version of manual ... [1s/2s] OK
- checking for non-standard things in the check directory ... OK
- DONE
Status: 2 ERRORs