- using R version 4.6.1 (2026-06-24)
- using platform: x86_64-pc-linux-gnu
- R was compiled by
gcc-16 (Debian 16.1.0-3) 16.1.0
GNU Fortran (Debian 16.1.0-3) 16.1.0
- running under: Debian GNU/Linux forky/sid
- using session charset: UTF-8
* current time: 2026-08-01 16:04:09 UTC
- checking for file ‘mlr3benchmark/DESCRIPTION’ ... OK
- this is package ‘mlr3benchmark’ version ‘0.1.7’
- package encoding: UTF-8
- checking package namespace information ... OK
- checking package dependencies ... OK
- checking if this is a source package ... OK
- checking if there is a namespace ... OK
- checking for executable files ... OK
- checking for hidden files and directories ... OK
- checking for portable file names ... OK
- checking for sufficient/correct file permissions ... OK
- checking serialization versions ... OK
- checking whether package ‘mlr3benchmark’ can be installed ... OK
See the install log for details.
- checking package directory ... OK
- checking for future file timestamps ... OK
- checking DESCRIPTION meta-information ... OK
- checking top-level files ... OK
- checking for left-over files ... OK
- checking index information ... OK
- checking package subdirectories ... OK
- checking code files for non-ASCII characters ... OK
- checking R files for syntax errors ... OK
- checking whether the package can be loaded ... [2s/3s] OK
- checking whether the package can be loaded with stated dependencies ... [1s/2s] OK
- checking whether the package can be unloaded cleanly ... [1s/2s] OK
- checking whether the namespace can be loaded with stated dependencies ... [2s/3s] OK
- checking whether the namespace can be unloaded cleanly ... [2s/3s] OK
- checking loading without being on the library search path ... [2s/3s] OK
- checking use of S3 registration ... OK
- checking dependencies in R code ... OK
- checking S3 generic/method consistency ... OK
- checking replacement functions ... OK
- checking foreign function calls ... OK
- checking R code for possible problems ... [12s/16s] OK
- checking Rd files ... [0s/1s] OK
- checking Rd metadata ... OK
- checking Rd line widths ... OK
- checking Rd cross-references ... OK
- checking for missing documentation entries ... OK
- checking for code/documentation mismatches ... OK
- checking Rd \usage sections ... OK
- checking Rd contents ... OK
- checking for unstated dependencies in examples ... OK
- checking examples ... [2s/3s] ERROR
Running examples in ‘mlr3benchmark-Ex.R’ failed
The error most likely occurred in:
> base::assign(".ptime", proc.time(), pos = "CheckExEnv")
> ### Name: BenchmarkAggr
> ### Title: Aggregated Benchmark Result Object
> ### Aliases: BenchmarkAggr
>
> ### ** Examples
>
> # Not restricted to mlr3 objects
> df = data.frame(tasks = factor(rep(c("A", "B"), each = 5),
+ levels = c("A", "B")),
+ learners = factor(paste0("L", 1:5)),
+ RMSE = runif(10), MAE = runif(10))
> as_benchmark_aggr(df, task_id = "tasks", learner_id = "learners")
<BenchmarkAggr> of 10 rows with 2 tasks, 5 learners and 2 measures
tasks learners RMSE MAE
<fctr> <fctr> <num> <num>
1: A L1 0.26550866 0.2059746
2: A L2 0.37212390 0.1765568
3: A L3 0.57285336 0.6870228
4: A L4 0.90820779 0.3841037
5: A L5 0.20168193 0.7698414
6: B L1 0.89838968 0.4976992
7: B L2 0.94467527 0.7176185
8: B L3 0.66079779 0.9919061
9: B L4 0.62911404 0.3800352
10: B L5 0.06178627 0.7774452
>
> if (requireNamespaces(c("mlr3", "rpart"))) {
+ library(mlr3)
+ task = tsks(c("pima", "spam"))
+ learns = lrns(c("classif.featureless", "classif.rpart"))
+ bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 2)))
+
+ # coercion
+ as_benchmark_aggr(bm)
+ }
Warning in data(list = id, package = package, envir = ee) :
data set ‘PimaIndiansDiabetes2’ not found
Error in UseMethod("as_data_backend") :
no applicable method for 'as_data_backend' applied to an object of class "NULL"
Calls: tsks ... dictionary_initialize_item -> do.call -> <Anonymous> -> as_data_backend
Execution halted
- checking for unstated dependencies in ‘tests’ ... OK
- checking tests ... [7s/8s] ERROR
Running ‘testthat.R’ [7s/8s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate") # for more expect_*() functions
+ library("mlr3benchmark")
+ test_check("mlr3benchmark")
+ }
Saving _problems/test_BenchmarkAggr-99.R
INFO [18:05:27.535] [mlr3] Running benchmark with 18 resampling iterations
INFO [18:05:27.935] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3)
INFO [18:05:28.008] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3)
INFO [18:05:28.046] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3)
INFO [18:05:28.110] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3)
INFO [18:05:28.167] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3)
INFO [18:05:28.210] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3)
INFO [18:05:28.265] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3)
INFO [18:05:28.307] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3)
INFO [18:05:28.350] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3)
INFO [18:05:28.392] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3)
INFO [18:05:28.430] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3)
INFO [18:05:28.499] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3)
INFO [18:05:28.548] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3)
INFO [18:05:28.603] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3)
INFO [18:05:28.661] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3)
INFO [18:05:28.719] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3)
INFO [18:05:28.800] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3)
INFO [18:05:28.868] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3)
INFO [18:05:28.940] [mlr3] Finished benchmark
[ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ]
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ─────────────────────────
Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL"
Backtrace:
▆
1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3
2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...)
3. └─base::lapply(...)
4. └─mlr3misc (local) FUN(X[[i]], ...)
5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest)
6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots)
7. ├─base::do.call(constructor, cargs)
8. └─mlr3 (local) `<fn>`()
9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench"))
[ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ]
Error:
! Test failures.
Execution halted
- checking PDF version of manual ... [4s/7s] OK
- checking HTML version of manual ... [2s/2s] OK
- checking for non-standard things in the check directory ... OK
- DONE
Status: 2 ERRORs