- using R Under development (unstable) (2026-07-23 r90295)
- using platform: x86_64-pc-linux-gnu
- R was compiled by
clang version 22.1.8 (https://github.com/llvm/llvm-project ca7933e47d3a3451d81e72ac174dcb5aa28b59d1)
flang version 22.1.8 (https://github.com/llvm/llvm-project ca7933e47d3a3451d81e72ac174dcb5aa28b59d1)
- running under: Fedora Linux 42 (Workstation Edition)
- using session charset: UTF-8
* current time: 2026-07-24 09:02:22 UTC
- using option ‘--no-stop-on-test-error’
- checking for file ‘mlr3benchmark/DESCRIPTION’ ... OK
- this is package ‘mlr3benchmark’ version ‘0.1.7’
- package encoding: UTF-8
- checking package namespace information ... OK
- checking package dependencies ... OK
- checking if this is a source package ... OK
- checking if there is a namespace ... OK
- checking for executable files ... OK
- checking for hidden files and directories ... OK
- checking for portable file names ... OK
- checking for sufficient/correct file permissions ... OK
- checking whether package ‘mlr3benchmark’ can be installed ... [12s/16s] OK
See the install log for details.
- checking installed package size ... OK
- checking package directory ... OK
- checking DESCRIPTION meta-information ... OK
- checking top-level files ... OK
- checking for left-over files ... OK
- checking index information ... OK
- checking package subdirectories ... OK
- checking code files for non-ASCII characters ... OK
- checking R files for syntax errors ... OK
- checking whether the package can be loaded ... OK
- checking whether the package can be loaded with stated dependencies ... OK
- checking whether the package can be unloaded cleanly ... OK
- checking whether the namespace can be loaded with stated dependencies ... OK
- checking whether the namespace can be unloaded cleanly ... OK
- checking loading without being on the library search path ... OK
- checking use of S3 registration ... OK
- checking dependencies in R code ... OK
- checking S3 generic/method consistency ... OK
- checking replacement functions ... OK
- checking foreign function calls ... OK
- checking R code for possible problems ... [19s/26s] OK
- checking Rd files ... OK
- checking Rd metadata ... OK
- checking Rd line widths ... OK
- checking Rd cross-references ... OK
- checking for missing documentation entries ... OK
- checking for code/documentation mismatches ... OK
- checking Rd \usage sections ... OK
- checking Rd contents ... OK
- checking for unstated dependencies in examples ... OK
- checking examples ... ERROR
Running examples in ‘mlr3benchmark-Ex.R’ failed
The error most likely occurred in:
> ### Name: BenchmarkAggr
> ### Title: Aggregated Benchmark Result Object
> ### Aliases: BenchmarkAggr
>
> ### ** Examples
>
> # Not restricted to mlr3 objects
> df = data.frame(tasks = factor(rep(c("A", "B"), each = 5),
+ levels = c("A", "B")),
+ learners = factor(paste0("L", 1:5)),
+ RMSE = runif(10), MAE = runif(10))
> as_benchmark_aggr(df, task_id = "tasks", learner_id = "learners")
<BenchmarkAggr> of 10 rows with 2 tasks, 5 learners and 2 measures
tasks learners RMSE MAE
<fctr> <fctr> <num> <num>
1: A L1 0.26550866 0.2059746
2: A L2 0.37212390 0.1765568
3: A L3 0.57285336 0.6870228
4: A L4 0.90820779 0.3841037
5: A L5 0.20168193 0.7698414
6: B L1 0.89838968 0.4976992
7: B L2 0.94467527 0.7176185
8: B L3 0.66079779 0.9919061
9: B L4 0.62911404 0.3800352
10: B L5 0.06178627 0.7774452
>
> if (requireNamespaces(c("mlr3", "rpart"))) {
+ library(mlr3)
+ task = tsks(c("pima", "spam"))
+ learns = lrns(c("classif.featureless", "classif.rpart"))
+ bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 2)))
+
+ # coercion
+ as_benchmark_aggr(bm)
+ }
Warning in data(list = id, package = package, envir = ee) :
data set ‘PimaIndiansDiabetes2’ not found
Error in UseMethod("as_data_backend") :
no applicable method for 'as_data_backend' applied to an object of class "NULL"
Calls: tsks ... dictionary_initialize_item -> do.call -> <Anonymous> -> as_data_backend
Execution halted
- checking for unstated dependencies in ‘tests’ ... OK
- checking tests ... [12s/14s] ERROR
Running ‘testthat.R’ [12s/14s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate") # for more expect_*() functions
+ library("mlr3benchmark")
+ test_check("mlr3benchmark")
+ }
Saving _problems/test_BenchmarkAggr-99.R
INFO [10:04:45.637] [mlr3] Running benchmark with 18 resampling iterations
INFO [10:04:46.385] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3)
INFO [10:04:46.515] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3)
INFO [10:04:46.577] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3)
INFO [10:04:46.637] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3)
INFO [10:04:46.712] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3)
INFO [10:04:46.854] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3)
INFO [10:04:46.998] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3)
INFO [10:04:47.076] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3)
INFO [10:04:47.184] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3)
INFO [10:04:47.252] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3)
INFO [10:04:47.315] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3)
INFO [10:04:47.402] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3)
INFO [10:04:47.461] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3)
INFO [10:04:47.594] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3)
INFO [10:04:47.700] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3)
INFO [10:04:47.789] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3)
INFO [10:04:47.881] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3)
INFO [10:04:47.976] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3)
INFO [10:04:48.083] [mlr3] Finished benchmark
[ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ]
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ─────────────────────────
Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL"
Backtrace:
▆
1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3
2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...)
3. └─base::lapply(...)
4. └─mlr3misc (local) FUN(X[[i]], ...)
5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest)
6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots)
7. ├─base::do.call(constructor, cargs)
8. └─mlr3 (local) `<fn>`()
9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench"))
[ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ]
Error:
! Test failures.
Execution halted
- checking PDF version of manual ... OK
- checking HTML version of manual ... OK
- checking for non-standard things in the check directory ... OK
- checking for detritus in the temp directory ... OK
- DONE
Status: 2 ERRORs