- using R Under development (unstable) (2025-12-19 r89206)
- using platform: x86_64-pc-linux-gnu
- R was compiled by
gcc-15 (Debian 15.2.0-11) 15.2.0
GNU Fortran (Debian 15.2.0-11) 15.2.0
- running under: Debian GNU/Linux forky/sid
- using session charset: UTF-8
- checking for file ‘mlr3fairness/DESCRIPTION’ ... OK
- checking extension type ... Package
- this is package ‘mlr3fairness’ version ‘0.4.0’
- package encoding: UTF-8
- checking CRAN incoming feasibility ... [2s/3s] OK
- checking package namespace information ... OK
- checking package dependencies ... OK
- checking if this is a source package ... OK
- checking if there is a namespace ... OK
- checking for executable files ... OK
- checking for hidden files and directories ... OK
- checking for portable file names ... OK
- checking for sufficient/correct file permissions ... OK
- checking serialization versions ... OK
- checking whether package ‘mlr3fairness’ can be installed ... OK
See the install log for details.
- checking package directory ... OK
- checking for future file timestamps ... OK
- checking ‘build’ directory ... OK
- checking DESCRIPTION meta-information ... OK
- checking top-level files ... OK
- checking for left-over files ... OK
- checking index information ... OK
- checking package subdirectories ... OK
- checking code files for non-ASCII characters ... OK
- checking R files for syntax errors ... OK
- checking whether the package can be loaded ... [2s/3s] OK
- checking whether the package can be loaded with stated dependencies ... [2s/2s] OK
- checking whether the package can be unloaded cleanly ... [2s/3s] OK
- checking whether the namespace can be loaded with stated dependencies ... [2s/3s] OK
- checking whether the namespace can be unloaded cleanly ... [2s/3s] OK
- checking loading without being on the library search path ... [2s/3s] OK
- checking whether startup messages can be suppressed ... [2s/3s] OK
- checking use of S3 registration ... OK
- checking dependencies in R code ... OK
- checking S3 generic/method consistency ... OK
- checking replacement functions ... OK
- checking foreign function calls ... OK
- checking R code for possible problems ... [20s/23s] OK
- checking Rd files ... [1s/1s] OK
- checking Rd metadata ... OK
- checking Rd line widths ... OK
- checking Rd cross-references ... OK
- checking for missing documentation entries ... OK
- checking for code/documentation mismatches ... OK
- checking Rd \usage sections ... OK
- checking Rd contents ... OK
- checking for unstated dependencies in examples ... OK
- checking contents of ‘data’ directory ... OK
- checking data for non-ASCII characters ... [0s/1s] OK
- checking LazyData ... OK
- checking data for ASCII and uncompressed saves ... OK
- checking installed files from ‘inst/doc’ ... OK
- checking files in ‘vignettes’ ... OK
- checking examples ... [8s/9s] ERROR
Running examples in ‘mlr3fairness-Ex.R’ failed
The error most likely occurred in:
> base::assign(".ptime", proc.time(), pos = "CheckExEnv")
> ### Name: fairness_accuracy_tradeoff
> ### Title: Plot Fairness Accuracy Trade-offs
> ### Aliases: fairness_accuracy_tradeoff
>
> ### ** Examples
>
> ## Don't show:
> if (rlang::is_installed("rpart") && rlang::is_installed("ranger")) (if (getRversion() >= "3.4") withAutoprint else force)({ # examplesIf
+ ## End(Don't show)
+ library("mlr3")
+ library("mlr3learners")
+ library("ggplot2")
+
+ # Setup the Fairness measure and tasks
+ task = tsk("adult_train")$filter(1:500)
+ learner = lrn("classif.ranger", predict_type = "prob")
+ fairness_measure = msr("fairness.tpr")
+
+ # Example 1 - A single prediction
+ learner$train(task)
+ predictions = learner$predict(task)
+ fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
+
+ # Example2 - A benchmark
+ design = benchmark_grid(
+ tasks = task,
+ learners = lrns(c("classif.featureless", "classif.rpart"),
+ predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2)
+ )
+ bmr = benchmark(design)
+ fairness_accuracy_tradeoff(bmr, fairness_measure)
+ ## Don't show:
+ }) # examplesIf
> library("mlr3")
> library("mlr3learners")
> library("ggplot2")
> task = tsk("adult_train")$filter(1:500)
> learner = lrn("classif.ranger", predict_type = "prob")
> fairness_measure = msr("fairness.tpr")
> learner$train(task)
> predictions = learner$predict(task)
> fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
> design = benchmark_grid(tasks = task, learners = lrns(c("classif.featureless",
+ "classif.rpart"), predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2))
> bmr = benchmark(design)
INFO [17:18:23.763] [mlr3] Running benchmark with 4 resampling iterations
INFO [17:18:23.989] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/2)
INFO [17:18:24.042] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/2)
INFO [17:18:24.090] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/2)
INFO [17:18:24.137] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/2)
INFO [17:18:24.183] [mlr3] Finished benchmark
Error in `[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash") :
attempt access index 9/9 in VECTOR_ELT
Calls: <Anonymous> ... initialize -> .__ResultData__initialize -> [ -> [.data.table
Execution halted
- checking for unstated dependencies in ‘tests’ ... OK
- checking tests ... [20s/23s] ERROR
Running ‘testthat.R’ [20s/23s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
Saving _problems/test_visualizations-6.R
Saving _problems/test_visualizations-30.R
Saving _problems/test_visualizations-52.R
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:10:5', 'test_learners_fairml.R:21:5',
'test_learners_fairml.R:33:5', 'test_learners_fairml.R:43:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:18:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_visualizations.R:6:3'): fairness_accuracy_tradeoff ─────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:6:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:30:3'): compare_metrics ───────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:30:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:52:3'): prediction_density ────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:52:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
Error:
! Test failures.
Execution halted
- checking for unstated dependencies in vignettes ... OK
- checking package vignettes ... OK
- checking re-building of vignette outputs ... [91s/112s] ERROR
Error(s) in re-building vignettes:
...
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
INFO [17:18:56.071] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:18:56.198] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:18:56.456] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:18:56.580] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:18:56.841] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:18:57.548] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:18:58.086] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:18:58.800] [mlr3] Finished benchmark
Quitting from debiasing-vignette.Rmd:61-67 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(grd)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
INFO [17:19:08.345] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:19:08.479] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [17:19:33.349] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [17:19:58.308] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [17:20:21.060] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:20:21.646] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:20:21.918] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:20:22.193] [mlr3] Finished benchmark
Quitting from measures-vignette.Rmd:174-189 [unnamed-chunk-13]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
INFO [17:20:26.897] [mlr3] Resampling 'cv' is being instantiated on task 'adult_train'
INFO [17:20:27.031] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/5)
INFO [17:20:27.089] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/5)
INFO [17:20:27.111] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/5)
INFO [17:20:27.133] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 4/5)
INFO [17:20:27.156] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 5/5)
Quitting from reports-vignette.Rmd:69-75 [build_fairness_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::resample(task, learner, rsmp("cv", folds = 5))
2. └─ResultData$new(data, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
INFO [17:20:35.165] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:20:35.632] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [17:20:37.047] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [17:20:38.845] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [17:20:40.488] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:20:40.622] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:20:40.707] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:20:40.794] [mlr3] Finished benchmark
Quitting from visualization-vignette.Rmd:56-65 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following files failed:
‘debiasing-vignette.Rmd’ ‘measures-vignette.Rmd’
‘reports-vignette.Rmd’ ‘visualization-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
- checking PDF version of manual ... [6s/9s] OK
- checking HTML version of manual ... [3s/7s] OK
- checking for non-standard things in the check directory ... OK
- DONE
Status: 3 ERRORs