Contents | 1. Introduction | 2. Standard operation: single group | 3. Standard operation: multiple groups | 4. Running on Caret train output: single group, balanced data | 5. Running on Caret train output: multiple groups, balanced data | 6. Running on Caret train output: single group, imbalanced data | 7. Running on Caret train output: log-likelihood to select model | 8. Closing comments | 9. References
Package: MLeval 0.3
MLeval: Machine Learning Model Evaluation
Straightforward and detailed evaluation of machine learning models. 'MLeval' can produce receiver operating characteristic (ROC) curves, precision-recall (PR) curves, calibration curves, and PR gain curves. 'MLeval' accepts a data frame of class probabilities and ground truth labels, or, it can automatically interpret the Caret train function results from repeated cross validation, then select the best model and analyse the results. 'MLeval' produces a range of evaluation metrics with confidence intervals.
Authors:
MLeval_0.3.tar.gz
MLeval_0.3.zip(r-4.7)MLeval_0.3.zip(r-4.6)MLeval_0.3.zip(r-4.5)
MLeval_0.3.tgz(r-4.6-any)MLeval_0.3.tgz(r-4.5-any)
MLeval_0.3.tar.gz(r-4.7-any)MLeval_0.3.tar.gz(r-4.6-any)
MLeval_0.3.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION
card.svg |card.png
MLeval/json (API)
| # Install 'MLeval' in R: |
| install.packages('MLeval', repos = c('https://crj32.r-universe.dev', 'https://cloud.r-project.org')) |
Bug tracker:https://github.com/crj32/mleval/issues
Datasets:
- fit - Random forest fitted object from Caret on Sonar data
- fit1 - Random forest fitted object from Caret on Sonar data
- fit2 - Gradient boosted machines fitted object from Caret on Sonar data
- fit3 - Random forest fitted object from Caret on Sonar data with log-likelihood objective function
- im_fit - Random forest fitted object from Caret on simulated imbalanced data
- preds - Predictions from gbm on the Sonar test data
- predsc - Predictions from gbm and random forest on the Sonar test data
- Sonar - Sonar data
Last updated from:ca1184d564. Checks:7 WARNING, 2 OK. Indexed: yes.
| Target | Result | Time | Files | Syslog |
|---|---|---|---|---|
| linux-devel-x86_64 | WARNING | 155 | ||
| source / vignettes | OK | 153 | ||
| linux-release-x86_64 | WARNING | 134 | ||
| macos-release-arm64 | WARNING | 166 | ||
| macos-oldrel-arm64 | WARNING | 131 | ||
| windows-devel | WARNING | 80 | ||
| windows-release | WARNING | 79 | ||
| windows-oldrel | WARNING | 78 | ||
| wasm-release | OK | 100 |
Exports:brier_scoreevalmLL
Dependencies:clicpp11farverggplot2gluegtableisobandlabelinglifecycleR6RColorBrewerrlangS7scalesvctrsviridisLitewithr
