PRECISE Seminar: Evaluation and calibration of AI models with uncertain ground truth
/
https://upenn.zoom.us/j/96715197752
For safety, AI systems in health undergo thorough evaluations before deployment, validating their predictions against a ground truth that is assumed certain. However, this is actually not the case and the ground truth may be uncertain. Unfortunately, this is largely ignored in standard evaluation of AI models but can have severe consequences such as overestimating […]


