Final Evaluation Criteria

“The judges will score the top 10 submissions on accuracy, speed, and interpretability. The accuracy of the submission counts for 80% of the final score. Accuracy will be determined using the IoU method described above for the Predictive Leaderboard on a holdout dataset. The top 20% of scores will receive full points (80). Other submissions will receive points based on how closely they were to the top performing submissions.”

Something that I am confused about is the top 20%, is it from the top 10 selected or all participating teams?

Hello,

Good question. The 20% refers to the finalists. We always evaluate the top ten finalists. However, we have widened to the top twenty finalists in the past, depending on how competitive the challenge is.

Team Xeek

1 Like