Discussion

Congratulations to redrock, the competition winner! dietmarw and Deflect_or_Die also deserve a very special mention having deserved second and third place. The final evaluation of the submissions on the full test set changed dramatically the preliminary leaderboard catapulting redrock on top! A nice twist given that the opposite happened for the Mars Express Challenge when redrock lost his first place for a few digits.

This competition was a very close one and it has been remarkable that the faint signal contained in the dataset was detected and leveraged to this extent. For reference, the "submit the  average" strategy (on the full test set), evalutes to 0.4622.

We are aware that the models developed here will not be usable in the real case and we are working on some follow-up where we will be releasing more problem knowledge and changing the dataset creation pipeline as to improve significantly the usability of the result.

Thanks again to everybody for taking part, we will soon send around a questionnaire we would like you to fill in and we really hope to see you at the workshop to discuss further!