The OPS-SAT case
Timeline

July 1, 2022, midnight UTC

Oct. 31, 2022, midnight UTC

The competition is over.

Rules

Next to the Code of Honor the following rules apply to the competition.

Eligibility

  • "The OPS-SAT case" competition is open to everybody, including space experts, data-mining experts and citizen scientists.
  • No nationality restrictions apply for the submission of solution files.

Winner

  • The submissions are ranked in one main leaderboard, according to the score of the quantized model. While the score before quantization is also reported, the competition will be won only by the team reachng the best score as evaluated on the quantized model.
  • The winners will be invited to collaborate with the European Space Agency's OPS-SAT spacecraft operation team and run their models on-board to produce inferences during a dedicated flight campaign.
  • The final ranking and the winner is determined after the deadline, after all submissions will be re-evaluated on the entire test set (read more about partial evaluation during the challenge in the Submission section below).
  • In case of a tie, the tied teams will share their ranking (irrespective on the order at which they are listed on our leaderboards). In other words: there is no tie breaker.
  • The final decision on the winner(s) is subject to whether the participants conformed to the rules as checked by ESA Advanced Concepts Team.

License

By submitting, the authors grant to the organizers a license to use the submission files for the purpose of verifying and publishing the challenge results.

Submission

  • Before the competition deadline, solutions, notebooks, code snippets may only be shared publicly. Private sharing between teams is thus not allowed.
  • After the competition deadline, we encourage all participants to publicly share their solutions and code so that anyone interested can reproduce their results.
  • The submission limit is two submissions within 24 hours per team.
  • The leaderboards during the competition use only part of the submission data: we calculate all scores on a subset of the test labels.
  • The complete submission data will only be evaluated after the competition ends to compute the final ranking.
  • The final ranking determines the winners of the competition.

Teams

  • There is no upper limit on the number of members in a team.
  • Merging of teams is not allowed.
  • The daily submission limit is based on teams, not on users. Thus, each team will have 2 submission per 24h interval.