As soon as a file is submitted two steps will happen in our servers: a) preliminary validation and b) scoring step. During the validation step we try to filter any invalid submissions (e.g. invalid fields in the submission files, unknown filenames, etc.), and make sure that the submission contains pose estimates for all test and real_test images.
If a problem arises at this stage an error code and a description of the problem will appear to help the user debug the problem. Otherwise the preliminary validation is passed, and the submitted file will be stored in our servers and appear in the submission list.
Then scoring is run on the submission. If scoring is successful, the result will appear on the leaderboard, otherwise it will appear in the private submission list as an invalid submission. Score on the real_test set is listed on the leaderboard as Real Image Score, while score on the (synthetic) test set is displayed in the Best Score column.