ThisIsCompetition at SemEval-2019 Task 9:BERT is unstable for out-of-domain samples
(a) Subtask A
['Rank', 'Model', 'F-Score']
Overall, JESSI-A ranks second out of 33 official submissions with an F-Score of 77.78%. Although we were not able to submit JESSI-B during the submission phase, JESSI-B achieves an F-Score of 79.59% on the official test set. This performance is similar to the performance of the model that obtained sixth place in the competition. We emphasize that JESSI does not use any labeled and external data for Subtask B, and thus is just exposed to the hotels domain using the available unlabeled trial dataset, containing 808 data instances. We expect the model to perform better when additional data from the hotels domain.