Federated Learning for Emoji Prediction in a Mobile Keyboard
Table 3: Relative changes to metrics as a result of the server trained and federated emoji prediction models, measured in experiments on live user traffic. The baseline does not have any emoji predictions. Quoted 95% confidence interval errors for all results are derived using the jackknife method with user buckets.
['[ITALIC] Metric', '[ITALIC] Relative change [%]  [ITALIC] Server trained', '[ITALIC] Relative change [%]  [ITALIC] Federated']
We ran a live-traffic experiment for users in USA and Canada typing in English (US). We also observed that the federated model did better than the server trained model on all of the metrics.