CodeBERT: A Pre-Trained Model for Programming and Natural Languages
Table 6: Code-to-NL generation on C# language.
['Model', 'BLEU']
However, our model achieve slightly lower results than code2seq The main reason could be that code2seq makes use of compositional paths in its abstract syntax tree (AST) while CodeBERT only takes original code as the input. We have trained a version of CodeBERT by traversing the tree structure of AST following a certain order, but applying that model does not bring improvements on generation tasks. This shows a potential direction to improve CodeBERT by incorporating AST.