Edit RoBERTa is an extension of BERT with changes to the pretraining procedure. The modifications include: training the model longer, with bigger batches, over more data RoBERTa has almost similar architecture as compare to BERT, but in order to improve the results on BERT architec