Page 56 - The-5th-MCAIT2021-eProceeding

Output: Document Ranking

Answer Score

…... …...

Fine Tuning
…... …...

Word 1 Word 2 …... Word n Word 1 Word 2 …... Word m

Sentence A Sentence B
Input: Essay Answer i

Output: Embedding and Sentence Class
Mask Prediction Mask Prediction
Sentence
class

…... …...

Pretrained
Embedding

Word 1 Word 2 Mask …... Word n Word 1 Word 2 Mask …... Word m
Lookup
Repository
Sentence A Sentence B
Pretraining Language Modelling
Input: Essay Answer i

Fig. 2. The proposed BERT architecture for AES task

E- Proceedings of The 5th International Multi-Conference on Artificial Intelligence Technology (MCAIT 2021) [43]
Artificial Intelligence in the 4th Industrial Revolution