Sentence Prediction using BERT based on Malayalam

Arya K A; Shelja Jose M1

1

Publication Date: 2023/02/15

Abstract: This paper deals with advancements that have occurred in the field of Natural language processing. Most of the text prediction-related tasks are conducted in different dialects but not in Malayalam. Numerous frameworks with various techniques were produced for various dialects. Only a few of the models fit into Malayalam. In this paper, the BERT algorithm is applied to the Malayalam language. BERT uses bi-directional pre-training on multiple tasks such as Next Sentence Prediction and Masked Language Model. This paper mainly deals with the Next sentence prediction.

Keywords: BERT, Malayalam Next Sentence Prediction.

DOI: https://doi.org/10.5281/zenodo.7642130

PDF: https://ijirst.demo4.arinfotech.co/assets/upload/files/IJISRT23JAN1504.pdf

REFERENCES

No References Available