Text Generator using GPT2 Model

Text Generator using GPT2 Model

R Roshini , A Preethi , C Arulmozhi  and  P Sivaganga* Artificial Intelligence and Data science

Veltech Hightech Dr.Rangarajan Dr.Sakunthala Engineering College,Avadi,         Chennai 600062- India .

Abstract- GPT-2 is state of art algorithm transfer learning with respect to nlp task we can do it like text summarization and many more applications. The text generation application programming interface is supported by a large-scale unsupervised language model capable of generating paragraphs of text This transformer-based language model, based on OpenAI's GPT-2 model, accepts a sentence or partial sentence as input and predicts subsequent text. GPT-2 uses input text to set the initial context for further text generation. The length of an input string can range from few words to a maximum sequence length of 1024 tokens. The longer an initial input, the more subject context is provided to a model. Generally, longer inputs produce a more coherent text output. It was specifically trained to guess the next word in sentences. GPT-2 is a massive model that contains a massive amount of compressed knowledge from various parts of the internet. It can be used to forecast the likelihood of a sentence. The model learns an internal representation of the English language, which it can then use to extract features useful for subsequent tasks. We have used a tkinter which is a GUI to display the generated output.

Keywords—Text generation, Graphical User Interface, gpt2 transformer,Open AI,tkinter,