QUESTION ANSWERING SYSTEM UPON UNIFIED LANGUAGE MODEL AND EVALUATING PERFORMANCE OF DATASETS

Loading...
Thumbnail Image

Date

2023

Journal Title

Journal ISSN

Volume Title

Publisher

СДУ хабаршысы - 2023

Abstract

Abstract. Present days require automation and optimization in simple but urgent tasks. It is granted to use opportunities of technologies and science in order to work efficiently and to stay productive. In this paper, I seek to understand opportunities and drawbacks of the publicly available datasets, such as SQuAD, TriviaQA, Natural Questions (NQ). QUAC, NewsQA. It is vital to choose a suitable dataset in order to create a system with better performance. Specifically, the paper proposes an automatic question creating system that uses state-of-the-art Natural Language Processing (NLP) - Unified Language Model (UniLM). The question generating algorithm was verified using best datasets, and it has shown noteworthy results - questions generated were logical and correct. This study is important for teachers, teacher assistants, to save time writing test questions and spend it for more important duties.

Description

Keywords

NLP, SQuAD, dataset, UniLM, education, wikipedia, СДУ хабаршысы - 2023, №1

Citation

N. Ismagulov / QUESTION ANSWERING SYSTEM UPON UNIFIED LANGUAGE MODEL AND EVALUATING PERFORMANCE OF DATASETS / СДУ хабаршысы - 2023