DEVELOPMENT OF IMAGE CAPTIONING MODEL BY USING DEEP LEARNING TOOLS

No Thumbnail Available

Date

2019

Journal Title

Journal ISSN

Volume Title

Publisher

СДУ хабаршысы - 2019

Abstract

Abstract. Automatic formation of image description is one of the most challenging and popular topics in the field of deep learning (DL) for nowadays. In this work image captioning convolutional neural network model (VGG16) is developed by implementing deep learning tools and techniques. Specifically, this work’s resulting product can be implemented in a system that answers to the question, based on the image given. Image captioning includes two main sub-processes: image processing and natural language processing. The model was constructed from 16 layers and it uses Flicker 8K data-set of images for captioning. The model was evaluated by using BLEU metric and its value was nearly 0.75, it takes one image as an input and returns one description for that image.

Description

Keywords

Deep learning, convolutional neural network, image captioning, VGG16, visual question answering, bilingual evaluation understudy, СДУ хабаршысы - 2019, №4

Citation

B. Kynabay , A. Aldabergen , S. Shamiluulu / DEVELOPMENT OF IMAGE CAPTIONING MODEL BY USING DEEP LEARNING TOOLS / СДУ хабаршысы - 2019