DEVELOPMENT OF IMAGE CAPTIONING MODEL BY USING DEEP LEARNING TOOLS
Loading...
Date
2019
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
СДУ хабаршысы - 2019
Abstract
Abstract. Automatic formation of image description is one of the most challenging and popular topics in the field of deep learning (DL) for nowadays. In this work image captioning convolutional neural network model (VGG16) is developed by implementing deep learning tools and techniques. Specifically, this work’s resulting product can be implemented in a system that answers to the question, based on the image given. Image captioning includes two main sub-processes: image processing and natural language processing. The model was constructed from 16 layers and it uses Flicker 8K data-set of images for captioning. The model was evaluated by using BLEU metric and its value was nearly 0.75, it takes one image as an input and returns one description for that image.
Description
Keywords
Deep learning, convolutional neural network, image captioning, VGG16, visual question answering, bilingual evaluation understudy, СДУ хабаршысы - 2019, №4
Citation
B. Kynabay , A. Aldabergen , S. Shamiluulu / DEVELOPMENT OF IMAGE CAPTIONING MODEL BY USING DEEP LEARNING TOOLS / СДУ хабаршысы - 2019