Image Captioning has gained tremendous spotlight in recent years. However, the captioning models generate captions in English language. In this paper, we present an image caption generator for our regional language that is Hindi using Resnet50 and LSTM with attention module. An experimental study is shown highlighting the effect of attention-based learning on generated Hindi captions. Flickr8k dataset in Hindi language is used to validate the performance of proposed work in terms of BLEU score.