Image Captioning is the process of generating textual descriptions of an image. These descriptions need to be syntactically and semantically correct. Image Captioning has potential advantages in many applications like image indexing techniques, devices for visually impaired persons, social media and several other natural language processing applications. Image Captioning is a popular research area where numerous scopes for new findings exist in preparation of datasets, generating language models, developing the models and evaluating the same. This paper extensively surveys very early literature that includes the advent of Artificial Intelligence, the Machine Learning pathway, the photography era, the early Deep Learning and the current Deep Learning methodology for image Captioning. This survey will definitely help novice researchers to understand the roadmap to current techniques.