In this study, an attempt has been made to differentiate Alzheimer’s Disease (AD) stages in structural Magnetic Resonance (MR) images using single inception module network. For this, T1-weighted MR brain images of AD, mild cognitive impairment and Normal Controls (NC) are obtained from a public database. From the images, significant features are extracted and classified using an inception module network. The performance of the model is computed and analyzed for different input image sizes. Results show that the single inception module is able to classify AD stages using MR images. The end-to-end network differentiates AD from NC with 85% precision. The model is found to be effective for varied sizes of input images. Since the proposed approach is able to categorize AD stages, single inception module networks could be used for the automated AD diagnosis with minimum medical expertise.