The group of diseases related to heart and blood vessels are commonly known as Cardio vascular diseases. Considering today’s lifestyle, they are the major cause of deaths globally. So early identification of the diseases can give us a fair chance of effective treatment and proper precautions for a healthy life. The proposed novel model is created using convolutional neural networks in combination with random forest algorithm and there will be 12 factors that help to predict the heart disease and chest X-rays will also be used as one of the parameters.