In the present world the security of the home, banks, shops, etc., are the prime concerns. The traditional security such as Closed-Circuit Television (CCTV) cameras are very easy to break and lead to theft. And moreover, the installation cost of the security systems is costlier. To overcome these problems, we are presenting Internet of Things (IoT) based solution where we can setup a smart security system. In this paper, we are proposing the system with the help of face detection and face recognition algorithms to secure our home which gives us the facility of entire surveillance of our buildings remotely and take appropriate action if anything goes wrong. The Camera Serial Interface (CSI) is attached to the Raspberry PI which detects presence of person using Face detection and recognition algorithms. The multiple Raspberry PIs attached in different areas of our buildings are connected to the main Raspberry PI which acts as hub module. If the person is identified as unknown, the information is sent to Hub module which in turn sends the alert message and live video streaming to the user using an app which we developed.