Facial recognition systems has captivated research attention in recent years. Facial recognition technology is often required in real-time systems. With the rapid development, diverse algorithms of machine learning for detection and facial recognition have been proposed to address the challenges existing. In the present paper we proposed a system for facial detection and recognition under unconstrained conditions in video sequences. We analyze learning based and hand-crafted feature extraction approaches that have demonstrated high performance in task of facial recognition. In the proposed system, we compare different traditional algorithms with the avant-garde algorithms of facial recognition based on approaches discussed. The experiments on unconstrained datasets to study the face detection and face recognition show that learning based algorithms achieves a remarkable performance to face the challenges in real-time systems.