This paper introduces a human-friendly interface based on hand gesture recognition so as to endow the users with the ability to control various home appliances naturally at various places without individual remote controller for each appliance. Through the developed system, the user first selects the device that he/she wants to control by pointing it with his/her hand. Then, the user can command the operation of desired functions via 10 predefined basic hand motion commands. In order to complement the errors in recognizing the user's pointing directions, we adopt the concept of feedback by which the user can adjust the pointing direction and confirm the recognition result. The developed system complements some inconveniences of conventional remote controllers specially by giving additional freedom to persons with movement deficits.