Intelligent Environments are supposed to act proactively anticipating the user's needs and preferences in order to provide effective support. Therefore, the capability of an Intelligent Environment to learn user's habits and common behaviors becomes an important step towards allowing an environment to provide such personalized services. In this chapter we explain and exemplify the importance of detecting patterns of behavior, we propose a system which learns patterns of behavior and also a complementary interaction system, based on speech recognition, which facilitates the use of such patterns in real applications.