Unsupervised feature selection is very important in the document clustering process. This paper presents the empirical research on feature selection as well as clustering methods and feature representation suitability for Lithuanian and Russian document clustering.