The COVID-19 pandemic has caused millions of infections and deaths worldwide in an ongoing pandemic. With the passage of time, several variants of this virus have surfaced. Machine learning methods and algorithms have been very useful in understanding the virus and its implications so far. In this paper, we have studied a set of novelty detection algorithms and applied it to the problem of detecting COVID-19 variants. Our results show accuracies of 79.64% and 82.43% on the B.1.1.7 and B.1.351 variants respectively on ProtVec unaligned COVID-19 spike protein sequences using One Class SVM with fine-tuned parameters. We believe that a system for automated and timely detection of variants will help countries formulate mitigation measures and study remedies in terms of medicines and vaccines that can protect against the new variants.