When entering a system, an agent should be aware of the obligations and prohibitions (collectively norms) that affect it. Existing solutions to this norm identification problem make use of observations of either norm compliant, or norm violating, behaviour. Thus, they assume an extreme situation where norms are typically violated, or complied with. In this paper we propose a Bayesian approach to norm identification which operates by learning from both norm compliant and norm violating behaviour. We evaluate our approach's effectiveness empirically and compare its accuracy to existing approaches. By utilising both types of behaviour, we not only overcome a major limitation of such approaches, but also obtain improved performance over the state of the art, allowing norms to be learned with fewer observations.