The European PALANTE project aims to improve patient empowerment. The Austrian contribution to the PALANTE objectives is the personal, electronic Xray-Record “eRöntgenpass”, which has been available to the public since October 2014. The eXray-Record is integrated into the patient portal of the Styrian Hospital Cooperation KAGes and can accesses data of recent radiological examinations which were carried out in KAGes hospitals. The main goal is to provide necessary information on the personal radiological exposure to allow for informed decisions of patients, when discussing diagnostic alternatives with health care providers. This paper describes the multi-step process of setting up an evaluation for these goals which can be adapted to other online portals for accessing medical data. Pre-tests showed that the integration of the evaluation process from the beginning of the project has led to a more concise evaluation method which is still able to produce relevant data for assessing the project objectives. This emphasizes the necessity of an integrated evaluation process from the beginning of portal development in contrast to an evaluation task at the end of the development.