The health informatics research community has been undertaking work at the organization-technology intersection for some time now. However there is no one place in the literature which presents a rigorously-defined evaluation framework for use by practitioners and researchers seeking to assess the impact of information and communication technologies on organizational processes and outcomes. There are two main challenges. One is to conceptualize the design features of such an evaluation framework. The second is to specify what data will be gathered and how. This paper aims to address each of these problems.