Measuring the Success of Changes to Existing Business Intelligence Solutions to Improve Business Intelligence Reporting

Abstract. To objectively evaluate the success of alterations to existing Business Intelligence (BI) environments, we need to a way to compare measures from al-tered and unaltered versions of applications. The focus of this paper is on produc-ing an evaluation tool which can be used to measure the success of amendments or updates made to existing BI solutions to support improved BI reporting. We define what we understand by success in this context, we elicit appropriate clus-ters of measurements together with the factors to be used for measuring success, and we develop an evaluation tool to be used by relevant stakeholders to measure success. We validate the evaluation tool with relevant domain experts and key us-ers and make suggestions for future work

note that this workshop paper later become an invited paper for the Journal of Management Analytics