Pries-Heje et al. (2008) Strategies for Design Science Research Evaluation

Pries-Heje, Jan and Baskerville, Richard L. and Venable, John R.

Abstract

Seminal works in the application of design science research (DSR) in IS emphasize the importance of evaluation. However, discussion of evaluation activities and methods is limited and typically assumes an ex post perspective, in which evaluation occurs after the construction of an IS artifact. Such perspectives can assume that the evaluation is an empirical process and its methods can be selected in the same way as empirical research methods. In this paper, we analyze a broader range of evaluation strategies, which includes ex ante (prior to artifact construction) evaluation. This broader view is developed as a strategic DSR evaluation framework, which expands evaluation choices for IS DSR researchers, and also adds emphasis to strategies for evaluating design processes in addition to design products, using well-known quality criteria as an important asset. The framework encompasses both ex ante and ex post orientations as well as naturalistic settings (e.g., case studies) and artificial settings (e.g., lab experiments) for DSR evaluation. The framework proposed offers a strategic view of DSR evaluation that is useful in analyzing published studies, and also in surfacing the evaluation opportunities that present themselves to IS DSR researchers.

Citation Jan Pries-Heje, Richard L. Baskerville, John R. Venable (2008). Strategies for Design Science Research Evaluation. European Conference on Information Systems (ECIS), vol. Paper 87, pp. 1–13. DOI

BibTex entry for this article:

BibTex entry for this article:

@article{pries-heje2008strategies,
author = {Pries-Heje, Jan and Baskerville, Richard L. and Venable, John R.},
doi = {10.1177/1933719108329095},
isbn = {9780955315923},
issn = {19337205},
journal = {European Conference on Information Systems (ECIS)},
pages = {1--13},
pmid = {19208789},
title = {{Strategies for Design Science Research Evaluation}},
volume = {Paper 87},
year = {2008}
}

Key ideas

Keywords:

Design Science, Design Science Research, Information Systems Evaluation, Research Criteria, Research Methodology

Print/export