Seddon & Scheepers (2012) Towards the Improved Treatment of Generalization of Knowledge Claims in IS Resea...

Abstract

Towards the Improved Treatment of Generalization of Knowledge Claims in IS Research: Drawing General Conclusions from Samples

This paper presents a framework for justifying generalization in information systems (IS) research. First, using evidence from an analysis of two leading IS journals, we show that the treatment of generalization in many empirical papers in leading IS research journals is unsatisfactory. Many quantitative studies need clearer definition of populations and more discussion of the extent to which significant statistics and use of non-probability sampling affect support for their knowledge claims. Many qualitative studies need more discussion of boundary conditions for their sample-based general knowledge claims. Second, the proposed new framework is presented. It defines eight alternative logical pathways for justifying generalizations in IS research. Three key concepts underpinning the framework are the need for researcher judgment when making any claim about the likely truth of sample-based knowledge claims in other settings; the importance of sample representativeness and its assessment in terms of the knowledge claim of interest; and the desirability of integrating a study's general knowledge claims with those from prior research. Finally, we show how the framework may be applied by researchers and reviewers. Observing the pathways in the framework has potential to improve both research rigour and practical relevance for IS research. {\textcopyright

Citation Peter B. Seddon, Rens Scheepers (2012). Towards the Improved Treatment of Generalization of Knowledge Claims in IS Research: Drawing General Conclusions from Samples. European Journal of Information Systems, vol. 21 no. 1, pp. 6–21. URL

BibTex entry for this article:

BibTex entry for this article:

@article{seddon2012towards,
author = {Seddon, Peter B. and Scheepers, Rens},
doi = {10.1057/ejis.2011.9},
isbn = {0960-085X},
issn = {0960-085X},
journal = {European Journal of Information Systems},
number = {1},
pages = {6--21},
pmid = {913016854},
publisher = {Nature Publishing Group},
title = {{Towards the Improved Treatment of Generalization of Knowledge Claims in IS Research: Drawing General Conclusions from Samples}},
url = {http://dx.doi.org/10.1057/ejis.2011.9},
volume = {21},
year = {2012}
}

Key ideas

Keywords:

INF6001W, bayesian statistics, external validity, other-settings generalization, p -value, research methodology, sample

Print/export