Academia.eduAcademia.edu

Validity Research

description460 papers
group15,363 followers
lightbulbAbout this topic
Validity research is the systematic investigation of the degree to which a test, measurement, or assessment accurately measures what it purports to measure. It encompasses various types of validity, including content, construct, and criterion-related validity, and is essential for ensuring the reliability and applicability of research findings in various fields.
lightbulbAbout this topic
Validity research is the systematic investigation of the degree to which a test, measurement, or assessment accurately measures what it purports to measure. It encompasses various types of validity, including content, construct, and criterion-related validity, and is essential for ensuring the reliability and applicability of research findings in various fields.

Key research themes

1. How can reliability and validity be rigorously established and interpreted across qualitative research paradigms?

This research theme focuses on the adaptation, redefinition, and operationalization of traditional reliability and validity concepts within qualitative inquiry. Given the philosophical divergence from positivist quantitative paradigms, there is a critical focus on developing verification strategies that are integral and self-correcting during qualitative research to ensure rigor. Moreover, researchers investigate validation criteria suited to qualitative designs and address how validity practices can be communicated effectively to enhance the trustworthiness and impact of qualitative studies, particularly in fields like psychology and biomedical research.

Key finding: This paper argues for reclaiming reliability and validity as central concepts in qualitative research by implementing verification strategies *during* the research process rather than post hoc evaluations of trustworthiness.... Read more
Key finding: Through systematic review of qualitative research in school psychology journals, this study identifies 15 distinct strategies to enhance validity, emphasizing how these are variably operationalized depending on context. It... Read more
Key finding: This article provides a conceptual clarification by redefining reliability, validity, and triangulation to fit qualitative research’s multiple ways of establishing truth. It synthesizes the reconceptualization of these terms... Read more
Key finding: This protocol outlines a multi-method approach to systematically review, analyze, and develop practical recommendations for assuring quality and validity in qualitative biomedical research. It critically addresses ongoing... Read more

2. What are the comprehensive frameworks and methodologies for validity assessment in quantitative and mixed-method measurement instruments?

This research theme addresses the theoretical foundations and practical applications of validity and reliability testing in quantitative instruments and mixed-method measures such as patient-reported outcome measures (PROMs). It covers a broad spectrum of validity aspects—from construct and content validity to criterion, internal, and external validity—as well as methodological innovations including argument-based validation, content validity quantification, meta-analytic perspectives, and systematic use of expert panels. The focus is on establishing robust psychometric evidence to support valid interpretations and uses of instruments in real-world decisions across education, health, and social sciences.

Key finding: This paper provides a detailed exposition of reliability estimations (including test-retest, internal consistency, inter-rater) and validity types (internal, external, content, construct, criterion, factorial, discriminant),... Read more
Key finding: This narrative review articulates a rigorous, multi-stage content validation process critical for psychometric instrument development, especially in complex constructs within social and administrative pharmacy. It... Read more
Key finding: This paper applies contemporary validity theory, rooted in Standards for Psychological and Educational Testing, to the development and validation of PROMs. It advocates moving beyond classical psychometrics towards... Read more
Key finding: This work clarifies conceptual confusion around validity and reliability by tracing their history and elaborating their foundational roles in both instrument development and research methods. It discusses challenges in... Read more

3. How can validity be systematically defined, operationalized, and integrated in specialized research methodologies such as design science, case study, and metaevaluation?

This theme investigates how validity is conceptualized and operationalized across specialized research approaches that do not neatly fit traditional quantitative or qualitative paradigms. It covers the establishment of validity frameworks tailored for artifact-based design science research, postgraduate case study methodologies, and evaluation science through metaevaluation techniques. The focus is on creating domain-specific validity models, checklists, and protocols that ensure rigor, enable systematic validation of knowledge claims, and provide actionable guidance for researchers and evaluators in diverse applied contexts.

Key finding: This paper articulates the Design Science Validity Framework, defining validity types (criterion, causal, context) and subtypes specific to design science research. It provides a systematic process model to help researchers... Read more
by Şaban Berk and 
1 more
Key finding: This article exemplifies a metaevaluation process for assessing the quality of a program evaluation using four standards (utility, feasibility, propriety, accuracy), combining qualitative and quantitative methods. It... Read more
Key finding: This integrative review critically analyzes validation methods used in nursing research, emphasizing content, construct, and criterion validity alongside common reliance on Cronbach’s alpha for reliability. It identifies... Read more
Key finding: This study developed a validated checklist targeting the minimum methodological quality items necessary in observational studies, providing evidence of content validity and intercoder reliability through expert panel review... Read more

All papers in Validity Research

This paper discusses the perceptions of secondary school teachers in Bangladesh regarding the selection of English teaching materials. The opinions of Bangladeshi secondary school teachers about the choice of English teaching resources... more
This paper discusses the perceptions of secondary school teachers in Bangladesh regarding the selection of English teaching materials. The opinions of Bangladeshi secondary school teachers about the choice of English teaching resources... more
The growing interdisciplinary research field of psycholinguistics is in constant need of new and up-to-date tools which will allow researchers to answer complex questions, but also expand on languages other than English, which dominates... more
The reliability of the instrument was re-established using the 2-PLM generalized partial credit models of IRT framework through the item information function. The items gives high amount of information in assessing the theta level of... more
The present research aims to build and apply the Repetitive Thinking Scale among the students of the Faculties of Education for Humanities and Pure Sciences. The research sample consisted of (400) male and female students who were... more
This paper offers a set of principles-beyond item hygiene issues-to apply in item development and item evaluation during the test development process that focuses on the substantive content of items and their ability to elicit evidence of... more
This study investigates the viability of the new Low-Bar Item Draft Acceptability Tool (LBIDAT) to assess the quality of earlystage item drafts produced by AIG/AQG. These tools address overlooked cognitive and content traits, offering a... more
Educational measurement rests on a foundational assumption that is rarely interrogated: unidimensionality. Unlike many assumptions, this one is not hidden—practitioners know they report unidimensional results. What goes unacknowledged are... more
Item logic—the theory of action underlying an assessment item, connecting item design to targeted cognition through the cognitive paths it prompts in test takers—has always been present in content development practice, but has remained... more
Item alignment is the heart of test validation, yet the micro-level judgments that determine whether individual items actually align to their assessment targets remain a largely unexamined black box in the literature. Existing alignment... more
Makalah ini membahas konsep, tujuan, serta penerapan teknik pengambilan sampel sebagai bagian penting dalam metodologi penelitian. Ketika populasi terlalu besar atau tidak memungkinkan untuk diteliti secara keseluruhan, teknik sampling... more
Puji syukur penulis haturkan ke hadirat Allah subhanahuwata'ala, Yang Maha Pengasih lagi Maha Penyayang karena berkat rahmat dan karunia-nya penulis dapat menyelesaikan tugas makalah pada mata kuliah Metodologi Penelitian dengan judul... more
Puji syukur kehadirat Tuhan Yang Maha Esa atas segala limpahan rahmat dan karunia-Nya, sehingga makalah berjudul "Teknik Pengambilan Sampel" ini dapat diselesaikan dengan baik untuk memenuhi tugas mata kuliah Metodologi Penelitian.... more
This paper presents a forensic evaluation of four commercially available large language models (LLMs), Gemini (Google DeepMind), ChatGPT (OpenAI), Claude (Anthropic), and Grok (xAI), tasked with fact-checking a single source article on... more
Objective: This paper builds on the ipsatisation technique outlined by Bartram (1996) to explore validity in the prediction of performance from personality variables. Bartram (2007) found that observed validity could be increased through... more
This paper has investigated the extent to which the Joint Admission and Matriculation Board’s (JAMB) Unified Tertiary Matriculation Examination (UTME) and Kaduna State University Post Unified Tertiary Matriculation Examination (PUTME) are... more
Purpose NeuroTouch is a virtual reality (VR) simulator developed for neurosurgical skill training. Validation demonstrating that the system is useful and reliable is required for formal adoption into training curriculums. Face and content... more
Objetivo: validar la capacidad de la prueba Montreal Cognitive Assessment test (MoCA) para identificar deterioro cognitivo y comparar los resultados con el gold standard Mini-Mental State Examination test (MMSE). Metodología: estudio de... more
This study aimed to determine the predictive relationship between admission academic abilities and subsequent undergraduates' academic achievement in Nigeria. This research adopted an ex post facto descriptive design. The total population... more
This study investigated the Predictive validity of Unified Tertiary Matriculation Examinations (UTME) scores on Academic performance of 100 level students of the University of Ibadan. The data used for this study was collected from the... more
Experimental treatment, experimental and control group, placebo, research variables, research validity. Research design is the conceptual structure within which research is conducted. It consists of the blueprint for the collection,... more
Objectives: The goal of this work was to compare ways of coping with stress used by women after preterm delivery and term delivery, as well as to determine possible connection between hopelessness and ways of coping with stress in these... more
The goal of this work was to compare ways of coping with stress used by women after preterm delivery and term delivery, as well as to determine possible connection between hopelessness and ways of coping with stress in these two groups.... more
by Rey Ty
Issues arise when checks, for accuracy and dependability are neglected. These issues encompass bias, opinions of the author, misinterpretation, lack of credibility and unreliable deductions all of which bear weight on research ethics by... more
Family functioning profoundly influences individual psychological resilience and well-being. This research sought to examine the psychometric properties, including validity, reliability, and standardization of the Persian family... more
deðerlendirmek için test-tekrar test yapýlmýþ ve her iki uygulama arasýnda fark olmadýðý belirlenmiþtir (p>0,05). Sonuç: Bu çalýþmada, "Hemþirelik Ýþ Ýndeksi-Hemþirelik Çalýþma Ortamýný Deðerlendirme Ölçeði"nin Türkçe formunun, ülkemizde... more
This book explores the vital role of translation in language teaching, emphasizing its power to connect language, culture, and identity. It begins by examining how translation serves as a bridge for understanding and a lens for deeper... more
This policy research paper examines current ideas for curriculum reform in Bangladesh, with a focus on the multilingual and sports-integrated education model associated with Tarique Rahman, the Acting Chairman of the Bangladesh... more
This study aimed to develop and validate a questionnaire on Malaysian students' knowledge and belief toward breast cancer and breast cancer screening. A cross sectional study was conducted among 792 female undergraduate students in... more
Download research papers for free!