Development and validation of quantitative questionnaires
a prescriptive model
DOI:
https://doi.org/10.14488/1676-1901.v26i1.5483Keywords:
Research methodology, Quantitative research, Factor analysis, Data collection, Production EngineeringAbstract
In the field of Production Engineering, researchers frequently conduct studies that involve data collection from individuals within organizational settings. To this end, they often use research instruments that have not always undergone a rigorous construction process based on established development and validation procedures. This article aims to present a practical model, in the form of a prescriptive guide, to assist researchers in this field (and related areas) in designing Likert-scale-based quantitative questionnaires to capture workers’ perceptions, attitudes, and behaviors in organizational contexts. The proposed model was developed based on a literature review on the subject and comprises two processes: the development and subsequent validation of the research instrument. The use of three types of validation is proposed: content validation, reliability validation, and, finally, internal structure validation through the statistical technique of dimensional analysis. At the end of the article, an explanatory tutorial on how to perform dimensional analysis using the IBM SPSS® statistical software is provided. This article seeks to offer researchers in the field of Production Engineering a simplified yet methodologically framework for constructing data collection instruments.
Downloads
References
ABABNEH, O. M. How can human capital promote innovative behaviour? exploring the attitudinal dynamics of employee engagement and mental involvement. The International Journal of Entrepreneurship and Innovation, Londres, v. 26, n. 2, p. 108–122, 2025. DOI: https://doi.org/10.1177/14657503221123405
ALEXANDRE, N. M. C.; COLUCI, M. Z. O. Validade de conteúdo nos processos de construção e adaptação de instrumentos de medidas. Ciência & Saúde Coletiva, Rio de Janeiro, v. 16, n. 7, p. 3061–3068, 2011. DOI: https://doi.org/10.1590/S1413-81232011000800006
BÉLAND, S.; FALK, C. F. A Comparison of Modern and Popular Approaches to Calculating Reliability for Dichotomously Scored Items. Applied Psychological Measurement, Minneapolis, v. 46, n. 4, p. 321–337, 2022. DOI: https://doi.org/10.1177/01466216221084210
BORGES, L. de O.; ALVES-FILHO, A.; TAMAYO, Á. Motivação e significado do trabalho. In: SIQUEIRA, M. M. M. (org.). Medidas do Comportamento Organizacional: ferramentas de diagnóstico e de gestão. Porto Alegre: Artmed, 2008. p. 215–248.
CAMPOS, C. I. D.; PITOMBO, C. S.; DELHOMME, P.; QUINTANILHA, J. A. Comparative analysis of data reduction techniques for questionnaire validation using self-reported driver behaviors. Journal of Safety Research, Itasca, v. 73, p. 133–142, 2020. DOI: https://doi.org/10.1016/j.jsr.2020.02.004
DE BEER, L. T.; SCHAUFELI, W. B.; DE WITTE, H.; HAKANEN, J. J.; KALTIAINEN, J.; GLASER, J.; SEUBERT, C.; SHIMAZU, A.; BOSAK, J.; PROCHÁZKA, J.; KAJZAR, A.; CHRISTENSEN, M. Revisiting a global burnout score with the Burnout Assessment Tool (BAT) across nine country samples. European Journal of Psychological Assessment, Göttingen, p. 1–6, 2024. DOI: https://doi.org/10.1027/1015-5759/a000839
DOVAL, E.; VILADRICH, C.; ANGULO-BRUNET, A. Coefficient Alpha: The Resistance of a Classic. Psicothema, Oviedo, v. 1, n. 35, p. 5–20, 2023. DOI: https://doi.org/10.7334/psicothema2022.321
FIELD, A. Discovering Statistics Using IBM SPSS Statistics. London Thousand Oaks, California New Delhi Singapore: Sage Publications Ltd, 2024. 1144 p.
GREENACRE, M.; GROENEN, P. J. F.; HASTIE, T.; IODICE D’ENZA, A.; MARKOS, A.; TUZHILINA, E. Principal component analysis. Nature Reviews Methods Primers, Londres, v. 2, n. 100, 2022. DOI: https://doi.org/10.1038/s43586-022-00184-w
HADŽIBAJRAMOVIĆ, E.; SCHAUFELI, W.; DE WITTE, H. Shortening of the Burnout Assessment Tool (BAT)—from 23 to 12 items using content and Rasch analysis. BMC Public Health, Londres, v. 22, n. 560, p. 1-16, 2022. DOI: https://doi.org/10.1186/s12889-022-12946-y
HAIR JR., J.; BLACK, W.; BABIN, B.; ANDERSON, R. Multivariate Data Analysis. 8. ed. Andover: Cengage Learning, 2019. 813 p.
HUTZ, C. S. O que é avaliação psicológica: métodos, técnicas e testes. In: HUTZ, C. S.; BANDEIRA, D. R.; TRENTINI, C. M. (org.). Psicometria. Porto Alegre: Artmed, 2015. p. 11–21.
IBM. Categorical Principal Components Analysis (CATPCA). Software documentation - 31.0.0 change version. Armonk: IBM, 2026. Disponível em: https://www.ibm.com/support/knowledgecenter/en/SSLVMB_23.0.0/spss/categories/idh_cpca.html. Acesso em: 15 maio 2022.
LINTING, M.; VAN DER KOOIJ, A. Nonlinear principal components analysis with CATPCA: a tutorial. Journal of Personality Assessment, London, v. 94, n. 1, p. 12–25, 2012. DOI: https://doi.org/10.1080/00223891.2011.627965
LUPANO PERUGINI, M. L. Rasgos Positivos de La Tríada Luminosa como Predictores de Satisfacción y Performance Laboral. El Rol Mediador del Engagement. Revista psicodebate: psicología, cultura y sociedad, Buenos Aires, v. 24, n. 2, p. 63–76, 2024. DOI: https://doi.org/10.18682/pd.v24i2
MARÔCO, J. Análise Estatística com o SPSS Statistics. 8. ed. Pêro Pinheiro: ReportNumber, 2021. 1022 p.
MAY, D. R.; GILSON, R. L.; HARTER, L. M. The psychological conditions of meaningfulness, safety and availability and the engagement of the human spirit at work. Journal of Occupational and Organizational Psychology, Leics, v. 77, n. 1, p. 11–37, 2004. DOI: https://doi.org/10.1348/096317904322915892
MAZZETTI, G.; ROBLEDO, E.; VIGNOLI, M.; TOPA, G.; GUGLIELMI, D.; SCHAUFELI, W. B. Work engagement: a meta-analysis using the job demands-resources model. Psychological Reports, Thousand Oaks, v. 126, n. 3, p. 1069–1107, 2023. DOI: https://doi.org/10.1177/00332941211051988
MCKECHNIE, D.; FISHER, M. J. Considerations when examining the psychometric properties of measurement instruments used in health. Australian Journal of Advanced Nursing, Melbourne, v. 39, n. 2, 2022. DOI: https://doi.org/10.37464/2020.392.481
NORONHA, A. P. P.; REPPOLD, C. T.; BANDEIRA, D. R.; SANTOS, A. A. A. D. The Development of Psychological Assessment in Brazil and Current and Future Challenges. Psicologia: Teoria e Pesquisa, Brasília, v. 39, n. spe, p. e39nspe10, 2023. DOI: https://doi.org/10.1590/0102.3772e39nspe10.en
PACICO, J. C. Como é feito um teste? Produção de itens. In: HUTZ, C. S.; BANDEIRA, D. R.; TRENTINI, C. M. (org.). Psicometria. Porto Alegre: Artmed, 2015. p. 54–69.
PACICO, J. C.; HUTZ, C. S.; SCHNEIDER, A.; BANDEIRA, D. R. Validade. In: HUTZ, C. S.; BANDEIRA, D. R.; TRENTINI, C. M. (org.). Psicometria. Porto Alegre: Artmed, 2015. p. 70–83.
PASQUALI, L. Instrumentação no estudo das organizações: a utilização de escalas psicométricas. In: TAMAYO, Á.; BORGES-ANDRADE, J. E.; CODO, W. (org.). Trabalho, organizações e cultura. São Paulo: Cooperativa de Autores Associados, 1998. p. 75–82.
PASQUALI, L. Princípios de elaboração de escalas. In: GORENSTEIN, C.; WANG, Y.-P.; HUNGERBÜHLER, I. (org.). Instrumentos de avaliação em saúde mental. Porto Alegre: Artmed, 2016.
PASQUALI, L. Testes referentes a construto: teoria e modelo de construção. In: PASQUALI, L. (org.). Instrumentos psicológicos: manual prático de elaboração. Brasília: LabPAM/IBAPP, 1999. p. 37–72.
PASQUALI, L. Validade dos testes psicológicos: será possível reencontrar o caminho? Psicologia: Teoria e Pesquisa, Brasília, v. 23, n. número especial, p. 99–107, 2007. DOI: https://doi.org/10.1590/S0102-37722007000500019
PEREIRA, D. S.; FLORÊNCIO, R. S.; CESTARI, V. R. F.; MOREIRA, T. M. M. Vulnerability to physical inactivity: evidence of content validity and response processes. Revista Brasileira de Enfermagem, Brasília, v. 76, p. e20220563, 2023. DOI: https://doi.org/https://doi.org/10.1590/0034-7167-2022-0563
REDELINGHUYS, K.; MORGAN, B. Psychometric properties of the Burnout Assessment Tool across four countries. BMC Public Health, Londres, v. 23, n. 824, p. 1-14, 2023. DOI: https://doi.org/10.1186/s12889-023-15604-z
REVELLE, W.; CONDON, D. M. Reliability from α to ω: A tutorial. Psychological Assessment, Gottingen, v. 31, n. 12, p. 1395–1411, dez. 2019. DOI: https://doi.org/10.1037/pas0000754
ROGERS, P. Melhores Práticas para sua Análise Fatorial Exploratória: Tutorial no Factor. Revista de Administração Contemporânea, Rio de Janeiro, v. 26, p. e210085, 2022. DOI: https://doi.org/10.1590/1982-7849rac2022210085.por
RUENGVIRAYUDH, P.; BROOKS, G. P. Sample Size for Parallel Analysis and Not-So-Common Criteria for Dimensions in Factor Analysis:Modifying the Eigenvalue > 1 Kaiser Rule. General Linear Model Journal, DeKalb, v. 46, n. 1, p. 20–34, 2022. DOI: https://doi.org/10.31523/glmj.046001.002
SCHAUFELI, W.; SALANOVA, M.; GONZALEZ-ROMA, V.; BAKKER, A. The measurement of engagement and burnout: a two sample confirmatory factor analytic approach. Journal of Happiness Studies, Dordrecht, v. 3, n. 1, p. 71–92, 2002.
SINVAL, J.; VAZQUEZ, A. C. S.; HUTZ, C. S.; SCHAUFELI, W. B.; SILVA, S. Burnout Assessment Tool (BAT): validity evidence from Brazil and Portugal. International Journal of Environmental Research and Public Health, Basileia, v. 19, n. 3, p. 1–25, 25, 2022. DOI: https://doi.org/10.3390/ijerph19031344
TEIXEIRA, P. M. R. Dimensões do significado do trabalho e a constituição de perfis de trabalhadoras e trabalhadores brasileiros: relações com aspectos sociais, demográficos e de empregabilidade. 2024. 290 f. Tese (Doutorado em Engenharia de Produção) – Universidade de São Paulo, São Carlos, 2024. DOI: https://doi.org/10.11606/T.18.2024.tde-06022025-105327
UHER, J. What Are Constructs? Ontological Nature, Epistemological Challenges, Theoretical Foundations and Key Sources of Misunderstandings and Confusions. Psychological Inquiry, Abingdon, v. 34, n. 4, p. 280–290, 2023. DOI: https://doi.org/10.1080/1047840X.2023.2274384
WANG, C.; GUO, J.; MA, Y.; ZHENG, S. Kaiser Criterion in Factor Models. Acta Mathematica Sinica, English Series, Beijing, v. 41, n. 2, p. 547–552, 2025. DOI: https://doi.org/10.1007/s10114-025-3383-3
ZANON, C.; HAUCK FILHO, N. Fidedignidade. In: HUTZ, C. S.; BANDEIRA, D. R.; TRENTINI, C. M. (org.). Psicometria. Porto Alegre: Artmed, 2015. p. 84–95.
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Revista Produção Online
This work is licensed under a Creative Commons Attribution 4.0 International License.
The Journal reserves the right to make spelling and grammatical changes, aiming to keep a default language, respecting, however, the style of the authors.
The published work is responsibility of the (s) author (s), while the Revista Produção Online is only responsible for the evaluation of the paper. The Revista Produção Online is not responsible for any violations of Law No. 9.610 / 1998, the Copyright Act.
The journal allows the authors to keep the copyright of accepted articles, without restrictions
This work is licensed under a Creative Commons License .
