Volume 18, Issue 2 (7-2023)                   bjcp 2023, 18(2): 102-122 | Back to browse issues page

XML Persian Abstract Print

Research Limitations and Assessing Its Quality in the Field of Health Psychology: A Mixed-Methods Research
Razieh Esmaeili1 , Keyvan Salehi *2
1- University of Tehran, Tehran, Iran
2- Department of Methods, Educational Planning and Curriculum, Faculty of Psychology and Education, University of Tehran, Tehran, Iran , keyvansalehi@ut.ac.ir
Abstract:   (308 Views)
The study's limitations indicate weaknesses in the research design that were beyond the control of the researcher and may influence the results. Researchers have a responsibility to the scientific community to report these limitations fully and honestly. Therefore, elucidating the concept of research limitations is of significant importance. This study utilized a two-phase exploratory mixed-methods design. In Phase 1, a documentary method was conducted by systematically retrieving data from five academic databases (SID, Ganj IranDoc, Scopus, Web of Science, and PubMed). In Phase 2, a survey-based evaluation was performed to assess the reporting quality of limitations in scientific articles published in the Health Psychology journal during 2021–2022 (1401–1402 Persian calendar). From a pool of 40 retrieved articles, 21 documents were selected for detailed analysis using the PRISMA checklist criteria. Data was selected and analyzed using the Altheide's method. The findings showed that the concept of research limitations resulted in identifying two controllable and uncontrollable factors. Including the indicators related to the limitation criteria to limit the scope of the study, the inefficiency of the data collection tool, deficiency in collecting accurate data, small sample size, non-random sampling method, internal validity, external validity, and uncontrollability factors, including the limitation indicators to limit the scope of the study was the ineffectiveness of the data collection tool, lack of accurate data collection, small sample size, non-random sampling method, internal validity, external validity. The findings revealed that only 19% of the assessed articles reported their research limitations after identifying the evaluation indicators for research limitations, leaving 81% of the indicators unaddressed. This indicates widespread neglect among authors, educators, journals, and reviewers in articulating the nature and precise evaluation of research limitations. In light of the identified barriers and constraints, suggestions were made to enrich this crucial aspect of scientific research.
Keywords: Research Ethics, Health Psychology, Research Method, Research Delimitations, Research Limitations, Mixed Approach
Full-Text [PDF 1154 kb]   (94 Downloads)    
Type of Study: Research | Subject: General
Received: 2024/05/16 | Revised: 2024/04/9 | Accepted: 2025/05/29 | ePublished ahead of print: 2025/07/10 | Published: 2025/07/13
References
1. Sahar, [12.07.25 23:32] Abdollahzadeh, F., Kamel Tabbakh Farizani, S. R., Forghani, Y., Niazi Torshiz, M., & Abdollahzadeh, H. (2023). Comparing the Effectiveness of Cognitive Behavioral Therapy and Augmented Reality Technology on Physical Factors and Public Speaking Anxiety. Health Psychology, 12(46), 149-170. https://doi:0.30473/hpj.2023.64868.5598. (in persian)
2. Abu-Bader, S. H. (2021). Using statistical methods in social science research: With a complete SPSS guide. Oxford University Press, USA.
3. Adams, K. A., & McGuire, E. K. (2022). Research methods, statistics, and applications. Sage Publications.
4. Akanle, O., Ademuson, A. O., & Shittu, O. S. (2020). Scope and limitation of study in social research. Contemporary issues in social research, 105-114.
5. Ali Akbari, M., Hassanzadeh Hanoui, M., Alipor, A., & Bayat, N. (2023). The Effectiveness of Schema Therapy on Coping Styles in Rheumatoid Arthritis Patients. Health Psychology, 12(45), 147-162. https://doi:10.30473/hpj.2023.67051.5754. (in persian)
6. Aravind, P. G., & Kathirvel, S. (2024). Principles of public health research and writing. In Principles and Application of Evidence-based Public Health Practice (pp. 23-40). Academic Press. [DOI:10.1016/B978-0-323-95356-6.00011-2]
7. Asadollah Najafi, M., Aminjafari, B., & Marvi, M. (2023). The Effect of Group Self-Healing Training on Distress Tolerance, Emotional Reactivity and Anxiety in Women with Breast Cancer. Health Psychology, 12(47), 19-32. https://doi:0.30473/hpj.2024.66318.5692. (in persian)
8. Aslami, E., Malekzadeh, A., & Rajabi, F. (2023). Predicting Post-Traumatic Growth of Infertile Women based on Personality Traits, Mindfulness and Gender Role Attitudes. Health Psychology, 12(45), 113-128. https://doi:0.30473/hpj.2023.63349.5507 . (in persian)
9. Azari ghahfarrokhi, Z., ansari shahidi, M., & shahzamani, M. (2023). Efficacy of Family-Based Social Support Training on the Social Adjustment and Self-Care Behaviors of the Cardiac Patients with the Signs of Depression (After Open Surgery). Health Psychology, 12(45), 95-112. https://doi:0.30473/hpj.2023.62887.5476. (in persian)
10. bagheri, S., hatami, M., Rezaei-Jamalouei, H., & abbasi, M. (2023). Comparison of the Effectiveness of Cognitive and Behavioral Training based on Fatigue and Cognitive Self-Compassion on the Dimensions of Fatigue and Self-Criticism in Patients with Multiple Sclerosis. Health Psychology, 11(44), 7-30. https://doi:10.30473/hpj.2022.62077.5430. (in persian)
11. Ceresoli, M., Abu-Zidan, F. M., Staudenmayer, K. L., Catena, F., & Coccolini, F. (Eds.). (2022). Statistics and research methods for acute care and general surgeons. Springer. [DOI:10.1007/978-3-031-13818-8] []
12. Chung, K. C., Huynh, K. A., & Rohrich, R. J. (2019). Common fallacies in designing a research project: guidance principles. Plastic and Reconstructive Surgery, 144(5), 1247-1253. [DOI:10.1007/978-3-031-13818-8_9]
13. Coe, R., Waring, M., Hedges, L. V., & Ashley, L. D. (Eds.). (2021). Research methods and methodologies in education. Sage.
14. Cooksey, R. W. (2020). Illustrating statistical procedures: Finding meaning in quantitative data. Springer Nature. [DOI:10.1007/978-981-15-2537-7]
15. Cooper, H., Hedges, L. V., & Valentine, J. C. (2019). Potentials and limitations of research synthesis. The handbook of research synthesis and meta-analysis, 517-525. [DOI:10.7758/9781610448864.26]
16. Creswell, John W, and J. David Creswell. (2018). Research design: Qualitative, quantitative, and mixed methods approaches. Fifth Edition. London: SAGE Publications, Inc. Sahar, [12.07.25 23:32] Cristancho, S., Watling, C. J., & Lingard, L. A. (2021). Three principles for writing an effective qualitative results section. Focus on Health Professional Education: A Multi-Professional Journal, 22(3), 110-124. https://search.informit.org/doi/10.3316/informit.193479105981467 [DOI:10.11157/fohpe.v22i3.556]
17. de Oliveira Vargas, Mara Ambrosina, and Joel Rolim Mancia. 2019. The importance and earnest of the researcher in pointing out the study limitations. Revista Brasileira De Enfermagem 72 (4):832-833. [DOI:10.1590/0034-7167-2019-720402] [PMID]
18. DeBono, A. (2021). Research methods and statistics for the social sciences.
19. Education 8 (4):261-264. https://doi:0.1007/s40037-019-00530-x
20. Shirdel, M., Salehi, K., & Ghadirian, H. (2023). writing attractiveness in academic scientific writing: a phenomenological study. University Textbooks; Research and Writting, 27(52), 173-198. [DOI:10.30487/rwab.2023.1998733.1561 (in persian)]
21. Shirdel, M., Salehi, K., & Ghadirian, H. (2024). The System of Indicators for Assessing writing coherence in Behavioral Science Theses. Rooyesh, 13(8), 100-112. (in persian)
22. Soghari Hejazi, F., Parvizi, R., & khanjani, Z. (2023). The Effectiveness of Behavioral Activation Therapy on Cognitive Flexibility and Depression in Patients with a History of Cardiac Surgery. Health Psychology, 11(44), 153-166. https://doi:10.30473/hpj.2023.61505.5394. (in persian)
23. Sürücü, L., & Maslakçi, A. (2020). Validity and reliability in quantitative research. Business & Management Studies: An International Journal, 8(3), 2694-2726. [DOI:10.15295/bmij.v8i3.1540]
24. Tamannaifar, M. R., Mansourinik, A., & Ahmadpoursamani, S. (2023). Relationship between Personality Traits and Quality of Life in Heart Failure Patients: The Mediating Role of Self-Care Behaviors. Health Psychology, 12(47), 33-46. https://doi:10.30473/hpj.2024.64156.5552. (in persian)
25. Theofanidis, D., & Fountouki, A. (2018). Limitations and delimitations in the research process. Perioperative Nursing-Quarterly scientific, online official journal of GORNA, 7(3 September-December 2018), 155-163.
26. torkian valashani, S., latifi, Z., bagheri, N., & Soltanizadeh, M. (2023). The effect of self-healing training on spiritual well-being and positive and negative emotions in patients with multiple sclerosis. Health Psychology, 12(47), 89-104. https://doi:10.30473/hpj.2024.63756.5524. (in persian)
27. Wagge, J. R., Hurst, M. A., Brandt, M. J., Lazarevic, L. B., Legate, N., & Grahe, J. E. (2023). Teaching Research in Principle and in Practice: What Do Psychology Instructors Think of Research Projects in Their Courses?. Psychology Learning & Teaching, 22(1), 4-19. [DOI:10.1177/14757257221101942]
28. Walliman, N. (2021). Research methods: The basics. Routledge. [DOI:10.4324/9781003141693]
29. Weyant, E. (2022). Research Design: Qualitative, Quantitative, and Mixed Methods Approaches: by John W. Creswell and J. David Creswell, Los Angeles, CA: SAGE, 2018, 38.34, 304pp., ISBN: 978-1506386706.
30. Wheatley, D. (2021). Tracing Back Beyond the Text: Using Regressive Content Analysis to Study Journalistic Practices. Comunicación & Métodos, 3(1), 40-55. [DOI:10.35951/v3i1.93]
31. zarieh, S., Naderi, F., Bakhtiarpoor, S., & askari, P. (2023). The effectiveness of Emotion-Focused Therapy in Cognitive Emotion Regulation and Ego Strength among Cardiovascular Patients with Obesity. Health Psychology, 12(47), 119-132.
32. doi: https://10.30473/hpj.2024.66573.5712 (in persian)
33. Frozanfar, F., jabal ameli, S., Soltanizadeh, M., emami, S. M. H., & ansari shahidi, M. (2023). Model of Predicting Psychosocial Adaptation to Disease According to Health-Promoting Behaviors with the Mediation Role of Self-Compassion in the Patients with Irritable Bowel Syndrome. Health Psychology, 12(45), 163-179. Sahar, [12.07.25 23:32] https://doi:0.30473/hpj.2023.62915.5479. (in persian)
34. Głowacka, E. (2021). Assessment of the quality of digital libraries based on the principles of information architecture. Research plan. Digital Library Perspectives, 37(4), 416-428. [DOI:10.1108/DLP-10-2020-0104]
35. Gorvine, Ben, Karl Rosengren, Lisa Stein, and Kevin Biolsi. (2018). Research methods: from theory to practice. New York: Oxford University Press. https://ui.adsabs.harvard.edu/link_gateway/2023arXiv231012019P/doi:10.48550/arXiv.2310.12019
36. Gotby, S., & Goli, Z. S. (2023). The Effectiveness of Meta cognitive Therapy in Thought Control Strategies and Reducing Anxiety in Women with Gestational Diabetes. Health Psychology, 11(44), 105-120. https://doi:10.30473/hpj.2023.60787.5329. (in persian)
37. Greener, S. (2018). Research limitations: the need for honesty and common sense. Interactive Learning Environments, 26(5), 567-568. [DOI:10.1080/10494820.2018.1486785]
38. Greener, Sue. (2018). Research limitations: the need for honesty and common sense. Interactive Learning Environments 26 (5):567-568. [DOI:10.1080/10494820.2018.1486785]
39. GRS Writing Group. (2018). Research Limitations. University of Western Australia. http://www.postgraduate.
40. hashemi, M., frozandeh, E., 10.26182/5dbba1d68cc28 & heydarpour, M. (2023). Efficacy of Acceptance and Commitment Therapy on the Emotional Distress and Commitment to Treatment in Diabetic Patients with Depression. Health Psychology, 12(46), 111-130. doi: 10.30473/hpj.2023.64312.5561. (in persian) []
41. Hayes, A. F. (2020). Statistical methods for communication science. Routledge. [DOI:10.4324/9781410613707]
42. Hodges, T. S. (2023). The WRITE Principles for Developing a Research‐to‐Practice Cycle Professional Development. The Reading Teacher, 76(5), 545-557. [DOI:10.1002/trtr.2158]
43. Jalali, A., Pourhosein, R., Alipour, A., & Afrooz, G. A. (2023). Comparing the Effectiveness of Stress Management Method based on Cognitive Behavioral Approach and Self-Care Training and their Combination on the Quality of Life in People with Type 2 Diabetes. Health Psychology, 11(44), 167-188. https://doi:10.30473/hpj.2023.65106.5615. (in persian)
44. Jalali, M., & pourahmadi, E. (2023). The Effectiveness of Neurofeedback on Pregnancy Anxiety and Prenatal Depression in Pregnant Women during the COVID-19: A Single-Case Research with Multiple Baseline Design. Health Psychology, 12(47), 1-18. https://doi:10.30473/hpj.2024.64013.5544. (in persian)
45. Kargar, K., Vaziri, S., Lotfi Kashani, F., Nasri, M., & Shahabizadeh, F. (2023). Efficacy of Unified Trans-Diagnostic Treatment on the Emotional Expression and Sexual Function in Infertile Women's. Health Psychology, 12(46), 23-40. https://doi:10.30473/hpj.2023.64543.5580. (in persian)
46. Kazemi, M., Agah heris, M., Jalali, M., & kordmirza, E. (2023). Comparison of the Effectiveness of Autogenic Training and Progressive Muscle Relaxation on Pain and Cardiac Enzymes in Women with Chest Pain. Health Psychology, 12(46), 131-148. https://doi:10.30473/hpj.2023.66350.5696. (in persian)
47. Kent, R. (2020). Data construction and data analysis for survey research. Bloomsbury Publishing.
48. Lechien, J. R., Rodriguez Ruiz, A., Dequanter, D., Bobin, F., Mouawad, F., Muls, V., ... & Saussez, S. (2020). Validity and reliability of the reflux sign assessment. Annals of Otology, Rhinology & Laryngology, 129(4), 313-325. [DOI:10.1177/0003489419888947] [PMID]
49. Levitt, H. M., Morrill, Z., Collins, K. M., & Rizo, J. L. (2021). The methodological integrity of critical qualitative research: Principles to support design and research review. Journal of Counseling Psychology, 68(3), 357. https://psycnet.apa.org/doi/10.1037/cou0000523 Sahar, [12.07.25 23:32] [DOI:10.1088/1742-6596/1823/1/012021]
50. Shahriari, P., & Rasuli, B. (2020). No study is ever perfectly flawless: Exploring research limitations in theses and dissertations of Iranian higher education institutes. Iranian Journal of Information Processing and Management, 36(1), 95-126. [DOI:10.35050/JIPM010.2020.015]
51. Shirdel, M., Salehi, K., & Ghadirian, H. (2023). Identifying the criteria and indicators of authentic writing in academic scientific writing. University Textbooks; Research and Writting, 26(51), 1-24. Sahar, [12.07.25 23:32] https://doi.org/10.1037/cou0000523 [DOI:10.30487/rwab.2023.1987891.1548 (in persian)] [PMID]
52. Liamputtong, P. (2020). Qualitative research methods.
53. Lingard, Lorelei. 2015. The art of limitations. Perspectives on medical education 4 (3):136-137. [DOI:10.1007/S40037-015-0181-0] [PMID] []
54. Maciak, M., Pešta, M., & Schindler, M. (2020). Analytical Methods in Statistics. Springer International Publishing. [DOI:10.1007/978-3-030-48814-7]
55. Matanda, E. (2022). Research Methods and Statistics for Cross-Cutting Research: Handbook for Multidisciplinary Research. African Books Collective. [DOI:10.2307/j.ctv2z6qds4]
56. Meeker, W. Q., Escobar, L. A., & Pascual, F. G. (2022). Statistical methods for reliability data. John Wiley & Sons.
57. Mirdrikvand, F. (2023). Structural Model of Pain Perception in Patients With Refractory Joint Pain Based on Personality Traits and Early Maladaptive Schemas: The Moderating Role of Social Support. Health Psychology, 12(46), 41-62. https://doi:10.30473/hpj.2023.63629.5516. (in persian)
58. Mishra, S. B., & Alok, S. (2022). Handbook of research methodology. Educreation publishing.
59. Mohr, D. L., Wilson, W. J., & Freund, R. J. (2021). Statistical methods. Academic Press.
60. nikoravesk, M., alizadeh, H., rezaei, S., & dastjerdi kazemi, M. (2023). Designing Adlerian play therapy program and evaluating its effect on social interest in children with cancer. Health Psychology, 12(47), 47-58. https://doi:10.30473/hpj.2024.65719.5667. (in persian)
61. Oh, D. M., & Pyrczak, F. (2023). Making sense of statistics: A conceptual overview. Routledge. [DOI:10.4324/9781003299356]
62. Paknahad, N., & saffarinia, M. (2023). The Effectiveness of Mindfulness-Based Stress Reduction on Perceived Stress, Negative Mood, Self-Efficacy and Pain Perception in Patients with Rheumatoid Arthritis. Health Psychology, 12(45), 129-146.
63. https://doi:10.30473/hpj.2023.53231.4838. (in persian)
64. Pourmohammad ghouchani, K., mandanizade safi, S., & noori, J. (2023). The Effectiveness of Positive Psychotherapy on Alexithymia and Recurrent Negative Thoughts in Cardiovascular Patients. Health Psychology, 12(45), 7-20.
65. https://doi:10.30473/hpj.2023.61537.5396. (in persian)
66. Price, James H., and Judy Murnan. 2004. Research Limitations and the Necessity of Reporting Them. American Journal of Health Education 35 (2):66-67. [DOI:10.1080/19325037.2004.10603611]
67. Ramezan khani, M., & Golpour, R. (2023). The Relationship between Meta cognitive Beliefs and Self-Compassion with Nutritional Problems of Patients with Diabetes. Health Psychology, 12(46), 63-76. https://doi:10.30473/hpj.2023.62528.5454 (in persian)
68. Rassel, G., Leland, S., Mohr, Z., & O'Sullivan, E. (2020). Research methods for public administrators. Routledge. [DOI:10.4324/9780429319860]
69. Ross, P. T., & Bibler Zaidi, N. L. (2019). Limited by our limitations. Perspectives on medical education, 8, 261-264. [DOI:10.1007/S40037-019-00530-X] [PMID] []
70. Rubin, Allen, & Earl R Babbie. 2016. Research Methods for Social Work. Boston: Cengage Learning.
71. Salas-Blas, E. (2019). Understanding the Limitations of Research. Propósitos y Representaciones, 7 (SPE), 1414-1432. http://dx.doi.org/10.20511/pyr2019.v7nSPE.424b
72. Salehi, K., & Golafshani, N. (2010). Commentary: Using mixed methods in research studies: An opportunity with its challenges. International journal of multiple research approaches, 4(3), 186-191.‏ [DOI:10.5172/mra.2010.4.3.186]
73. Setiawati, E. (2021, March). Training Class Action Research, School Action Research and Writing of Scientific Articles for Teachers and Principals of Basic School in Banyuurip Purworejo. In Journal of Physics: Conference Series (Vol. 1823, No. 1, p. 012021). IOP Publishing. [DOI:10.1088/1742-6596/1823/1/012021]
Send email to the article author

Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.