Outcome Measurement of Counseling Interventions: A Data-Driven Approach to Assessing the Effectiveness of Therapy Programs

Fauzi Aldina (1), Lusiana Rahmadani Putri (2), Deng Jiao (3)
(1) Universitas Jabal Ghafur, Indonesia,
(2) Universitas Islam Negeri Mahmud Yunus Batusangkar, Indonesia,
(3) Universiti Sains Malaysia, Malaysia

Abstract

Measuring the effectiveness of counseling interventions is essential for ensuring the quality and impact of therapy programs. However, assessing therapeutic outcomes can be challenging due to the subjective nature of mental health improvements and the diversity of therapeutic approaches. A data-driven approach offers an opportunity to quantitatively evaluate the effectiveness of these programs, enabling a more objective assessment of therapy outcomes. This study aims to develop and implement a data-driven model for measuring the outcomes of counseling interventions. The goal is to provide a structured and reliable method to assess the effectiveness of therapy programs across various mental health conditions. A mixed-methods approach was used, incorporating both quantitative and qualitative data. Quantitative data were collected using standardized mental health assessment tools such as the Depression Anxiety Stress Scales (DASS) and the General Health Questionnaire (GHQ) to track changes in clients' mental health over time. Additionally, qualitative data from client feedback and therapist evaluations were analyzed using thematic analysis to capture subjective experiences. Statistical analysis was performed to evaluate the overall effectiveness of the interventions. The data-driven approach demonstrated significant improvements in mental health outcomes across various counseling interventions. Clients reported reductions in symptoms of depression, anxiety, and stress, with quantitative scores showing consistent improvements. Qualitative feedback further supported these findings, with clients highlighting increased emotional resilience and coping strategies as key benefits of the therapy programs. A data-driven approach to measuring counseling outcomes provides a reliable and comprehensive way to assess the effectiveness of therapy interventions. This model can be used to improve the quality of mental health services and guide the development of more effective therapeutic strategies.

Full text article

Generated from XML file

References

Agazzi, H., Soca Lozano, S., & Hernandez, M. (2023). Low Treatment Fidelity as an Indication to Switch Interventions: Pivoting From Child-Parent Psychotherapy to Parent-Child Interaction Therapy for Early Childhood Trauma. Clinical Case Studies, 22(2), 192–208. Scopus. https://doi.org/10.1177/15346501221124980

Aggarwal, K., Ravi, R., & Yerraguntla, K. (2024). Self-esteem among Individuals with Hearing Loss: A Systematic Review. Indian Journal of Otolaryngology and Head and Neck Surgery, 76(1), 314–321. Scopus. https://doi.org/10.1007/s12070-023-04153-x

Alon, N., Macrynikola, N., Jester, D. J., Keshavan, M., Reynolds, C. F., Saxena, S., Thomas, M. L., Torous, J., & Jeste, D. V. (2024). Social determinants of mental health in major depressive disorder: Umbrella review of 26 meta-analyses and systematic reviews. Psychiatry Research, 335. Scopus. https://doi.org/10.1016/j.psychres.2024.115854

Aron, E., Londoño Tobón, A., Finelli, J., & Romanowicz, M. (2024). Serving Families Where They Live: Supporting Multigenerational Health During Infancy and Early Childhood Through Community-centered Approaches. Child and Adolescent Psychiatric Clinics of North America, 33(3), 331–342. Scopus. https://doi.org/10.1016/j.chc.2024.03.007

Arthur, A., McDevitt, M., Rooney, R. M., MacLeod, A., Kane, R. T., Tonta, K., McMillan, K., Peckover, J., & Baughman, N. (2023). Short-term effects of the “I Spy Feelings” program on emotion regulation in 5- to 6-year-old children. Frontiers in Psychology, 14. Scopus. https://doi.org/10.3389/fpsyg.2023.1016521

Bailey, S., Newton, N., Perry, Y., Grummitt, L., Goldbach, J., & Barrett, E. (2024). It’s time for change: Inequities and determinants of health-related quality of life among gender and sexually diverse young people in Australia. Quality of Life Research, 33(6), 1647–1662. Scopus. https://doi.org/10.1007/s11136-024-03633-z

Bechdolf, A., Hanser, S., Baumgardt, J., Brose, A., Jäckel, D., Döring, S., Holzner, L., Aliakbari, N., von Hardenberg, L., Shmuilovich, O., Gencaggi, D., Schellong, M., Izat, Y., Leopold, S., Ituarte, B. P., & Leopold, K. (2024). Soulspace: Integrated youth mental health care in Berlin, Germany—An introduction to the program and a description of its users. Early Intervention in Psychiatry, 18(7), 571–577. Scopus. https://doi.org/10.1111/eip.13522

Bhimavarapu, U. (2024). Stacked artificial neural network to predict the mental illness during the COVID-19 pandemic. European Archives of Psychiatry and Clinical Neuroscience. Scopus. https://doi.org/10.1007/s00406-024-01799-8

Burkhardt, T., Huang, L. A., Herriott, A., Pacheco-Applegate, A., & Spielberger, J. (2023). Strengthening Home Visitor Practice Through an Embedded Model of Infant and Early Childhood Mental Health Consultation. Prevention Science, 24(1), 105–114. Scopus. https://doi.org/10.1007/s11121-022-01461-6

Cao, H., Zhou, N., Buehler, C., Li, X., Liang, Y., & Chen, Y. (2024). Mothers’ work-to-family conflict, depressive symptoms, and parental role functioning: A five-wave, cross-lagged panel model from infancy through middle childhood. Family Relations, 73(2), 1178–1200. Scopus. https://doi.org/10.1111/fare.12931

Cardenas, P., Ásgeirsdóttir, B. B., Sam, D. L., & Doná, G. (2023). Stressful life events, psychological symptoms, and social support of children and young asylum-seekers in Iceland. Scandinavian Journal of Public Health, 51(3), 483–489. Scopus. https://doi.org/10.1177/14034948221142080

Chawner, S. J. R. A., Evans, A., Williams, N., Owen, M. J., Hall, J., van den Bree, M. B. M., Wolstencroft, J., Skuse, D., & Raymond, F. L. (2023). Sleep disturbance as a transdiagnostic marker of psychiatric risk in children with neurodevelopmental risk genetic conditions. Translational Psychiatry, 13(1). Scopus. https://doi.org/10.1038/s41398-022-02296-z

Chen, Y.-L., & Kuo, P.-H. (2023). Social Support Reduces the Risk of Unfavorable Parenting Styles for Suicidal Behaviors in Early Adolescents. Archives of Suicide Research, 27(2), 780–795. Scopus. https://doi.org/10.1080/13811118.2022.2066590

Chiang, C.-H., Lin, T.-L., Lin, H.-Y., Ho, S. Y., Wong, C.-C., & Wu, H.-C. (2023). Short-term low-intensity Early Start Denver Model program implemented in regional hospitals in Northern Taiwan. Autism, 27(3), 778–787. Scopus. https://doi.org/10.1177/13623613221117444

Ciechanowski, K., Jemielniak, D., & Silczuk, A. (2023). Public interests in mental health topics in COVID-19: Evidence from Wikipedia searches. Advances in Mental Health. Scopus. https://doi.org/10.1080/18387357.2023.2253936

Comertoglu Arslan, S., Uzun Cicek, A., Ucuz, I., & Dogru, H. (2023). Sociodemographic variables, clinical characteristics, and treatments in children with trichotillomania in terms of age and gender: A multicenter study. Nordic Journal of Psychiatry, 77(1), 36–45. Scopus. https://doi.org/10.1080/08039488.2022.2052179

Coscini, N., Heyes, P., Bedford, H., Cohen, E., D’Aprano, A., Goldfeld, S., Hargreaves, D., Loveday, S., Nejat, S., Roberts, G., Sarkadi, A., Saunders, N. R., Woolfenden, S., & Milner, K. (2023). Multicountry review: Developmental surveillance, assessment and care by outpatient paediatricians. Archives of Disease in Childhood, 108(3), 153–159. Scopus. https://doi.org/10.1136/archdischild-2021-322799

de Lacy, N., & Ramshaw, M. J. (2023). Selectively predicting the onset of ADHD, oppositional defiant disorder, and conduct disorder in early adolescence with high accuracy. Frontiers in Psychiatry, 14. Scopus. https://doi.org/10.3389/fpsyt.2023.1280326

Deotto, A., Fabiano, G. F., Chung, B. Y. T., Wade, S. L., Anagnostou, E., Crosbie, J., Kelley, E., Nicolson, R., Andrade, B. F., Miller, S. P., & Williams, T. S. (2023). Stepping up to COVID-19: A Clinical Trial of a Telepsychology Positive Parenting Program Targeting Behavior Problems in Children With Neurological Risk. Journal of Pediatric Psychology, 48(6), 523–536. Scopus. https://doi.org/10.1093/jpepsy/jsad032

Driscoll, D. J. O., Fagan, J., Jennings, R., Clifford, M., Maher, C., Corbett, M., Wade, S., & McDevitt, S. (2024). National Clinical Programme for Eating Disorders: A pragmatic review of a new national eating disorder service in Ireland. Irish Journal of Psychological Medicine, 41(1), 68–77. Scopus. https://doi.org/10.1017/ipm.2022.30

Espinosa-Díaz, N., Vega-Arce, M., Jara, M. I., & Garrido, F. (2024). Stress in parents of preschoolers with Autism Spectrum Disorders: An update review. Boletin Medico Del Hospital Infantil de Mexico, 81(4), 195–209. Scopus. https://doi.org/10.24875/BMHIM.23000182

Evans-Barns, H. M. E., Hall, M., Trajanovska, M., Hutson, J. M., Muscara, F., & King, S. K. (2024). Psychosocial Outcomes of Parents of Children with Hirschsprung Disease Beyond Early Childhood. Journal of Pediatric Surgery, 59(4), 694–700. Scopus. https://doi.org/10.1016/j.jpedsurg.2023.11.012

Georg, A. K., Moessner, M., & Taubner, S. (2023). Stability of improvements: Follow-up data on focused parent–infant psychotherapy (fPIP) for treating regulatory disorders in infancy. European Child and Adolescent Psychiatry, 32(11), 2379–2383. Scopus. https://doi.org/10.1007/s00787-022-02057-9

Gerson, R., Sharma, P., Lohr, W. D., & Larson, J. (2024). Strengthening Support for Community Mental Health Programs Through Partnership and Collective Impact. Child and Adolescent Psychiatric Clinics of North America, 33(3), 355–367. Scopus. https://doi.org/10.1016/j.chc.2024.02.002

Gilbert, L., Raubenheimer, D., Hibbert, E. J., & Nanan, R. (2024). PsyNBIOsis: Investigating the Association between Maternal Gestational Diabetes, Mental Health, Diet and Childhood Obesity Risk: Protocol for a Prospective, Longitudinal, Observational Study. Nutrients, 16(1). Scopus. https://doi.org/10.3390/nu16010124

Gu, Z., Dawson, G., & Engelhard, M. (2023). Sex differences in the age of childhood autism diagnosis and the impact of co-occurring conditions. Autism Research, 16(12), 2391–2402. Scopus. https://doi.org/10.1002/aur.3043

Habayeb, S., Inge, A., Eisenman, E., Godovich, S., Lauer, M., Hastings, A., Fuentes, V., Long, M., Marshall, X., Khuu, A., & Godoy, L. (2024). Short report: Integrated evaluations for autism spectrum disorder in pediatric primary care clinics. Autism. Scopus. https://doi.org/10.1177/13623613241260800

Kenyon, L. K., Krajenka, V. M., Lach, K., VanBeek, H., Williams, B., & Bower Russa, M. (2023). Motivate-to-move: Development of an intervention promoting parental adherence to early power mobility programs. Disability and Rehabilitation: Assistive Technology, 18(2), 185–194. Scopus. https://doi.org/10.1080/17483107.2020.1841310

Klusek, J., Will, E., Christensen, T., Caravella, K., Hogan, A., Sun, J., Smith, J., Fairchild, A. J., & Roberts, J. E. (2024). Social Communication Delay in an Unbiased Sampof Preschoolers With the FMR1 Premutation. Journal of Speech, Language, and Hearing Research, 67(7), 2316–2332. Scopus. https://doi.org/10.1044/2024_JSLHR-23-00580

Kristoffersen, L., Bergseng, H., Engesland, H., Bagstevold, A., Aker, K., & Støen, R. (2023). Skin-to-skin contact in the delivery room for very preterm infants: A randomised clinical trial. BMJ Paediatrics Open, 7(1). Scopus. https://doi.org/10.1136/bmjpo-2022-001831

Kromm, G. H., Patankar, H., Nagalotimath, S., Wong, H., & Austin, T. (2024). Socioemotional and Psychological Outcomes of Hypoxic-Ischemic Encephalopathy: A Systematic Review. Pediatrics, 153(4). Scopus. https://doi.org/10.1542/peds.2023-063399

Kumar, V. H. S. (2023). Special Issue: Prematurity, Preterm-Born Adults, and Long-Term Effects on Children and Adults. Children, 10(6). Scopus. https://doi.org/10.3390/children10060989

Lin, S., Gong, Q., Chen, J., Wang, J., Gao, H., Hong, J., Guo, Y., Zhang, Y., & Jiang, D. (2023). Sleep duration is associated with depressive symptoms in Chinese adolescents. Journal of Affective Disorders, 340, 64–70. Scopus. https://doi.org/10.1016/j.jad.2023.07.114

Mar, J., Larrañaga, I., Ibarrondo, O., González-Pinto, A., Hayas, C. L., Fullaondo, A., Izco-Basurko, I., Alonso, J., Mateo-Abad, M., & de Manuel, E. (2024). Socioeconomic and gender inequalities in mental disorders among adolescents and young adults. Spanish Journal of Psychiatry and Mental Health, 17(2), 95–102. Scopus. https://doi.org/10.1016/j.rpsm.2022.07.001

McDonald, B., Lester, K. J., & Michelson, D. (2023). ‘She didn’t know how to go back’: School attendance problems in the context of the COVID-19 pandemic—A multiple stakeholder qualitative study with parents and professionals. British Journal of Educational Psychology, 93(1), 386–401. Scopus. https://doi.org/10.1111/bjep.12562

Mills, L., McLoughlin, L. T., Driver, C., Boyes, A., Sacks, D. D., Wood, A., Lagopoulos, J., & Hermens, D. F. (2023). Social Connectedness and Impulsivity as Predictors of Cyberbullying Behaviors in Early Adolescence. Journal of Aggression, Maltreatment and Trauma, 32(5), 726–744. Scopus. https://doi.org/10.1080/10926771.2022.2164535

Moffa, G., Kuipers, J., Kuipers, E., McManus, S., & Bebbington, P. (2023). Sexual abuse and psychotic phenomena: A directed acyclic graph analysis of affective symptoms using English national psychiatric survey data. Psychological Medicine, 53(16), 7817–7826. Scopus. https://doi.org/10.1017/S003329172300185X

Mousikou, M., Kyriakou, A., & Skordis, N. (2023). Stress and Growth in Children and Adolescents. Hormone Research in Paediatrics, 96(1), 25–33. Scopus. https://doi.org/10.1159/000521074

Mulatu, T., Dessie, Y., & Abera, M. (2024). Multi-level analysis of intimate partner violence and its determinants among reproductive age group women in Ethiopia: Evidence from Ethiopian Demographic Health Survey, 2016. BMC Public Health, 24(1). Scopus. https://doi.org/10.1186/s12889-024-18781-7

Nagata, J. M., Lee, C. M., Yang, J. H., Kiss, O., Ganson, K. T., Testa, A., Jackson, D. B., Al-Shoaibi, A. A. A., & Baker, F. C. (2023). Sexual Orientation Disparities in Early Adolescent Sleep: Findings from the Adolescent Brain Cognitive Development Study. LGBT Health, 10(5), 355–362. Scopus. https://doi.org/10.1089/lgbt.2022.0268

Neuhaus, E., Rea, H., Jones, E., Benavidez, H., Miles, C., Whiting, A., Johansson, M., Eayrs, C., Kurtz-Nelson, E. C., Earl, R., Bernier, R. A., & Eichler, E. E. (2024). Shared and divergent mental health characteristics of ADNP-, CHD8- and DYRK1A-related neurodevelopmental conditions. Journal of Neurodevelopmental Disorders, 16(1). Scopus. https://doi.org/10.1186/s11689-024-09532-1

Oyegoke, S., Hughes, P. M., & Gigli, K. H. (2024). Neighborhood-Level Social Determinants of Health and Adolescent Mental Health. Academic Pediatrics. Scopus. https://doi.org/10.1016/j.acap.2024.08.008

Paton, C., Gringras, P., Ruan, A., Liew, A., Rendora, O., Bove, G., & Barnes, T. R. E. (2024). Quality of melatonin use in children and adolescents: Findings from a UK clinical audit. BMJ Mental Health, 27(1). Scopus. https://doi.org/10.1136/bmjment-2023-300894

Pelizza, L., Leuci, E., Quattrone, E., Azzali, S., Pupo, S., Paulillo, G., Pellegrini, P., & Menchetti, M. (2024). Short-term disengagement from early intervention service for first-episode psychosis: Findings from the “Parma Early Psychosis” program. Social Psychiatry and Psychiatric Epidemiology, 59(7), 1201–1213. Scopus. https://doi.org/10.1007/s00127-023-02564-3

Pinandari, A. W., Kågesten, A. E., Li, M., Moreau, C., van Reeuwijk, M., & Wilopo, S. A. (2023). Short-Term Effects of a School-Based Comprehensive Sexuality Education Intervention Among Very Young Adolescents in Three Urban Indonesian Settings: A Quasi-Experimental Study. Journal of Adolescent Health, 73(1), S21–S32. Scopus. https://doi.org/10.1016/j.jadohealth.2023.01.030

Rickwood, D., McEachran, J., Saw, A., Telford, N., Trethowan, J., & McGorry, P. (2023). Sixteen years of innovation in youth mental healthcare: Outcomes for young people attending Australia’s headspace centre services. PLoS ONE, 18(6 June). Scopus. https://doi.org/10.1371/journal.pone.0282040

Rojo, M., Beltrán-Garrayo, L., del Blanco-Barredo, M. D. C., & Sepúlveda, A. R. (2023). Spanish validation of two social media appearance-related constructs associated with disordered eating in adolescents: The Appearance-related Social Media Consciousness scale (ASMC) and the Critical Thinking about Media Messages scale (CTMM). Body Image, 45, 401–413. Scopus. https://doi.org/10.1016/j.bodyim.2023.04.004

Rosholm, M., Tranberg Bodilsen, S., Michel, B., & Søren Nielsen, A. (2024). Predictive risk modeling for child maltreatment detection and enhanced decision-making: Evidence from Danish administrative data. PLoS ONE, 19(7 July). Scopus. https://doi.org/10.1371/journal.pone.0305974

Saggu, S., Daneshvar, H., Samavi, R., Pires, P., Sassi, R. B., Doyle, T. E., Zhao, J., Mauluddin, A., & Duncan, L. (2024). Prediction of emergency department revisits among child and youth mental health outpatients using deep learning techniques. BMC Medical Informatics and Decision Making, 24(1). Scopus. https://doi.org/10.1186/s12911-024-02450-1

Scott, B., & Gardiner, D. (2023). Public health prevention in maternity programme: Supporting the local system. British Journal of Midwifery, 31(4), 220–225. Scopus. https://doi.org/10.12968/bjom.2023.31.4.220

Siller, M. (2023). Moving beyond the mother–child dyad: A commentary on Oppenheim et al. (2023). Journal of Child Psychology and Psychiatry and Allied Disciplines, 64(9), 1369–1371. Scopus. https://doi.org/10.1111/jcpp.13849

Sirotich, A. C., & Camisasca, E. (2024). PTSD risk factors in earthquake survivors and their families: A systematic review. European Journal of Psychotraumatology, 15(1). Scopus. https://doi.org/10.1080/20008066.2024.2365477

Sorsa, M., Hohenthal, M., Pikulinsky, M., Sellergren, H., & Puura, K. (2023). Qualitative description of outreach and engagement in perinatal substance treatment in Finland. Substance Abuse: Treatment, Prevention, and Policy, 18(1). Scopus. https://doi.org/10.1186/s13011-022-00513-y

Stornæs, A. V., Sundgot-Borgen, J., Pettersen, G., Rosenvinge, J. H., & Nordin-Bates, S. M. (2023). Self-Expectations, Socially Prescribed Expectations, and Wellness in 14- to 15-Year-Old Athletes, Ballet, and Music Students in Norwegian Talent Schools—An Interview Study. Sport Psychologist, 37(2), 92–105. Scopus. https://doi.org/10.1123/tsp.2022-0133

Tarullo, A. R., Ewell, A. R., & Garrison, M. M. (2023). Sleep, Poverty, and Biological Stress: Mitigating Sleep Health Disparities in Early Childhood. Policy Insights from the Behavioral and Brain Sciences, 10(2), 221–228. Scopus. https://doi.org/10.1177/23727322231199942

Trembath, D., Stainer, M., Caithness, T., Dissanayake, C., Eapen, V., Fordyce, K., Frewer, V., Frost, G., Hudry, K., Iacono, T., Mahler, N., Masi, A., Paynter, J., Pye, K., Quan, S., Shellshear, L., Sutherland, R., Sievers, S., Thirumanickam, A., … Tucker, M. (2023). Spoken Language Change in Children on the Autism Spectrum Receiving Community-Based Interventions. Journal of Autism and Developmental Disorders, 53(6), 2232–2245. Scopus. https://doi.org/10.1007/s10803-022-05511-4

Tyler, K. A., & Ray, C. M. (2024). PTSD Symptoms Among College Students: Linkages with Familial Risk, Borderline Personality, and Sexual Assault. Journal of Child Sexual Abuse, 33(2), 127–145. Scopus. https://doi.org/10.1080/10538712.2024.2326543

Vaezghasemi, M., Vogt, T., Lindkvist, M., Pulkki-Brännström, A.-M., Richter Sundberg, L., Lundahl, L., Silfverdal, S.-A., Feldman, I., & Ivarsson, A. (2023). Multifaceted determinants of social-emotional problems in preschool children in Sweden: An ecological systems theory approach. SSM - Population Health, 21. Scopus. https://doi.org/10.1016/j.ssmph.2023.101345

Wang, L., Bai, Y., Zhang, Z., Zhu, Y., Wang, Y., Sun, M., & Pang, W. (2024). Status and influencing factors of mental health services in primary and secondary schools in Shanghai. Academic Journal of Naval Medical University, 45(7), 821–830. Scopus. https://doi.org/10.16781/j.CN31-2187/R.20230669

Yang, Y., Zha, S., & Li, T. (2024). Secular Trends in Depressive Symptoms in Adolescents in Yunnan, Southwest China From Before COVID-19 to During the COVID-19 Pandemic: Longitudinal, Observational Study. JMIR Public Health and Surveillance, 10. Scopus. https://doi.org/10.2196/52683

Yuan, M., He, Y., Wang, F., Wen, X., Tong, Y., Zhu, D., Wang, G., & Su, P. (2024). Multi-level factors associated with psychological resilience in the face of adverse childhood experiences among Chinese early adolescents. Child Abuse and Neglect, 153. Scopus. https://doi.org/10.1016/j.chiabu.2024.106861

Yule, A. M., Fernandes, C.-S. F., Stormshak, E. A., Yang, Y., Shelley, L., Fiellin, L. E., Larkin, K., Ridenour, T. A., Saavedra, L. M., Kelleher, K., Feng, X., Walton, M. A., & Bonar, E. E. (2023). Multidisciplinary Strategies for Preventing Opioid Misuse and Escalation by Targeting Mental Health Symptoms and Conditions. Prevention Science, 24, 77–87. Scopus. https://doi.org/10.1007/s11121-023-01556-8

Authors

Fauzi Aldina
fauzialdiana@unigha.ac.id (Primary Contact)
Lusiana Rahmadani Putri
Deng Jiao
Aldina, F., Putri, L. R., & Jiao, D. (2024). Outcome Measurement of Counseling Interventions: A Data-Driven Approach to Assessing the Effectiveness of Therapy Programs. Research Psychologie, Orientation Et Conseil, 1(4), 187–205. https://doi.org/10.70177/rpoc.v1i4.1384

Article Details