Assessing the validity of the Australian Treatment Outcomes Profile for telephone administration in drug health treatment populations

Abstract

Introduction and aims: The Australian Treatment Outcomes Profile (ATOP) is a brief clinical tool measuring recent substance use, health and wellbeing among clients attending alcohol and other drug (AOD) treatment services. It has previously been assessed for concurrent validity and inter-rater reliability. In this study we examine whether it is suitable for administration over the telephone. Design and methods: We recruited a sample of 107 AOD clients across public sector specialist AOD treatment services in New South Wales, Australia between 2016 and 2018. Participants had a mean age of 47 years and 46% were female. Participants completed a face-to-face ATOP and a phone ATOP with a researcher within 5 days. Comparisons between the two administration modes were undertaken using Spearman's rank correlation coefficient for continuous or ordinal variables, and Cohen's Kappa for nominal variables. Results: Among 107 participants, 59% were attending for alcohol treatment and 41% for opioid treatment. Most ATOP items (76%) reached above 0.7 (good) or 0.9 (excellent) agreement between face-to-face and telephone use. Discussion and conclusions: Our findings suggest that the ATOP is a suitable instrument for telephone monitoring of recent substance use, health and social functioning among AOD clients. Its validation for remote use over the telephone will support staff to monitor clients' risks and outcomes-of particular relevance in response to the COVID-19 pandemic in which services are increasingly relying on telework approaches to client monitoring.