Dr. Miner is a licensed clinical psychologist, epidemiologist, and Instructor at Stanford University, Department of Psychiatry and Behavioral Sciences. His research addresses potential benefits and challenges of language-focused artificial intelligence to triage, diagnose, and augment treatment in mental health settings. This talk will critically evaluate risks and opportunities in AI-augmented systems in clinical psychology.

Accurate transcription of audio recordings in psychotherapy would improve therapy effectiveness, clinician training, and safety monitoring. Although automatic speech recognition software is commercially available, its accuracy in mental health settings has not been well described. It is unclear which metrics and thresholds are appropriate for different clinical use cases, which may range from population descriptions to individual safety monitoring. Here we show that automatic speech recognition is feasible in psychotherapy, but further improvements in accuracy are needed before widespread use. Our HIPAA-compliant automatic speech recognition system demonstrated a transcription word error rate of 25%. For depression-related utterances, sensitivity was 80% and positive predictive value was 83%. For clinician-identified harm-related sentences, the word error rate was 34%. These results suggest that automatic speech recognition may support understanding of language patterns and subgroup variation in existing treatments but may not be ready for individual-level safety surveillance.