pipette
ENEnglish

Comparing Human Role-Players and LLM-Simulated Clients in Online Counselling Training: An Analysis of Counselling Patterns

Eric Rudolph, Philipp Steigerwald, Jens Albrecht

Preprint con versión publicadaUso en el mundo real

En palabras de los autores

This study investigates the capabilities of Large Language Models to simulate counselling clients in educational role-plays in comparison to human role-players. Initially, we recorded role-playing sessions, where novice counsellors interacted with human peers acting as clients, followed by role-plays between humans and clients simulated by Mistrals Mixtral 8x7b using 4-bit quantization. These interactions were analysed with a counselling communication pattern system at sentence level. We investigated two key questions: (1) to what extent LLM-generated responses replicate authentic conversational dynamics and (2) whether counsellors' communication behaviour differs when interacting with human versus LLM-simulated clients. The findings highlight both similarities and differences in the application of counselling patterns across scenarios, showing the potential of LLM-based role-playing exercises to enhance counselling competencies and to identify areas for further refinement in virtual client simulations.

Resultado principalLimitación que admiten los autores

Apareció: viernes, 30 de octubre. arXiv. Preprint con versión publicada.

DOI: 10.5281/zenodo.15870260

Versión publicada: Proceedings of the 18th International Conference on Educational Data Mining (EDM 2025), short papers

Comentario de los autores: Published at EDM 2025 (18th International Conference on Educational Data Mining), short paper. 7 pages