A Template Application For Practicing Social Interactions Using the Causality Protocol

This is a presentation on researching HCI application which is held in Digicon-22, the 2022 International Conference on Digital Contents (http://journal.dcs.or.kr/digicon/2022/index.html).

Transcript

1. A Template Application For Practicing Social Interactions Using the Causality Protocol Dec 19, 2022 Taein Kim (tikim@dsp.inha.ac.kr) Bowon Lee (bowon.lee@inha.ac.kr) Department of Electrical and Computer Engineering Inha University, Incheon, Republic Of Korea
2. Introduction 2 There is consistent demand in the humanities, society, and education sectors for applications that simulate social interactions to aid people to improve communication and social skills based on smart devices
3. Introduction 3 The functions and designs for simulation application are: 1. It should work on a PC or mobile device 2. Text, video, and voice should be provided to users in an organized flow, such as a scenario 3. The answers data left by the user should be preserved 4. The original content should be fully translated into digital content with appropriate media
4. Logical flow of the protocol 4 Causality Protocol Template application Scenario written with Causality An XML* and OOD** based protocol that can specify social interaction content • For example, a scenario that can practice ordering coffee, talking to a colleague • Temporal flow within social interactions is translated into digital content with the protocol *eXtensible Markup Language **Object-oriented Design Kim, T., Kim, T., Lee, B. (2021). Causality: A Portable Protocol for Rapid Development of Applications for Social Interactions. In: Stephanidis, C., Antona, M., Ntoa, S. (eds) HCI International 2021 - Posters. HCII 2021. Communications in Computer and Information Science, vol 1421. Springer, Cham. https://doi.org/10.1007/978-3-030-78645-8_43
5. 5 Causality Protocol Classes belonging to behavior Classes belonging to flow Classes belonging to representation Logical flow of the protocol Kim, T., Kim, T., Lee, B. (2021). Causality: A Portable Protocol for Rapid Development of Applications for Social Interactions. In: Stephanidis, C., Antona, M., Ntoa, S. (eds) HCI International 2021 - Posters. HCII 2021. Communications in Computer and Information Science, vol 1421. Springer, Cham. https://doi.org/10.1007/978-3-030-78645-8_43
6. Template Application 6 Developed and tested based on Google Android with 8-inch touchscreen display The scenario content was created by referring PEERS*, previously validated social program * Program for the Education and Enhancement of Relational Skills
7. Template Application 7 Main menu screen Scenario selection menu
8. Template Application 8 Content screen with recording UI The UI screen displaying content must have: 1. UI to display lines defined by Caption 2. UI for displaying visual content defined by Media 3. UI to move on to the following Caption 4. UI to escape from the scenario to the main screen 5. UI to collect multiple-choice or subject responses defined as Options from users 6. (Optional) UI to listen again to audio content to be played with Caption
9. Discussion 9 An intervention study with volunteers based on the template application: • Scenario content: audio-transcribed text with video materials • Stress from interpersonal stress has decreased • Interpersonal skills and the ability to solve social problems have increased The Effects of Intervention using Simulation Game Programs on the Interpersonal and Social Problem-Solving Skills of Adults with Developmental Disabilities in Their Work Environment Ran Ju, Young-Sun Lee (2021.11) Intervention program 1. Orientation 2. Session 1 – Conversation skills 3. Session 2 – Compliment skills 4. Session 3 – Asking for/Getting help 5. Session 4 – Dealing with mistake 6. Session 5 – Expressing own opinion 7. Evaluation of results var pre-test post-test t (p < .001) mean SD 95%CI mean SD 95%CI LL UL LL UL V1 3.475 .903 2.829 4.120 2.288 .504 1.927 2.648 -5.563 V2 2.450 .528 2.073 2.827 2.850 .420 2.550 3.150 5.400 V3 9.742 2.548 7.919 11.564 16.542 1.382 15.553 17.530 7.296 V1: Interpersonal stress, V2: Interpersonal skills – Organizational adaptability V3: Ability to solve social problems Rubric result (Paired t-test)
10. Conclusion 10 • This study proposed a template application that can provide interactive social scenarios • The study used the application: • provided text/video-based content • improved social abilities of adults with developmental disabilities • Improved stress from interpersonal relationships • In future work, • GUI-based content editor will be developed • Overall system’s usability will be improved