Rostislav Yavorskiy. Designing Hybrid Teams of Virtual Assistants, Robots, and Humans

We invite you to join the International Summer School on Data Science in Software Engineering. The summer school will be held online on 12-16 July, 2021, organized by the Laboratory of Software Testing, Tomsk Polytechnic University.
Participation is free. The official language of the school is English.

Students, young researchers and practitioners interested in applications of modern data science methods to the development and testing of complex software systems are invited to join. Follow the link to learn the full program and register your participation: https://itr-tpu.timepad.ru/event/1629835/
____
To learn more about Exactpro, visit our website https://exactpro.com/

Follow us on
LinkedIn https://www.linkedin.com/company/exactpro-systems-llc
Twitter https://twitter.com/exactpro
Facebook https://www.facebook.com/exactpro/
Instagram https://www.instagram.com/exactpro/
Vkontakte https://vk.com/exactpro_llc

Subscribe to Exactpro YouTube channel https://www.youtube.com/c/exactprosystems

Transcript

1. International Summer School on Data Science in Software Engineering
   Hybrid Teams
   of Virtual Assistants, Robots, and Humans
   Rostislav Yavorskiy
   Tomsk Polytechnic University
   12 July 2021 1
   

   View Slide

2. Skills profile of a
   computer engineer
   2
   

   View Slide

3. 3
   https://resume.io/
   

   View Slide

4. Evolution of Computer Engineering: Hardware
   4
   

   View Slide

5. Evolution of Computer Engineering: Mathematics
   5
   

   View Slide

6. Evolution of Computer Engineering: Networks
   6
   

   View Slide

7. Evolution of Computer Engineering: Architectures
   7
   

   View Slide

8. Evolution of Computer Engineering: Big Data
   8
   

   View Slide

9. Evolution of Computer Engineering:
   Robots and Virtual Assistants
   9
   

   View Slide

10. Human-robot interaction
    ● Robot’s personality
    ● Physical embodiment of robots
    ● Multimodal human-computer interaction
    ● Socially interactive robots
    ● Human-robot collaboration
    10
    

    View Slide

11. Virtual Agents
    ● Models of conversations
    ● Situation awareness
    ● Expression of emotions and mood states
    ● Autobiography and self-perception
    ● Visual presence and appearance
    ● Building close and harmonious relationship
    ● Research and development tools
    11
    

    View Slide

12. Teams of human, robots and virtual agents
    ● Integration architecture and team dynamics
    ● Models of of perception, belief and intention
    ● Trust in hybrid teams
    ● Navigation in a group
    ● Coordination of tasks
    ● Multi-cultural hybrid teams
    ● Hybrid team efficiency
    12
    

    View Slide

13. Specific applications
    ● Urban disaster recovery
    ○ overview of the situation
    ○ rescue teams
    ● Sea robot-assisted inspection for
    ○ military
    ○ environmental
    ○ disaster-response
    13
    

    View Slide

14. View Slide

15. Systematic analysis of team performance
    ● Task characteristics
    ○ depend on the mechanical and intellectual abilities of
    robots and VAs
    ● Work structure
    ○ new communication structure
    ○ role differentiation
    ● Team member characteristics
    ○ should be re-implemented for robots and VAs
    15
    

    View Slide

16. ● Team characteristics
    ○ rearranged power distribution
    ○ new levels of member diversity and the team climate
    ● Team processes
    ○ based on human-robot collaboration
    ● Team interventions
    ○ trainings for humans
    ○ calibration or update procedures for robots and VAs
    ● Measurement of outputs
    ○ team member satisfaction
    ○ team viability
    16
    

    View Slide

17. Computer autonomy: from Device to Master
    1. Computer offers a complete set of action alternatives
    2. Computer narrows the selection down to a few choices
    3. Computer suggests a single action
    4. Computer executes that action if human approves
    5. Computer allows the human limited time to veto before
    automatic execution
    6. Computer executes automatically then informs the human
    7. Computer decides everything and acts autonomously,
    ignoring the human
    17
    

    View Slide

18. Computer autonomy: from Device to Master
    1. Computer offers a complete set of action alternatives
    2. Computer narrows the selection down to a few choices
    3. Computer suggests a single action
    4. Computer executes that action if human approves
    5. Computer allows the human limited time to veto before
    automatic execution
    6. Computer executes automatically then informs the human
    7. Computer decides everything and acts autonomously,
    ignoring the human
    18
    

    View Slide

19. Computer decides everything
    means
    computer engineer decides
    everything
    19
    

    View Slide

20. Thank you!
    Questions?
    20
    

    View Slide