miya oshiro
The incorporation and evaluation of non-verbal gesture synchrony into online social gaming communication mechanics.
Master's thesis research for the University of Maryland HCIM program.
Role: Principal Investigator | Timeline: 2022
Technology: GameMaker Studio 2.0, Android Studio, Figma, Adobe Illustrator, Adobe Photoshop
I evaluated the emotional response to the incorporation of nonverbal gesture synchrony into social gaming communication systems. As we move into a more remote world, building new systems of online communication are imperative.
This study resulted in design recommendation and key insights that help guide designs of gesture-based social communication systems within online gaming spaces.
I focused on capturing the emotional response of players when comparing the two communication systems. My research design approach included:
Mirror neurons and the psychology of socialization
The usage of mirror neurons in nonverbal synchrony are essential instruments of social interaction and collaboration.
Extension of self in games and social mechanics
Multiple communication tools are necessary for players to express themselves and their actions in a meaningful way.
Social games and player Intentions
Social games communication systems have a reduced set of intuitive and non-verbal cues and communication tools that compromise player trust
Social gaming and its role/impact during COVID-19
Social gaming is an effective tool for socialization during periods of isolation like the COVID-19 isolation period.
Other areas of research included distance affection devices, mental frameworks for the psychology of mimicry, and nonverbal gesture synchrony in dyadic relationships.
Successfully integrated non-verbal gestural communication between avatars into an online gaming space.
Players feel in control and trust each other enough to build successful relationships.
Solidified the mechanical difference between social and collaborative games.
Custom Game Development
Pre-Study
Questionnaires
Playtest
Sessions
Likert Evaluation
Surveys
User
Interviews
Data Consolidation & Analysis
Each participant completed the play test individually and played through both versions (emoji vs. gesture) of the KANDI.io social simulation game.
While participants found the gesture interaction to be more enjoyable than the emoji design, they were more comfortable performing the emoji trade with new players rather than the gesture design.
However, the likert scale results revealed that participants' emotional ratings were not as negatively intense when presented with the opposite perspective. This pattern was investigated more in the participant interviews.
Negative statement results were re-color coded to properly represent the emotional direction of the participant's answer.
A thematic analysis and a working activity affinity diagram were completed to thoroughly understand the interview and short-answer survey data. The results from this analysis provided context for the patterns discovered in the likert scale data.
Combined with the results found from interviews, it was apparent that participants were more affected by an inherent distrust of other players.
The interview data revealed that the gesture-based interaction left participants feeling more vulnerable, which made them more weary of interacting with new players.
Players have a desire for freedom to express their individuality and to interact with other players asymmetrically during social play.
When engaging with more free-play mechanics like gesture pathways, players felt more vulnerable. This impacted their openness to new players.
Players need to give and receive the same amount of emotional feedback to feel comfortable with each other during social play.
Co-creation activities generate feelings of bonding. Players reported feeling closer to players while creating something together.
From the perspective of personal growth, this project taught me so much about my abilities as a developer, designer, and researcher. I gained invaluable experience in project management and completion and found a true passion in gaming research.
I felt as though my time at the University of Maryland built up to me completing this project and I am thankful for my thesis committee and my thesis advisor for supporting me through it all.
Connect with me!
If you see something interesting - contact me!
Email: msoshiro8@gmail.com
LinkedIn: /miya-oshiro