We're in this Together

A collaborative mixed reality simulation game for complex systems in science

Roles & Responsibilities

Immersive Learning Designer

  • Design, prototype, and test core gameplay, systems, and UX
  • Design embodied hand tracking interactions in Mixed Reality
  • Collaborate with teachers and subject matter experts to align gameplay to learning standards and scientific phenomena

Tools: Oculus Quest 3 / Pro, Unity, Figma, TinkerCAD

Client: MIT, Education Arcade

Timeframe: 2 years, ongoing

Achievements

  • Improved stakeholder approval by 25%, streamlined development time by 20%
  • Co-authored design paper presented at the International Society of the Learning Sciences

Project Goals

This work is supported by NSF. PIs: Dr. Aditi Wagh, Dr. Eric Klopfer.

We're in this Together is a mixed reality (MR) participatory simulation game to engage middle school science students in exploring complex systems. Our goal is to explore how immersion, embodiment, and presence in MR can be leveraged to support collaborative learning in the classroom.

My role is to propose, document, and test the primary design elements, including game mechanics, system, UX, and interactions for our weather game.

Instructional Design

We used the following to research weather and its instructional methods:

Playtesting paper & model prototypes during co-design sessions with teachers

LEARNING GOALS

Based on my research, I defined the following learning goals at the intersection of complex systems and 8th grade science standards:

  • Students will be able to reason about the interrelations between air masses (involving temperature, pressure, humidity, precipitation, and wind), landforms (e.g. mountains, hills, cliffs, lakes), and weather fronts. 
  • Students will be able to identify how local phenomena affect weather on a global scale through complex interactions.

Design & Iteration

ALIGNING SCIENCE TO GAME MECHANICS

To achieve our learning goals, I designed ways for players to manipulate air mass movement and properties. Although directly grabbing air masses would be the easiest for students, it would obscure the complex interactions we want students to investigate. Instead, I identified air pressure and terrain height as balanceable, scientifically accurate factors that can be manipulated predictably.

Students collaborate to place pressure systems and terrain formations across the classroom, aiming to influence weather around their assigned regions.

EXPLORING COMPLEX SYSTEMS

To achieve our learning goal of connecting complex systems between localities on a global scale, players are split into groups to focus on affecting weather around assigned regions on the map. Although players can only directly influence the air masses that move over their regions, their actions influence air masses that move towards or away from other regions.

Players can see air masses moving across the room, realize that air masses are approaching their region in unpredictable patterns, and trace their origins to other regions. This promotes negotiation and collaboration with other regions to help deflect or send certain air masses their way.

DESIGNING EMBODIED INTERACTIONS

I analyzed 4 main design patterns for terraforming in game and design tools.

Competitive analysis of terraforming mechanics

Although a terrain elevation system like in Cities: Skylines is common and well-afforded for computer-based technologies, I advocated for a blended approach where players pinch the land and pull it to their desired height. This design aligns better with embodied gestures in VR and provides easier control over altitude, the most important variable for weather.

Translating terraforming mechanics to embodied VR gestures

Takeaways

We are currently securing IRB approval for student testing in the coming months. As development progresses, I am collaborating with my team lead to finalize design details and prioritize tasks for the development team to implement. Based on initial user testing, we have re-designed for the following:

Other projects: 

Sharleen Loh

lohsharleen@gmail.com