HUH!? I’ve Been Hired by Alien Researchers!

AR LANGUAGE LEARNING

Grand Prize Winner @ Lightship Real-World AR Challenge 2023

Overview

Our project, "Huh!? I’ve Been Hired By Alien Researchers", is an AR Language learning world exploration game meant to motivate users to one of the most tedious parts of language learning, memorizing vocabulary. Players are introduced to the ICRC, the Interplanetary Communications Research Company whose aim is to solve language barrier problems by studying how human brains memorize words. Dr. Zero, their boss, offers you a job to help them!

Role

Unity Developer3D Modeler

Tools

UnityBlenderFigma

Members

Xinying ChewSonia LinEmilee MengRuifeng Xu

Duration

2 weeks

Hackathon Challenge

Build an augmented reality app using Niantic’s Lightship ARDK 3.0

Track: Immersive Learning

drawing of train car interior

Preliminary Research

Memory retainment improves during light to moderate aerobic exercise

Physical Exercise during Encoding Improves Vocabulary Learning in Young Female Adults: A Neuroendocrinological Study

Physical Activity Improves Learning a Second Language

The Effects of Acute Physical Exercise on Memory, Peripheral BDNF, and Cortisol in Young Adults

Effectiveness of Studying When Coupled with Exercise-Induced Arousal

New Study Strengthens the Link Between Exercise and Memory

Idea

Users walk to different real-world waypoints to discover and practice new vocabulary sets

User Flow

Solution Concept

FLASHCARDS

Flashcards are excellent for vocabulary learning as they:
  • Promote active recall
  • Provide immediate feedback
  • Enhance memory through spaced repetition
  • Are portable and customizable

AR VOCABULARY MATCHING GAME

AR combines visual, auditory, and kinesthetic elements, catering to different learning styles and enhancing overall comprehension. As a result of the timed aspect of the game, players must also actively think, process, and respond quickly, which reinforces memory retention and improves recall.

AR WAYPOINT INTERACTION

Each NPC is responsible to their own vocabulary category (e.g. numbers, greetings, animals). Users can meet and talk to various NPC’s at different real-world waypoints nearby to discover new vocabulary sets or get tested on them. Only after mastering a set of vocabulary, do users unlock new ones.

DIALOGUE AND MESSAGING SYSTEM

After meeting NPC’s at their respective waypoints, users can engage in unique conversations with them to learn more about the ICRC and their work in language research! These interactions would hopefully motivate users to keep working towards to their language learning goals while having fun.

Niantic’s Lightship ARDK

Building AR and Geolocation Experiences with Lightship

01. VPS (Virtual Position System)

Localize users and persist AR content in real time.

02. Lightship Maps

Display and guide users to location-based experiences.

03. Real Time Meshing

Enable realistic visuals with real-time depth occlusion and session-persistent meshing.

Characters

MAKI
maki

NUMBERS AGENT

RESEARCHER #008