CLOSE ✕
Get in Touch
Thank you for your interest! Please fill out the form below if you would like to work together.

Thank you! Your submission has been received!

Oops! Something went wrong while submitting the form

Cast a Spell

Cast a Spell
AR

Cast a Spell

AR game for learning chéngyǔ

To help Chinese language learners to memorize acronym-like Chinese four-character idioms - chéngyǔ, I designed and developed an augmented reality mobile game that combined situated learning, dual coding, active learning, and social learning to promote effective encoding and retrieving.

Individual Project

Features

GPS tracking | 3D Modeling | Animation | Speech Recognition | Geotagging | Video Editing

Tool: Unity | Maya | Adobe Premiere

Chengyu are condensed expressions with rich meanings and stories behind them, so that learners feel hard to memorize them, like memorizing acronyms and abbreviations. This AR game can overlay the backstories or animated visual cues of chengyu in the environment, to link the words to the context of using. Learners will easily remember the short-forms of these big ideas. It helps to build learners’ mental models of each chengyu.

Chengyu is also difficult to use correctly because they convey very specific meanings in specific contexts. Some people don’t even remember to use them. The social interaction of this AR game aims to engage learners to find the right place to use chengyu.

Storyboard

Background knowledge about the 3 sample objects

爱(Aì)屋(Wū)及(Jí)乌(Wū) means “love for a person extends even to the crows on his roof”, literally translated as “love the house to the crow”, equivalent to “love me, love my dog” in English.

对(Duì)牛(Niú)弹(Tán)琴(Qín) means someone chose the wrong audience, literally translated as “play lute to a cow”, equivalent to “cast pearls before swine” in English.

人(Rén)山(Shān)人(Rén)海(Hǎi) means this place is packed, literally translated as “People mountain people sea”.



Credits
Speech to Text plug-in:PingAK9 - Speech And Text in Unity iOS and Unity Android
https://github.com/PingAK9/Speech-And-Text-Unity-iOS-Android
GPS Tracking plug-in: Daniel Fortes - Unity AR+GPS Location
https://docs.unity-ar-gps-location.com
3D Assets:
Poly by Google
House (https://poly.google.com/view/75V_MLvKMqM)
Heart (https://poly.google.com/view/8RA5hHU5gHK)
Crow (https://poly.google.com/view/1MIvWQ5Q3R9)
Cow (https://poly.google.com/view/4w-_VbcSECP)
Piano (https://poly.google.com/view/7U-93vxPOER)
Mountain (https://poly.google.com/view/0GzMb32v3oH)
Bill Baran (Sirkut)
Music notes
https://poly.google.com/view/1dv0C0-wEyU
https://poly.google.com/view/5OMCPYd7exA
Don Carson
People (https://poly.google.com/view/fyhTCnE2xlT)
Kakky
KY Magic Effects Free (https://assetstore.unity.com/packages/vfx/particles/spells/ky-magic-effects-free-21927)


I'm still growing...🌱 I appreciate your feedback on my project 😘

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Lets Work Together
Contact Me

More...