A child acts out a story and watches her animated character mirror her moves on screen as part of a motion tracking project being conducted by Sharon Chu, Texas A&M assistant professor of visualization.
By Sarah Wilson, Texas A&M University College of Architecture
Using motion-tracking technology, Texas A&M visualization researchers are developing and testing an enhanced play system aimed at boosting children’s imaginations and enriching their storytelling and writing skills.
“The goal is to use play, something very natural to children, to let them express ideas without being blocked by the technical aspects of language,” said Sharon Chu, assistant professor of visualization and principal investigator on the three-year, $550,000 National Science Foundation project.
The system is aimed at students ages nine to 11 who are learning to write more technically in school. The system, she said, will prove particularly helpful for non-native English speakers trying to learn language specifics, but it will help native and non-native speakers to improve their grammar, spelling and writing, as well.
Chu plans to package the motion-capturing technology in a portable classroom kit for teachers. Her finished Digital Micro-Enactment Storytelling System, or D.I.M.E., will require only a short training session before an educator is able to operate it.
The process entails using motion-tracking cameras to film children, outfitted with sensors, as they act out a story of their own creation. Their movement, translated in real time by software, is mirrored on a screen by an animated avatar previously drawn by the actor. The initial product is a video drawn, acted and told by the child.
The child actor then views the video and is tasked with writing a story, drawing inspiration from the experience gained in the video creation process.
“Tom walked to the store,” Chu said. “Any child can write that, but when they enact it, they might use richer language. It’s part of why enactment works.”
The idea, Chu said, is “to split the learning so they focus first on the ideas, then on the technical aspects of language, ultimately improving their storytelling and writing abilities.”
These steps harness embodied cognition, a psychological theory that what someone does affects how they think about it. Because the children assume characters they create and make real, they feel more committed when they write about them and do so more imaginatively.
The technique also has proven to enhance shy children’s self-esteem.