This work is a hearing-centric swordsman somatic game that provides visually impaired people who would like to exercise their hearing sensitivity and common people who interested in physical games. We proposed a handheld physical interactive device that
used Infrared laser detectors, wireless headphones. Users will use wireless headphones to listen to game com- mands while holding the physical interaction device. The user should always stand in one direction, and user’s face orientation
cannot be changed, and then he or she asked to make an action, which is to swing the sword in four different directions around him. In the process, the user should always maintain a direction because the device uses a physical laser detector
to determine the direction, and the direction of the sensor cannot be changed with the direc- tion of the user's walking. The four infrared lasers will detect users ’behavior, and the winning or losing of the game depends on whether the
user can cut the right laser beam. The Inspirations of this project is from marvel superhero Daredevil and movie Zatoich. This idea hopes that through keen listening training for players, they can practice players hearing sensitivity and
bring visually impaired players strength and balance in different ways.
FROM INDIVIDUAL PERSPECTIVE
This is a 10-minute adventure game, without any game screen, only through voice prompts to help the protagonist fight back and escape. Game sound is crucial to this project.My work focus on how use the 3D surrounds music that improve the immersion and
narrative of the game which is am responsible for designing the music used in the game. The technology will include using Adobe audition software to make the 3D game surrounds.And then I will using Unity to design the sounds as that put sounds
as that put sounds in a 3d space and virtually as that put sounds in
a 3d space and virtually move the player in the 3d space to change the sound levels from 4 speakers. In the end, unity will connect with Arduino to present how this game work. Making some paper models such as the Zombie will be conducted with
the game. It will make the game presentation more lifelike. The intended experience includes voice interaction and tactile interaction as the primary interaction methods.
DESIGN PROCESS
DESIGN PROCESS
1.THE IDEATION
Through the World cafe,from discuss with the various content, I chose ny intersting theme of the poster.The theme selected by our team at this time is to design a physical game to help the visually impaired people to train their hearing.
This game has three different levels of difficulty. The visually impaired people could play the sound of enemy attacks from the front, back, left, and right. The visually impaired people need to make different moves to attack or defense against
the enemy.
2.PROJECT PROPOSAL
Our team determined the problem space by proposing the project proposal and made more related work research on literature review and published games. The literature review includes a similar exploration, guidelines
for voice interface design and theoretical support for our project attempt. The research on published games summarizes the types of existing games and our inspirations from them. Also, we determined the extended experience. It includes voice
interaction and tactile interaction as the main interaction methods. In addition, emotional interaction will also be integrated into the plot design of the game.
3.PROTOTYPE
I first proposed the game music flow with the storyline. In the process of the game, five 3D game surrounds the background of this project is created.The sound including lightning sound outside the window,the sound of opening the door,the sound
of the house leaking after entering the door,the sound of the sword slashing towards the enemy and the sound of game victory.
3D surround sound of opening the door
3D surround lightning sound of outside of the window
3D surround sound of leaking after entering the door
3D surround sound of game victory
3D surround sound of sword slashing towards the enemy
3D SOUND DESING PROCESS
And then I set up the game scene with unity. It includes the sense of the room when the user is playing the game, four stereos, and laser columns, the main models that need to be built. Through programming the code, I completed the main game effect of
unity mouse controlling the camera to rotate around the object.
4.FINAL PROTOTYPR
From Miro's feedback, I update the 3D surround background music to suit our team’s theme. I sepearted the train music with two models, which including the easy model and the difficult model. In addition, I create the physical model of the enemies, three
zombies, and connect with the Arduino. The zombies' body connects with the led, which will flash when it is shot.I also resposible some coding part with connect the presentation game scence with unity and arduino.
FINAL PRODUCT
FINAL PRODUCT
Hasaki
1.WHAT IT IS?
This is a shooting game to train the hearing of the blind. Because the target masses are blind, the voice becomes particularly important. I am mainly responsible for the process of designing games, 3d audio. At the same time, I also made a
physical model of the zombie displayed in the game and participated in a part of the unity and Arduino connection task.
There are two models in the game, one is a simple model, and the other is a difficult model. There are two types of 3D background sound effects. The second difficult sound effect increases the noise of rain and the speed of zombie attacks.In terms of
physical installation, I cooperated with the team members to complete the connection between unity sound effects and physical Arduino models. Through sound, model and induction give users a more realistic game experience.
+
3D BACKGROUND MUSIC
VOICE INTERACTION
ARDUINO AND PHYSICAL MODEL
PHYSICAL INTERACTION
3.VIDEO
FINAL PRODUCT
OUTCOME
INDIVIDUAL WORK
Blog Posts: Weekly feedback of the project and the documentation to reflect the project
