SluitenHelpPrint
Switch to English
Cursus: INFOMMMI
INFOMMMI
Multimodal interaction
Cursus informatie
CursuscodeINFOMMMI
Studiepunten (EC)7,5
Cursusdoelen
After completing the course, the student: 
  • knows the basics of human visual, auditory and tactile perception.
  • knows the basic techniques of multisensory interfaces with virtual worlds (manipulation, navigation and communication).
  • is acquainted with the pros and cons of applying multisensory presentation in the design of interfaces for virtual worlds (affective appraisal, training transfer, ...).
  • is acquainted with psychophysical test methods to evaluate human performance in virtual worlds.
  • is aware of emerging interface technologies (synaesthetic media and brain machine interfaces).
  • knows the basics of state-of-the-art and emerging trends in technologies for augmented reality.
  • can apply basic techniques of multisensory interfaces to create a multimodal interaction, e.g., for control of a game (demonstrated by the related project work).
  • knows the advantages and disadvantages of using different media types and modalities depending on different contexts, conditions, and applications (demonstrated by the related project work).
Assessment
  • final exam, covering the lectures and related papers
  • practical assignment (project)  which will be done in a group. For the project, you will get one grade for the group, but individual differences may apply for students doing particularly well or bad.

In order to pass the course, you have to:

  • participate in the exam and score at least a 5.0 (before rounding)
  • hand in all deliverables for the project and score at least a 5.0 (before rounding)
  • score a total final grade of at least 5.5 (before rounding; exam and project grades are averaged)

You can participate in the retakes if and only if you fail the course and:

  • you participated in the exam and
  • handed in all deliverables for the project and
  • your final grade was at least 4.0 (before rounding)
If you qualify for the retake and your averaged grade from the exam was below 5.0 or your final grade was below 5.5
  • you must participate in the retake exam. Your retake exam result will replace your original exam grade. Depending on the number of students, the retake exam may be oral instead of a written test.
If you qualify for the retake and your averaged grade from the practicals was below 5.0
  • you will get a new practical assignment. The concrete topic will be decided individually by the instructors. Your grade from this new assignment will replace your original grade for the project.
You will pass the course if and only if your new grade after the retakes fulfils the criteria for passing specified above.
Inhoud
Interaction is one of the most important aspects of games and simulations. For example, you can create games without sounds. Or games with no visuals. But a game without interaction? Not really. And apart from faster and better graphics, maybe the most important technological achievements in game development in recent years have been related to advanced and new interaction styles. Think of the Nintendo Wii's motion-based controller, the XBox Kinect's human body tracking, or the tilt- and touch-based input used for handheld gaming. Compared to traditional controllers, these new ways for human-computer interaction often create a more natural and engaging gaming experience by using multiple modalities that are also characteristic for communications between humans.

In this course, we will take a closer look at all kinds of multimodal interaction including the related relevant theoretical background, e.g. about human perception. We will cover the emerging areas of virtual and augmented reality and cover a few other trends (e.g., brain-computer interfaces).
The lectures will be accompanied by a practical part where students develop and analyze an interactive multimodal system. The course is part of the Game & Media Technology master, but open to students from other programs (e.g., Computing Science, MBI), too, and also well suited for them.
The discussed content is relevant well beyond games and simulations (i.e., even if you are not into games, this course might be interesting for you). For more information about content, procedure, and formal issues please see the course website.

Course form
Lectures, practical, project.

Literature
There will be no textbook but we will use journal articles and conference papers instead. These will be announced in the lectures and on the course website.
SluitenHelpPrint
Switch to English