Wiimote news - March 2011

[english version]

Once again, this post will provide you a lot of new references about Wiimote-based works. Thanks to all authors for sharing their ideas and their knowledges. Thanks to all past and future contributors for increasing the amount of hacks with this famous peripheral. Once again, the wii remote remains one of the preferred devices for teaching and experimenting in various domains as gesture recognition, motion tracking, IMU applications, cognitive studies, etc.

[Project WiiChem]

1. Courses with a wiimote

- Practical course about Wiimote and Labview (teaching at BoSc level) : Interfacing WiiMote (Lang. Eng) (2011)
Authors : J. C. Jensen, T. N. Tran (National Instruments) Instructors: E. A. Lee, S. A. Seshia, University of California, Berkeley United States
- Notes for teachers : wiimote experiments for high schools(pdf)(web) , ( 2011 – teaching at undergraduate level – Lang. Eng.)
Contact, University of New South Wales - Sydney Australia
- Development of a Wiimote-based gesture recognizer in a microprocessor laboratory course (Lang. Eng.) (2010)
A. Lorente-Leal, J. A. Fernández-Rodrigues, J. M. Montero, Department of Electronic Engineering, University of Madrid, Europe(Spain)
State Of Art for university teaching (level BoSc)

- Oral Training for physic experiments (course : CAPES Physique Chimie) TP Notion de capteur (Trans. sensors : an introduction) (teaching at undergraduate level – Lang. French)
D. Longuépé, Y. Marquant, University of Valenciennes, Europe(France)
- Project WiiChem Teaching Chemistry (teaching at undergraduate and BoSc levels – Lang. French)
University of Reims Champagne-Ardenne, Europe(France)
- Attracting Students to Engineering: using Intuitive HRIs for Educational Purposes (Lang. Eng.)
P. Neto, N. Mendes, N. Mourato, J. N. Pires, University of Coimbra A. P. Moreira, University of Porto Europe(Portugal)
- Sviluppo di applicazioni basate su Wiimote per scopi didattici (Lang. Italian - 2010)
(trans. Wiimote-based application for educational purposes)
D. Rucatti, University of Padoue, Europe(Italy)
Including physic experiments as inclinometer, frequency analysis with Matlab and Labview.

2. Overview of processing techniques and some technical charasteristics

- Motion Plus Exposed – A blog about Wii Motion Plus (communication protocol, calibration, etc.)
- Preprocessing Techniques for Context Recognition from Accelerometer Data (Lang. Eng.) (2010)
D. Figo, P. C. Diniz, D. R. Ferreira,J. M. P. Cardoso, Department of Computer Engineering, Lisbon Technical University, Europe(Portugal)
An exhaustive view of signal processing for accelerometer data and especially with some examples with the wiimote.

- Analysis and Comparison of Low Cost Gaming Controllers for Motion Analysis (Lang. Eng.) (2010)
S. N. Purkayastha, N. Eckenstein, M. D. Byrne, and . K. O’Malley Mechatronics and Haptic Interfaces Lab, RICE University, United States
A comparison between Nintendo Wii Remote and Sony Playstation 3 Sixaxis.

- La Wii et la Wiimote (a basic presentation for undergraduate students) (Lang. French)(2009)
K. Bettayeb
- Investigating Moving Target Search Algorithms : Deriving Displacement from a 3 axis Accelerometer (Lang. Eng.)
A. Blake, G. Winstanley, W. Wilkinson, University of Brighton, Europe(United Kingdom)
- Development of Functional Game Contents Using Wireless Acceleration Sensor(Lang. Eng.) (2010)
H.-C. Lee , I.-C. Kang, E.-S. Kim and G.-T. Hur University of Dohgshin, South Korea
About designing game contents to facilitate game operation for elderly people.


3. 3D processing techniques and virtual reality

[titre : Spatial Sketch]

- Interactive Fabrication : New Interfaces for Digital Fabrication (2009 - Created by K. D.D. Willis & J. Lin)
Spatial Sketch: Bridging Between Movement & Fabrication (Lang. Eng.)
K. D.D. Willis, Carnegie Mellon University, United States J. Lin, J. Mitani, T. Igarashi, JST, ERATO, Japan
- Use of the wiimote as a wireless sensor, Final Year Project Report (2010) (Lang. Catalan)
J. Iglesias Garcia, Postgraduate Engineering School of Univerisity of Terrassa, Europe(Spain)
- Characterizing and Optimizing Rater Performance for Internet-based Collaborative Labeling (Lang. Eng.)
J. A. Stein, A. J. Asman, Electrical Engineering, Vanderbilt University
B. A. Landman, Biomedical Engineering, Johns Hopkins University
United States
About touch-screen tracking, the "wii remote/IR pen" touch-screen system is less efficient than other peripherals (and especially the mouse) for a medical image application.

- User Model for Predictive Calibration Control on Interactive Screens (Lang. Eng.)
B. Migge, A. Kunz, Department of Mechanical and Process Engineering, ETH Zurich, Switzerland
- Using ego motion feedback to improve the immersion in virtual reality environments (Lang. Eng.)
S. Noth, I. Iossifidis, Institut für Neuroinformatik, Ruhr-Universität Bochum
E. Schrowangen, Fachhochschule Gelsenkirchen
Europe(Germany)
About headtracking for advanced driver assitance system.

- Kostengünstiges Virtual Reality Eingabegerät (Lang. German)
L. Klingbeil, Institut für Mikro- und Informationstechnik, Europe(Germany)
About virtual reality lowcost equiment and including a customization of a magnetometric sensor with a wiimote.

- Virtual Reality Logistikplanung (2010 - Lang. German) (Trans. Virtual Reality for logistic application)
F. Kammergruber, W. A. Günthner, University of Technology, Munich, Europe(Germany)
- Headtracking mit Wii-Cam (Lang. German) (2010)
E. Ellwardt, University Koblenz-Landau, Europe(Germany)
Especially about hacking the IR camera from the wii controller for headtracking purposes.

- Human Computer Interface Virtual Acoustic Display Using Gyroscopics Sensors (Lang. Eng.) (2011)
M. Sunny, A. Kalkan-Savoy, C. Thompson
University of Massachusetts Lowell Center for Advanced Computations and Telecommunications
United States
- Wii Remote alkalmazása PC-s környezetben (trans. Using the Wii remote for PC applications) (Lang. Hungarian) (2010) MoSc thesis
T. Brerczki, University of Debrecen, Europe(Hungary)

[Augmented reality - Youtube video from AutonomikForschung]
(ImRoNet: A Real-Time Wearable Projector-Wiimote-System for AR Interaction Scenarios on Plane Objects)

4. Gesture Recognition

[Wii Whole Body Interaction - youtube video from MarkOfStrathclyde]

- A 3D Gesture Recognition System for Multimodal Dialog Systems (Lang. Eng.)
R. Neßelrath, J. Alexandersson, DFKI GmbH, Europe(Germany)
- A Novel Accelerometer-based Gesture Recognition System (Lang.Eng.) MoSc Thesis, A. Akl and its related publication Accelerometer-based gesture recognition via dynamic-time warping, affinity propagation and compressive sensing (Lang. Eng.)
A.Akl, S. Valaee, University of Toronto, Canada
- Body-Centric Interaction Techniques for Very Large Wall Displays (Lang. Eng.)
G. Shoemaker, K. S. Booth, University of British Columbia, Canada
T. Tsukitani, Osaka University, Japan
Y. Kitamura, Tohoku University, Japan
- Thrii: a multimodal interactive installation (Lang. Eng.)
N. Lehrer, S. Rajko, D. Siwiak, D. Tinapple, I. Wallis, T. Koziupa, M. Chen, M. Baran, A. Kidane, D. Lorig, L. Olson
School of Arts, Media and Engineering, Arizona State University, United States
Using interactive and wiimote-based spheres

- Use of gesture recognition to control household devices for older people (Lang. Eng.)
C. Langensiepen, A. Lotfi and S. Higgins
School of Science and Technology, Nottingham Trent University, Europe(United Kingdom)
- Automatic learning of gesture recognition model using SOM and SVM (Lang. Eng.)
M. Oshita and T. Matsunaga, Kyushu Institute of Technology, Japan
- Traitement de séquence et manette Wii (Trans. Gesture recognition with wii remote) (2008 - Lang. French) (Developer Guide)(User Guide)
N. Cheifetz, Pierre-Marie Curie University of Paris 6 - Europe(France)
- Interfaces multimodales - Mini-projet - Pilotage Nao (2010 - Lang. French) Project report
J. Dumoulin, J. Jeanneret, B. Wolf, D. Wyler, University of Fribourg, Switzerland

[NAO Navigation and Teleoperation - youtube video from ObiJerome ]

(How Taylor Veltrop, member of the NAO Developer Program, used Kinect and Wiimotes to guide NAO and do Teleoperation - Website of Taylor Veltrop)

5. Others

- Interactopus : An Interactive Dog Toy Final Prototype (Lang. Eng.)
Brittany R. Ransom
Hacking the wiimote for dog games.

Robot controlled by a wii remote

[english version]

Here, back to a work on Human-Computer Interfaces with docs and video supports :

High-level programming and control for industrial
robotics: using a hand-held accelerometer-based input
device for gesture and posture recognition [Article] (Lang. : English)
Pedro Neto(1), J. Norberto Pires(1), A. Paulo Moreira(2)
(1)Mechanical Engineering Department, University of Coimbra, Coimbra, Europe(Portugal)
(2)INESC Porto - Institute for Systems and Computer Engineering of Porto, Porto, Europe(Portugal)

Abstract :
"Most industrial robots are still programmed using the typical teaching process,
through the use of the robot teach pendant. This is a tedious and time-consuming task that
requires some technical expertise, and hence new approaches to robot programming are
required. The paper aims to present a robotic system that allows users to instruct and program
a robot with a high-level of abstraction from the robot language. "(extract from abstract in Emerald)

[Industrial robot controlled by a Wii Remote and speech - Youtube's video from Robotics Time]

Thanks to Pedro Neto for presenting his work.
Do not hesitate to show us your developments at : wiill.iam
You can also join the forum wiimoteproject.

Robot contrôlé à la wii remote

[version francaise]

Retour, ici, sur un travail sur les Interfaces Hommes Machines avec documentation et video à l'appui :

High-level programming and control for industrial
robotics: using a hand-held accelerometer-based input
device for gesture and posture recognition [Article] (trad. : Programmation haut niveau pour robot industriel : utilisation de la reconnaissance de mouvement à partir d'accéléromètre) (Lang. : Anglais)
Pedro Neto(1), J. Norberto Pires(1), A. Paulo Moreira(2)
(1)Mechanical Engineering Department, University of Coimbra, Coimbra, Europe(Portugal)
(2)INESC Porto - Institute for Systems and Computer Engineering of Porto, Porto, Europe(Portugal)

Résumé :
Le processus d'apprentissage d'un robot industriel requiert une expertise technique certaine. L'objectif, ici, est de présenter un prototype intuitif de programmation d'instruction haut niveau pour un système controle-commande robotisé. A partir de la wiimote, une reconnaissance de mouvement (basée sur des réseaux neuronaux) permet le contrôle du robot. (extrait du résumé présenté dans Emerald)

[Industrial robot controlled by a Wii Remote and speech - Youtube's video from Robotics Time]

Merci à Pedro Neto pour la présentation de son travail.
Vous aussi, n'hésitez pas à nous faire part de votre travail à l'adresse: wiill.iam
Faites aussi un tour sur le forum wiimoteproject

Wiimote and latest Human Computer Interfaces - efficiency and robustness

[English Version]

While Human Computer Interfaces are becoming popular ( multitouch tactile display, 3D vision device,...), several studies underlined their constraints and limitations in term of efficiency.

Did “Minority Report” Get it Wrong? Superiority of the Mouse over 3D Input in a 3D Placement Task (Lang. English)
F. Bérard1, J. Ip2, M. Benovoy2,
D. El-Shimy2, J. R. Blum2, J. R. Cooperstock2
1 University of Grenoble, Europe (France)
2 McGill University, Canada

Obviously, some usual devices will not disappear but the latest 3D peripherals will challenge the well-established ones (such as mouse or keyboard) for innovative applications.

Making Sense of Sensors (Lang. English)
Alex Wright Writer and Information Architect, New-York, USA
(Extract : Researchers are recognizing the potential of position sensors to help them overcome the limitations of traditional user interfaces.)

Here, many wiimote-based applications tackle the problem of robustness and accuracy, too. (in term of IR tracking error, accelerometer bandwidth, etc).

[YouTube's video video from TheTowerBarron]

Finally, the last chapters of this post give an overview of novel usages. Focusing on the use of wiimote as a scientific sensor, some behavioral studies and other hardwares customization will be presented.


1. Accuracy of IR sensor for tracking algorithms

Underlining tracking error around of 2cm for 1 wiimote :
- Dr. Oliver Kreylos' Wiimote Tracking Algorithm and its Limitations (Lang. English)
and Interaction within a VR environment using a wii remote (Lang. English)
P. Vuong, G. Kurillo, R. Bajcsy
University of California Berkeley, USA

Now, reaching accuracy of 2.233mm with 2 wiimotes :
- Stereowiision : stereo vision with wiimotes (Lang. English)
T. Cuypers(1), T. Van den Eede(2), S. Ligot(2), Y. Francken(1), C. Hermans(1), F. Arickx(3), P. Bekaert(1)
(1) Hasselt University - tUL - IBBT
(2)(3)University of Antwerp
Europe (Belgium)

[Stereowiision – youtube's video from uawiist]

An other evaluation :
- WiiRtrack - an evaluation of a low cost head tracking based on the Wiimote (Lang. English)
J. Frohnmayer1, R. Blach2, T. Gleue2, N. Frangakis3 1Merz Akademie, Hochschule für Gestaltung, Stuttgart, Germany 2CC Virtual Environments, Fraunhofer IAO, Stuttgart, Germany 3Institute of Communication and Computer Systems, Athens, Greece


2. Frequency range

- Development of a System for Measurement and Analysis of Tremor Using a Three-axis Accelerometer
N. Mamorita (1), T. Iizuka (2), A. Takeuchi (1), M. Shirataka (1), N. Ikeda (1) (1) Medical Informatics, Graduate School of Medical Sciences, Kitasato University, Kanagawa, Japan; (2) Department of Neurology, School of Medicine, Kitasato University, Kanagawa, Japan
(link 1)(link 2)
Extract from the abstract (file is not freely available - property and courtesy of US National Library of medicine):
"This system using a Wii Remote is capable of analyzing frequency and estimated amplitude of tremor between 3 Hz and 15 Hz. ... The acceleration data is sampled with about 30msec. After the measurement ends, a power spectral density (Fast Fourier transform method) and peak frequencies are presented.The frequency element that can be measured with this system is 15 Hz or less. Since the frequency elementsof tremor are estimated to be 12 Hz or less, the tremor frequency analysis using this system is applicable."


3. What's up in behavior and cognitive studies

- Dynamic Competition and the Cognitive Bottleneck (Lang. English)
K. Snyder-Tapp, R. Dale, Department of Psychology, Memphis, USA
- Predictive Arm Placement in the Statistical Learning of Position Sequences (Lang. English)
N. D. Duran, R. Dale, Department of Psychology, University of Memphis, USA
- Here, the web site is noticeable, too :
Nintendo Wiimote and experimental psychology : Blending cognition and action (Lang. English)
R. Dale, Assistant Professor, University of Memphis

- Development of Estimation System for Concentrate Situation Using Acceleration sensor (Lang. English) P.131-140
M. Okubo, A. Fujimura Doshiba University, Kyoto, Japan


4. Hardware customization

- Instructional manual on building a modified wiimote with an external Button

- Hacking a Wii Remote for Full 3D Absolute Position and Orientation Sensing
(link 1) (link 2)


5. other links to browse :

- The way Wii were: A blogosphere retrospective (Lang. English)

- jOG : podometer (example of new plugin hardwares) (Lang. English)

- Wii Remote Interaction for Industrial Use (student project report) (Lang. English)
M. Nielsen, M. Stenbacka
Mälardalens högskola, Europe (Sweeden)

- intuitive gestural interface for gamers (transl. : Intuitivité et incorporation des interactions gestuelles chez les utilisateurs de jeux vidéo) (Lang. French)
N. Nova, Liftlab, Switzerland
T. Jobert, CEA-LETI – Minatec®, Switzerland

- Wiimote on the physics hour :

[Wiimote as motion detector - YouTube's Video from pkarcsi55]