WISEglass is our approach to smart eyewear. It is based on WISEnode and embedded into off-the-shelf eyeglasses. The vision behind WISEglass is to embed electronics into regular eyeglasses where the focus is on sensing and processing.
Currently we are working on a 3D printed prototype which will integrate the hardware to a higher degree. The goal is to make all wires disappear and integrate the sensing and processing hardware in a ubiquitous fashion.
- Multi-modal wearable sensor platform.
- Stream data via Bluetooth Smart or store up to 512MB locally.
- Battery runtime of 32 hours.
- Integrate sensing and processing electronics into regular eyeglasses.
- Enable smart eyewear for a wide range of sensing applications.
WISEglass can be used to distinguish different activities of daily life. In a study with 9 participants we evaluated the recognition performance for 20 different activities which were grouped into 9 activity clusters. Using leave-one-person-out cross-validation, we achieved an average recognition rate of 77%. For more details, please see [2, 3].
Screen-use and its timing are important factors for circadian phase shift. Especially when exposed to at night, the light from e.g. a computer screen can induce a phase delay and hence hamper falling asleep. Using a Gaussian Mixture Model classifier we obtained 80%accuracy in the work presented in .
Heart rate estimation
The pulse sensor built into WISEnode can be used to determine heart rate. In our evaluation study  we found the mean root mean square error during stationary activities to be below 9 bpm. In  we integrated the heart rate into a the popular Pac-Man game.
Wireless game controller
To demonstrate the wide range of possible applications we modified the popular Pac-Man game such that it can be controlled using WISEglass . The user controls the moving direction of Pac-Man through head gestures (e.g. shaking head to the left for left) which are sensed by the gyroscope. In addition we integrated a heart rate display into the game so the user can see the effect of playing on the heart rate.
The combination of nutrition monitoring and eyeglasses is an innovating and promising concept. At our lab, we bring this concept into life and prove this is a practical method for the chewing monitoring. By integrating EMG (electromyography) sensor and skull vibration sensor into our eyeglasses, we turn the eyeglasses into "diet eyeglasses", which so far can count chewing numbers online, classifying category of daily food intake . Higher level of integration and better user experience will be our main focus.
-  Amft, O., Wahl, F., Ishimaru, S., and Kunze, K., "Making regular eyeglasses smart.", Pervasive Computing, IEEE 14, 3 (2015), 32–43.
-  Wahl, F., Freund, M., and Amft, O., "WISEglass: Multi-purpose context-aware smart eyeglasses" , ISWC 2015: Proceedings of the 2015 ACM International Symposium on Wearable Computers, ACM. In press.
-  Wahl, F., Freund, M., and Amft, O., "WISEglass: Smart eyeglasses recognising context", Bodynets 2015: Proceedings of the International Conference on Body Area Networks, ACM. In press.
-  Wahl, F., Freund, M., and Amft, O., "Using Smart Eyeglasses as a Wearable Game Controller", Ubicomp 2015: Adjunct Proceedings of the 2015 ACM Conference on Pervasive and Ubiquitous Computing, ACM. In press.
-  Zhang, R., Bernhart, S., & Amft, O.. Diet eyeglasses: Recognising food chewing using EMG and smart eyeglasses. In Proceedings of the International Conference on Wearable and Implantable Body Sensor Networks (BSN’16). IEEE.
-  Amft, O., "Smart eyeglasses, e-textiles, and the future of wearable computing", CIMTEC'16: Proceedings of the 11th International Conference on Medical Applications of Novel Biomaterials and Nanotechnology (CIMTEC'16). Trans Tech Publications.
-  Zhang, R., Amft, O., "Bite Glasses - Measuring chewing using EMG and bone vibration in smart eyeglasses", ISWC 2016: Proceedings of the International Symposium on Wearable Computers (ISWC). ACM.
-  Zhang, R., Amft, O., "Regular-Look Eyeglasses Can Monitor Chewing", ACM. In press.