Dr Arindam Dey

Lecturer Computing Digital Literacy

School of Information Technology and Electrical Engineering
Faculty of Engineering, Architecture and Information Technology
a.dey@uq.edu.au
+61 7 336 54537

Overview

**Currently recruiting Ph.D. students with interests and (some) experience in augmented reality and/or virtual reality. Unity 3D experience and excellent programming skill are required**

I am a Lecturer in the Co-innovation group of UQ's School of ITEE, primarily focusing on Mixed Reality, Empathic Computing, and Human-Computer Interaction. I am a proponent of "for good" research with these technologies and aiming to create positive societal impact with my research. I believe in designing solutions for users and accordingly put users ahead of the technology. Most of my work involves user research and statistics.

Before joining the University of Queensland in August 2018, I was a Research Fellow at the Empathic Computing Laboratory (UniSA) working with one of the world-leaders of Augmented Reality Prof. Mark Billinghurst between 2015 and 2018. Earlier, I held postdoctoral positions at the University of Tasmania, Worcester Polytechnic Institute (USA), and James Cook University. Earlier I completed my Ph.D. under the supervision of Prof. Christian Sandor and Prof. Bruce Thomas at the University of South Australia with a thesis titled Perceptual characteristics of visualizations for occluded objects in handheld augmented reality. During this time I did a research internship at the TU Munich under the supervision of Prof. Gudrun Klinker. I regularly serve as an organizer and a peer-reviewer of multiple international conferences and journals related to my research interests.

Originally, I was born in Kolkata, India (and lived there for 25 years) and now live in Brisbane, Australia with my wife and daughter! When not working, I enjoy spending time with my family and playing Cricket in the summer.

Research Interests

  • Mixed Reality (MR)
    MR is a technology continuum that covers both Augmented Reality (AR) and Virtual Reality (VR). I am interested in designing novel interfaces using both AR, VR, and a combination of both in collaborative applications. I believe MR being a user interface technology, we need to give utmost importance to the users to drive innovation. I am interested to supervise students and create collaborations in the space of user-centered MR.
  • Augmented Reality (AR) and Virtual Reality (VR)
    Both of these technologies are part of the MR continuum and my research interests. I am interested to use these technologies in multiple application domains including but not limited to remote collaborations, affective computing, gaming, education, health, and sustainability. I am a proponent of driving "for good" research using these technologies. If you are interested in one of these areas, I will be very happy to collaborate with and/or supervise.
  • Empathic Computing
    Empathy is about seeing with the eyes of another, listening with the ears of another and feeling with the heart of another. Empathic Computing is a research field that develops computer systems that recognize and share emotions and help people better understand one another. I am interested in creating and sharing empathy in computer-mediated collaboration (CSCW) or in single-user applications. This work involves working with physiological sensors and/or Electroencephalography (EEG). Please contact me if you are interested to explore this innovative space.
  • Human-Computer Interaction (HCI)
    While the above three areas are where I do most of my research, I am also interested in general HCI work including interaction design and visual perception. I will be happy to supervise students in other HCI related projects as well.

Qualifications

  • Doctor of Philosophy, S.Aust.

Publications

  • Piumsomboon, Thammathip, Dey, Arindam, Ens, Barrett, Lee, Gun and Billinghurst, Mark (2019) The effects of sharing awareness cues in collaborative mixed reality. Frontiers in Robotics and Ai, 6 . doi:10.3389/frobt.2019.00005

  • Dey, Arindam, Chen, Hao, Zhuang, Chang, Billinghurst, Mark and Lindeman, Robert W. (2019). Effects of Sharing Real-Time Multi-Sensory Heart Rate Feedback in Different Immersive Collaborative Virtual Environments. In: Proceedings of the 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2018. 17th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2018, Munich, , (165-173). October 16, 2018-October 20, 2018. doi:10.1109/ISMAR.2018.00052

  • Lawrence, Louise, Dey, Arindam and Billinghurst, Mark (2018). The effect of video placement in AR conferencing applications. In: Proceedings of the 30th Australian Computer-Human Interaction Conference, OzCHI 2018. 30th Australian Conference on Computer-Human Interaction, OzCHI 2018, Melbourne, VIC, (453-457). December 4, 2018-December 7, 2018. doi:10.1145/3292147.3292203

View all Publications

Supervision

  • Doctor Philosophy

  • Master Philosophy

View all Supervision

Available Projects

  • Current collaboration systems between remote users are mostly homogeneous, whereby the collaborators use the same technology and/or devices. These systems do not adapt to the emotional and cognitive states of the users however. This project will explore a mixed reality (MR) heterogeneous system to develop theories, visualizations and interaction methods, with the aim of producing an innovative and validated model of sharing of emotional and cognitive states in MR heterogeneous collaborations. The outcome will include a demonstration prototype, completed user evaluations and design guidelines leading to knowledge transfer and commercialization. This project will inform future larger projects to have significant benefits in industries where remote training and supervision are useful.

  • This project will design, develop, and evaluate cognitively adaptive interface (visualization and interaction methods) for learning using both augmented and virtual reality technologies. Physiological sensors, EEG, eye tracking information will be collected in real time and used to make the interface adaptive.

  • This project will design, develop, and evaluate visualization and interaction methods to share emotional cues between collaborators to make them collaborate seamlessly and understand one another emotionally. This project will involve using physiological sensors, EEG, and Unity 3D/Unreal gaming engine.

View all Available Projects

Publications

Book Chapter

  • Livingston, Mark A., Dey, Arindam, Sandor, Christian and Thomas, Bruce H. (2012). Pursuit of “X-ray vision” for augmented reality. In Weidong Huang, Leila Alem and Mark A. Livingston (Ed.), Human factors in augmented reality environments (pp. 67-107) New York, NY USA: Springer New York. doi:10.1007/978-1-4614-4205-9_4

Journal Article

Conference Publication

  • Dey, Arindam, Chen, Hao, Zhuang, Chang, Billinghurst, Mark and Lindeman, Robert W. (2019). Effects of Sharing Real-Time Multi-Sensory Heart Rate Feedback in Different Immersive Collaborative Virtual Environments. In: Proceedings of the 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2018. 17th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2018, Munich, , (165-173). October 16, 2018-October 20, 2018. doi:10.1109/ISMAR.2018.00052

  • Lawrence, Louise, Dey, Arindam and Billinghurst, Mark (2018). The effect of video placement in AR conferencing applications. In: Proceedings of the 30th Australian Computer-Human Interaction Conference, OzCHI 2018. 30th Australian Conference on Computer-Human Interaction, OzCHI 2018, Melbourne, VIC, (453-457). December 4, 2018-December 7, 2018. doi:10.1145/3292147.3292203

  • Dey, Arindam, Chen, Hao, Lindeman, Robert W. and Billinghurst, Mark (2018). Effects of manipulating physiological feedback in immersive virtual environments. In: CHI PLAY 2018 - Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play. 5th ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play, CHI PLAY 2018, Melbourne, VIC Australia, (101-111). 28 - 31 October 2018. doi:10.1145/3242671.3242676

  • Wen, James, Stewart, Amanda, Billinghurst, Mark, Dey, Arindam, Tossell, Chad and Finomore, Victor (2018). He who hesitates is lost (..in thoughts over a robot). In: Proceedings of the Technology, Mind, and Society Conference, TechMindSociety 2018. 2018 Technology, Mind, and Society Conference, TechMindSociety 2018, Washington, DC, United States, (). 5-7 April 2018. doi:10.1145/3183654.3183703

  • Chen, Hao, Dey, Arindam, Billinghurst, Mark and Lindeman, Robert W. (2017). Exploring the design space for multi-sensory heart rate feedback in immersive virtual reality. In: Proceedings of the 29th Australian Computer-Human Interaction Conference: Human-Nature, OzCHI 2017. 29th Australian Computer-Human Interaction Conference, OzCHI 2017, Brisbane, QLD, (108-116). November 28, 2017-December 1, 2017. doi:10.1145/3152771.3152783

  • See, Zi Siang, Sunar, Mohd Shahrizal, Billinghurst, Mark, Dey, Arindam, Santano, Delas, Esmaeili, Human and Thwaites, Harold (2017). Demo: Exhibition approach using an AR and VR pillar. In: SIGGRAPH Asia 2017 Mobile Graphics and Interactive Applications, SA 2017. SIGGRAPH Asia 2017 Mobile Graphics and Interactive Applications, SA 2017, Bangkok, , (). November 27, 2017-November 30, 2017. doi:10.1145/3132787.3132810

  • Piumsomboon, Thammathip, Dey, Arindam, Ens, Barrett, Lee, Gun and Billinghurst, Mark (2017). CoVAR: Mixed-Platform Remote Collaborative Augmented and Virtual Realities System with Shared Collaboration Cues. In: Adjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017. 16th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017, Nantes, , (218-219). October 9, 2017-October 13, 2017. doi:10.1109/ISMAR-Adjunct.2017.72

  • Lee, Gun, Kim, Seungwon, Lee, Youngho, Dey, Arindam, Piumsomboon, Thammatip, Norman, Mitchell and Billinghurst, Mark (2017). Mutually Shared Gaze in Augmented Video Conference. In: Adjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017. 16th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017, Nantes, , (79-80). October 9, 2017-October 13, 2017. doi:10.1109/ISMAR-Adjunct.2017.36

  • Piumsomboon, Thammathip, Lee, Youngho, Lee, Gun A., Dey, Arindam and Billinghurst, Mark (2017). Empathic Mixed Reality: Sharing What You Feel and Interacting with What You See. In: Proceedings - 2017 International Symposium on Ubiquitous Virtual Reality, ISUVR 2017. 2017 International Symposium on Ubiquitous Virtual Reality, ISUVR 2017, Nara, , (38-41). June 27, 2017-June 29, 2017. doi:10.1109/ISUVR.2017.20

  • Lee, Youngho, Shin, Choonsung, Plopski, Alexander, Itoh, Yuta, Piumsomboon, Thammathip, Dey, Arindam, Lee, Gun, Kim, Seungwon and Billinghurst, Mark (2017). Estimating Gaze Depth Using Multi-Layer Perceptron. In: Proceedings - 2017 International Symposium on Ubiquitous Virtual Reality, ISUVR 2017. 2017 International Symposium on Ubiquitous Virtual Reality, ISUVR 2017, Nara, , (26-29). June 27, 2017-June 29, 2017. doi:10.1109/ISUVR.2017.13

  • Dey, Arindam, Billinghurst, Mark, Lindeman, Robert W. and Swan, J. Edward (2017). A Systematic Review of Usability Studies in Augmented Reality between 2005 and 2014. In: Adjunct Proceedings of the 2016 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016. 15th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016, Merida, Yucatan, , (49-50). September 18, 2016-September 23, 2016. doi:10.1109/ISMAR-Adjunct.2016.0036

  • Dalim, Che Samihah Che, Piumsomboon, Thammathip, Dey, Arindam, Billinghurst, Mark and Sunar, Shahrizal (2017). TeachAR: An Interactive Augmented Reality Tool for Teaching Basic English to Non-native Children. In: Adjunct Proceedings of the 2016 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016. 15th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016, Merida, Yucatan, , (344-345). September 18, 2016-September 23, 2016. doi:10.1109/ISMAR-Adjunct.2016.0113

  • Dey, Arindam, Piumsomboon, Thammathip, Lee, Youngho and Billinghurst, Mark (2017). Effects of sharing physiological states of players in collaborative virtual reality gameplay. In: CHI 2017 - Proceedings of the 2017 ACM SIGCHI Conference on Human Factors in Computing Systems: Explore, Innovate, Inspire. 2017 ACM SIGCHI Conference on Human Factors in Computing Systems, CHI 2017, Denver, CO, United States, (4045-4056). 6-11 May 2017. doi:10.1145/3025453.3026028

  • Dalim, Che Samihah Che, Dey, Arindam, Piumsomboon, Thammathip, Billinghurst, Mark and Sunar, Shahrizal (2017). TeachAR: an interactive augmented reality tool for teaching basic English to non-native children. In: Adjunct Proceedings of the 2016 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016. 15th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016, Merida, Mexico, (82-86). 18-23 September 2016. doi:10.1109/ISMAR-Adjunct.2016.0046

  • Jahani, Hessam, Alyamani, Hasan J., Kavakli, Manolya, Dey, Arindam and Billinghurst, Mark (2017). User evaluation of hand gestures for designing an intelligent in-vehicle interface. In: DESRIST 2017: Designing the Digital Transformation. 12th International Conference on Design Science Research in Information Systems and Technology, DESRIST 2017, Karlsruhe, Germany, (104-121). 30 May - 1 June 2017. doi:10.1007/978-3-319-59144-5_7

  • Feng, Mi, Dey, Arindam and Lindeman, Robert W. (2016). An initial exploration of a multi-sensory design space: tactile support for walking in immersive virtual environments. In: B. H. Thomas, R. Lindeman and M. Marchal, 2016 IEEE Symposium On 3D User Interfaces (3DUI). IEEE Symposium on 3D User Interfaces (3DUI), Greenville, SC, United States, (95-104). 19-20 March 2016. doi:10.1109/3DUI.2016.7460037

  • Yan, Zhixin, Lindeman, Robert W. and Dey, Arindam (2016). Let your fingers do the walking: a unified approach for efficient short-, medium-, and long-distance travel in VR. In: B. H. Thomas, R. Lindeman and M. Marchal, 2016 IEEE Symposium On 3D User Interfaces (3DUI) . IEEE Symposium on 3D User Interfaces (3DUI), Greenville, SC, United States, (27-30). 19-20 March 2016. doi:10.1109/3DUI.2016.7460027

  • Feng, Mi, Dey, Arindam and Lindeman, Robert W. (2016). The effect of multi-sensory cues on performance and experience during walking in immersive virtual environments. In: 2016 IEEE Virtual Reality Conference, VR 2016 - Proceedings. 18th IEEE Virtual Reality Conference, VR 2016, Greenville, SC, United States, (173-174). 19-23 March 2016. doi:10.1109/VR.2016.7504709

  • Weir, Peter, Sandor, Christian, Swoboda, Matt, Nguyen, Thanh, Eck, Ulrich, Reitmayr, Gerhard and Dey, Arindam (2012). BurnAR: feel the heat. In: 2012 IEEE International Symposium On Mixed and Augmented Reality (ISMAR) - Science and Technology. 11th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), Atlanta, GA, United States, (331-332). 5-8 November 2012. doi:10.1109/ISMAR.2012.6402599

  • Sherstyuk, Andrei, Dey, Arindam, Sandor, Christian and State, Andrei (2012). Dynamic eye convergence for head-mounted displays improves user performance in virtual environments. In: Stephen N. Spencer, I3D '12 Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games. ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, I3D 2012, Costa Mesa, CA, USA, (23-30). 9-11 March 2012. doi:10.1145/2159616.2159620

  • Benzina, Amal, Dey, Arindam, Tönnis, Marcus and Klinker, Gudrun (2012). Empirical evaluation of mapping functions for navigation in virtual reality using phones with integrated sensors. In: APCHI'12 - Proceedings of the 2012 Asia Pacific Conference on Computer-Human Interaction. 10th Asia-Pacific Conference on Computer-Human Interaction, APCHI 2012, Matsue-city, Shimane, Japan, (149-158). 28-31 August 2012. doi:10.1145/2350046.2350078

  • Sherstyuk, Andrei, Dey, Arindam and Sandor, Christian (2012). Head-turning approach to eye-tracking in immersive virtual environments. In: 2012 IEEE Virtual Reality Workshops (VRW), Costa Mesa, CA, United States, (137-138). 4-8 March 2012. doi:10.1109/VR.2012.6180919

  • Dey, Arindam, Jarvis, Graeme, Sandor, Christian and Reitmayr, Gerhard (2012). Tablet versus phone: depth perception in handheld augmented reality. In: 2012 IEEE International Symposium On Mixed and Augmented Reality (Ismar) - Science and Technology. 11th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), Atlanta GA, United States, (187-196). 5-8 November 2012.

  • Maier, Patrick, Dey, Arindam, Waechter, Christian A. L., Sandor, Christian, Tonnis, Marcus and Klinker, Gudrun (2011). An empiric evaluation of confirmation methods for optical see-through head-mounted display calibration. In: 2011 10th IEEE International Symposium on Mixed and Augmented Reality. IEEE International Symposium on Mixed and Augmented Reality 2011, Basel, Switzerland, (267-268). 26-29 October 2011. doi:10.1109/ismar.2011.6162910

  • Dey, Arindam, Cunningham, Andrew and Sandor, Christian (2010). Evaluating depth perception of photorealistic mixed reality visualizations for occluded objects in outdoor environments. In: , , (127-128). . doi:10.1109/3DUI.2010.5444706

  • Sandor, Christian, Cunningham, Andrew, Dey, Arindam and Mattila, Ville-Veikko (2010). An Augmented Reality X-Ray system based on visual saliency. In: Tobias Höllerer, Vincent Lepetit and Jun Park, 2010 IEEE International Symposium on Mixed and Augmented Reality. 9th IEEE International Symposium on Mixed and Augmented Reality 2010, Seoul, South Korea, (27-36). 13 -16 October 2010. doi:10.1109/ismar.2010.5643547

  • Sandor, Christian, Dey, Arindam, Cunningham, Andrew, Barbier, Sebastien, Eck, Ulrich, Urquhart, Donald, Marner, Michael R., Jarvis, Graeme and Rhee, Sang (2010). Egocentric space-distorting visualizations for rapid environment exploration in mobile mixed reality. In: Benjamin Lok, Gudrun Klinker and Ryohei Nakatsu, 2010 IEEE Virtual Reality Conference (VR). IEEE Virtual Reality 2010, Waltham, MA, United States, (-47). 20-24 March 2010. doi:10.1109/vr.2010.5444815

  • Dey, Arindam, Cunningham, Andrew and Sandor, Christian (2010). Evaluating depth perception of photorealistic mixed reality visualizations for occluded objects in outdoor environments. In: Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology. 17th ACM Symposium on Virtual Reality Software and Technology, Hong Kong, (211-218). 22-24 November 2010. doi:10.1145/1889863.1889911

  • Sandor, Christian, Cunningham, Andrew, Eck, Ulrich, Urquhart, Donald, Jarvis, Graeme, Dey, Arindam, Barbier, Sebastien, Marner, Michael R. and Rhee, Sang (2009). Egocentric space-distorting visualizations for rapid environment exploration in mobile mixed reality. In: , , (211-212). . doi:10.1109/ISMAR.2009.5336461

PhD and MPhil Supervision

Current Supervision

  • Doctor Philosophy — Principal Advisor

  • Master Philosophy — Principal Advisor

    Other advisors:

Possible Research Projects

Note for students: The possible research projects listed on this page may not be comprehensive or up to date. Always feel free to contact the staff for more information, and also with your own research ideas.

  • Current collaboration systems between remote users are mostly homogeneous, whereby the collaborators use the same technology and/or devices. These systems do not adapt to the emotional and cognitive states of the users however. This project will explore a mixed reality (MR) heterogeneous system to develop theories, visualizations and interaction methods, with the aim of producing an innovative and validated model of sharing of emotional and cognitive states in MR heterogeneous collaborations. The outcome will include a demonstration prototype, completed user evaluations and design guidelines leading to knowledge transfer and commercialization. This project will inform future larger projects to have significant benefits in industries where remote training and supervision are useful.

  • This project will design, develop, and evaluate cognitively adaptive interface (visualization and interaction methods) for learning using both augmented and virtual reality technologies. Physiological sensors, EEG, eye tracking information will be collected in real time and used to make the interface adaptive.

  • This project will design, develop, and evaluate visualization and interaction methods to share emotional cues between collaborators to make them collaborate seamlessly and understand one another emotionally. This project will involve using physiological sensors, EEG, and Unity 3D/Unreal gaming engine.