Dr Arindam Dey

Lecturer Computing Digital Literacy

School of Information Technology and Electrical Engineering
Faculty of Engineering, Architecture and Information Technology
a.dey@uq.edu.au
+61 7 336 54537

Overview

I am a Lecturer in the Co-innovation group of UQ's School of ITEE, primarily focusing on Mixed Reality, Empathic Computing, and Human-Computer Interaction. I am co-directing Empathic XR and Pervasive Computing Laboratory. I am a proponent of "for good" research with these technologies and aiming to create positive societal impact with my research. I believe in designing solutions for users and accordingly put users ahead of the technology. Most of my work involves user research and statistics.

Before joining the University of Queensland in August 2018, I was a Research Fellow at the Empathic Computing Laboratory (UniSA) working with one of the world-leaders of Augmented Reality Prof. Mark Billinghurst between 2015 and 2018. Earlier, I held postdoctoral positions at the University of Tasmania, Worcester Polytechnic Institute (USA), and James Cook University. Earlier I completed my Ph.D. under the supervision of Prof. Christian Sandor and Prof. Bruce Thomas at the University of South Australia with a thesis titled Perceptual characteristics of visualizations for occluded objects in handheld augmented reality. During this time I did a research internship at the TU Munich under the supervision of Prof. Gudrun Klinker. I regularly serve as an organizer and a peer-reviewer of multiple international conferences and journals related to my research interests.

Originally, I was born in Kolkata, India (and lived there for 25 years) and now live in Brisbane, Australia with my wife and daughter! When not working, I enjoy spending time with my family and playing Cricket in the summer.

Research Interests

  • Mixed Reality (MR)
    MR is a technology continuum that covers both Augmented Reality (AR) and Virtual Reality (VR). I am interested in designing novel interfaces using both AR, VR, and a combination of both in collaborative applications. I believe MR being a user interface technology, we need to give utmost importance to the users to drive innovation. I am interested to supervise students and create collaborations in the space of user-centered MR.
  • Augmented Reality (AR) and Virtual Reality (VR)
    Both of these technologies are part of the MR continuum and my research interests. I am interested to use these technologies in multiple application domains including but not limited to remote collaborations, affective computing, gaming, education, health, and sustainability. I am a proponent of driving "for good" research using these technologies. If you are interested in one of these areas, I will be very happy to collaborate with and/or supervise.
  • Empathic Computing
    Empathy is about seeing with the eyes of another, listening with the ears of another and feeling with the heart of another. Empathic Computing is a research field that develops computer systems that recognize and share emotions and help people better understand one another. I am interested in creating and sharing empathy in computer-mediated collaboration (CSCW) or in single-user applications. This work involves working with physiological sensors and/or Electroencephalography (EEG). Please contact me if you are interested to explore this innovative space.
  • Human-Computer Interaction (HCI)
    While the above three areas are where I do most of my research, I am also interested in general HCI work including interaction design and visual perception. I will be happy to supervise students in other HCI related projects as well.

Qualifications

  • Doctor of Philosophy, S.Aust.

Publications

  • Dey, Arindam, Chen, Hao, Zhuang, Chang, Billinghurst, Mark and Lindeman, Robert W. (2019). Effects of sharing real-time multi-sensory heart rate feedback in different immersive collaborative virtual environments. 17th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2018, Munich, Germany, 16-20 October 2018. New York, NY, United States :Institute of Electrical and Electronics Engineers. doi: 10.1109/ISMAR.2018.00052

  • Dey, Arindam, Chatourn, Alex and Billinghurst, Mark (2019). Exploration of an EEG-based cognitively adaptive training system in virtual reality. 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Osaka, Japan, 23-27 March 2019. Piscataway, NJ, United States :Institute of Electrical and Electronics Engineers. doi: 10.1109/VR.2019.8797840

  • Dey, Arindam, Billinghurst, Mark, Lindeman, Robert W. and Swan, J. Edward (2018). A systematic review of 10 Years of Augmented Reality usability studies: 2005 to 2014. Frontiers in Robotics and AI, 5 (APR) 37, doi:10.3389/frobt.2018.00037

  • Dey, Arindam, Piumsomboon, Thammathip, Lee, Youngho and Billinghurst, Mark (2017). Effects of sharing physiological states of players in collaborative virtual reality gameplay. 2017 ACM SIGCHI Conference on Human Factors in Computing Systems, CHI 2017, Denver, CO, United States, 6-11 May 2017. New York, NY, United States :Association for Computing Machinery. doi: 10.1145/3025453.3026028

View all Publications

Supervision

  • Doctor Philosophy

  • Doctor Philosophy

  • Master Philosophy

View all Supervision

Available Projects

  • Current collaboration systems between remote users are mostly homogeneous, whereby the collaborators use the same technology and/or devices. These systems do not adapt to the emotional and cognitive states of the users however. This project will explore a mixed reality (MR) heterogeneous system to develop theories, visualizations and interaction methods, with the aim of producing an innovative and validated model of sharing of emotional and cognitive states in MR heterogeneous collaborations. The outcome will include a demonstration prototype, completed user evaluations and design guidelines leading to knowledge transfer and commercialization. This project will inform future larger projects to have significant benefits in industries where remote training and supervision are useful.

  • This project will design, develop, and evaluate cognitively adaptive interface (visualization and interaction methods) for learning using both augmented and virtual reality technologies. Physiological sensors, EEG, eye tracking information will be collected in real time and used to make the interface adaptive.

  • This project will design, develop, and evaluate visualization and interaction methods to share emotional cues between collaborators to make them collaborate seamlessly and understand one another emotionally. This project will involve using physiological sensors, EEG, and Unity 3D/Unreal gaming engine.

View all Available Projects

Publications

Featured Publications

Book Chapter

  • Livingston, Mark A., Dey, Arindam, Sandor, Christian and Thomas, Bruce H. (2012). Pursuit of “X-ray vision” for augmented reality. Human factors in augmented reality environments. (pp. 67-107) edited by Weidong Huang, Leila Alem and Mark A. Livingston.New York, NY USA: Springer New York. doi:10.1007/978-1-4614-4205-9_4

Journal Article

Conference Publication

  • Dey, Arindam, Phoon, Jane, Saha, Shuvodeep, Dobbins, Chelsea and Billinghurst, Mark (2020). Neurophysiological effects of presence in calm virtual environments. 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, Atlanta, GA, United States, 22-26 March 2020. Piscataway, NJ, United States :IEEE. doi: 10.1109/vrw50115.2020.00223

  • Resnyansky, Dmitry, Billinghurst, Mark and Dey, Arindam (2019). An AR/TUI-supported Debugging Teaching Environment. OZCHI'19: The 31st Australian Conference on Human Computer Interaction, Fremantle, WA Australia, December 2019. New York, NY United States :Association for Computing Machinery. doi: 10.1145/3369457.3369538

  • Singh, Katyayani, Srivastava, Ayushi, Achary, Krishnaveni, Dey, Arindam and Sharma, Ojaswa (2019). Augmented reality-based procedural task training application for less privileged children and autistic individuals. International Conference on Virtual-Reality Continuum and its Applications in Industry, Brisbane, QLD, Australia, 14-16 November 2019. New York, NY, United States :Association for Computing Machinery. doi: 10.1145/3359997.3365703

  • Tomar, Yash, Srivastava, Ayushi, Dey, Arindam and Sharma, Ojaswa (2019). Conformal redirected walking for shared indoor spaces. International Conference on Virtual-Reality Continuum and its Applications in Industry, Brisbane, QLD, Australia, 14-16 November 2019. New York, NY, United States :Association for Computing Machinery. doi: 10.1145/3359997.3365702

  • Dey, Arindam, Chen, Hao, Zhuang, Chang, Billinghurst, Mark and Lindeman, Robert W. (2019). Effects of sharing real-time multi-sensory heart rate feedback in different immersive collaborative virtual environments. 17th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2018, Munich, Germany, 16-20 October 2018. New York, NY, United States :Institute of Electrical and Electronics Engineers. doi: 10.1109/ISMAR.2018.00052

  • Dey, Arindam, Chatourn, Alex and Billinghurst, Mark (2019). Exploration of an EEG-based cognitively adaptive training system in virtual reality. 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Osaka, Japan, 23-27 March 2019. Piscataway, NJ, United States :Institute of Electrical and Electronics Engineers. doi: 10.1109/VR.2019.8797840

  • Almohamed, Asam, Dey, Arindam, Zhang, Jinglan and Vyas, Dhaval (2019). Extended reality for refugees: pragmatic ideas through ethnographic research with refugees in Australia. IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Beijing, China, 14-18 October 2019. Piscataway, NJ, United States :Institute of Electrical and Electronics Engineers Inc.. doi: 10.1109/ISMAR-Adjunct.2019.00046

  • Dey, Arindam, Chen, Hao, Hayati, Ashkan, Billinghurst, Mark and Lindeman, Robert W. (2019). Sharing manipulated heart rate feedback in collaborative virtual environments. IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Beijing, China, 14-18 October 2019. Piscataway, NJ, United States :Institute of Electrical and Electronics Engineers. doi: 10.1109/ISMAR.2019.00022

  • Garcia-Godos, Enrique Klein, Williams, Valerie and Dey, Arindam (2019). Who you are is what you tell: Effects of perspectives on virtual reality story experiences. SIGGRAPH Asia, Brisbane, QLD, Australia, 17-20 November 2019. New York, NY, United States :Association for Computing Machinery. doi: 10.1145/3355355.3361879

  • Dey, Arindam, Billinghurst, Mark, Welch, Gregory and Rojas-Munoz, Edgar (2018). 3rd Virtual and Augmented Reality for Good (VAR4Good) Workshop. 17th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Munich, Germany, 16-20 October 2018. Piscataway, NJ United States :IEEE. doi: 10.1109/ISMAR-Adjunct.2018.00105

  • Dey, Arindam, Chen, Hao, Lindeman, Robert W. and Billinghurst, Mark (2018). Effects of manipulating physiological feedback in immersive virtual environments. 5th ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play, CHI PLAY 2018, Melbourne, VIC Australia, 28 - 31 October 2018. New York, NY, United States :Association for Computing Machinery. doi: 10.1145/3242671.3242676

  • Wen, James, Stewart, Amanda, Billinghurst, Mark, Dey, Arindam, Tossell, Chad and Finomore, Victor (2018). He who hesitates is lost (..in thoughts over a robot). 2018 Technology, Mind, and Society Conference, TechMindSociety 2018, Washington, DC, United States, 5-7 April 2018. New York, NY, United States :Association for Computing Machinery. doi: 10.1145/3183654.3183703

  • Lawrence, Louise, Dey, Arindam and Billinghurst, Mark (2018). The effect of video placement in AR conferencing applications. 30th Australian Conference on Computer-Human Interaction, OzCHI 2018, Melbourne, Victoria, 4-7 December 2018 . New York, NY, United States :Association for Computing Machinery. doi: 10.1145/3292147.3292203

  • Dey, Arindam, Billinghurst, Mark, Lindeman, Robert W. and Swan, J. Edward (2017). A Systematic Review of Usability Studies in Augmented Reality between 2005 and 2014. 15th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016, Merida, Mexico, 18-23 September 2016. Piscataway, NJ United States :Institute of Electrical and Electronics Engineers. doi: 10.1109/ISMAR-Adjunct.2016.0036

  • See, Z. S., Sunar, M. S., Billinghurst, M., Dey, A., Santano, D., Esmaeili, H. and Thwaites, H. (2017). An augmented reality and virtual reality pillar for exhibitions: A subjective exploration. Eurographics Association. doi: 10.2312/egve.20171342

  • Piumsomboon, Thammathip, Dey, Arindam, Ens, Barrett, Lee, Gun and Billinghurst, Mark (2017). CoVAR: Mixed-Platform Remote Collaborative Augmented and Virtual Realities System with Shared Collaboration Cues. 16th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017, Nantes, France, 9-13 October 2017. Piscataway, NJ United States :Institute of Electrical and Electronics Engineers. doi: 10.1109/ISMAR-Adjunct.2017.72

  • See, Zi Siang, Sunar, Mohd Shahrizal, Billinghurst, Mark, Dey, Arindam, Santano, Delas, Esmaeili, Human and Thwaites, Harold (2017). Demo: Exhibition approach using an AR and VR pillar. SIGGRAPH Asia 2017 Mobile Graphics and Interactive Applications, SA 2017, Bangkok, Thailand, 27-30 November 2017. Washington, DC United States :Association for Computing Machinery. doi: 10.1145/3132787.3132810

  • Dey, Arindam, Piumsomboon, Thammathip, Lee, Youngho and Billinghurst, Mark (2017). Effects of sharing physiological states of players in collaborative virtual reality gameplay. 2017 ACM SIGCHI Conference on Human Factors in Computing Systems, CHI 2017, Denver, CO, United States, 6-11 May 2017. New York, NY, United States :Association for Computing Machinery. doi: 10.1145/3025453.3026028

  • Piumsomboon, Thammathip, Lee, Youngho, Lee, Gun A., Dey, Arindam and Billinghurst, Mark (2017). Empathic Mixed Reality: Sharing What You Feel and Interacting with What You See. 2017 International Symposium on Ubiquitous Virtual Reality, ISUVR 2017, Nara, Japan, 27-29 June 2017. Piscataway, NJ United States :Institute of Electrical and Electronics Engineers. doi: 10.1109/ISUVR.2017.20

  • Lee, Youngho, Shin, Choonsung, Plopski, Alexander, Itoh, Yuta, Piumsomboon, Thammathip, Dey, Arindam, Lee, Gun, Kim, Seungwon and Billinghurst, Mark (2017). Estimating Gaze Depth Using Multi-Layer Perceptron. 2017 International Symposium on Ubiquitous Virtual Reality, ISUVR 2017, Nara, Japan, 27-29 June 2017. Piscataway, NJ United States :Institute of Electrical and Electronics Engineers. doi: 10.1109/ISUVR.2017.13

  • Chen, Hao, Dey, Arindam, Billinghurst, Mark and Lindeman, Robert W. (2017). Exploring pupil dilation in emotional virtual reality environments. Eurographics Association. doi: 10.2312/egve.20171355

  • Chen, Hao, Dey, Arindam, Billinghurst, Mark and Lindeman, Robert W. (2017). Exploring the design space for multi-sensory heart rate feedback in immersive virtual reality. 29th Australian Computer-Human Interaction Conference, OzCHI 2017, Brisbane, QLD Australia, 28 November- 1 December 2017. New York, NY United States :Association for Computing Machinery. doi: 10.1145/3152771.3152783

  • Lee, Gun, Kim, Seungwon, Lee, Youngho, Dey, Arindam, Piumsomboon, Thammathip, Norman, Mitchell and Billinghurst, Mark (2017). Improving collaboration in augmented video conference using mutually shared gaze. Eurographics Association. doi: 10.2312/egve.20171359

  • Lee, Gun, Kim, Seungwon, Lee, Youngho, Dey, Arindam, Piumsomboon, Thammatip, Norman, Mitchell and Billinghurst, Mark (2017). Mutually Shared Gaze in Augmented Video Conference. 16th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017, Nantes, France, 9-13 October 2017. Piscataway, NJ United States :Institute of Electrical and Electronics Engineers. doi: 10.1109/ISMAR-Adjunct.2017.36

  • Dalim, Che Samihah Che, Piumsomboon, Thammathip, Dey, Arindam, Billinghurst, Mark and Sunar, Shahrizal (2017). TeachAR: An Interactive Augmented Reality Tool for Teaching Basic English to Non-native Children. 15th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016, Merida, Mexico, 18-23 September 2016. Piscataway, NJ United States :Institute of Electrical and Electronics Engineers. doi: 10.1109/ISMAR-Adjunct.2016.0113

  • Dalim, Che Samihah Che, Dey, Arindam, Piumsomboon, Thammathip, Billinghurst, Mark and Sunar, Shahrizal (2017). TeachAR: an interactive augmented reality tool for teaching basic English to non-native children. 15th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016, Merida, Mexico, 18-23 September 2016. Piscataway, NJ, United States :Institute of Electrical and Electronics Engineers. doi: 10.1109/ISMAR-Adjunct.2016.0046

  • Jahani, Hessam, Alyamani, Hasan J., Kavakli, Manolya, Dey, Arindam and Billinghurst, Mark (2017). User evaluation of hand gestures for designing an intelligent in-vehicle interface. 12th International Conference on Design Science Research in Information Systems and Technology, DESRIST 2017, Karlsruhe, Germany, 30 May - 1 June 2017. Heidelberg, Germany :Springer Verlag. doi: 10.1007/978-3-319-59144-5_7

  • Feng, Mi, Dey, Arindam and Lindeman, Robert W. (2016). An initial exploration of a multi-sensory design space: tactile support for walking in immersive virtual environments. IEEE Symposium on 3D User Interfaces (3DUI), Greenville, SC, United States, 19-20 March 2016. Piscataway, NJ, United States :Institute of Electrical and Electronics Engineers. doi: 10.1109/3DUI.2016.7460037

  • Yan, Zhixin, Lindeman, Robert W. and Dey, Arindam (2016). Let your fingers do the walking: a unified approach for efficient short-, medium-, and long-distance travel in VR. IEEE Symposium on 3D User Interfaces (3DUI), Greenville, SC, United States, 19-20 March 2016. Piscataway, NJ, United States :Institute of Electrical and Electronics Engineers . doi: 10.1109/3DUI.2016.7460027

  • Feng, Mi, Dey, Arindam and Lindeman, Robert W. (2016). The effect of multi-sensory cues on performance and experience during walking in immersive virtual environments. 18th IEEE Virtual Reality Conference, VR 2016, Greenville, SC, United States, 19-23 March 2016. Piscataway, NJ, United States :IEEE Computer Society. doi: 10.1109/VR.2016.7504709

  • Maier, Patrick, Dey, Arindam, Waechter, Christian A.L., Sandor, Christian, Tönnis, Marcus and Klinker, Gudrun (2012). An empiric evaluation of confirmation methods for optical see-through head-mounted display calibration. Joint Virtual Reality Conference of ICAT - EGVE - EuroVR, Madrid, Spain, 16-19 October 2012. Graz, Austria :Eurographics Association. doi: 10.2312/EGVE/JVRC12/073-080

  • Weir, Peter, Sandor, Christian, Swoboda, Matt, Nguyen, Thanh, Eck, Ulrich, Reitmayr, Gerhard and Dey, Arindam (2012). BurnAR: feel the heat. 11th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), Atlanta, GA, United States, 5-8 November 2012. Washington, DC, United States :IEEE Computer Society. doi: 10.1109/ISMAR.2012.6402599

  • Sherstyuk, Andrei, Dey, Arindam, Sandor, Christian and State, Andrei (2012). Dynamic eye convergence for head-mounted displays improves user performance in virtual environments. ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, I3D 2012, Costa Mesa, CA, USA, 9-11 March 2012. New York, NY, USA :Association for Computing Machinery. doi: 10.1145/2159616.2159620

  • Benzina, Amal, Dey, Arindam, Tönnis, Marcus and Klinker, Gudrun (2012). Empirical evaluation of mapping functions for navigation in virtual reality using phones with integrated sensors. 10th Asia-Pacific Conference on Computer-Human Interaction, APCHI 2012, Matsue-city, Shimane, Japan, 28-31 August 2012. New York, NY, USA :Association for Computing Machinery. doi: 10.1145/2350046.2350078

  • Sherstyuk, Andrei, Dey, Arindam and Sandor, Christian (2012). Head-turning approach to eye-tracking in immersive virtual environments. 2012 IEEE Virtual Reality Workshops (VRW), Costa Mesa, CA, United States, 4-8 March 2012. IEEE. doi: 10.1109/VR.2012.6180919

  • Dey, Arindam, Jarvis, Graeme, Sandor, Christian and Reitmayr, Gerhard (2012). Tablet versus phone: depth perception in handheld augmented reality. 11th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), Atlanta GA, United States, 5-8 November 2012. New York, NY United States :IEEE. doi: 10.1109/ISMAR.2012.6402556

  • Maier, Patrick, Dey, Arindam, Waechter, Christian A. L., Sandor, Christian, Tonnis, Marcus and Klinker, Gudrun (2011). An empiric evaluation of confirmation methods for optical see-through head-mounted display calibration. IEEE International Symposium on Mixed and Augmented Reality 2011, Basel, Switzerland, 26-29 October 2011. Piscataway, NJ, United States :Institute of Electrical and Electronics Engineers. doi: 10.1109/ismar.2011.6162910

  • Dey, Arindam, Cunningham, Andrew and Sandor, Christian (2010). Evaluating depth perception of photorealistic mixed reality visualizations for occluded objects in outdoor environments. doi: 10.1109/3DUI.2010.5444706

  • Sandor, Christian, Cunningham, Andrew, Dey, Arindam and Mattila, Ville-Veikko (2010). An Augmented Reality X-Ray system based on visual saliency. 9th IEEE International Symposium on Mixed and Augmented Reality 2010, Seoul, South Korea, 13 -16 October 2010. Piscataway, NJ, United States :Institute of Electrical and Electronics Engineers. doi: 10.1109/ismar.2010.5643547

  • Sandor, Christian, Dey, Arindam, Cunningham, Andrew, Barbier, Sebastien, Eck, Ulrich, Urquhart, Donald, Marner, Michael R., Jarvis, Graeme and Rhee, Sang (2010). Egocentric space-distorting visualizations for rapid environment exploration in mobile mixed reality. IEEE Virtual Reality 2010, Waltham, MA, United States, 20-24 March 2010. Piscataway, NJ, United States :Institute of Electrical and Electronics Engineers. doi: 10.1109/vr.2010.5444815

  • Dey, Arindam, Cunningham, Andrew and Sandor, Christian (2010). Evaluating depth perception of photorealistic mixed reality visualizations for occluded objects in outdoor environments. 17th ACM Symposium on Virtual Reality Software and Technology, Hong Kong, 22-24 November 2010. New York, NY, USA :Association for Computing Machinery. doi: 10.1145/1889863.1889911

  • Sandor, Christian, Cunningham, Andrew, Eck, Ulrich, Urquhart, Donald, Jarvis, Graeme, Dey, Arindam, Barbier, Sebastien, Marner, Michael R. and Rhee, Sang (2009). Egocentric space-distorting visualizations for rapid environment exploration in mobile mixed reality. doi: 10.1109/ISMAR.2009.5336461

PhD and MPhil Supervision

Current Supervision

Possible Research Projects

Note for students: The possible research projects listed on this page may not be comprehensive or up to date. Always feel free to contact the staff for more information, and also with your own research ideas.

  • Current collaboration systems between remote users are mostly homogeneous, whereby the collaborators use the same technology and/or devices. These systems do not adapt to the emotional and cognitive states of the users however. This project will explore a mixed reality (MR) heterogeneous system to develop theories, visualizations and interaction methods, with the aim of producing an innovative and validated model of sharing of emotional and cognitive states in MR heterogeneous collaborations. The outcome will include a demonstration prototype, completed user evaluations and design guidelines leading to knowledge transfer and commercialization. This project will inform future larger projects to have significant benefits in industries where remote training and supervision are useful.

  • This project will design, develop, and evaluate cognitively adaptive interface (visualization and interaction methods) for learning using both augmented and virtual reality technologies. Physiological sensors, EEG, eye tracking information will be collected in real time and used to make the interface adaptive.

  • This project will design, develop, and evaluate visualization and interaction methods to share emotional cues between collaborators to make them collaborate seamlessly and understand one another emotionally. This project will involve using physiological sensors, EEG, and Unity 3D/Unreal gaming engine.