I am a Ph.D. student in the Department of Computer Science and Engineering, IIT Kharagpur, since Jan 2015. My supervisors are Prof. Bivas Mitra and Prof. Niloy Ganguly. I am a part of the Complex Network Research Group (CNeRG) at IIT Kharagpur. In my research, I closely collaborate with Prof. Pradipta De from Georgia Southern University, USA . My research interest lies in the area of Mobile Affective Computing and Human Computer Interaction. Additionally, I also work on the research problems related to transport systems.
Research | Publications | Projects | Academics | Experience | Achievements | Resume | Contact
RESEARCH ABSTRACT [Back to top]
I am working in the area of Mobile Affective Computing. I focus on different aspects of affective computing e.g. affect determination, self-report collection, self-reflection using ubiquitous smart mobile devices. Currently, I am focusing to determine affect based on non-intrusive, low overhead information sources present in smartphone and devising intelligent self-report collection methods. For further details please visit the Projects page.
Keyboard Interaction Driven Emotion Detection on Smartphone [ACII'17] [MobileHCI'17] [IJHCS'19]
A significant amount of smartphone interaction involves keyboard interaction (typing, swyping) owing to the large amount of usage of IM applications like WhatsApp, FB messenger. In these applications, people often express their emotions using different emojis. This provides an opportunity to trace the keyboard interaction details along the emotions reported. Moreoever, the feeling of an emotion often persists for some duration before fading. All these together (typing, swyping, emotion persistence) can be leveraged to develop a non-intrusive way of emotion detection from smartphone interaction.
Experience Sampling Method in Emotion Detection [MCSS(UbiComp Adj)'15] [CCNC'17] [TAFFC'19]
One of the key challenges in developing smartphone based emotion detection applications is to collect the emotion self-reports, which are used as emotion ground truth. In most of the emotion detection systems, the self-reports are collected via Experience Sampling Method (ESM). Designing an ESM schedule involves probing the user repeatedly at suitable moments to collect self-reports. Timely probe generation to collect high fidelity user responses while keeping probing rate low is challenging. In mobile-based ESM, timeliness of the probe is also impacted by user's availability to respond to self-report request. Thus, a good ESM design must consider - probing frequency, timely self-report collection, and notifying at opportune moment to ensure high response quality.
Application of Emotion Detection [Mobicom'18] [COMSNETS'19] [IUI'19]
(a) EmoKey: We develop an emotion-aware keyboard EmoKey for monitoring emotion state over long-period of time. In order to make the predictions accurate we deploy an deep neural network (DNN) on the device. We also measure the resource overhead of executing such a DNN model on the device.
(b) Keyboard Layout Optimization: The advances in affective computing have led to the development of many affect-aware applications. As human emotion can be inferred unobtrusivley based on text-input interaction in smartphone, it becomes imperative to optimize the keyboard layout based on human emotion. We investigate the correlation between auto-suggest usage and huamn emotion, which opens the scope for optimizing the layout by dynamically displaying the auto-suggest facility.
PUBLICATIONS [Back to top]
Google Scholar | DBLP
Surjya Ghosh, Kaustubh Hiware, Niloy Ganguly, Bivas Mitra and Pradipta De; Emotion Detection from Touch Interactions during Text Entry on Smartphones , International Journal of Human-Computer Studies, Elsevier, 2019. (Impact Factor: 2.3) [Article].
Surjya Ghosh, Niloy Ganguly, Bivas Mitra and Pradipta De; Designing An Experience Sampling Method for Smartphone based Emotion Detection, IEEE Transactions on Affective Computing, 2019. (Impact Factor: 4.585) [Early Access]
Mukhopadhyay, D., Mukherjee, A., Ghosh, S., Chakraborty, P., and Biswas, S. (2005); A New Approach for Message Hiding in Steganography and Audio Hiding using Substitution Technique, Journal of The Institution of Engineers, Computer Engineering Division, India, 86(2), 41-- 44. [PDF]
Surjya Ghosh, Kaustubh Hiware, Niloy Ganguly, Bivas Mitra and Pradipta De; Does Emotion Influence the Use of Auto-suggest during Smartphone Typing?, 24th International Conference on Intelligent User Interfaces (ACM IUI 2019), Los Angeles, USA, Mar 2019. [PDF] [PPT]
Surjya Ghosh, Sumit Sahu, Niloy Ganguly, Bivas Mitra and Pradipta De; EmoKey: An Emotion-aware Smartphone Keyboard for Mental Health Monitoring, 11th International Conference on Communication Systems and Networks (COMSNETS 2019), Bangalore, India, Jan 2019 (Poster). [PDF] [Poster] (Best Poster Award - 3rd Place)
Surjya Ghosh, Niloy Ganguly, Bivas Mitra and Pradipta De; Effectiveness of Deep Neural Network Model in Typing-based Emotion Detection on Smartphones, 24th Annual International Conference on Mobile Computing and Networking (ACM Mobicom 2018), New Delhi, India, Oct 2018 (Poster). [PDF] [Poster]
Surjya Ghosh, Niloy Ganguly, Bivas Mitra and Pradipta De; Evaluating Effectiveness of Smartphone Typing as an Indicator of User Emotion, 7th International Conference on Affective Computing and Intelligent Interaction (ACII 2017), San Antonio, Texas, USA, Oct 2017. [PDF] [PPT]
Surjya Ghosh, Niloy Ganguly, Bivas Mitra and Pradipta De; TapSense: Combining Self-Report Patterns and Typing Characteristics for Smartphone based Emotion Detection, 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (ACM MobileHCI 2017), Vienna, Austria, Sep 2017. [PDF] [PPT]
Surjya Ghosh; Emotion-aware Computing using Smartphone, 9th International Conference on Communication Systems and Networks (COMSNETS 2017), Bangalore, India, Jan 2017 (PhD Forum). [PDF]
Surjya Ghosh, Niloy Ganguly, Bivas Mitra and Pradipta De; Towards Designing an Intelligent Experience Sampling Method for Emotion Detection, 14th Annual IEEE Consumer Communications & Networking Conference (IEEE CCNC 2017), Las Vegas, USA, Jan 2017. [PDF] [PPT]
Surjya Ghosh, Vatsalya Chauhan, Niloy Ganguly, Bivas Mitra and Pradipta De; Impact of Experience Sampling Methods on Tap Pattern based Emotion Recognition, 4th ACM Workshop on Mobile Systems for Computational Social Science - MCSS (ACM Ubicomp.15) Osaka, Japan. [PDF] [PPT]
Rohit Verma, Surjya Ghosh, Saketh Mahankali, Niloy Ganguly, Bivas Mitra, and Sandip Chakraborty; ComfRide: A Smartphone based System for Comfortable Public Transport Recommendation, 12th ACM Conference on Recommender Systems (ACM RecSys 2018), Vancouver, Canada, Oct 2018. [PDF] [PPT]
Rohit Verma, Surjya Ghosh, Niloy Ganguly, Bivas Mitra and Sandip Chakraborty; Smart-phone based Spatio-temporal Sensing for Annotated Transit Map Generation, ACM SIGSPATIAL 2017, Redondo Beach, California, USA, Nov 2017. [PDF] [PPT]
Rohit Verma, Surjya Ghosh, Aviral Shrivastava, Niloy Ganguly, Bivas Mitra and Sandip Chakraborty; Unsupervised Annotated City Traffic Map Generation, ACM SIGSPATIAL 2016 (short paper), San Francisco Bay Area, California, USA. [PDF]
Suman Kalyan Maity, Ankan Mullick, Surjya Ghosh, Anil Kumar, Sunny Dhamnani, Sudhansu Bahety, and Animesh Mukherjee; Understanding Psycholinguistic Behavior of Predominant Drunk Texters in Social Media, In IEEE ISCC Workshops - ICTS4eHealth (2018) Natal, Brazil. (Best Paper Award) [PDF]
ACADEMICS [Back to top]
B.Tech. in Computer Science & Engg. from Haldia Institute of Technology, Haldia, India [1999 - 2003]
Spring 2015: Programming and Data Structures Laboratory (CS19001), CSE, IIT Kharagpur
Autumn 2015: Ubiquitous Computing (CS60055), CSE, IIT Kharagpur
Spring 2016: Operating Systems Laboratory (CS30002), CSE, IIT Kharagpur
Autumn 2016: Ubiquitous Computing (CS60055), CSE, IIT Kharagpur
Spring 2017: Complex Networks (CS60078), CSE, IIT Kharagpur
Autumn 2017: Smartphone Computing & Application (CS60009), CSE, IIT Kharagpur
Spring 2018: Machine Learning (CS60050), CSE, IIT Kharagpur
Autumn 2018: Social Computing (CS60017), CSE, IIT Kharagpur
Spring 2019: Information Retrieval (CS60092), CSE, IIT Kharagpur
PROFESSIONAL EXPERIENCE [Back to top]
SAP CRM Consultant, Capgemini India Pvt. Ltd , Kolkata, India [July 2014 - Jan 2015]
Senior Advisory Consultant, IBM India Pvt. Ltd , Kolkata, India [Mar 2013 - Mar 2014]
Assistant Consultant, TATA Consultancy Services Ltd , Kolkata, India [Oct 2003 - Mar 2013]
ACHIEVEMENTS [Back to top]
Received Best Poster Award (3rd Place) at COMSNETS 2019
Received Best Paper Award at ICTS4eHealth 2018
Received Student Scholarship for attending Mobicom 2018
Received COMSNETS Travel Grant for attending COMSNETS 2017, 2018, 2019
Received Student Travel Grant for attending ACII 2017, IUI 2019
Received Microsoft Research India Travel Grant for attending UbiComp 2015, MobileHCI 2017, IUI 2019
CONTACT ME [Back to top]
Permanent Address: Paikpari, Kolaghat, Purba Medinipur, West Bengal-721134, India.
Email addresses: surjya [DOT] ghosh [AT] gmail [DOT] com
Date modified: Mar 27, 2019