Rajiv Ratn Shah

Assistant Professor
Google Scholar

Rajiv Ratn Shah currently works as an Assistant Professor in the Department of Computer Science and Engineering (joint appointment with the Department of Human-centered Design) at IIIT-Delhi. He is the founder of MIDAS lab at IIIT-Delhi. He received his Ph.D. in computer science from the National University of Singapore, Singapore. Before joining IIIT-Delhi, he worked as a Research Fellow in Living Analytics Research Center (LARC) at the Singapore Management University, Singapore. Prior to completing his Ph.D., he received his M.Tech. and M.C.A. degrees in Computer Applications from the Delhi Technological University, Delhi and Jawaharlal Nehru University, Delhi, respectively. He has also received his B.Sc. in Mathematics (Honors) from the Banaras Hindu University, Varanasi. Dr. Shah is the recipient of several awards, including the prestigious Heidelberg Laureate Forum (HLF) and European Research Consortium for Informatics and Mathematics (ERCIM) fellowships. He has also received the best paper award in the IWGS workshop at the ACM SIGSPATIAL conference 2016, San Francisco, USA and was runner-up in the Grand Challenge competition of ACM International Conference on Multimedia 2015, Brisbane, Austraila. He is involved in organizing and reviewing of many top-tier international conferences and journals. Recently, he has organized a workshop on Multimodal Representation, Retrieval, and Analysis of Multimedia Content (MR2AMC) in the conjunction of the first IEEE MIPR 2018 conference. His research interests include multimedia content processing, natural language processing, image processing, multimodal computing, data science, social media computing, and the internet of things.

Specifically, his current research interests include:

  • Multimodal deep learning based healthcare solutions

  • Multimodal fake news detection using deep learning techniques

  • Multimodal semantic and sentiment analysis of user-generated social media content

  • Event detection and recommendation on social media

  • Multimodal multimedia search, retrieval, and recommendation

  • Deep learning based multimedia systems


User Input Based Style Transfer While Retaining Facial Attributes

Text2FaceGAN: Face Generation from Fine Grained Textual Descriptions

Supervised Generative Adversarial Cross-modal Hashing by Transferring Pairwise Similarities for Venue Discovery.

Are you paying attention? Detecting Distracted Driving in Real-time.

Transfer Learning for Detecting Hateful Sentiments in Code Switched Language

Multilingual Sentiment Analysis

Deep Learning Approaches for Speech Emotion Recognition

Aspect Based Sentiment Analysis of Financial Headlines and Microblogs

Harnessing GANs for Zero-shot Learning of New Classes in Visual Speech Recognition.

MeTooMA: Multi-Aspect Annotations of Tweets Related to the MeToo movement.

SpotFake+: A Multimodal Framework for Fake News Detection via Transfer Learning

Video Summarization using Global Attention with Memory Network and LSTM

MobiVSR: Efficient and Light-weight Neural Network for Visual Speech Recognition on Mobile Devices.

Multimodal Analysis of Disaster Tweets

Maybe look closer? Detecting Trolling Prone Images on Instagram.

Automating Car Insurence Claims using Deep Learning Techniques.

Bagged support vector machines for emotion recognition from speech.

SpotFake: A Multimodal Framework For Fake News Detection

Universal EEG Encoder for Learning Diverse Intelligent Tasks

Facefetch: An Efficient and Scalable Face Retrieval System That uses Your Visual Memory

CISNet - Leveraging Community Interaction and Social Network Graphs For Detection Of Religious Hate Speech In Arabic

ARHNet-Leveraging Community Interaction for Detection of Religious Hate Speech in Arabic

MIDAS at SemEval-2019 Task 9: Suggestion Mining from Online Reviews using ULMFiT.

MIDAS at SemEval-2019 Task 6: Identifying Offensive Posts and Targeted Offense from Twitter

Speak up, Fight Back! Detection of Social Media Disclosures of Sexual Harassment

SNAP-BATNET: Cascading Author Profiling and Social Network Graphs for Suicide Ideation Detection on Social Media

Identifying Adverse Drug Reactions and Personal Health Experience Mentions from Twitter

Investigating Political Herd Mentality: A Community Sentiment Based Approach

IceBreaker: Solving Cold Start Problem for Video Recommendation Engines

MyLipper: A Personalized System for Speech Reconstruction using Multi-view Visual Feeds

Multilingual Author Profiling from SMS

Harnessing AI for Kidney Glomeruli Classification

Did you offend me? Classification of Offensive Tweets in Hinglish Language

Identification of Emergency Blood Donation Request on Twitter

Exploring and Learning Suicidal Ideation Connotations in Social Media with DL

Neural Machine Translation for English-Tamil

Mind Your Language: Abuse and Offense Detection for Code-Switched Languages

DeepLip: Speaker Independent Speech Synthesis using Multi-View Lipreading

Lipper: Synthesizing Thy Speech using Multi-View Lipreading

Exploring Classification of Histological Disease Bio-markers from Renal Biopsy Images

Kiki Kills: Identifying Dangerous Challenge Videos from Social Media

Harnessing AI for Speech Reconstruction using Multi-view Silent Video Feed

Learning and Fusing Multimodal Deep Features for Acoustic Scene Categorization

Detecting Offensive Tweets in Hindi-English Code-Switched Language

Key2Vec: Automatic Ranked Keyphrase Extraction from Scientific Articles using Phrase Embeddings

Aspect-Based Financial Sentiment Analysis using Deep Learning

Did you take the #pill? - Detecting Personal Intake of Medicine from Twitter

Feature-based Map Matching for Low-Sampling-Rate GPS Trajectories

Geometry-based Localization for GPS Outage in Vehicular Cyber Physical Systems

FastShrinkage: Perceptually-aware Retargeting Toward Mobile Platforms

Virtualization in Wireless Sensor Networks: Fault Tolerant Embedding for Internet of Things