Sumit Sarin

I currently work at Google Search on AI Mode and AI Overviews.

I completed my MS in Computer Science at Columbia University in New York, working on computer vision and machine learning problems as a Research Assistant (RA) with Prof. Carl Vondrick.

profile photo

Research

FacET Research [ECCV 2024] FacET: How Video Meetings Change Your Expression
Sumit Sarin, Utkarsh Mall, Purva Tendulkar, Carl Vondrick
European Conference on Computer Vision (ECCV), 2024.
Project Page | Paper | Code

We present FacET, a general-purpose framework to discover interpretable, spatio-temporal trends between two domains, that works even in the presence of dominant biases.

Gait Research CNN-based Multimodal Touchless Biometric Recognition System using Gait and Speech
Sumit Sarin, Antriksh Mittal, Anirudh Chugh, Smriti Srivastava
Journal of Intelligent & Fuzzy Systems, 2022.

We propose a novel touchless multimodal person identification model using deep learning techniques by combining the gait and speech modalities.

Speech Scoring Research Multi-modal Automated Speech Scoring using Attention Fusion
Manraj Singh Grover, Yaman Kumar, Sumit Sarin, Payman Vafaee, Mika Hama, Rajiv Ratn Shah
Arxiv.

In this study, we propose a novel multi-modal end-to-end neural approach for automated assessment of non-native English speakers' spontaneous speech using attention fusion.

Academic Service and Teaching

  • Conference Reviewer: ICLR 2025
  • Teaching Assistant: Analysis of Algorithms I (Spring 2023, Columbia University)

Random

  • In my free time, I enjoy hitting the gym and taking hip-hop/bollywood dance classes.
  • Recently, I have been listening to post-hardcore bands like Dayseeker, Asking Alexandria, and Elijah. I appreciate more recommendations!