click me

📍 New York ·

currently

  • 🎧 on repeat: See You Again — Tyler, The Creator
  • 📖 reading: the Parthenon
  • 🍵 matcha this week: 7

Hi, I'm Arav Dhoot.

I am an undergraduate student at Columbia University, studying Computer Science and Statistics. I am interested in making AI go well. I have worked on consistency training, chain of thought monitorability, model personas, and representation learning. I want to work on ways to make sure we build systems that are i) robust, controllable, and interpretable; ii) capable and intelligent; iii) efficient (in order of priority).

I am currently a SPAR fellow (for a second time!). I have also been a Second Look and CyberNYC fellow.

I have had the privilege of being the advisee of Prof. Junfeng Yang, Dr. Wei Hao, Prof. Kexin Pei, and David Africa.

Outside of research, I might be interesting to talk to if you enjoy conversations on commercial aircraft, philosophical hypotheticals, geopolitics, economic policies, and the history of things that shaped the way the world is today.

Research & Projects

LLM CoTs remain monitorable when being unfaithful requires computation

Arav Dhoot, Yixiong Hao, Zephy Roe

July 2026 · LessWrong

TL;DR

A replication across 11 models from 6 families: models readily follow simple hints without verbalizing them, but revert to baseline on complex hints that require real computation — so unfaithful chains of thought stay monitorable where it matters.

Figure 1 from the CoT monitorability replication

Consistency Training Along the Transformer Stack

Sukrati Gautam*, Neil Shah*, Arav Dhoot*, Bryan Maruyama*, Caroline Wei*, Rohan Kapoor, Robert Sidey, Prakhar Gupta, Zi Cheng Huang, David Demitri Africa (* equal contribution)

June 2026 · accepted at the EMNLP main conference and the AI4GOOD workshop at ICML

Abstract

Consistency training encourages models to behave similarly across different contexts, and has shown promise for reducing misalignment. We broaden the scope of consistency training in two ways. First, we introduce two new internal consistency targets: MLP Consistency Training (MLPCT), which matches post-activation MLP states, and Attention Consistency Training (AttCT), which matches per-head attention distributions. Second, we apply consistency training to four additional safety threats: persona in-context learning attacks, adversarial frustration, prefill attacks, and conditional misalignment. Across several models and threat settings, we find that consistency training reduces misalignment well beyond the sycophancy and jailbreak settings studied in prior work. We also find cases of cross-threat generalization, where training against one failure mode improves robustness to another, and identify a shared residual-stream mechanism underlying ACT, MLPCT, and AttCT, while distinguishing BCT as mechanistically distinct. Our results suggest that consistency training is a flexible and extensible framework for alignment, capable of unifying defenses against a broader class of model pathologies.

Figure 1 from Consistency Training Along the Transformer Stack

Failing to Ragebait the New Gemma

Arav Dhoot, Neil Shah, David Africa

June 2026 · LessWrong

TL;DR

Attempts to reproduce Gemma 3's frustration behaviors on Gemma 4 using repeated rejection, prefill attacks, and reasoning-trace analysis — and fails: the new model stays markedly more stable across every vector tried.

Figure 1 from Failing to Ragebait the New Gemma

SemRep: Generative Code Representation Learning with Code Transformations

Weichen Li, Jiamin Song, Bogdan Alexandru Stoica, Arav Dhoot, Gabriel Ryan, Shengyu Fu, Kexin Pei

March 2026 · accepted at the ICML main conference

Abstract

Code transformation is a foundational capability in the software development process, where its effectiveness relies on constructing a high-quality code representation to characterize the input code semantics and guide the transformation. Existing approaches treat code transformation as an end-to-end learning task, leaving the construction of the representation needed for semantic reasoning implicit in model weights or relying on rigid compiler-level abstractions. We present SemRep, a framework that improves code transformation through generative code representation learning. Our key insight is to employ the semantics-preserving transformations as the intermediate representation, which serves as both a generative mid-training task and the guidance for subsequent instruction-specific code transformations. Across general code editing and optimization tasks (e.g., GPU kernel optimization), SemRep outperforms the extensively finetuned baselines with strictly the same training budget by 6.9% in correctness, 1.1x in performance, 13.9% in generalization, and 6.7% in robustness. With the improved exploration of diverse code transformations, SemRep is particularly amenable to evolutionary search. Combined with an evolutionary coding agent, SemRep finds optimizations that 685B larger-weight baselines fail to discover while achieving the same performance with 25% less inference compute.

Figure 1 from SemRep

NEO-FLOOD: Neuromorphic Onboard Flood-Mapping

Arav Dhoot*, Farhaan Siddiqui*, Rohan Timmaraju*, Bhavyansh Sabharwal* (* equal contribution)

September 2025 · winner of the NASA Beyond the Algorithm Challenge and its Audience Favorite Award

TL;DR

A satellite architecture that puts flood detection directly in orbit: spiking neural networks fuse optical and synthetic-aperture-radar imagery onboard power-efficient neuromorphic processors (Intel Loihi 2, BrainChip Akida, 2–5W), cutting flood intelligence delivery from the usual hours down to minutes for emergency and humanitarian response.

Two NEO-FLOOD team members holding the $100,000 winner's check at the NASA Beyond the Algorithm Challenge

Severity Classification of Parkinson's Disease via Synthesis of Energy Skeleton Images from Videos Produced in Uncontrolled Environments

Nejib Ben Hadj-Alouane, Arav Dhoot, Monia Turki-Hadj Alouane, Vinod Pangracious

November 2024 · published in Diagnostics

Abstract

Parkinson's Disease is a prevalent neurodegenerative disorder affecting millions worldwide, with early diagnosis remaining a critical challenge, particularly in underserved areas. This paper proposes a novel framework for the diagnosis and severity classification of PD using video data captured in uncontrolled environments. Leveraging deep learning techniques, the approach synthesizes Skeleton Energy Images (SEIs) from gait sequences and employs a CNN, a ResNet, and a Vision Transformer to analyze these images, allowing accurate detection of PD and differentiation of its severity without specialized equipment or professional oversight. The ResNet-18 model achieved 100% test accuracy, with the ViT and CNN five-layer models at 99.96% and 96.40% respectively. Given the nature of the dataset used, the framework stands to function as a cost-effective and accessible tool for early PD detection in various healthcare settings.

Figure 1 from the Parkinson's severity classification paper