Part-level Instruction Following for Fine-grained Robot Manipulation
Robot Learning Workshop @ ICLR 2025
Shivam Aarya
CS + AMS + Robotics @ Johns Hopkins
Developing embodied AI systems for domestic robotics
SCAI Lab, Johns Hopkins
CoCoSci Lab, MIT
3x Startup Founder (JHU Spark)
About
Hey there! I'm Shivam, a student with a deep passion for robotics and AI. I've always been fascinated by automation, and to me, AI represents its ultimate form. My love for robotics started back in high school, where I was heavily involved in FRC, and that enthusiasm has only grown.
My research focuses on embodied AI and domestic robotics — exploring how robotics and AI can enhance everyday life in domestic settings, making household robots smarter and more helpful. I'm particularly interested in enabling household robots to understand and interact with home environments through vision, language, and fine-grained manipulation. This includes part-level reasoning about objects and their relationships with intended tasks.
I'm currently working on embodied AI for home environments under Prof. Tianmin Shu in the SCAI Lab at Johns Hopkins University. I also recently joined the Computational Cognitive Science (CoCoSci) Lab at MIT as a Research Assistant, working with Prof. Josh Tenenbaum.
Beyond research, I really enjoy building systems, which often pulls me into the startup world. Right now, I'm involved with three ventures, two of which are being incubated by JHU's Spark Accelerator.
If you're into AI, robotics, or just want to chat about cool projects, feel free to reach out!
I believe the future of robotics lies in systems that can seamlessly integrate into our homes, understanding both the physical environment and human intent through multimodal AI.
Publications
Building
Entrepreneurial ventures combining technology and impact
Stealth Project
In development
More details coming soon.
In DevelopmentExperience
Talks, teaching, and service contributions