Ayush Vaidande
Résumé

AI & Robotics Researcher
CAIR, IIT Mandi

Mandi, Himachal Pradesh
local time

Open to research
collaborations

Teaching robots to see the world with a single camera.

I'm Ayush Vaidande. I build AI that has to work outside the notebook: perception for autonomous mobile robots, language and speech models for Indic languages, and the backends that ship them.

Selected work Get in touch

Live · 3D Gaussian Splatting

Drag to orbit

Fig. 1 A robot maps a room using one 360° camera, then marks obstacles in the map. A running sketch of my current research, rendered in your browser.
Splats
0
Obstacles
0
Pose
0.00, 0.00
Clock
t 00:00.0

01

About

I started in electronics, moved through language models and speech, and now build the eyes of mobile robots.

My degree is in Electronics & Telecommunication with honours in AI/ML. It gave me a grounding in deep learning, NLP and computer vision, and in the signals and hardware that robotics runs on.

Today I'm an AI & Robotics researcher at CAIR, IIT Mandi. Before that, at YellowSense Technologies, I built generative models with speech-to-text and text-to-speech for Indic languages, along with the APIs and databases behind them. I'm driven by LLMs, AI research and well-engineered backends.

Education
B.E. Electronics & TelecommunicationHonours in AI/ML
Currently
AI & Robotics ResearcherCAIR, IIT Mandi · since Jun 2024
Interests
Robot perception, 3D visionLLMs · Speech
Credential
GATE 2024, DS & AIQualified · IISc Bangalore

02

Experience

Where I've worked.

  1. Jun 2024 — Now

    AI & Robotics Researcher

    Centre for Artificial Intelligence & Robotics, IIT Mandi

    Research on perception for autonomous mobile robots: building monocular 3D Gaussian Splatting maps from a single 360° camera and detecting obstacles for navigation.

    • Robotics
    • 360° vision
    • 3DGS
    • Computer vision

  2. Feb — May 2024

    AI/ML & Backend Engineer

    YellowSense Technologies

    Built generative LLMs with TTS/STT for Indic languages, an AI-driven recommendation system for household services, and the databases and APIs that serve them.

    • LLM
    • TTS / STT
    • RecSys
    • Backend

  3. Jun — Jul 2023

    Machine Learning Intern

    Techno Hacks Edu Tech

    Data preprocessing, model development and collaborative problem-solving with Python and ML frameworks.

    • Python
    • Machine learning

03

Selected work

Things I've built.

A

Ongoing researchCAIR, IIT Mandi2024 —

Camera-only mapping for mobile robots

Autonomous mobile robots usually lean on LiDAR or depth sensors to understand a room. This work asks how far one 360° camera can go on its own. Monocular imagery is reconstructed into a 3D Gaussian Splatting map, and that map is used to detect obstacles for navigation.

  • 360° vision
  • 3D Gaussian Splatting
  • Monocular mapping
  • Obstacle detection
  • AMR

  1. aCapture

    One equirectangular 360° frame. No LiDAR, no depth.

  2. bReconstruct

    Build a 3D Gaussian Splatting map from monocular imagery.

  3. cDetect

    Find obstacles in the reconstructed map.

  4. dNavigate

    Plan a path around what the camera found.

BYellowSense2024

Generative AI for Indic languages

LLMs with speech-to-text and text-to-speech for Hindi, Bengali and Marathi, paired with an AI-driven recommendation engine for household services.

  • Generative AI
  • LLM
  • TTS / STT
  • RecSys
  • Backend

Private codebase

CExhibited at IETE2023

Therapy-LLM

A real-time therapy assistant that pairs Llama 2-7B with a fine-tuned model to give empathetic, human-like responses for mental-health support.

  • Python
  • PyTorch
  • Llama 2
  • Fine-tuning

View on GitHub

04

Skills

The toolkit.

AI / ML

  • Large language models
  • Training & fine-tuning
  • NLP & speech (TTS / STT)
  • PyTorch
  • OpenCV

Robotics & vision

  • Computer vision
  • 3D Gaussian Splatting
  • 360° / omnidirectional vision
  • Obstacle detection

Backend & data

  • API & backend development
  • Python
  • Pandas · NumPy
  • SQL
  • Data analysis

Platforms

  • Google Cloud Platform
  • Firebase
  • Git & GitHub
  • Tableau
  • Power BI

Certifications

  • GATE 2024 — Data Science & AI (Qualified)IISc Bangalore
  • Big Data & Machine Learning FundamentalsGoogle Cloud
  • Perform Foundational Infrastructure TasksGoogle Cloud
  • Introduction to Artificial IntelligenceCoursera

05Contact

Have an idea worth building? Let's talk.

I'm open to new projects, research collaborations and opportunities.

vaidandeayush.av@gmail.com