Adversarial Masking Approach for Robust Target Source Localization in the SH Domain
Gyanajyoti Routray, Priyadarshini Dwivedi, Rahul Peter, Rajesh M. Hegde
Asilomar 2025 (Paper #1523)
About My Journey
I started out making music in my bedroom when I was 15, and I got deep into production during my later years. During my undergrad, coursework in DSP and math brought me closer to my interests. I couldn't go for my higher studies right after my bachelors's (to save up), during which I worked as a software engineer. During this time, I was able to beef up my coding skills and craft a path for me to pursue my research in acoustics and signal processing (which I'm now invested in at Aalto). I'm continuing to do this by participating in challenges with ML/Audio/Acoustics and even winning one this year. I'll continue to push these boundaries.
Background
I spent 2 years at PineLabs building scalable fintech microservices (Kotlin + Rust + Docker/Kubernetes), automating deployments, and optimizing webhook failure pipelines. Under the hood I mastered CI/CD, cloud infra and high-throughput data processing. Just right after I left my job, I've been invested in spatial audio and 3D signal processing research (more particularly sound source localization). Other than that I engage in audio information retrieval and deep learning for audio signal processing.
Focus Areas
• Spatial Audio & SELD: Sound event localization with Conformer models trained on synthetic stereo via SpatialScaper
• DCASE & QVIM Challenges: Ensemble-based ML pipelines (PaSST, PANNs, BEATs) with DSP-driven data augmentation
• Acoustics & TDOA: ICASSP research on beamforming and adversarial masking for robust source localization
• Psychoacoustics & Interactive Audio: Designing real-time DSP tools for immersive audio experiences (plugin in the works)
Approach
I try to deconstruct complex technical logic (which I used to abstract in my early days) and apply the same to real-world scenarios. Now I'm learning more at my uni!
Technical Skills
Building expertise across the acoustics spectrum
Acoustic Measurement
- Sound Level Meters
- FFT & STFT Analysis
- Impulse Response
- Reverberation Time
- MATLAB/Python
Audio Engineering
- DSP Algorithm Design
- Pro Tools
- Ableton Live
- Loudspeaker Tuning
- Real-time Audio Plugins
Signal Processing
- TDOA & Beamforming
- Variational Mode Decomposition
- Log-Mel & FOA Feature Extraction
Machine Learning
- PyTorch/TensorFlow
- Conformer Architectures
- Data Augmentation (SpatialScaper, RIRs)
- SELD
Microservices & DevOps
- Kotlin/Ktor
- Rust
- Docker & Kubernetes
- CI/CD
- AWS/GCP
Creative Coding
- React/Next.js
- Three.js Waveform Visuals
- Max4Live (Gen~)
- MIDI Scripting
Featured Projects
Showcasing practical applications of acoustic engineering principles
Publications
Selected Papers
Titles, authors, and links to the work. No abstracts here.
Real-Time Audio Monitoring Pipeline with Edge Inference and IoT Supervision via ThingsBoard
Rahul Peter, Vivek Mohan
AES International Conference on Artificial Intelligence and Machine Learning for Audio 2025 — Late Breaking
The Creatives
Side quests in music production and interactive audio tools
Electronic Music by me
Experience & Education
Building expertise through education and hands-on experience
M.Sc. Acoustics & Audio Technology (incoming)
Sept 2025 – PresentAalto University
Specializing in spatial audio, environmental noise control, and psychoacoustics.
Awarded with the Aalto Excellency scholarship
Backend Developer – PineLabs (Fintech)
2023 – 2025PineLabs, Bengaluru
Designed and maintained Kotlin/Ktor microservices, built Rust DLQ processors for webhook reliability, and led CI/CD pipelines on Kubernetes.
Reduced webhook failures by 36% with Rust retry logicAutomated 10+ deployment pipelines (Docker, Helm)
Researcher (part time) – Multimodal Information Processing Lab
Jul 2024 – Sep 2024IIT Kanpur
Conducted beamforming and TDOA experiments for source localization. Drafted an ICASSP and ASILOMAR paper on adversarial masking.
Part of the research team for the publications
B.E. Electronics & Communication
2019 – 2023Birla Institute of Technology and Science, Pilani, K.K. Birla Goa Campus
Specializing in Signal Processing, Programming, Applied Mathematics and Algorithms.
CGPA: 8.14/10.00Research in Speech Signal Processing
Let's Connect
Whether you’re hiring for audio research, backend engineering, or creative collaborations, let’s connect!