publications

2024

1. 

   IndraEye: Infrared Electro-Optical Drone-based Aerial Object Detection Dataset

   Manjunath D, Prajwal Gurunath^*, Sumanth Udupa^*, and Suresh Sundaram

   Submitted to NeurIPS Track Datasets and Benchmarks, 2024

   Abs

   Deep neural networks (DNNs) have demonstrated superior performance when trained on well-illuminated environments, given that the images are captured through an Electro-Optical (EO) camera, which offers rich texture content. In critical applications such as aerial surveillance, maintaining consistent reliability of DNNs throughout all times of the day is paramount, including during low-light conditions where EO cameras often struggle to capture relevant details. Furthermore, UAV-based aerial object detection encounters significant scale variability stemming from varying altitudes and slant angles, introducing an additional layer of complexity. Existing approaches consider only illumination change/style variations as the domain shift, while in aerial surveillance, correlation shifts also acts as a hindrance to the performance of DNNs. In this paper we propose a multi-sensor (EO-IR) labelled object detection dataset consisting of 5276 images with 142991 instances covering multiple viewing angles and altitudes, 7 backgrounds and at different times of the day. This dataset serves as an effective resource for UAV-based object detection, facilitating the development of robust DNNs capable of operating round-the-clock. Dataset and source codes are available at https://bit.ly/indraeye.

2. 

   MRFP: Learning Generalizable Semantic Segmentation from Sim-2-Real with Multi-Resolution Feature Perturbation

   Sumanth Udupa^*, Prajwal Gurunath^*, Aniruddh Sikdar^*, and Suresh Sundaram

   IEEE/CVF Computer Vision and Pattern Recognition, CVPR, 2024

   Abs PDF Code

   Deep neural networks have shown exemplary performance on semantic scene understanding tasks on source domains, but due to the absence of style diversity during training, enhancing performance on unseen target domains using only single source domain data remains a challenging task. Generation of simulated data is a feasible alternative to retrieving large style-diverse real-world datasets as it is a cumbersome and budget-intensive process. However, the large domain-specific inconsistencies between simulated and real-world data pose a significant generalization challenge in semantic segmentation. In this work, to alleviate this problem, we propose a novel MultiResolution Feature Perturbation (MRFP) technique to randomize domain-specific fine-grained features and perturb style of coarse features. Our experimental results on various urban-scene segmentation datasets clearly indicate that, along with the perturbation of style-information, perturbation of fine-feature components is paramount to learn domain invariant robust feature maps for semantic segmentation models. MRFP is a simple and computationally efficient, transferable module with no additional learnable parameters or objective functions, that helps state-of-the-art deep neural networks to learn robust domain invariant features for simulation-to-real semantic segmentation.

2023

1. 

   DeepMAO: Deep Multi-Scale Aware Overcomplete Network for Building Segmentation in Satellite Imagery

   Aniruddh Sikdar^*, Sumanth Udupa^*, Prajwal Gurunath^*, and Suresh Sundaram

   Perception Beyond Visible Spectrum (PBVS) Workshop, CVPR, 2023

   Abs PDF Code

   Building segmentation in large-scale aerial images is challenging, especially for small buildings in dense and cluttered urban environments. Complex building structures with highly varied geometric footprints pose an additional challenge for the building segmentation task in satellite imagery. In this work, we propose to tackle the issue of detecting and segmenting small and complex-shaped buildings in Electro-Optical (EO) and SAR satellite imagery. A novel architecture Deep Multi-scale Aware Overcomplete Network (DeepMAO), is proposed that comprises an overcomplete branch that focuses on fine structural features and an undercomplete (U-Net) branch tasked to focus on coarse, semantic-rich features. Additionally, a novel self-regulating augmentation strategy, "Loss-Mix," is proposed to increase pixel representation of misclassified pixels. DeepMAO is simple and efficient in accurately identifying small and geometrically complex buildings. Experimental results on SpaceNet 6 dataset, on both EO and SAR modalities, and the INRIA dataset show that DeepMAO achieves state-of-the-art building segmentation performance, including small and complex-shaped buildings with a negligible increase in the parameter count. In addition, the presence of the over-complete branch in DeepMAO helps in handling the speckle noise present in the SAR image modality.

2021

1. 

   [Oral Presentation] Dynamic Characteristics of Human Hand-Arm System—Analytical and Simulation Approaches

   Raj Dhanush, Prajwal Gurunath, Prajwal Kamath, Ninad Murthy, and C.V. Chandrashekara

   Recent Advances in Machines and Mechanisms, Springer Singapore, 2021

   Abs PDF

   Investigation on the dynamic characteristics of the human hand-arm system plays a crucial role in assessing the health risks involved due to persistent exposure to hand transmitted vibrations (HTV), during operation of hand-operated tools. Finite element analysis and mathematical modelling are widely used computational tools to simulate dynamics of the hand-arm system and provide insights on the dynamic characteristics such as natural frequencies and mode shapes. For the present work, an anatomically accurate 3D model of the hand-arm system, developed using a CT scan, is simulated in ANSYS to determine the natural frequencies and mode shapes. Mathematical model of a three degree of freedom hand-arm system is developed using lumped mass approach, and dynamic characteristics are determined. Emphasis is given primarily to the torsional aspects of the hand-arm system, to analyze the effects of vibration in the vertical direction. A quantitative comparison of the results obtained through simulation and mathematical approaches is provided. The results obtained show good correlation with existing and literature and show good scope for further research in the area of biomechanical analysis on the hand-arm system.