{"id":1399,"date":"2025-10-06T20:27:57","date_gmt":"2025-10-06T20:27:57","guid":{"rendered":"https:\/\/scipapermill.com\/index.php\/2025\/10\/06\/domain-adaptation-breakthroughs-from-efficient-llms-to-robotic-perception\/"},"modified":"2025-12-28T21:59:32","modified_gmt":"2025-12-28T21:59:32","slug":"domain-adaptation-breakthroughs-from-efficient-llms-to-robotic-perception","status":"publish","type":"post","link":"https:\/\/scipapermill.com\/index.php\/2025\/10\/06\/domain-adaptation-breakthroughs-from-efficient-llms-to-robotic-perception\/","title":{"rendered":"Domain Adaptation Breakthroughs: From Efficient LLMs to Robotic Perception"},"content":{"rendered":"

Latest 50 papers on domain adaptation: Oct. 6, 2025<\/h3>\n

Domain adaptation (DA) is a cornerstone of robust AI, enabling models trained in one environment to perform effectively in another. Yet, the chasm between source and target domains \u2013 whether due to differing data distributions, imaging modalities, or even accents \u2013 remains a persistent challenge. Recent research has unveiled a flurry of groundbreaking methods that not only bridge this gap but do so with unprecedented efficiency, privacy, and precision, pushing the boundaries of what\u2019s possible in diverse fields from healthcare to autonomous systems. This digest delves into these exciting advancements, synthesizing key innovations that are shaping the future of adaptable AI.<\/p>\n

The Big Idea(s) & Core Innovations<\/h3>\n

The overarching theme in recent domain adaptation research is a drive towards efficiency and robustness<\/strong>, often leveraging sophisticated techniques like self-supervision, visual reprogramming, and foundational models. For instance, in Unsupervised Domain Adaptation (UDA)<\/em>, researchers are finding ways to adapt models without requiring any labeled data from the target domain, significantly reducing annotation costs.<\/p>\n

A standout innovation is VirDA: Reusing Backbone for Unsupervised Domain Adaptation with Visual Reprogramming<\/strong> by Duy Nguyen and Dat Nguyen from Hanoi University of Science and Technology and Harvard University. They propose a method that achieves higher accuracy with fewer parameters by introducing visual reprogramming layers, enabling pre-trained models to be reused across different domains without fine-tuning the entire backbone. This is a game-changer for resource-constrained environments.<\/p>\n

Another significant leap in source-free scenarios comes from Consistent Assistant Domains Transformer for Source-free Domain Adaptation<\/strong> by Rory Shao, which leverages self-supervised learning and self-distillation to enhance cross-domain performance. Similarly, the Vicinity-Guided Discriminative Latent Diffusion for Privacy-Preserving Domain Adaptation<\/strong> by Jing Wang and colleagues at The University of British Columbia introduces DVD, an LDM-based framework that enables explicit knowledge transfer without exposing raw source data\u2014a critical advancement for privacy-sensitive applications like healthcare.<\/p>\n

In the realm of medical imaging<\/strong>, Multi-Domain Brain Vessel Segmentation Through Feature Disentanglement<\/strong> by Francesco Galati et al.\u00a0from EURECOM demonstrates robust cross-modal segmentation by preserving vessel spatial information during image translation. This is complemented by B\u00e9zier Meets Diffusion: Robust Generation Across Domains for Medical Image Segmentation<\/strong> from Chen Li and team, which uses B\u00e9zier-curve-based style transfer and conditional diffusion models to generate synthetic labeled images, effectively reducing domain gaps and improving segmentation robustness. Furthermore, pFedSAM: Personalized Federated Learning of Segment Anything Model for Medical Image Segmentation<\/strong> by Tong Wang et al.\u00a0(Zhejiang University) integrates parameter-efficient adaptation with federated learning, tailoring powerful models like SAM to diverse medical datasets while preserving privacy.<\/p>\n

Language models<\/strong> are also seeing transformative domain adaptation strategies. Dynamic Prompt Fusion for Multi-Task and Cross-Domain Adaptation in LLMs<\/strong> by Xin Hu and colleagues introduces dynamic prompt scheduling to improve cross-domain generalization, making LLMs more versatile. For specialized applications, 3DS: Medical Domain Adaptation of LLMs via Decomposed Difficulty-based Data Selection<\/strong> by Hongxin Ding et al.\u00a0from Peking University leverages a two-stage data selection framework to significantly enhance LLM performance in medical microdomains. Moreover, Agent Fine-tuning through Distillation for Domain-specific LLMs in Microdomains<\/strong> by Raja Vavekanand and Kira Sam (OpenAI, Qwen Team) uses distillation techniques for efficient, domain-specific LLM adaptation, reducing computational overhead.<\/p>\n

Addressing the unique challenges in robotics<\/strong>, EgoBridge: Domain Adaptation for Generalizable Imitation from Egocentric Human Data<\/strong> by Ryan Punamiya et al.\u00a0(Georgia Institute of Technology) aligns latent representations between humans and robots using Optimal Transport, achieving up to 44% improvement in policy success rates for real-world manipulation tasks. This enables robots to learn complex behaviors directly from human demonstrations.<\/p>\n

For remote sensing and computer vision<\/strong>, papers like Source-Free Domain Adaptive Semantic Segmentation of Remote Sensing Images with Diffusion-Guided Label Enrichment<\/strong> by Wenjie Liu et al.\u00a0(University of Science and Technology Beijing) and Prototype-Based Pseudo-Label Denoising for Source-Free Domain Adaptation in Remote Sensing Semantic Segmentation<\/strong> by Bin Wang et al.\u00a0(Sichuan University) harness diffusion models and prototype-guided self-training, respectively, to overcome noisy pseudo-labels and achieve state-of-the-art results without source data. Similarly, Domain Adaptive Object Detection for Space Applications with Real-Time Constraints<\/strong> by Samet Hicsonmez et al.\u00a0(University of Luxembourg) shows how supervised domain adaptation can dramatically improve spacecraft object detection with minimal real-world annotations.<\/p>\n

Under the Hood: Models, Datasets, & Benchmarks<\/h3>\n

Recent advancements in domain adaptation are heavily reliant on novel architectural designs, specialized datasets, and rigorous benchmarks. Here are some key highlights:<\/p>\n