Yang Wang

No Adaptation Without Observation: Observability-Constrained Test-Time Prompt Tuning for LiDAR Semantic Segmentation

Linlian Jiang

Wentao Ju

Sadman Rakib Pinon

Jianwei Xian

Zhixiang Chi

Xinxin Zuo

LiDAR semantic segmentation often degrades under real-world deployment due to evolving sensing conditions, while collecting new annotations … (see more)for retraining is impractical. Test-time adaptation (TTA) updates model parameters online using pseudo-label supervision, but directly applying standard TTA strategies to LiDAR data is challenging. Because pseudo-label reliability is spatially heteroscedastic under range-dependent sparsity and occlusion, uniform updates on globally shared parameters can inject unstable gradients and destabilize adaptation. We propose a geometry-constrained test-time prompt tuning framework for LiDAR semantic segmentation. Our method estimates per-location sensing reliability from depth-consistent beam terminations and neighborhood support, and uses it to reweight spatial supervision. Adaptation is confined to lightweight prompt adapters inserted into a frozen backbone, with spatial gating to prevent unreliable regions from perturbing globally shared representations. A temporally smoothed prototype alignment strategy further stabilizes online updates by accumulating reliable semantic evidence over time. Experiments on standard LiDAR benchmarks demonstrate improved adaptation stability and segmentation performance under deployment variations without additional annotations.

2026-06-28

arXiv (preprint)

A four-amino-acid YRIN insertion in ftsI reduced ceftiofur susceptibility in a canine Escherichia coli isolate

Xukun Dang

Zeshi Chen

Rina Bai

Junyao Jiang

Weishuai Zhai

Shizhen Ma

Lu Liu

Dejun Liu

Zhaofei Xia

Zhangqi Shen

Siyu Chen

Abstract Ceftiofur resistance in canine clinical Escherichia coli is usually associated with extended-spectrum β-lactamases (ESBLs) or AmpC… (see more) β-lactamases. However, some isolates display elevated ceftiofur minimum inhibitory concentrations (MICs) without carrying these known resistance genes. In this study, we identified a phenotype-genotype discordant canine clinical E. coli isolate named 231255, with a ceftiofur MIC of 8 μg/mL. Routine resistance gene screening detected only bla TEM-1 and a chromosomal bla EC variant, bla EC-1149 , which could not adequately explain the elevated ceftiofur MIC. To investigate the underlying mechanism, a genomic library was constructed from genomic DNA of isolate 231255 and screened on ceftiofur-containing plates. Positive clones revealed one candidate determinant: an altered ftsI fragment encoding penicillin-binding protein 3 (PBP3) with a four-amino-acid YRIN insertion downstream of residue P333, previously identified in human E. coli . Previous studies have shown that this type of YRIN/YRIK insertion alone can reduce susceptibility to PBP3-targeting β-lactams, particularly aztreonam and ceftazidime. Functional validation showed that recombinant plasmids carrying the altered ftsI consistently increased the ceftiofur MIC to 4 μg/mL in different recipient backgrounds. These findings provide experimental evidence that ftsI /PBP3 alteration can elevate ceftiofur MIC in canine E. coli . Notably, the isolate belonged to ST410, and phylogenetic analysis indicated that it was not confined to a dog-associated background but instead clustered within a broader lineage shared across multiple sources, highlighting the need for potential dissemination of this mechanism and its associated resistant lineages at the human-companion animal interface.

2026-06-22

One Health Advances (published)

Beyond the GUI Paradigm: Do Mobile Agents Need the Phone Screen?

Zihuan Jiang

Linqiang Guo

Zhixiang Chi

Ziqiang Wang

Huan Liu

Yuanhao Yu

Tse-Hsun Chen

Recent advances in mobile agents are dominated by the GUI paradigm, in which agents perceive UI information and emit screen interactions. Ho… (see more)wever, mobile platforms also expose a command-line interface (CLI) that provides direct access to device services and data. We argue CLI deserves first-class consideration alongside GUI. We evaluate three coding agents (Claude Code, Terminus-2, mini-swe-agent) across four model APIs on AndroidWorld and MobileWorld without any mobile-specific post-training, comparing against three reproducible GUI baselines (GUI-Owl-1.5-32B, MAI-UI, Qwen3-VL-32B). Claude Code (Opus 4.7) reaches 71.8\% and 51.9\%, outperforming every reproducible GUI baseline (69.3/68.1/57.8\% on AndroidWorld; 43.2/26.3/13.3\% on MobileWorld), while every other CLI configuration remains competitive. To establish the paradigm's ceiling, we provide oracle CLI solutions that reach 88.8\% on AndroidWorld (103/116 tasks CLI-solvable) and 86.3\% on MobileWorld (101/117 tasks CLI-solvable), indicating substantial room for future improvement. To cover everyday user intents beyond the GUI scope, we introduce the \textbf{CLI-Advantage Task Suite}, comprising 45 templates across five categories: bulk operations, multi-condition filtering, aggregation, cross-app workflows, and hidden device state. Every CLI agent outperforms every GUI baseline in all five categories, with substantially fewer steps per task (10.7 vs.\ 18.6). To support future research on mobile CLI agents, we will open-source agent implementations, oracle solutions, the CLI-Advantage suite, and evaluation infrastructure.

2026-06-15

arXiv (preprint)

Dynamic Neural Graph Encoding of Inference Processes in Deep Weight Space

Di Wu

Huan Liu

Zhixiang Chi

Yuanhao Yu

Konstantinos N. Plataniotis

The rapid advancements in using neural networks as implicit data representations have attracted significant interest in developing machine l… (see more)earning methods that analyze and process the weight spaces of other neural networks. However, efficiently handling these high-dimensional weight spaces remains challenging. Existing methods often overlook the sequential nature of layer-by-layer processing in neural network inference. In this work, we propose a novel approach using dynamic graphs to represent neural network parameters, capturing the temporal dynamics of inference. Our Dynamic Neural Graph Encoder (DNG-Encoder) processes these graphs, preserving the sequential nature of neural processing. Additionally, we also leverage DNG-Encoder to develop INR2JLS (Implicit Neural Representation to Joint Latent Space) for facilitate downstream applications, such as classifying Implicit Neural Representations (INRs). Our approach demonstrates significant improvements across multiple tasks, surpassing the state-of-the-art INR classification accuracy by approximately 10\% on the CIFAR-100-INR. Our code is available at https://github.com/dddiowww/DNG.

2026-06-09

Transactions on Machine Learning Research (accepted)

AES: Curing Optimizer Blindness in Long-Tailed Recognition via State-Aware Correction

Fanfu Wang

Jiachang Zhan

Zhiheng Gong

Pengkun Wang

Long-tailed recognition fundamentally suffers from optimizer blindness where the optimization process mistakenly conflates the magnitude of … (see more)gradient accumulation with the scarcity of semantic information. Existing strategies relying on static frequency-based priors fail to correct this bias and result in state blindness regarding supervision and micro-level blindness regarding parameter updates. To address these limitations, we propose the AES framework to establish a dynamic and state-aware correction system across the entire learning lifecycle. We specifically introduce Adaptive Residual Supervision loss to act as a real-time reality check for supervision completeness via precision shielding. We also propose Entropy-aware PCGrad to resolve parameter-level conflicts by quantifying task specificity through gradient entropy. Additionally, we devise Sample-level Conflict Arbitrated Fusion to serve as a dynamic inference arbiter that routes predictions based on instance difficulty. Extensive experiments on CIFAR-100-LT, ImageNet-LT, and iNaturalist 2018 demonstrate that our method consistently achieves state-of-the-art performance by effectively balancing head-class stability and tail-class discrimination. Code is available at [here](https://github.com/wangff0101/AES)

2026-04-29

International Conference on Machine Learning (accepted)

Crisp: A Spectral-Based Interaction Strategy for Multivariate Time Series Forecasting

Binwu Wang

Gaoyun Lin

Jiaming Ma

Qihe Huang

Zhengyang Zhou

Xu Wang

Pengkun Wang

Multivariate time series (MTS) forecasting critically depends on modeling inter-variable dependencies, yet existing paradigms face a trade-o… (see more)ff: channel-isolation strategies can suffer from information fragmentation in strongly coupled systems, whereas channel-interaction methods often introduce spurious interactions among irrelevant variables. To address this challenge, we propose Coherent Resonance Interaction with Spectral Priors (Crisp). Crisp adopts the principle that effective information exchange should occur only between variables with compatible oscillatory patterns. Concretely, we derive spectral priors in the frequency domain to construct dynamic resonance topologies. With a differentiable, adaptive, and strictly sparse blocking mechanism, Crisp forces attention weights for spectrally inconsistent neighbors to be exactly zero. In addition, we introduce a spectral-gated feature filtering module to refine variable representations using intrinsic spectral characteristics. Extensive experiments demonstrate that Crisp significantly outperforms 20+ baselines. Our code is available at Anonymous GitHub.

2026-04-29

International Conference on Machine Learning (accepted)

Generalization in Online Reinforcement Learning for Mobile Agents

Zihuan Jiang

Zhixiang Chi

Huan Liu

Ziqiang Wang

Yuanhao Yu

Glen Berseth

Graphical user interface (GUI)-based mobile agents automate digital tasks on mobile devices by interpreting natural-language instructions an… (see more)d interacting with the screen. While recent methods apply reinforcement learning (RL) to train vision-language-model(VLM) agents in interactive environments with a primary focus on performance, generalization remains underexplored due to the lack of standardized benchmarks and open-source RL systems. In this work, we formalize the problem as a Contextual Markov Decision Process (CMDP) and introduce \textbf{AndroidWorld-Generalization}, a benchmark with three increasingly challenging regimes for evaluating zero-shot generalization to unseen task instances, templates, and applications. We further propose an RL training system that integrates Group Relative Policy Optimization (GRPO) with a scalable rollout collection system, consisting of containerized infrastructure and asynchronous execution % , and error recovery to support reliable and efficient training. Experiments on AndroidWorld-Generalization show that RL enables a 7B-parameter VLM agent to surpass supervised fine-tuning baselines, yielding a 26.1\% improvement on unseen instances but only limited gains on unseen templates (15.7\%) and apps (8.3\%), underscoring the challenges of generalization. As a preliminary step, we demonstrate that few-shot adaptation at test-time improves performance on unseen apps, motivating future research in this direction. To support reproducibility and fair comparison, we open-source the full RL training system, including the environment, task suite, models, prompt configurations, and the underlying infrastructure \footnote{https://github.com/zihuanjiang/AndroidWorld-Generalization}.

2026-03-07

arXiv (preprint)

PointMAC: Meta-Learned Adaptation for Robust Test-Time Point Cloud Completion

Linlian Jiang

Rui Ma

Ziqiang Wang

Xinxin Zuo

Point cloud completion is essential for robust 3D perception in safety-critical applications such as robotics and augmented reality. However… (see more), existing models perform static inference and rely heavily on inductive biases learned during training, limiting their ability to adapt to novel structural patterns and sensor-induced distortions at test time. To address this limitation, we propose PointMAC, a meta-learned framework for robust test-time adaptation in point cloud completion. It enables sample-specific refinement without requiring additional supervision. Our method optimizes the completion model under two self-supervised auxiliary objectives that simulate structural and sensor-level incompleteness. A meta-auxiliary learning strategy based on Model-Agnostic Meta-Learning (MAML) ensures that adaptation driven by auxiliary objectives is consistently aligned with the primary completion task. During inference, we adapt the shared encoder on-the-fly by optimizing auxiliary losses, with the decoder kept fixed. To further stabilize adaptation, we introduce Adaptive

2025-12-02

Conference on Neural Information Processing Systems (Accept (poster))

MetaWriter: Personalized Handwritten Text Recognition Using Meta-Learned Prompt Tuning

Wenhao Gu

Ching Yee Suen

Recent advancements in handwritten text recognition (HTR) have enabled the effective conversion of handwritten text to digital formats. Howe… (see more)ver, achieving robust recognition across diverse writing styles remains challenging. Traditional HTR methods lack writer-specific personalization at test time due to limitations in model architecture and training strategies. Existing attempts to bridge this gap, through gradient-based meta-learning, still require labeled examples and suffer from parameter-inefficient fine-tuning, leading to substantial computational and memory overhead. To overcome these challenges, we propose an efficient framework that formulates personalization as prompt tuning, incorporating an auxiliary image reconstruction task with a self-supervised loss to guide prompt adaptation with unlabeled test-time examples. To ensure self-supervised loss effectively minimizes text recognition error, we leverage meta-learning to learn the optimal initialization of the prompts. As a result, our method allows the model to efficiently capture unique writing styles by updating less than 1% of its parameters and eliminating the need for time-intensive annotation processes. We validate our approach on the RIMES and IAM Handwriting Database benchmarks, where it consistently outperforms previous state-of-the-art methods while using 20x fewer parameters. We believe this represents a significant advancement in personalized handwritten text recognition, paving the way for more reliable and practical deployment in resource-constrained scenarios.

2025-06-12

IEEE/CVF Conference on Computer Vision and Pattern Recognition (Accept)

Learning to Adapt Frozen CLIP for Few-Shot Test-Time Domain Adaptation

Zhixiang Chi

Huan Liu

Ziqiang Wang

Yanan Wu

Konstantinos N Plataniotis

Few-shot Test-Time Domain Adaptation focuses on adapting a model at test time to a specific domain using only a few unlabeled examples, addr… (see more)essing domain shift. Prior methods leverage CLIP's strong out-of-distribution (OOD) abilities by generating domain-specific prompts to guide its generalized, frozen features. However, since downstream datasets are not explicitly seen by CLIP, solely depending on the feature space knowledge is constrained by CLIP's prior knowledge. Notably, when using a less robust backbone like ViT-B/16, performance significantly drops on challenging real-world benchmarks. Departing from the state-of-the-art of inheriting the intrinsic OOD capability of CLIP, this work introduces learning directly on the input space to complement the dataset-specific knowledge for frozen CLIP. Specifically, an independent side branch is attached in parallel with CLIP and enforced to learn exclusive knowledge via revert attention. To better capture the dataset-specific label semantics for downstream adaptation, we propose to enhance the inter-dispersion among text features via greedy text ensemble and refinement. The text and visual features are then progressively fused in a domain-aware manner by a generated domain prompt to adapt toward a specific domain. Extensive experiments show our method's superiority on 5 large-scale benchmarks (WILDS and DomainNet), notably improving over smaller networks like ViT-B/16 with gains of \textbf{+5.1} in F1 for iWildCam and \textbf{+3.1\%} in WC Acc for FMoW.

2025-04-22

International Conference on Learning Representations (Accept (Poster))