Publishing Service

Polishing & Checking

Frontiers of Information Technology & Electronic Engineering

ISSN 2095-9184 (print), ISSN 2095-9230 (online)

Dual collaboration for decentralized multi-source domain adaptation

Abstract: The goal of decentralized multi-source domain adaptation is to conduct unsupervised multi-source domain adaptation in a data decentralization scenario. The challenge of data decentralization is that the source domains and target domain lack cross-domain collaboration during training. On the unlabeled target domain, the target model needs to transfer supervision knowledge with the collaboration of source models, while the domain gap will lead to limited adaptation performance from source models. On the labeled source domain, the source model tends to overfit its domain data in the data decentralization scenario, which leads to the negative transfer problem. For these challenges, we propose dual collaboration for decentralized multi-source domain adaptation by training and aggregating the local source models and local target model in collaboration with each other. On the target domain, we train the local target model by distilling supervision knowledge and fully using the unlabeled target domain data to alleviate the domain shift problem with the collaboration of local source models. On the source domain, we regularize the local source models in collaboration with the local target model to overcome the negative transfer problem. This forms a dual collaboration between the decentralized source domains and target domain, which improves the domain adaptation performance under the data decentralization scenario. Extensive experiments indicate that our method outperforms the state-of-the-art methods by a large margin on standard multi-source domain adaptation datasets.

Key words: Multi-source domain adaptation; Data decentralization; Domain shift; Negative transfer

Chinese Summary  <29> 双向协同的去中心化多源域自适应

魏义康1,2,韩亚洪1,2
1天津大学智能与计算学部,中国天津市,300350
2天津大学天津市机器学习重点实验室,中国天津市,300350
摘要:去中心化多源域自适应是指在数据去中心化场景下执行无监督多源域自适应。数据去中心化的挑战是源域与目标域在训练中缺乏跨域协同。对于无标签的目标域,目标域模型需要在源域模型的协助下迁移监督知识,而域差距会导致源域模型的适应性能有限。对于有标签的源域,源域模型在数据去中心化场景下倾向于过拟合本地数据,从而导致负迁移问题。对于以上挑战,提出双向协同的去中心化多源域自适应方法,通过其它域模型的协助进行局部源域模型与局部目标域模型的协同训练与聚合。对于目标域,我们在源域模型的协助下蒸馏监督知识,同时完全利用无标签目标域的数据来缓解域偏移问题。对于源域,我们在目标域模型的协助下正则化源域模型来避免负迁移问题。以上过程在去中心化的源域和目标域之间形成一种双向协同,以便在数据去中心化场景下提升域自适应性能。在标准多源域自适应数据集上的实验表明,我们的方法以较大优势优于现有的多源域自适应方法。

关键词组:多源域自适应;数据去中心化;域偏移;负迁移


Share this article to: More

Go to Contents

References:

<Show All>

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





DOI:

10.1631/FITEE.2200284

CLC number:

TP181

Download Full Text:

Click Here

Downloaded:

2945

Download summary:

<Click Here> 

Downloaded:

288

Clicked:

1573

Cited:

0

On-line Access:

2022-12-14

Received:

2022-06-29

Revision Accepted:

2022-12-17

Crosschecked:

2022-09-22

Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952276; Fax: +86-571-87952331; E-mail: jzus@zju.edu.cn
Copyright © 2000~ Journal of Zhejiang University-SCIENCE