Full Text:   <128>

CLC number: 

On-line Access: 2023-02-24

Received: 2022-10-15

Revision Accepted: 2023-02-12

Crosschecked: 0000-00-00

Cited: 0

Clicked: 231

Citations:  Bibtex RefMan EndNote GB/T7714

-   Go to

Article info.
Open peer comments

Journal of Zhejiang University SCIENCE C 1998 Vol.-1 No.-1 P.

http://doi.org/10.1631/FITEE.2200466


DDUC: erasure-coded system with decoupled data updating and coding


Author(s):  Yaofeng TU, Rong XIAO, Yinjun HAN‡,, Zhenghua CHEN, Hao JIN, Xuecheng QI, Xinyuan SUN

Affiliation(s):  State Key Laboratory of Mobile Network and Mobile Multimedia Technology, China; more

Corresponding email(s):   tu.yaofeng@zte.com.cn, xiao.rong1@zte.com.cn, han.yinjun@zte.com.cn, chen.zhenghua@zte.com.cn, jin.hao1@zte.com.cn, qi.xuecheng@zte.com.cn, sun.xinyuan@zte.com.cn

Key Words:  Concurrent update, High reliability, Erasure code, Consistency, Distributed storage system


Yaofeng TU, Rong XIAO, Yinjun HAN‡, Zhenghua CHEN, Hao JIN, Xuecheng QI, Xinyuan SUN. DDUC: erasure-coded system with decoupled data updating and coding[J]. Frontiers of Information Technology & Electronic Engineering, 1998, -1(-1): .

@article{title="DDUC: erasure-coded system with decoupled data updating and coding",
author="Yaofeng TU, Rong XIAO, Yinjun HAN‡, Zhenghua CHEN, Hao JIN, Xuecheng QI, Xinyuan SUN",
journal="Frontiers of Information Technology & Electronic Engineering",
volume="-1",
number="-1",
pages="",
year="1998",
publisher="Zhejiang University Press & Springer",
doi="10.1631/FITEE.2200466"
}

%0 Journal Article
%T DDUC: erasure-coded system with decoupled data updating and coding
%A Yaofeng TU
%A Rong XIAO
%A Yinjun HAN‡
%A
%A Zhenghua CHEN
%A Hao JIN
%A Xuecheng QI
%A Xinyuan SUN
%J Journal of Zhejiang University SCIENCE C
%V -1
%N -1
%P
%@ 2095-9184
%D 1998
%I Zhejiang University Press & Springer
%DOI 10.1631/FITEE.2200466

TY - JOUR
T1 - DDUC: erasure-coded system with decoupled data updating and coding
A1 - Yaofeng TU
A1 - Rong XIAO
A1 - Yinjun HAN‡
A1 -
A1 - Zhenghua CHEN
A1 - Hao JIN
A1 - Xuecheng QI
A1 - Xinyuan SUN
J0 - Journal of Zhejiang University Science C
VL - -1
IS - -1
SP -
EP -
%@ 2095-9184
Y1 - 1998
PB - Zhejiang University Press & Springer
ER -
DOI - 10.1631/FITEE.2200466


Abstract: 
In distributed storage systems, replication and erasure code (EC) are common methods for data redundancy. Compared with replication, EC has better storage efficiency but suffers higher overhead in update. Moreover, consistency and reliability problems caused by concurrent updates bring new challenges to applications of EC. Many works focus on optimizing the EC solution, including optimized algorithm, novel data-updating method, and so on, but lack the solutions for consistency and reliability problems. In this paper, we introduce a storage system that decouples data updating and EC encoding, namely, decoupled data updating and coding (DDUC), and propose a data placement policy that combines replication and parity blocks. For the (N,M) EC system, the data are placed as N groups of M+1 replicas, and redundant data blocks of the same stripe are placed in the parity nodes, so that the parity nodes can autonomously perform local EC encoding. Based on the above policy, a two-phase data update method is implemented that data are updated in replica mode in Phase 1, and the EC encoding is done independently by parity nodes in Phase 2. This solves the problem of data reliability degradation caused by concurrent updates while ensuring high concurrency performance. It also utilizes persistent memory (PMem) hardware features of the byte addressing and 8-byte atomic write to implement a lightweight logging mechanism that improves performance while ensuring data consistency. Experiments show that compared with the state-of-the-art storage system Ceph, the concurrent access performance is improved by 1.70–3.73 times, and latency is only 3.4%–5.9% of Ceph.

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952783; E-mail: cjzhang@zju.edu.cn
Copyright © 2000 - 2023 Journal of Zhejiang University-SCIENCE