Full Text:   <826>

Summary:  <269>

CLC number: TP212

On-line Access: 2023-05-31

Received: 2022-10-15

Revision Accepted: 2023-05-31

Crosschecked: 2023-02-22

Cited: 0

Clicked: 1057

Citations:  Bibtex RefMan EndNote GB/T7714

 ORCID:

Youyou LU

https://orcid.org/0000-0002-6214-5390

-   Go to

Article info.
Open peer comments

Frontiers of Information Technology & Electronic Engineering  2023 Vol.24 No.5 P.675-687

http://doi.org/10.1631/FITEE.2200469


NICFS: a file system based on persistent memory and SmartNIC


Author(s):  Yitian YANG, Youyou LU

Affiliation(s):  Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China

Corresponding email(s):   yangyiti22@mails.tsinghua.edu.cn, luyouyou@tsinghua.edu.cn

Key Words:  Non-volatile memory, Persistent memory, Data processing unit, Smart network interface card (SmartNIC), File system


Yitian YANG, Youyou LU. NICFS: a file system based on persistent memory and SmartNIC[J]. Frontiers of Information Technology & Electronic Engineering, 2023, 24(5): 675-687.

@article{title="NICFS: a file system based on persistent memory and SmartNIC",
author="Yitian YANG, Youyou LU",
journal="Frontiers of Information Technology & Electronic Engineering",
volume="24",
number="5",
pages="675-687",
year="2023",
publisher="Zhejiang University Press & Springer",
doi="10.1631/FITEE.2200469"
}

%0 Journal Article
%T NICFS: a file system based on persistent memory and SmartNIC
%A Yitian YANG
%A Youyou LU
%J Frontiers of Information Technology & Electronic Engineering
%V 24
%N 5
%P 675-687
%@ 2095-9184
%D 2023
%I Zhejiang University Press & Springer
%DOI 10.1631/FITEE.2200469

TY - JOUR
T1 - NICFS: a file system based on persistent memory and SmartNIC
A1 - Yitian YANG
A1 - Youyou LU
J0 - Frontiers of Information Technology & Electronic Engineering
VL - 24
IS - 5
SP - 675
EP - 687
%@ 2095-9184
Y1 - 2023
PB - Zhejiang University Press & Springer
ER -
DOI - 10.1631/FITEE.2200469


Abstract: 
Emergence of new hardware, including persistent memory and smart network interface card (SmartNIC), has brought new opportunities to file system design. In this paper, we design and implement a new file system named NICFS based on persistent memory and SmartNIC. We divide the file system into two parts: the front end and the back end. In the front end, data writes are appended to the persistent memory in a log-structured way, leveraging the fast persistence advantage of persistent memory. In the back end, the data in logs are fetched, processed, and patched to files in the background, leveraging the processing capacity of SmartNIC. Evaluation results show that NICFS outperforms Ext4 by about 21%/10% and about 19%/50% on large and small reads/writes, respectively.

NICFS:基于持久化内存和智能网卡的文件系统

杨倚天,陆游游
清华大学计算机科学与技术系,中国北京市,100084
摘要:持久化内存和智能网卡等新型硬件的涌现,为文件系统架构设计带来新机遇。本文设计并实现一个基于持久化内存和智能网卡的新型文件系统NICFS。我们将NICFS分为前端与后端。在前端,数据的写入以日志结构的方式追加写到持久化内存上,从而发挥持久化内存的快速持久化优势;在后端,日志中的数据在后台被获取、处理并写入到文件中,从而充分利用智能网卡的处理能力。实验结果显示,NICFS在大粒度和小粒度的读/写性能上分别比Ext4高出约21%/10%和19%/50%。

关键词:非易失内存;持久化内存;数据处理器;智能网卡;文件系统

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Reference

[1]Anderson TE, Canini M, Kim J, et al., 2019. Assise: performance and availability via NVM colocation in a distributed file system. https://arxiv.org/abs/1910.05106

[2]Chen YM, Lu YY, Zhu BH, et al., 2021. Scalable persistent memory file system with kernel-userspace collaboration. Proc 19th USENIX Conf on File and Storage Technologies, p.81-95.

[3]Condit J, Nightingale EB, Frost C, et al., 2009. Better I/O through byte-addressable, persistent memory. Proc ACM SIGOPS 22nd Symp on Operating Systems Principles, p.133-146.

[4]Gray C, Cheriton D, 1989. Leases: an efficient fault-tolerant mechanism for distributed file cache consistency. ACM SIGOPS Oper Syst Rev, 23(5):202-210.

[5]Kim J, Jang I, Reda W, et al., 2021. LineFS: efficient SmartNIC offload of a distributed file system with pipeline parallelism. Proc ACM SIGOPS 28th Symp on Operating Systems Principles, p.756-771.

[6]Lee C, Sim D, Hwang JY, et al., 2015. F2FS: a new file system for flash storage. Proc 13th USENIX Conf on File and Storage Technologies, p.273-286.

[7]Li JR, Lu YY, Wang Q, et al., 2022. AlNiCo: SmartNIC-accelerated contention-aware request scheduling for transaction processing. Proc USENIX Annual Technical Conf, p.951-966.

[8]Liang Z, Lombardi J, Chaarawi M, et al., 2020. DAOS: a scale-out high performance storage stack for storage class memory. Proc 6th Asian Conf on Supercomputing Frontiers, p.40-54.

[9]Lu YY, Shu JW, Zheng WM, 2013. Extending the lifetime of flash-based storage through reducing write amplification from file systems. Proc 11th USENIX Conf on File and Storage Technologies, p.257-270.

[10]Lu YY, Shu JW, Wang W, 2014. ReconFS: a reconstructable file system on flash storage. Proc 12th USENIX Conf on File and Storage Technologies, p.75-88.

[11]Lu YY, Shu JW, Chen YM, et al., 2017. Octopus: an RDMA-enabled distributed persistent memory file system. Proc USENIX Annual Technical Conf, p.773-785.

[12]Lu YY, Shu JW, Zhang JC, 2019. Mitigating synchronous I/O overhead in file systems on open-channel SSDs. ACM Trans Stor, 15(3):17.

[13]NVIDIA, 2022. DOCA. https://developer.nvidia.com/networking/doca [Accessed on Oct. 8, 2022].

[14]Ou JX, Shu JW, Lu YY, 2016. A high performance file system for non-volatile main memory. Proc 11th European Conf on Computer Systems, Article 12.

[15]Schuh HN, Liang WH, Liu M, et al., 2021. Xenic: SmartNIC-accelerated distributed transactions. Proc ACM SIGOPS 28th Symp on Operating Systems Principles, p.740-755.

[16]Xu J, Swanson S, 2016. NOVA: a log-structured file system for hybrid volatile/non-volatile main memories. Proc 14th USENIX Conf on File and Storage Technologies, p.323-338.

[17]Zhang JC, Shu JW, Lu YY, 2016. ParaFS: a log-structured file system to exploit the internal parallelism of flash devices. Proc USENIX Annual Technical Conf, p.87-100.

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952783; E-mail: cjzhang@zju.edu.cn
Copyright © 2000 - 2024 Journal of Zhejiang University-SCIENCE