Fine-grained checkpoint based on non-volatile memory

Wen-zhe ZHANG; Kai LU; Mikel LUJÁN; Xiao-ping WANG; Xu ZHOU

doi:10.1631/FITEE.1500352

Your Location：

Home >

Browse articles >

Fine-grained checkpoint based on non-volatile memory

Regular Papers | Updated：2022-05-19

- Fine-grained checkpoint based on non-volatile memory
- 基于非易失存储器的细粒度检查点
- Frontiers of Information Technology & Electronic Engineering Vol. 18, Issue 2, Pages: 220-234(2017)
- Affiliations：
  
  1Science and Technology on Parallel and Distributed Processing Laboratory, College of Computer, National University of Defense Technology, Changsha 410072, China
  2School of Computer, The University of Manchester, Manchester M13 9PL, UK
- Author bio：
  
  E-mail:lukainudt@163.com
- Funds：
- DOI：10.1631/FITEE.1500352
  CLC： TP316
- Received：21 October 2015，
  
  Accepted：13 March 2016，
  
  Published：2017-02
- Accepted：
Scan QR Code
Wen-zhe ZHANG, Kai LU, Mikel LUJÁN, et al. Fine-grained checkpoint based on non-volatile memory[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(2): 220-234.
DOI：

Wen-zhe ZHANG, Kai LU, Mikel LUJÁN, et al. Fine-grained checkpoint based on non-volatile memory[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(2): 220-234. DOI： 10.1631/FITEE.1500352.

摘要

新型非易失存储器提供了高访问速度，大容量，字节访问粒度，以及非易失等特性。这些特性将为容错带来新的机遇。本文提出了基于非易失存储器的细粒度检查点。我们在现有操作系统内核的存储管理模块中加入了针对非易失存储器的管理，同时提供了一个非易失堆以供上层应用进行快速的内存分配和对相关对象（或数据结构）的检查点备份。为了实现细粒度检查点，我们将不同的对象（或数据结构）分布在不同的虚拟页面中，并利用硬件提供的页保护机制来实现对数据修改的监控。在此系统中，两个处于不同虚拟页面中的对象（或数据结构）有可能处于同一个物理页面中。对一个对象的修改将不会影响到对另一个对象的监控。以上机制使我们能够对小于一个页面的修改进行监控。和传统的基于页面粒度的检查点工作相比，我们的机制可以有效的减少检查点拷贝的数据量，从而更好的利用存储器带宽，提升性能。

Abstract

New non-volatile memory (e.g.

phase-change memory) provides fast access

large capacity

byteaddressability

and non-volatility features. These features

fast-byte-persistency

will bring new opportunities to fault tolerance. We propose a fine-grained checkpoint based on non-volatile memory. We extend the current virtual memory manager to manage non-volatile memory

and design a persistent heap with support for fast allocation and checkpointing of persistent objects. To achieve a fine-grained checkpoint

we scatter objects across virtual pages and rely on hardware page-protection to monitor the modifications. In our system

two objects in different virtual pages may reside on the same physical page. Modifying one object would not interfere with the other object. This allows us to monitor and checkpoint objects smaller than 4096 bytes in a fine-grained way. Compared with previous page-grained based checkpoint mechanisms

our new checkpoint method can greatly reduce the data copied at checkpoint time and better leverage the limited bandwidth of non-volatile memory.

关键词

Keywords

references

A Badam . . How persistent memory will change software systems . . Computer , , 2013 . . 46 ( ( 8 ): ): 45 - - 51 . . DOI: 10.1109/MC.2013.189 http://doi.org/10.1109/MC.2013.189 . .

L Bautista-Gomez , , , S Tsuboi , , , D Komatitsch , , , 等 . . FTI: high performance fault tolerance interface for hybrid systems . . 2011 . . Proc. Int. Conf. for High Performance Computing, Networking, Storage and Analysis . . Article 32 DOI: 10.1145/2063384.2063427 http://doi.org/10.1145/2063384.2063427 . .

J Bent , , , G Gibson , , , G Grider , , , 等 . . PLFS: a checkpoint filesystem for parallel applications . . 2009 . . Proc. Int. Conf. for High Performance Computing, Networking, Storage and Analysis . . Article 21 DOI: 10.1145/1654059.1654081 http://doi.org/10.1145/1654059.1654081 . .

ED Berger , , , KS McKinley , , , RD Blumofe , , , 等 . . Hoard: a scalable memory allocator for multithreaded applications . . ACM SIGPLAN Not. , , 2000 . . 35 ( ( 11 ): ): 117 - - 128 . . DOI: 10.1145/356989.357000 http://doi.org/10.1145/356989.357000 . .

S Cho , , , H Lee . . Flip-n-write: a simple deterministic technique to improve PRAM write performance, energy and endurance . . 2009 . . Proc. 42nd Annual IEEE/ACM Int. Symp. on Microarchitecture . . 347 - - 357 . . . .

C Chou , , , A Jaleel , , , MK Qureshi . . CAMEO: a two-level memory organization with capacity of main memory and flexibility of hardware-managed cache . . 2014 . . Proc. 47th Annual IEEE/ACM Int. Symp. on Microarchitecture . . 1 - - 12 . . DOI: 10.1109/MICRO.2014.63 http://doi.org/10.1109/MICRO.2014.63 . .

J Coburn , , , AM Caulfield , , , A Akel , , , 等 . . NV-Heaps: making persistent objects fast and safe with nextgeneration, non-volatile memories . . ACM SIGARCH Comput. Archit. News , , 2011 . . 39 ( ( 1 ): ): 105 - - 118 . . DOI: 10.1145/1961295.1950380 http://doi.org/10.1145/1961295.1950380 . .

J Condit , , , EB Nightingale , , , C Frost , , , 等 . . Better I/O through byte-addressable, persistent memory . . 2009 . . Proc. ACM SIGOPS 22nd Symp. on Operating Systems Principles . . 133 - - 146 . . DOI: 10.1145/1629575.1629589 http://doi.org/10.1145/1629575.1629589 . .

M di Ventra , , , YV Pershin , , , LO Chua . . Circuit elements with memory: memristors, memcapacitors, and meminductors . . Proc. IEEE , , 2009 . . 97 ( ( 10 ): ): 1717 - - 1724 . . DOI: 10.1109/JPROC.2009.2021077 http://doi.org/10.1109/JPROC.2009.2021077 . .

X Dong , , , Y Xie , , , N Muralimanohar , , , 等 . . Hybrid checkpointing using emerging nonvolatile memories for future exascale systems . . ACM Trans. Archit. Code Optim. , , 2011 . . 8 ( ( 2 ): ): Article 6 DOI: 10.1145/1970386.1970387 http://doi.org/10.1145/1970386.1970387 . .

SR Dulloor , , , S Kumar , , , A Keshavamurthy , , , 等 . . System software for persistent memory . . 2014 . . Proc. 9th European Conf. on Computer Systems . . Article 15 DOI: 10.1145/2592798.2592814 http://doi.org/10.1145/2592798.2592814 . .

P Felber , , , C Fetzer , , , T Riegel . . Dynamic performance tuning of word-based software transactional memory . . 2008 . . Proc. 13th ACM SIGPLAN Symp. on Principles and Practice of Parallel Programming . . 237 - - 246 . . DOI: 10.1145/1345206.1345241 http://doi.org/10.1145/1345206.1345241 . .

P Felber , , , C Fetzer , , , P Marlier , , , 等 . . Time-based software transactional memory . . IEEE Trans. Parall. Distr. Syst. , , 2010 . . 21 ( ( 12 ): ): 1793 - - 1807 . . DOI: 10.1109/TPDS.2010.49 http://doi.org/10.1109/TPDS.2010.49 . .

N Gulur , , , M Mehendale , , , R Manikantan , , , 等 . . Bimodal DRAM cache: improving hit rate, hit latency and bandwidth . . 2014 . . Proc. 47th Annual IEEE/ACM Int. Symp. on Microarchitecture . . 38 - - 50 . . DOI: 10.1109/MICRO.2014.36 http://doi.org/10.1109/MICRO.2014.36 . .

M Hirabayashi . . Tokyo Cabinet: a Modern Implementation of DBM. , , 2010 . . http://fallabs.com/tokyocabinet/ http://fallabs.com/tokyocabinet/ . .

D Jevdjic , , , GH Loh , , , C Kaynak , , , 等 . . Unison cache: a scalable and effective die-stacked DRAM cache . . 2014 . . Proc. 47th Annual IEEE/ACM Int. Symp. on Microarchitecture . . 25 - - 37 . . DOI: 10.1109/MICRO.2014.51 http://doi.org/10.1109/MICRO.2014.51 . .

S Kannan , , , A Gavrilovska , , , K Schwan , , , 等 . . Optimizing checkpoints using NVM as virtual memory . . 2013 . . Proc. IEEE 27th Int. Symp. on Parallel & Distributed Processing . . 29 - - 40 . . DOI: 10.1109/IPDPS.2013.69 http://doi.org/10.1109/IPDPS.2013.69 . .

I Koltsidas , , , P Mueller , , , R Pletka , , , 等 . . PSS: a prototype storage subsystem based on PCM . . 2014 . . Proc. 5th Annual Non-volatile Memories Workshop . . 1 - - 2 . . . .

C Lattner , , , V Adve . . LLVM: a compilation framework for lifelong program analysis & transformation . . 2004 . . Proc. Int. Symp. on Code Generation and Optimization . . 75 - - 86 . . DOI: 10.1109/CGO.2004.1281665 http://doi.org/10.1109/CGO.2004.1281665 . .

D Li , , , JS Vetter , , , G Marin , , , 等 . . Identifying opportunities for byte-addressable non-volatile memory in extreme-scale scientific applications . . 2012 . . Proc. IEEE 26th Int. Parallel & Distributed Processing Symp. . . 945 - - 956 . . DOI: 10.1109/IPDPS.2012.89 http://doi.org/10.1109/IPDPS.2012.89 . .

C Luk , , , R Cohn , , , R Muth , , , 等 . . Pin: building customized program analysis tools with dynamic instrumentation . . ACM SIGPLAN Not. , , 2005 . . 40 ( ( 6 ): ): 190 - - 200 . . DOI: 10.1145/1064978.1065034 http://doi.org/10.1145/1064978.1065034 . .

C Minh , , , J Chung , , , C Kozyrakis , , , 等 . . STAMP: Stanford transactional applications for multi-processing . . 2008 . . Proc. IEEE Int. Symp. on Workload Characterization . . 35 - - 46 . . DOI: 10.1109/IISWC.2008.4636089 http://doi.org/10.1109/IISWC.2008.4636089 . .

JS Plank , , , K Li , , , MA Puening . . Diskless checkpointing . . IEEE Trans. Parall. Distr. Syst. , , 1998 . . 9 ( ( 10 ): ): 972 - - 986 . . DOI: 10.1109/71.730527 http://doi.org/10.1109/71.730527 . .

MK Qureshi , , , V Srinivasan , , , JA Rivers . . Scalable high performance main memory system using phasechange memory technology . . ACM SIGARCH Comput. Archit. News , , 2009 . . 37 ( ( 3 ): ): 24 - - 33 . . DOI: 10.1145/1555815.1555760 http://doi.org/10.1145/1555815.1555760 . .

MK Qureshi , , , MM Franceschini , , , A Jagmohan , , , 等 . . PreSET: improving performance of phase change memories by exploiting asymmetry in write times . . ACM SIGARCH Comput. Archit. News , , 2012 . . 40 ( ( 3 ): ): 380 - - 391 . . DOI: 10.1145/2366231.2337203 http://doi.org/10.1145/2366231.2337203 . .

P Rosenfeld , , , E Cooper-Balis , , , B Jacob . . DRAMSim2: a cycle accurate memory system simulator . . IEEE Comput. Archit. Lett. , , 2011 . . 10 ( ( 1 ): ): 16 - - 19 . . DOI: 10.1109/L-CA.2011.4 http://doi.org/10.1109/L-CA.2011.4 . .

B Schroeder , , , GA Gibson . . Understanding failures in petascale computers . . J. Phys. Conf. Ser. , , 2007 . . 78 012022 DOI: 10.1088/1742-6596/78/1/012022 http://doi.org/10.1088/1742-6596/78/1/012022 . .

H Volos , , , AJ Tack , , , MM Swift . . Mnemosyne: lightweight persistent memory . . ACM SIGARCH Comput. Archit. News , , 2011 . . 39 ( ( 1 ): ): 91 - - 104 . . DOI: 10.1145/1961295.1950379 http://doi.org/10.1145/1961295.1950379 . .

H Volos , , , S Nalli , , , S Panneerselvam , , , 等 . . Aerie: flexible file-system interfaces to storage-class memory . . 2014 . . Proc. 9th European Conf. on Computer Systems . . Article 14 DOI: 10.1145/2592798.2592810 http://doi.org/10.1145/2592798.2592810 . .

X Wu , , , ALN Reddy . . SCMFS: a file system for storage class memory . . 2011 . . Proc. Int. Conf. for High Performance Computing, Networking, Storage and Analysis . . Article 39 DOI: 10.1145/2063384.2063436 http://doi.org/10.1145/2063384.2063436 . .

W Xu , , , H Sun , , , X Wang , , , 等 . . Design of last-level on-chip cache using spin-torque transfer RAM (STT RAM) . . IEEE Trans. VLSI Syst. , , 2011 . . 19 ( ( 3 ): ): 483 - - 493 . . DOI: 10.1109/TVLSI.2009.2035509 http://doi.org/10.1109/TVLSI.2009.2035509 . .

DH Yoon , , , N Muralimanohar , , , J Chang , , , 等 . . FREE-p: protecting non-volatile memory against both hard and soft errors . . 2011 . . Proc. IEEE 17th Int. Symp. on High Performance Computer Architecture . . 466 - - 477 . . DOI: 10.1109/HPCA.2011.5749752 http://doi.org/10.1109/HPCA.2011.5749752 . .

G Zheng , , , L Shi , , , LV Kale . . FTC-Charm++: an in-memory checkpoint-based fault tolerant runtime for Charm++ and MPI . . 2004 . . Proc. IEEE Int. Conf. on Cluster Computing . . 93 - - 103 . . DOI: 10.1109/CLUSTR.2004.1392606 http://doi.org/10.1109/CLUSTR.2004.1392606 . .

P Zhou , , , B Zhao , , , J Yang , , , 等 . . A durable and energy efficient main memory using phase change memory technology . . ACM SIGARCH Comput. Archit. News , , 2009 . . 37 ( ( 3 ): ): 14 - - 23 . . DOI: 10.1145/1555815.1555759 http://doi.org/10.1145/1555815.1555759 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

Versionized process based on non-volatile random-access memory for fine-grained fault tolerance

Related Author

Wen-zhe ZHANG

Kai LU

Xiao-ping WANG

Related Institution

Science and Technology on Parallel and Distributed Processing Laboratory, College of Computer, National University of Defense Technology

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰