La Trobe
1184632_Gu,S_2021.pdf (1.24 MB)
Download file

Global repair bandwidth cost optimization of generalized regenerating codes in clustered distributed storage systems

Download (1.24 MB)
journal contribution
posted on 09.02.2022, 22:14 authored by S Gu, F Wang, Q Zhang, T Huang, Wei XiangWei Xiang
In clustered distributed storage systems (CDSSs), one of the main design goals is minimizing the transmission cost during the failed storage nodes repairing. Generalized regenerating codes (GRCs) are proposed to balance the intra-cluster repair bandwidth and the inter-cluster repair bandwidth for guaranteeing data availability. The trade-off performance of GRCs illustrates that, it can reduce storage overhead and inter-cluster repair bandwidths simultaneously. However, in practical big data storage scenarios, GRCs cannot give an effective solution to handle the heterogeneity of bandwidth costs among different clusters for node failures recovery. This paper proposes an asymmetric bandwidth allocation strategy (ABAS) of GRCs for the inter-cluster repair in heterogeneous CDSSs. Furthermore, an upper bound of the achievable capacity of ABAS is derived based on the information flow graph (IFG), and the constraints of storage capacity and intra-cluster repair bandwidth are also elaborated. Then, a metric termed global repair bandwidth cost (GRBC), which can be minimized regarding of the inter-cluster repair bandwidths by solving a linear programming problem, is defined. The numerical results demonstrate that, maintaining the same data availability and storage overhead, the proposed ABAS of GRCs can effectively reduce the GRBC compared to the traditional symmetric bandwidth allocation schemes.

Funding

National Natural Sciences Foundation of China, Grant/Award Numbers: 62027802, 61831008; Guangdong Science and Technology Planning Project, Grant/Award Numbers: 2018B030322004, 2021A1515011572; Shenzhen Natural Science Fund, Grant/Award Number: JCYJ20200109112822953; Shenzhen Natural Science Fund -Stable Support Plan Program, Grant/Award Number: GXWD20201230155427003-20200824081029001

History

Publication Date

01/12/2021

Journal

IET Communications

Volume

15

Issue

19

Pagination

13p. (p. 2469-2481)

Publisher

Wiley

ISSN

1751-8628

Rights Statement

This is an open access article under the terms of the Creative Commons Attribution-NonCommercial-NoDerivs License, which permits use and distribution in any medium, provided the original work is properly cited, the use is non-commercial and no modifications or adaptations are made. © 2021 The Authors. IET Communications published by John Wiley & Sons Ltd on behalf of The Institution of Engineering and Technology