Open Access Open Access  Restricted Access Subscription or Fee Access

File Synchronization Algorithm Using Hash Transfer Synchronization Method in Distributed System


(*) Corresponding author


Authors' affiliations


DOI: https://doi.org/10.15866/irecos.v11i4.8900

Abstract


One of the problems in a distributed system is how to synchronize files in the system that are located separately. Many ways can be used to detect files that are unsynchronized with file references of the source server. This article proposes a method that can detect and fix unsynchronized files quickly although the network has low-performance traffic using Hash Transfer Synchronization algorithm. The result of this study is a system that can be used to detect unsynchronized files and fix approximately 14 million files at 1400 servers within 8 hours in the distributed system.
Copyright © 2016 Praise Worthy Prize - All rights reserved.

Keywords


File Synchronization; Distributed System; Hash Transfer Synchronization

Full Text:

PDF


References


G. Couloris, J. Dollimore, T. Kindberg and Gordon, Distributed Systems Concept and Design fifth edition, Addison Wesley, 2011.

T. Suel, P. Noel and D. Trendafilov, "Improved File Synchronization Techniques for Maintaining Large Replicated Collections over Slow Networks," in Data Engineering 2004, Proceedings 20th International Conference, 2004.
http://dx.doi.org/10.1109/icde.2004.1319992

J. Kouki, W. Chainbi and G. Khaled, "An Agent-Based Approach for Binding Synchronization of Web Services," in International Workshop on Adaption of Web Services (AWS), 2012.
http://dx.doi.org/10.1016/j.procs.2012.06.123

A. Tridgell and P. MacKerras, "The Rsync Algorithm. Technical Report TR-CS-96-05," Australian National University, 1996.

D. Teodosiu, N. Bjorner, Y. Gurevich and M. Manasse, "Optimazing File Replication Over Limited Bandwith Networks Using Remote Differential Compression," MSR-TR-2006-157, Microsoft, 2006.

S. Uppoor, M. D. Flouris and A. Bilas, "Cloud-Based Synchronization of Distributed File System Hierarchies," in Cluster Computing Workshops and Posters (CLUSTER WORKSHOPS) , 2010.
http://dx.doi.org/10.1109/clusterwksp.2010.5613087

B. Muruganantham and T. K. Pandey, "Replica Synchronization in Distributed File System using Asynchronous Replication," SSRG International Journal of Computer Science and Engineering (SSRG-IJCSE) Volume 2 Issue 2, pp. 12-17, 2015.

P. Gupta and S. Kumar, "Comparative Analysis of SHA and MD5," International of Computer Science and Information Technology, , vol. Volume 5, no. 3, pp. 4492-4495, 2014.

C. Cioloca and M. Georgescu, "Increasing Database Performance using Indexes," Database Systems Journal 2011, Volume 2, pp. 13-22, 2011.

S. Han, H. Sen, K. Taesoo and A. . A. K. Kris, "MetaSync: File Synchronization Across Multiple Untrusted Storage Services," in USENIX Annual Techncal Conference, 2015.


Refbacks

  • There are currently no refbacks.


Please send any question about this web site to info@praiseworthyprize.com
Copyright © 2005-2024 Praise Worthy Prize