A PARALLEL COMPUTING FRAMEWORK FOR CLOUD SERVICES
Keywords:
Cloud Services, SOA, Python, Parallel Computing.Abstract
In recent years, the requirements of computer performance for large data processing are getting higher and higher. From the perspective of users, in order to conveniently use big data processing platform, and put more focus on writing the parallel computing algorithm. This paper presents a study of cloud service, parallel computing, IronPython and virtualization, and designs client, service node and node calculation module by using Python for its ability of self-reflexive and observation and calling the library functions of which cannot be achieved using other languages. In this paper, the parallel computing framework based on Python can be easily implemented on the virtual machine of the cloud computing platform.References
[1] M. Rodriguez and R. Buyya, “Deadline based resource provisioning and scheduling algorithm for scientific workflows on clouds,” IEEE Transactions on Cloud Computing, vol. 2, no. 2, pp. 222–235, April 2014.
[2] L. Chi, J. Liu, and Q. Hu. Evaluation and Test for Scalability of Numerical Parallel Computation，Journal of Computer Research and Development, vol.42, no.6, pp.1073-1078, 2005.
[3] D. Dang, Y. Liu, and X. Zhang et al., “A Crowdsourcing Worker Quality Evaluation Algorithm on MapReduce for Big Data Applications,” IEEE Trans. Parallel Distrib. Syst., vol.27, no.7, pp.1879–1888, July 2016..
[4] J. Li, S.Chen, H. Ma. Research of Service-oriented Architecture Reference Model and Its Application. Computer Engineering，2006, 32(20): 100-102.
[5] T. Andrews, F. Curbera, H. Dholakia, et al. Business process execution language for web services. 2003:22-23.
[6] F. Curbera, R. Khalaf, N. Mukhi, et al. The next step in web services. Communications of the ACM, 2003, 46(10): 29-34.
[7] C. Mohan, G. Alonso, R. Gunthor, et al. Exotica: A research perspective on workflow management systems. Data Engineering Bulletin, 1995, 18(1): 19-26.
[8] Z. Cai, X. Li, and J. N. D. Gupta, “Heuristics for provisioning services to workflows in XaaS clouds,” IEEE Transactions on Services Computing, vol. 9, no. 2, pp. 250–263, 2016.
[9] I. Ang. Watching Dallas: Soap opera and the melodramatic imagination. Psychology Press, 1985, 56-58.
[10] Y.Zhou. A Python-Calculation Grid Based on Service-Oriented Parallel Computing. Shanghai Jiaotong University，2008,12-67.
[11] S. Xue. The Comparison Research of Cloud Computing and Grid Computing, 2010, 2-9.
[12] T. Fang. Research on grid application of parallel computing. Guangdong University of Technology, 2006, 45-47.
[13] Y. Li. Design and implementation of parallel computing platform based on MPI. Northeast Normal University, 2007, 2-10.
[14] W. D. Liu. A distributed data flow model for composing software services. Stanford University, 2003,12-14
[15] A. Fuggetta, G. P. Picco, G. Vigna. Understanding code mobility. Software Engineering, IEEE Transactions on, 1998, 24(5): 342-361
[16] F. Curbera, R. Khalaf, N. Mukhi, et al. The next step in web services. Communications of the ACM, 2003, 46(10): 29-34.
[17] Y. Ye, S. Ying, and W. Li et al.. Research of SOA and Its System Building. Computer application research, 2005, 22(2): 32-34.
[18] R. Perrey, M. Lycett. Service-oriented architecture. Applications and the Internet Workshops, 2003. Proceedings. 2003 Symposium on. IEEE, 2003: 116-119.
[19] G. Li. Research on cloud computing platform architecture based on Virtualization Technology. Journal of Jilin Architectural and Civil Engineering Institute, 2011, 28(1): 79-81.
[20] J. Wen. Establishment and performance analysis of parallel computing platform. School of computer science, Guangdong University of Technology, 2007, 34-45.