Review of the Parallel Programming and its Challenges on the Multicore Processors
DOI:
https://doi.org/10.51983/ajcst-2015.4.1.1749Keywords:
Parallization, Sequential, High Performance Computing(HPC), Parallel ProgrammingAbstract
In this paper, we have reviewed and discussed about the challenges, advantages, disadvantages of the parallel
program, which occurs during the conversion of the sequential program into parallel program.The conversion of
the existing sequential programs and algorithm into parallel have limitations like partitioning the task, sharing input and output data, dependencies of the output of one subtask to next subtask, synchronization of the output of the subprogram, and shifting the subprogram from the failure processor to the active processor, communication among the processors, load balancing, etc. The parallel programming routines, libraries and management software for parallel programming have been implemented, and these have several limitations, and these are also discussed.
References
L. Moura E Silvay and R. Buyya, "Parallel Programming Models and Paradigms," [Online]. Available: http://www.buyya.com/cluster/v2chap1.pdf, Vol. 1, Chapter 1, pp 1-27,1999.
J.-D. Choi, M. Gupta, M. J. Serrano, V. C. Sreedhar, and S. P. Midkiff, "Stack allocation and synchronization optimizations for Java using escape analysis," ACM Transactions on Programming Languages and Systems (TOPLAS), vol. 25, no. 6, pp. 876-910, 2003.
J. Feo, D. Cann, and R. Oldehoeft, "A Report on the SISAL Language Project," Journal of Parallel and Distributed Computing, vol. 10, pp. 349-366, 1990.
I. Foster and S. Tuecke, "Parallel Programming with PCN," Technical Report ANL-91/32, Argonne National Laboratory, Argonne, December 1991.
B. L. Massingill, T. G. Mattson, and B. A. Sanders, "Reengineering for Parallelism: an entry point into PLPP for legacy applications," Concurrency and Computation: Practice and Experience, vol. 19, pp. 503-529, 2007.
G. Vélez and H. Horacio, "A New Industry-Centred Module on Structured Parallel Programming," School of Computing, Robert Gordon University, Postgraduate Certificate in Higher Education Learning and Teaching, 2010.
A. Meade, J. Buckley, and J. J. Collins, "Challenges of evolving sequential to parallel code: an exploratory review," In Proceedings of the 12th International Workshop on Principles of Software Evolution and the 7th annual ERCIM Workshop on Software Evolution, pp. 1-5. ACM, 2011.
W.-M. Hwu, "Three challenges in parallel programming," [Online]. Available: http://parallel.illinois.edu/blog/three-challenges-parallelprogramming, March, 2012.
MPICH2, [Online]. Available: http://www.mcs.anl.gov/research/projects/mpich2/, May 5, 2011.
S. Tucker Taft and SofCheck, "Introduction to ParaSail," Sofcheck Software Analysis and Verification, O'Reilly OSCON oscon.com, 2011.
CUDA C Programming Guide, PG-02829-001_v5.0, nvidia.com, May, 2014.
M. Snir, S. Otto, S. Huss-Lederman, D. Walker, and J. Dongarra, MPI: The Complete Reference, The MIT Press, Cambridge, Massachusetts London, England, 2002.
A. Geist, A. Beguelin, J. Dongarra, W. Jiang, R. Manchek, and V. Sunderam, PVM: Parallel Virtual Machine A Users' Guide and Tutorial for Networked Parallel Computing, The MIT Press, 1994.
G. Amdahl, "Princeton University - Amdahl's Law," [Online]. Available: https://www.princeton.edu/~achaney/tmve/wiki100k/docs/Amdahl_s_law.html, May, 2014.
J. L. Gustafson, [Online]. Available: http://en.wikipedia.org/wiki/Gustafson_s_law, May, 2014.
J. Li, W. Guo, and H. Zheng, "An Undergraduate Parallel and Distributed Computing Course in Multi-Core Era," 9th International Conference for Young Computer Scientists, ICYCS 2008, Zhang Jia Jie, Hunan, China, IEEE, pp. 18-21, November, 2008.
L. R. Scott, T. Clark, and B. Bagheri, "Lecture Notes in Computer Science," Springer, Volume 3515, pp. 44-51, 2005.
A. Geist, A. Beguelin, J. Dongarra, W. Jiang, R. Manchek, and V. Sunderam, PVM: Parallel Virtual Machine A Users Guide and Tutorial for Networked Parallel Computing, The MIT Press, 1994.
S. Palaniappan and C. S. Ling, "Clinical Decision Support Using OLAP with data mining," International Journal of Computer Science and Network Security, vol. 8, no. 9, pp. 290-296, 2008.
D. Jackson, Q. Snell, and M. Clement, "Core Algorithms of the Maui Scheduler," D.G. Feitelson and L. Rudolph (Eds.): JSSPP, pp. 87–102, 2001.
PBS, [Online]. Available: http://www.pbsworks.com/, June 25, 2011.
Digipede, "Grid and Cluster Computing: Options for Improving Windows® Application Performance," ©Copyright Digipede Technologies, LLC, 2011.
D. Burford D, "Cloud Computing: A Brief Introduction," Land Enterprises Inc., [Online]. Available: http://www.ladenterprizes.com/pdf/CloudComputing.pdf, 2010.
S. Peyton Jones and S. Singh, "A Tutorial on Parallel and Concurrent Programming in Haskell: Lecture Notes from Advanced Functional Programming," Summer School, Microsoft Research Cambridge, 2008.
X. Quanqing, L. Zhao, and X. Mingzhong, "YuruBackup: A Space-Efficient and Highly Scalable Incremental Backup System in the Cloud," Int J Parallel Prog, Springer Science, October 2013.
P. H. Madden, "Parallel Computing: The Elephant in the Room," Computer Science Department, SUNY Binghamton, August 19, 2010.
http://www.intel.com/technology/itj/2007/v11i4/3-development/4- challenges.htm, December, 2013.
G. Barish, "Scalablead High-Performance Web Applications," May 24, 2002.
M. Wrinn, "Top 10 challenges in parallel computing," [Online]. Available: http://software.intel.com/en-us/blogs/2008/12/31/top-10-challengesin-parallel-computing, May, 2014.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2015 The Research Publication
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
