DistOS-2011W Globus: Difference between revisions
No edit summary |
No edit summary |
||
Line 8: | Line 8: | ||
The basis of grid computing has been around for quite some time, starting with super computers which have many processors and vasts amounts of memory working under one machine. The idea behind a supercomputer, allowing the power of many machines to be run under one machine gives that one "single" machine a large threshold of computational power, and that itself is the idea that is to be implemented in grid computing. Multiple machines across various geographic distances working together to give power to any one machine that requires it. The thought of such a system seems like an obvious task to do, but with such a system it gives rise to different implementation issues that current operating systems have to deal with, such as heterogeneity, scalability, and adaptability[http://books.google.ca/books?hl=en&lr=&id=b4LWXLRBRLsC&oi=fnd&pg=PR31&dq=grid+computing&ots=GRUnCeRcOX&sig=opgUj03TBSOWW1agykR8MHTvcIw#v=onepage&q=globus&f=false]. Heterogeneity refers to having standards of use and data that the grid can follow so that when other domains are part of the grid there is no problems with integration and usage of the grid. Scalability is necessary for when the grid size increases because of the scalability of application usage on the grid and the organization/management of jobs distributed across it. Adaptability is also necessary because at any given point a node on the grid may go down and the job it had been doing must be done by another node, so with increased scalability the grid can utilize multiple nodes to adapt to dropped nodes as well as malicious nodes who might attempt to do incorrect jobs. The job of the Globus Toolkit is being the middleware, which provides the services that allow for grid computing to work successfully. Other known middleware implementations are [http://glite.cern.ch/ glite], and [http://www.unicore.eu/ UNICORE]. | The basis of grid computing has been around for quite some time, starting with super computers which have many processors and vasts amounts of memory working under one machine. The idea behind a supercomputer, allowing the power of many machines to be run under one machine gives that one "single" machine a large threshold of computational power, and that itself is the idea that is to be implemented in grid computing. Multiple machines across various geographic distances working together to give power to any one machine that requires it. The thought of such a system seems like an obvious task to do, but with such a system it gives rise to different implementation issues that current operating systems have to deal with, such as heterogeneity, scalability, and adaptability[http://books.google.ca/books?hl=en&lr=&id=b4LWXLRBRLsC&oi=fnd&pg=PR31&dq=grid+computing&ots=GRUnCeRcOX&sig=opgUj03TBSOWW1agykR8MHTvcIw#v=onepage&q=globus&f=false]. Heterogeneity refers to having standards of use and data that the grid can follow so that when other domains are part of the grid there is no problems with integration and usage of the grid. Scalability is necessary for when the grid size increases because of the scalability of application usage on the grid and the organization/management of jobs distributed across it. Adaptability is also necessary because at any given point a node on the grid may go down and the job it had been doing must be done by another node, so with increased scalability the grid can utilize multiple nodes to adapt to dropped nodes as well as malicious nodes who might attempt to do incorrect jobs. The job of the Globus Toolkit is being the middleware, which provides the services that allow for grid computing to work successfully. Other known middleware implementations are [http://glite.cern.ch/ glite], and [http://www.unicore.eu/ UNICORE]. | ||
=Installation | =Installation= | ||
==Environment Setup == | ==Environment Setup == | ||
=Globus Toolkit Installation= | ==Globus Toolkit Installation== | ||
Attempted to install on february 10th 2011, but problems with Ubuntu image occured. Installation on february 15th 12:00-12:53 | Attempted to install on february 10th 2011, but problems with Ubuntu image occured. Installation on february 15th 12:00-12:53 | ||
Line 31: | Line 31: | ||
-apt-get install globus-gsi-cert-utils-progs was needed to be installed and not mentioned for creating certificates | -apt-get install globus-gsi-cert-utils-progs was needed to be installed and not mentioned for creating certificates | ||
= Certification = | == Certification == | ||
= Evaluation of Installation = | = Evaluation of Installation = | ||
= Hello World Implementation = | = Hello World Implementation = |
Revision as of 00:06, 24 February 2011
Matthew Chou
Introduction
The system that I have attempted to implement was the Globus Toolkit, and from my current knowledge and understanding it seems quite difficult to create software that can be used on a grid system. While searching for different distributed systems I have come across different systems that are utilized for various fields of research, such as BOINC, folding@home, and many other @home projects as well as Condor.(list can be found here) Seeing as there are many of these types of systems being used around the world, I thought it would interesting to see what steps it would take to implement such a system and to see if I could get something to run on them.
Background
The basis of grid computing has been around for quite some time, starting with super computers which have many processors and vasts amounts of memory working under one machine. The idea behind a supercomputer, allowing the power of many machines to be run under one machine gives that one "single" machine a large threshold of computational power, and that itself is the idea that is to be implemented in grid computing. Multiple machines across various geographic distances working together to give power to any one machine that requires it. The thought of such a system seems like an obvious task to do, but with such a system it gives rise to different implementation issues that current operating systems have to deal with, such as heterogeneity, scalability, and adaptability[1]. Heterogeneity refers to having standards of use and data that the grid can follow so that when other domains are part of the grid there is no problems with integration and usage of the grid. Scalability is necessary for when the grid size increases because of the scalability of application usage on the grid and the organization/management of jobs distributed across it. Adaptability is also necessary because at any given point a node on the grid may go down and the job it had been doing must be done by another node, so with increased scalability the grid can utilize multiple nodes to adapt to dropped nodes as well as malicious nodes who might attempt to do incorrect jobs. The job of the Globus Toolkit is being the middleware, which provides the services that allow for grid computing to work successfully. Other known middleware implementations are glite, and UNICORE.
Installation
Environment Setup
Globus Toolkit Installation
Attempted to install on february 10th 2011, but problems with Ubuntu image occured. Installation on february 15th 12:00-12:53
many iterations of the form "gpt-build ====> CHECKING BUILD DEPENDENCIES FOR globus_ftp_client_test gpt-build ====> Changing to /usr/local/globus-5.0.3/gt5.0.3-all-source-installer/source-trees/gridftp/client/test gpt-build ====> BUILDING FLAVOR gcc32dbg gpt-build ====> Changing to /usr/local/globus-5.0.3/etc /usr/local/globus-5.0.3/sbin/gpt-build -srcdir=source-trees/gsi/gssapi/test gcc32dbg "
in 1. Set environment variables, it isn't well documented to type
Source $GLOBUS_LOCATION/etc/globus-user-env.sh when it stated to write
globus$ . $GLOBUS_LOCATION/etc/globus-user-env.sh
-apt-get install globus-gsi-cert-utils-progs was needed to be installed and not mentioned for creating certificates
Certification
Evaluation of Installation
Hello World Implementation
Implementation Overview
Discussion of Experience
Conclusion
Summarize the report, point to future work.
References
Give references in proper form (not just URLs if possible, give dates of access). Install guide: http://www.globus.org/toolkit/docs/latest-stable/admin/install/#gtadmin http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/quickstart/ Installer source: http://www.globus.org/toolkit/downloads/5.0.3/