DistOS-2011W Globus - Revision history

Mchou2: /* References */

2011-03-01T23:50:31Z

References

← Older revision		Revision as of 23:50, 1 March 2011
Line 123:		Line 123:

	Reference relations:		Reference relations:

	Installation: (1),(9),(10),(11),(13).		Installation: (1),(9),(10),(11),(13).

	Implementation tutorials: (14)Video filtering program, (15)Webservice, (16)Helloworld.		Implementation tutorials: (14)Video filtering program, (15)Webservice, (16)Helloworld.

	Information:(1),(2),(3),(4),(5),(6),(7),(8),(12),(17).		Information:(1),(2),(3),(4),(5),(6),(7),(8),(12),(17).

Mchou2: /* References */

2011-03-01T23:50:15Z

References

← Older revision		Revision as of 23:50, 1 March 2011
Line 121:		Line 121:
	*(16) HOW TO INSTALL GLOBUS AND WRITE A HELLO WORLD SERVICE: Drs. Wico Mulder Ing. A.M. Kuipers, November 2004, Version 0.22 [electronic source] http://www.dutchgrid.nl/install/gang/HowTo-GlobusInstallationExperience.pdf		*(16) HOW TO INSTALL GLOBUS AND WRITE A HELLO WORLD SERVICE: Drs. Wico Mulder Ing. A.M. Kuipers, November 2004, Version 0.22 [electronic source] http://www.dutchgrid.nl/install/gang/HowTo-GlobusInstallationExperience.pdf
	*(17) Virtual Data Toolkit: Open Science Grid (OSG), Accessed: Feb 23,2011 [electronic source] http://vdt.cs.wisc.edu/		*(17) Virtual Data Toolkit: Open Science Grid (OSG), Accessed: Feb 23,2011 [electronic source] http://vdt.cs.wisc.edu/

			Reference relations:
			Installation: (1),(9),(10),(11),(13).
			Implementation tutorials: (14)Video filtering program, (15)Webservice, (16)Helloworld.
			Information:(1),(2),(3),(4),(5),(6),(7),(8),(12),(17).

Mchou2: /* Hello World Implementation */

2011-03-01T20:58:20Z

Hello World Implementation

← Older revision		Revision as of 20:58, 1 March 2011
Line 81:		Line 81:
	= Hello World Implementation =		= Hello World Implementation =
	There was only a few different tutorials I could find that taught you how to implement a program onto the grid you have created. There was one tutorial that implemented an application that has a video file be edited(by some process) on each node in the grid and they return their edited pieces so that it can be remade into a complete edited video(from the [http://www.globusconsortium.org/tutorial/ Globus Consortium(14)]. That tutorial seemed quite complicated for me and would require more time to implement. Another tutorial that was available was linked from the Globus Toolkit homepage which explains in large detail of how web services are an integral part to the grid network and the infrastructure of the Globus Toolkit ([http://gdp.globus.org/gt4-tutorial/singlehtml/progtutorial_0.2.1.html Globus Tutorial(15)]). This was too extensive of a tutorial considering it was 191 pages in length, so I opted to try and implement a simple [http://www.dutchgrid.nl/install/gang/HowTo-GlobusInstallationExperience.pdf java based hello world(16)] example I found. This tutorial required the usage of Java, Ant, JUnit, Postgresql and JDBC(java API for sql) to be installed, all of which can be found in the Synaptic Package Manager on Ubuntu. After this additional installation, I started the Postgresql server and activated the grid container which enables for jobs to be done on the grid.(the postgresql server was started in the root account, and the globus container started in the globus account)		There was only a few different tutorials I could find that taught you how to implement a program onto the grid you have created. There was one tutorial that implemented an application that has a video file be edited(by some process) on each node in the grid and they return their edited pieces so that it can be remade into a complete edited video(from the [http://www.globusconsortium.org/tutorial/ Globus Consortium(14)]. That tutorial seemed quite complicated for me and would require more time to implement. Another tutorial that was available was linked from the Globus Toolkit homepage which explains in large detail of how web services are an integral part to the grid network and the infrastructure of the Globus Toolkit ([http://gdp.globus.org/gt4-tutorial/singlehtml/progtutorial_0.2.1.html Globus Tutorial(15)]). This was too extensive of a tutorial considering it was 191 pages in length, so I opted to try and implement a simple [http://www.dutchgrid.nl/install/gang/HowTo-GlobusInstallationExperience.pdf java based hello world(16)] example I found. This tutorial required the usage of Java, Ant, JUnit, Postgresql and JDBC(java API for sql) to be installed, all of which can be found in the Synaptic Package Manager on Ubuntu. After this additional installation, I started the Postgresql server and activated the grid container which enables for jobs to be done on the grid.(the postgresql server was started in the root account, and the globus container started in the globus account)
	[[Image:Comp_4000.png\|thumb\|center\|upright=5.0\|alt=\|Diagram of file structure used in tutorial(~~Drawn by myself~~)]]		[[Image:Comp_4000.png\|thumb\|center\|upright=5.0\|alt=\|Diagram of file structure used in tutorial. (self drawn)(16)]]
	By following the tutorial I created the files :		By following the tutorial I created the files :

Mchou2: /* References */

2011-03-01T20:57:17Z

References

← Older revision		Revision as of 20:57, 1 March 2011
Line 119:		Line 119:
	*(14) Globus Toolkit Tutorial: Globus Consortium, Accessed: Feb 20,2011 [electronic source] http://www.globusconsortium.org/tutorial/		*(14) Globus Toolkit Tutorial: Globus Consortium, Accessed: Feb 20,2011 [electronic source] http://www.globusconsortium.org/tutorial/
	*(15) The Globus Toolkit 4 Programmer's Tutorial: Borja Sotomayor, Accessed: Feb 21,2011 [electronic source] http://gdp.globus.org/gt4-tutorial/singlehtml/progtutorial_0.2.1.html		*(15) The Globus Toolkit 4 Programmer's Tutorial: Borja Sotomayor, Accessed: Feb 21,2011 [electronic source] http://gdp.globus.org/gt4-tutorial/singlehtml/progtutorial_0.2.1.html
	*(16) HOW TO INSTALL GLOBUS AND WRITE A HELLO WORLD SERVICE: Drs. Wico Mulder Ing. A.M. Kuipers, November 2004, Version 0.22 [electronic source] http://www.dutchgrid.nl/install/gang/HowTo-GlobusInstallationExperience.pdf ~~java based hello world~~		*(16) HOW TO INSTALL GLOBUS AND WRITE A HELLO WORLD SERVICE: Drs. Wico Mulder Ing. A.M. Kuipers, November 2004, Version 0.22 [electronic source] http://www.dutchgrid.nl/install/gang/HowTo-GlobusInstallationExperience.pdf
	*(17) Virtual Data Toolkit: Open Science Grid (OSG), Accessed: Feb 23,2011 [electronic source] http://vdt.cs.wisc.edu/		*(17) Virtual Data Toolkit: Open Science Grid (OSG), Accessed: Feb 23,2011 [electronic source] http://vdt.cs.wisc.edu/

Mchou2: /* References */

2011-03-01T20:57:00Z

References

← Older revision		Revision as of 20:57, 1 March 2011
Line 115:		Line 115:
	*(10) GT 5.0 Quickstart: Globus Alliance, Accessed: Feb 10,2011 [electronic source] http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/quickstart/		*(10) GT 5.0 Quickstart: Globus Alliance, Accessed: Feb 10,2011 [electronic source] http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/quickstart/
	*(11) Installing GT 5.0.3: Globus Alliance, Accessed: Feb 10,2011 [electronic source] http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/install/		*(11) Installing GT 5.0.3: Globus Alliance, Accessed: Feb 10,2011 [electronic source] http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/install/
	https://www.verisign.com/ts-sem-page/?sl=t72320166440000002&gclid=CJH6qpyNoKcCFac65QodPjU4cA ~~VeriSign~~[12]		*(12) VeriSign Authentication services: Symantec Corporation, Accessed: Feb 15,2011 [electronic source] https://www.verisign.com/ts-sem-page/?sl=t72320166440000002&gclid=CJH6qpyNoKcCFac65QodPjU4cA
	http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/install/#gtadmin-simpleca ~~SimpleCA~~[13]		*(13) Appendix C.Installing SimpleCA: Globus Alliance, Accessed: Feb 16,2011 [electronic source] http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/install/#gtadmin-simpleca
	http://www.globusconsortium.org/tutorial/ Globus ~~Consortium~~[14]		*(14) Globus Toolkit Tutorial: Globus Consortium, Accessed: Feb 20,2011 [electronic source] http://www.globusconsortium.org/tutorial/
	[http://gdp.globus.org/gt4-tutorial/singlehtml/progtutorial_0.2.1.html ~~Globus Tutorial[15]]~~		*(15) The Globus Toolkit 4 Programmer's Tutorial: Borja Sotomayor, Accessed: Feb 21,2011 [electronic source] http://gdp.globus.org/gt4-tutorial/singlehtml/progtutorial_0.2.1.html
	~~[http://www.dutchgrid.nl/install/gang/HowTo-GlobusInstallationExperience.pdf java based hello world[~~16]		*(16) HOW TO INSTALL GLOBUS AND WRITE A HELLO WORLD SERVICE: Drs. Wico Mulder Ing. A.M. Kuipers, November 2004, Version 0.22 [electronic source] http://www.dutchgrid.nl/install/gang/HowTo-GlobusInstallationExperience.pdf java based hello world
			*(17) Virtual Data Toolkit: Open Science Grid (OSG), Accessed: Feb 23,2011 [electronic source] http://vdt.cs.wisc.edu/
	~~http~~:~~//vdt~~.cs.~~wisc~~.~~edu/ Virtual Data Kit(17~~

	*Globus Toolkit Admin guide [http://www.~~globus.org/toolkit/docs/latest-stable/admin/install/#gtadmin] Accessed: Feb 10~~,~~2011~~.
	*Globus Toolkit Quickstart guide [~~http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/quickstart/] Accessed: Feb 10,2011.~~
	*Globus Toolkit installer source ~~[http://www.globus.org/toolkit/downloads/5.0.3/~~] ~~Accessed: Feb 10,2011.~~

	*Hello World Tutorial [http://www.dutchgrid.nl/install/gang/HowTo-GlobusInstallationExperience.pdf~~] Accessed: Feb 22,2011.~~
	*Grid ~~Computing~~ (~~Wiley~~)~~[http://books.google.ca/books?hl=en&lr=&id=b4LWXLRBRLsC&oi=fnd&pg=PR31&dq=grid+computing&ots=GRUnCeRcOX&sig=opgUj03TBSOWW1agykR8MHTvcIw#v=onepage&q=globus&f=false]~~ Accessed: Feb~~, 19~~,2011~~. (For further understanding of grid computing)~~
	*Grid Cafe [~~http://www.gridcafe.org/middleware.html~~] ~~Acccessed: Feb 22,2011.(general knowledge of grid computing systems)~~
	*Virtual Data Toolkit [http://vdt.cs.wisc.edu/~~] Accessed: Feb 23,2011.~~
	*Globus Toolkit Tutorial (Globus Alliance)[http://gdp.globus.org/gt4-tutorial/singlehtml/progtutorial_0.2.1.html] Accessed: Feb 19,2011. (Math application)
	*Globus Toolkit Tutorial (Globus Consortium)[http://www.globusconsortium.org/tutorial/] Accessed:Feb 20,2011. (Video editing application)

Mchou2: /* References */

2011-03-01T20:38:50Z

References

← Older revision		Revision as of 20:38, 1 March 2011
Line 107:		Line 107:
	*(2) BOINC Homepage: University of California, Accessed: Feb 3,2011 [electronic source] http://boinc.berkeley.edu/		*(2) BOINC Homepage: University of California, Accessed: Feb 3,2011 [electronic source] http://boinc.berkeley.edu/
	*(3) Folding@home Homepage: Vijay Pande and Stanford University, Accessed: Feb 3,2011 [electronic source] http://folding.stanford.edu/		*(3) Folding@home Homepage: Vijay Pande and Stanford University, Accessed: Feb 3,2011 [electronic source] http://folding.stanford.edu/
	*(4) Condor http://www.cs.wisc.edu/condor/ ~~Condor~~[4]		*(4) Condor Homepage: Accessed: Feb 3,2011 [electronic source] http://www.cs.wisc.edu/condor/
	http://en.wikipedia.org/wiki/List_of_distributed_computing_projects ~~here~~[5]		*(5) List of distributed computing projects: Wikipedia, Accessed: Feb 8,2011 [electronic source] http://en.wikipedia.org/wiki/List_of_distributed_computing_projects
	http://books.google.ca/books?hl=en&lr=&id=b4LWXLRBRLsC&oi=fnd&pg=PR31&dq=grid+computing&ots=GRUnCeRcOX&sig=opgUj03TBSOWW1agykR8MHTvcIw#v=onepage&q=globus&f=false [6]		*(6) Grid computing: making the global infrastructure a reality: Fran Berman, Geoffrey Fox, Anthony J. G. Hey,Published: John Wiley and Sons, 2003 , Accessed: Feb 19,2011 [electronic source link] [http://books.google.ca/books?hl=en&lr=&id=b4LWXLRBRLsC&oi=fnd&pg=PR31&dq=grid+computing&ots=GRUnCeRcOX&sig=opgUj03TBSOWW1agykR8MHTvcIw#v=onepage&q=globus&f=false]
	http://glite.cern.ch/ ~~glite~~[7].		*(7) gLite Homepage: gLite, Accessed:Feb 5,2011 [electronic source] http://glite.cern.ch/
	http://www.unicore.eu/ ~~UNICORE~~[8]		*(8) UNICORE Homepage: Jülich Supercomputing Centre, Accessed:Feb 5,2011 [electronic source] http://www.unicore.eu/
	http://www.virtualbox.org/ ~~Oracle VM VirtualBox~~[9]		*(9) VirtualBox Homepage: ORACLE, Accessed: Feb 3,2011 [electronic source] http://www.virtualbox.org/
	http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/quickstart/ ~~quickstart~~[10]		*(10) GT 5.0 Quickstart: Globus Alliance, Accessed: Feb 10,2011 [electronic source] http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/quickstart/
	http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/install/ ~~Admin Guide tutorial[11]~~		*(11) Installing GT 5.0.3: Globus Alliance, Accessed: Feb 10,2011 [electronic source] http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/install/
	https://www.verisign.com/ts-sem-page/?sl=t72320166440000002&gclid=CJH6qpyNoKcCFac65QodPjU4cA VeriSign[12]		https://www.verisign.com/ts-sem-page/?sl=t72320166440000002&gclid=CJH6qpyNoKcCFac65QodPjU4cA VeriSign[12]
	http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/install/#gtadmin-simpleca SimpleCA[13]		http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/install/#gtadmin-simpleca SimpleCA[13]

Mchou2: /* References */

2011-03-01T20:15:02Z

References

← Older revision		Revision as of 20:15, 1 March 2011
Line 102:		Line 102:
	=References=		=References=



			*(1) Globus Toolkit Homepage: Globus Alliance, Accessed: Feb 3,2011 [electronic source] http://www.globus.org/toolkit/
			*(2) BOINC Homepage: University of California, Accessed: Feb 3,2011 [electronic source] http://boinc.berkeley.edu/
			*(3) Folding@home Homepage: Vijay Pande and Stanford University, Accessed: Feb 3,2011 [electronic source] http://folding.stanford.edu/
			*(4) Condor http://www.cs.wisc.edu/condor/ Condor[4]
			http://en.wikipedia.org/wiki/List_of_distributed_computing_projects here[5]
			http://books.google.ca/books?hl=en&lr=&id=b4LWXLRBRLsC&oi=fnd&pg=PR31&dq=grid+computing&ots=GRUnCeRcOX&sig=opgUj03TBSOWW1agykR8MHTvcIw#v=onepage&q=globus&f=false [6]
			http://glite.cern.ch/ glite[7].
			http://www.unicore.eu/ UNICORE[8]
			http://www.virtualbox.org/ Oracle VM VirtualBox[9]
			http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/quickstart/ quickstart[10]
			http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/install/ Admin Guide tutorial[11]
			https://www.verisign.com/ts-sem-page/?sl=t72320166440000002&gclid=CJH6qpyNoKcCFac65QodPjU4cA VeriSign[12]
			http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/install/#gtadmin-simpleca SimpleCA[13]
			http://www.globusconsortium.org/tutorial/ Globus Consortium[14]
			[http://gdp.globus.org/gt4-tutorial/singlehtml/progtutorial_0.2.1.html Globus Tutorial[15]]
			[http://www.dutchgrid.nl/install/gang/HowTo-GlobusInstallationExperience.pdf java based hello world[16]

			http://vdt.cs.wisc.edu/ Virtual Data Kit(17

	*Globus Toolkit Admin guide [http://www.globus.org/toolkit/docs/latest-stable/admin/install/#gtadmin] Accessed: Feb 10,2011.		*Globus Toolkit Admin guide [http://www.globus.org/toolkit/docs/latest-stable/admin/install/#gtadmin] Accessed: Feb 10,2011.

Mchou2: /* Conclusion */

2011-03-01T19:58:28Z

Conclusion

← Older revision		Revision as of 19:58, 1 March 2011
Line 98:		Line 98:

	=Conclusion=		=Conclusion=
	After setting up my environment, installing the toolkit, and implementing the Hello World tutorial, I can say that the setup and installation of the Globus Toolkit was relatively smooth, and the implementation of an application onto the grid would have been a nightmare had I not found the tutorial that I did. Even though I did say that the tutorial was easy, it does change my mind about how it would be difficult to implement an application on the grid because the Hello World example does not seem like a fair judgment to how complicated the applications that exist on the grid of today. The one thing that I have learned from the following the Globus Toolkit tutorials on the Globus Alliance web page would be that they have very specific instructions at time, and very vague ones as well. The challenge to getting resources on how to implement a grid computing system also depends vastly on the version you are attempting to install. I have found many different tutorials, such as the ones i mentioned, who are made for earlier versions of the Globus Toolkit, some of which that do not have features that the future ones hold. This causes much confusion for as to what different commands are called and what services may or may not be available. I have looked into other grid computing systems and have also found an alternative method to testing a grid system. The [http://vdt.cs.wisc.edu/ Virtual Data Kit] apparently contains a wide variety of distributed computing software that can be easily used, so it seems to be a worthy solution to follow, as well as the implementation of already built services on the grid such as Condor might be something to look into how it is done. Therefore, from my experimentation of the Globus Toolkit 5.0.3, I have concluded that it is simple enough to install the basic services and setup a Certification Authority, but remains difficult to create/implement your own services onto the grid without further knowledge of grid computing and networks in general.		After setting up my environment, installing the toolkit, and implementing the Hello World tutorial, I can say that the setup and installation of the Globus Toolkit was relatively smooth, and the implementation of an application onto the grid would have been a nightmare had I not found the tutorial that I did. Even though I did say that the tutorial was easy, it does change my mind about how it would be difficult to implement an application on the grid because the Hello World example does not seem like a fair judgment to how complicated the applications that exist on the grid of today. The one thing that I have learned from the following the Globus Toolkit tutorials on the Globus Alliance web page would be that they have very specific instructions at time, and very vague ones as well. The challenge to getting resources on how to implement a grid computing system also depends vastly on the version you are attempting to install. I have found many different tutorials, such as the ones i mentioned, who are made for earlier versions of the Globus Toolkit, some of which that do not have features that the future ones hold. This causes much confusion for as to what different commands are called and what services may or may not be available. I have looked into other grid computing systems and have also found an alternative method to testing a grid system. The [http://vdt.cs.wisc.edu/ Virtual Data Kit(17)] apparently contains a wide variety of distributed computing software that can be easily used, so it seems to be a worthy solution to follow, as well as the implementation of already built services on the grid such as Condor might be something to look into how it is done. Therefore, from my experimentation of the Globus Toolkit 5.0.3, I have concluded that it is simple enough to install the basic services and setup a Certification Authority, but remains difficult to create/implement your own services onto the grid without further knowledge of grid computing and networks in general.

	=References=		=References=

Mchou2 at 19:57, 1 March 2011

2011-03-01T19:57:43Z

← Older revision		Revision as of 19:57, 1 March 2011
Line 2:		Line 2:

	=Introduction=		=Introduction=
	The system that I have attempted to implement was the [http://www.globus.org/toolkit/ Globus Toolkit(1)], and from my current knowledge and understanding it seems quite difficult to create software that can be used on a grid system. While searching for different distributed systems I have come across different systems that are utilized for various fields of research, such as [http://boinc.berkeley.edu/ BOINC[2]], [http://folding.stanford.edu/ folding@home[3]], and many other @home projects as well as [http://www.cs.wisc.edu/condor/ Condor[4]].(list can be found [http://en.wikipedia.org/wiki/List_of_distributed_computing_projects here[5]]) Seeing as there are many of these types of systems being used around the world, I thought it would interesting to see what steps it would take to implement such a system and to see if I could get something to run on them.		The system that I have attempted to implement was the [http://www.globus.org/toolkit/ Globus Toolkit(1)], and from my current knowledge and understanding it seems quite difficult to create software that can be used on a grid system. While searching for different distributed systems I have come across different systems that are utilized for various fields of research, such as [http://boinc.berkeley.edu/ BOINC(2)], [http://folding.stanford.edu/ folding@home(3)], and many other @home projects as well as [http://www.cs.wisc.edu/condor/ Condor(4)].(list can be found [http://en.wikipedia.org/wiki/List_of_distributed_computing_projects here(5)]) Seeing as there are many of these types of systems being used around the world, I thought it would interesting to see what steps it would take to implement such a system and to see if I could get something to run on them.


	'''Background'''		'''Background'''

	The basis of grid computing has been around for quite some time, starting with super computers which have many processors and vasts amounts of memory working under one machine. The idea behind a supercomputer, allowing the power of many machines to be run under one machine gives that one "single" machine a large threshold of computational power, and that itself is the idea that is to be implemented in grid computing. Multiple machines across various geographic distances working together to give power to any one machine that requires it. The thought of such a system seems like an obvious task to do, but with such a system it gives rise to different implementation issues that current operating systems have to deal with, such as heterogeneity, scalability, and adaptability[http://books.google.ca/books?hl=en&lr=&id=b4LWXLRBRLsC&oi=fnd&pg=PR31&dq=grid+computing&ots=GRUnCeRcOX&sig=opgUj03TBSOWW1agykR8MHTvcIw#v=onepage&q=globus&f=false [6]]. Heterogeneity refers to having standards of use and data that the grid can follow so that when other domains are part of the grid there is no problems with integration and usage of the grid. Scalability is necessary for when the grid size increases because of the scalability of application usage on the grid and the organization/management of jobs distributed across it. Adaptability is also necessary because at any given point a node on the grid may go down and the job it had been doing must be done by another node, so with increased scalability the grid can utilize multiple nodes to adapt to dropped nodes as well as malicious nodes who might attempt to do incorrect jobs. The job of the Globus Toolkit is being the middleware, which provides the services that allow for grid computing to work successfully. Other known middleware implementations are [http://glite.cern.ch/ glite[7]], and [http://www.unicore.eu/ UNICORE[8]].		The basis of grid computing has been around for quite some time, starting with super computers which have many processors and vasts amounts of memory working under one machine. The idea behind a supercomputer, allowing the power of many machines to be run under one machine gives that one "single" machine a large threshold of computational power, and that itself is the idea that is to be implemented in grid computing. Multiple machines across various geographic distances working together to give power to any one machine that requires it. The thought of such a system seems like an obvious task to do, but with such a system it gives rise to different implementation issues that current operating systems have to deal with, such as heterogeneity, scalability, and adaptability[http://books.google.ca/books?hl=en&lr=&id=b4LWXLRBRLsC&oi=fnd&pg=PR31&dq=grid+computing&ots=GRUnCeRcOX&sig=opgUj03TBSOWW1agykR8MHTvcIw#v=onepage&q=globus&f=false (6)]. Heterogeneity refers to having standards of use and data that the grid can follow so that when other domains are part of the grid there is no problems with integration and usage of the grid. Scalability is necessary for when the grid size increases because of the scalability of application usage on the grid and the organization/management of jobs distributed across it. Adaptability is also necessary because at any given point a node on the grid may go down and the job it had been doing must be done by another node, so with increased scalability the grid can utilize multiple nodes to adapt to dropped nodes as well as malicious nodes who might attempt to do incorrect jobs. The job of the Globus Toolkit is being the middleware, which provides the services that allow for grid computing to work successfully. Other known middleware implementations are [http://glite.cern.ch/ glite(7)], and [http://www.unicore.eu/ UNICORE(8)].


Line 14:		Line 14:
	=Installation=		=Installation=
	==Environment Setup ==		==Environment Setup ==
	On my journey to installing the Globus Toolkit, I have decided upon installing the latest version available which is the Globus Toolkit 5.0.3. [[File:Screenshot1.png\|thumb\|alt=Example alt text\|Pre-requisite check]]This grid implementation must be installed on a UNIX based OS which I chose to be Ubuntu 10.10 on a virtual machine operated under [http://www.virtualbox.org/ Oracle VM VirtualBox[9]]. The installation instructions I followed had a [http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/quickstart/ quickstart[10] installation tutorial] and an [http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/install/ Admin Guide tutorial[11]] which I both read because some of the instructions were more simply explained in the quickstart tutorial than the Admin Guide. If I were to suggest how to set up one's environment, I would recommend following the Admin Guide and using the quickstart as a reference. The quickstart guide gives a list of required software that can be checked with a few simple commands in the terminal that check the versions/existence of '''openssl''', '''libssl''', '''zlib''', '''gcc''', '''g++''', '''tar''', '''sed''', and''' make'''. There are specific instructions on each type of platform before installing the toolkit so make sure to check and see if you have any additional steps or compatibility issues that you should be aware of. There are some additional packages that need to be installed for implementing the hello world application, as well as some optional software such as a relational database, for this I installed PostgreSQL and psqlODBC which is the driver for PostgreSQL. Setting up the environment was easy enough to do for me to say that anyone should be able to follow the tutorial up to this point.		On my journey to installing the Globus Toolkit, I have decided upon installing the latest version available which is the Globus Toolkit 5.0.3. [[File:Screenshot1.png\|thumb\|alt=Example alt text\|Pre-requisite check]]This grid implementation must be installed on a UNIX based OS which I chose to be Ubuntu 10.10 on a virtual machine operated under [http://www.virtualbox.org/ Oracle VM VirtualBox(9)]. The installation instructions I followed had a [http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/quickstart/ quickstart(10) installation tutorial] and an [http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/install/ Admin Guide tutorial(11)] which I both read because some of the instructions were more simply explained in the quickstart tutorial than the Admin Guide. If I were to suggest how to set up one's environment, I would recommend following the Admin Guide and using the quickstart as a reference. The quickstart guide gives a list of required software that can be checked with a few simple commands in the terminal that check the versions/existence of '''openssl''', '''libssl''', '''zlib''', '''gcc''', '''g++''', '''tar''', '''sed''', and''' make'''. There are specific instructions on each type of platform before installing the toolkit so make sure to check and see if you have any additional steps or compatibility issues that you should be aware of. There are some additional packages that need to be installed for implementing the hello world application, as well as some optional software such as a relational database, for this I installed PostgreSQL and psqlODBC which is the driver for PostgreSQL. Setting up the environment was easy enough to do for me to say that anyone should be able to follow the tutorial up to this point.

	==Globus Toolkit Installation==		==Globus Toolkit Installation==
Line 31:		Line 31:
	== Certification ==		== Certification ==
	The certification process is used in a Globus grid because of the security/authentication that is necessary for a scalable system to operate. If any random node in the world wanted to participate in the grid and use[[File:Screenshot2.png\|thumb\|alt=Example alt text\|SimpleCA setup]][[File:Screenshot5.png\|thumb\|alt=Example alt text\|User Certificate Request]]		The certification process is used in a Globus grid because of the security/authentication that is necessary for a scalable system to operate. If any random node in the world wanted to participate in the grid and use[[File:Screenshot2.png\|thumb\|alt=Example alt text\|SimpleCA setup]][[File:Screenshot5.png\|thumb\|alt=Example alt text\|User Certificate Request]]
	it or even abuse it without being accountable, it would not only cause possible harm to the work that is trying to be done on the grid, but also it will require the grid to be closely managed for these random inconsistencies in service and bad data. The system itself already tries to maintain the purity of nodes by doing multiple instances of the same operations over many nodes to have consistent results, as well as marking the nodes that may be malicious would be a nightmare if there was no certification process being implemented. The certification process allows for the host to know that a user is indeed a trusted user and that some organization is held responsible for vouching for this user. In real world implementations the Certified Authority(CA) (the one who signs the certificate) would normally be of some trusted organization such as how [https://www.verisign.com/ts-sem-page/?sl=t72320166440000002&gclid=CJH6qpyNoKcCFac65QodPjU4cA VeriSign[12]] operates, but in the case of my testings I will simply allow for the globus user to be the CA. I used the tool that the toolkit supports called [http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/install/#gtadmin-simpleca SimpleCA[13]] which provides a wrapper around the OpenSSL CA functionality and is sufficient for simple Grid services.		it or even abuse it without being accountable, it would not only cause possible harm to the work that is trying to be done on the grid, but also it will require the grid to be closely managed for these random inconsistencies in service and bad data. The system itself already tries to maintain the purity of nodes by doing multiple instances of the same operations over many nodes to have consistent results, as well as marking the nodes that may be malicious would be a nightmare if there was no certification process being implemented. The certification process allows for the host to know that a user is indeed a trusted user and that some organization is held responsible for vouching for this user. In real world implementations the Certified Authority(CA) (the one who signs the certificate) would normally be of some trusted organization such as how [https://www.verisign.com/ts-sem-page/?sl=t72320166440000002&gclid=CJH6qpyNoKcCFac65QodPjU4cA VeriSign(12)] operates, but in the case of my testings I will simply allow for the globus user to be the CA. I used the tool that the toolkit supports called [http://www.globus.org/toolkit/docs/5.0/5.0.3/admin/install/#gtadmin-simpleca SimpleCA(13)] which provides a wrapper around the OpenSSL CA functionality and is sufficient for simple Grid services.

	'''SimpleCA'''		'''SimpleCA'''
Line 80:		Line 80:

	= Hello World Implementation =		= Hello World Implementation =
	There was only a few different tutorials I could find that taught you how to implement a program onto the grid you have created. There was one tutorial that implemented an application that has a video file be edited(by some process) on each node in the grid and they return their edited pieces so that it can be remade into a complete edited video(from the [http://www.globusconsortium.org/tutorial/ Globus Consortium[14]]. That tutorial seemed quite complicated for me and would require more time to implement. Another tutorial that was available was linked from the Globus Toolkit homepage which explains in large detail of how web services are an integral part to the grid network and the infrastructure of the Globus Toolkit ([http://gdp.globus.org/gt4-tutorial/singlehtml/progtutorial_0.2.1.html Globus Tutorial[15]]). This was too extensive of a tutorial considering it was 191 pages in length, so I opted to try and implement a simple [http://www.dutchgrid.nl/install/gang/HowTo-GlobusInstallationExperience.pdf java based hello world[16]] example I found. This tutorial required the usage of Java, Ant, JUnit, Postgresql and JDBC(java API for sql) to be installed, all of which can be found in the Synaptic Package Manager on Ubuntu. After this additional installation, I started the Postgresql server and activated the grid container which enables for jobs to be done on the grid.(the postgresql server was started in the root account, and the globus container started in the globus account)		There was only a few different tutorials I could find that taught you how to implement a program onto the grid you have created. There was one tutorial that implemented an application that has a video file be edited(by some process) on each node in the grid and they return their edited pieces so that it can be remade into a complete edited video(from the [http://www.globusconsortium.org/tutorial/ Globus Consortium(14)]. That tutorial seemed quite complicated for me and would require more time to implement. Another tutorial that was available was linked from the Globus Toolkit homepage which explains in large detail of how web services are an integral part to the grid network and the infrastructure of the Globus Toolkit ([http://gdp.globus.org/gt4-tutorial/singlehtml/progtutorial_0.2.1.html Globus Tutorial(15)]). This was too extensive of a tutorial considering it was 191 pages in length, so I opted to try and implement a simple [http://www.dutchgrid.nl/install/gang/HowTo-GlobusInstallationExperience.pdf java based hello world(16)] example I found. This tutorial required the usage of Java, Ant, JUnit, Postgresql and JDBC(java API for sql) to be installed, all of which can be found in the Synaptic Package Manager on Ubuntu. After this additional installation, I started the Postgresql server and activated the grid container which enables for jobs to be done on the grid.(the postgresql server was started in the root account, and the globus container started in the globus account)
	[[Image:Comp_4000.png\|thumb\|center\|upright=5.0\|alt=\|Diagram of file structure used in tutorial(Drawn by myself)]]		[[Image:Comp_4000.png\|thumb\|center\|upright=5.0\|alt=\|Diagram of file structure used in tutorial(Drawn by myself)]]
	By following the tutorial I created the files :		By following the tutorial I created the files :
Line 98:		Line 98:

	=Conclusion=		=Conclusion=
	After setting up my environment, installing the toolkit, and implementing the Hello World tutorial, I can say that the setup and installation of the Globus Toolkit was relatively smooth, and the implementation of an application onto the grid would have been a nightmare had I not found the tutorial that I did. Even though I did say that the tutorial was easy, it does change my mind about how it would be difficult to implement an application on the grid because the Hello World example does not seem like a fair ~~judgement~~ to how complicated the applications that exist on the grid of today. The one thing that I have learned from the following the Globus Toolkit tutorials on the Globus Alliance ~~webpage~~ would be that they have very specific instructions at time, and very vague ones as well. The challenge to getting resources on how to implement a grid computing system also depends vastly on the version you are attempting to install. I have found many different tutorials, such as the ones i mentioned, who are made for earlier versions of the Globus Toolkit, some of which that do not have features that the future ones hold. This causes much confusion for as to what different commands are called and what services may or may not be available. I have looked into other grid computing systems and have also found an alternative method to testing a grid system. The [http://vdt.cs.wisc.edu/ Virtual Data Kit] apparently contains a wide variety of distributed computing software that can be easily used, so it seems to be a worthy solution to follow, as well as the implementation of already built services on the grid such as Condor might be something to look into how it is done. Therefore, from my experimentation of the Globus Toolkit 5.0.3, I have concluded that it is simple enough to install the basic services and setup a Certification Authority, but remains difficult to create/implement your own services onto the grid without further ~~knownledge~~ of grid computing and networks in general.		After setting up my environment, installing the toolkit, and implementing the Hello World tutorial, I can say that the setup and installation of the Globus Toolkit was relatively smooth, and the implementation of an application onto the grid would have been a nightmare had I not found the tutorial that I did. Even though I did say that the tutorial was easy, it does change my mind about how it would be difficult to implement an application on the grid because the Hello World example does not seem like a fair judgment to how complicated the applications that exist on the grid of today. The one thing that I have learned from the following the Globus Toolkit tutorials on the Globus Alliance web page would be that they have very specific instructions at time, and very vague ones as well. The challenge to getting resources on how to implement a grid computing system also depends vastly on the version you are attempting to install. I have found many different tutorials, such as the ones i mentioned, who are made for earlier versions of the Globus Toolkit, some of which that do not have features that the future ones hold. This causes much confusion for as to what different commands are called and what services may or may not be available. I have looked into other grid computing systems and have also found an alternative method to testing a grid system. The [http://vdt.cs.wisc.edu/ Virtual Data Kit] apparently contains a wide variety of distributed computing software that can be easily used, so it seems to be a worthy solution to follow, as well as the implementation of already built services on the grid such as Condor might be something to look into how it is done. Therefore, from my experimentation of the Globus Toolkit 5.0.3, I have concluded that it is simple enough to install the basic services and setup a Certification Authority, but remains difficult to create/implement your own services onto the grid without further knowledge of grid computing and networks in general.

	=References=		=References=

Mchou2 at 19:53, 1 March 2011

2011-03-01T19:53:16Z

← Older revision		Revision as of 19:53, 1 March 2011
Line 2:		Line 2:

	=Introduction=		=Introduction=
	The system that I have attempted to implement was the [http://www.globus.org/toolkit/ Globus Toolkit[1]]], and from my current knowledge and understanding it seems quite difficult to create software that can be used on a grid system. While searching for different distributed systems I have come across different systems that are utilized for various fields of research, such as [http://boinc.berkeley.edu/ BOINC[2]], [http://folding.stanford.edu/ folding@home[3]], and many other @home projects as well as [http://www.cs.wisc.edu/condor/ Condor[4]].(list can be found [http://en.wikipedia.org/wiki/List_of_distributed_computing_projects here[5]]) Seeing as there are many of these types of systems being used around the world, I thought it would interesting to see what steps it would take to implement such a system and to see if I could get something to run on them.		The system that I have attempted to implement was the [http://www.globus.org/toolkit/ Globus Toolkit(1)], and from my current knowledge and understanding it seems quite difficult to create software that can be used on a grid system. While searching for different distributed systems I have come across different systems that are utilized for various fields of research, such as [http://boinc.berkeley.edu/ BOINC[2]], [http://folding.stanford.edu/ folding@home[3]], and many other @home projects as well as [http://www.cs.wisc.edu/condor/ Condor[4]].(list can be found [http://en.wikipedia.org/wiki/List_of_distributed_computing_projects here[5]]) Seeing as there are many of these types of systems being used around the world, I thought it would interesting to see what steps it would take to implement such a system and to see if I could get something to run on them.