Distributed OS: Fall 2018: Difference between revisions

Latest revision as of 16:02, 21 November 2018

Course Outline

Here is the course outline.

Project Help

To develop your literature review or research proposal, start with a single research paper that you find interesting and that is related to distributed operating systems in some way.

To begin selecting a paper, I suggest that you:

search on Google Scholar using keywords relating to your interests, and/or
browse the proceedings of major conferences that publish work related to distributed operating systems.

The main operating system conferences are OSDI and ACM SOSP (sosp.org,ACM DL). Note that not all the work here is on distributed operating systems! Also, many other conferences publish some work related to distributed operating systems, e.g. NSDI.

To help you write a literature review or the background of a research paper, read the following:

Harvey, "What Is a Literature Review?" (DOC) (PPT)
Taylor, "The Literature Review: A Few Tips On Conducting It"

Assigned Readings

September 10, 2018

The Early Internet:

September 12, 2018

The Mother of All Demos:

Doug Engelbart Institute, "Doug's 1968 Demo". You may want to focus on the highlights or the annotated clips.
Wikipedia's page on "The Mother of all Demos"

September 17, 2018

The Alto:

Thacker et al., "Alto: A Personal computer" (1979) (archive.org)

September 19, 2018

Multics & UNIX:

Optional: Browse around the Multicians website.

September 24, 2018

LOCUS & Sprite:

September 26, 2018

V, Amoeba, Clouds:

October 1, 2018

NFS & AFS (+ Literature reviews)

Harvey, "What Is a Literature Review?" (DOC) (PPT)
Taylor, "The Literature Review: A Few Tips On Conducting It" (PDF)

October 3, 2018

Farsite & Oceanstore

October 8, 2018

Thanksgiving!

October 10, 2018

Plan 9 & Inferno

October 15, 2018

Test 1 review

October 17, 2018

Test 1

October 29, 2018

Background (optional but helpful):

October 31, 2018

Project Proposal Due

November 5, 2018

November 7, 2018

November 12, 2018

November 14, 2018

November 19, 2018

Anderson, "BOINC: A System for Public-Resource Computing and Storage" (Grid Computing 2004) (DOI) (Proxy)

November 21, 2018

Test 2

November 26, 2018

Containers & Orchestration

Wikipedia, Operating-System-Level Virtualization
Wikipedia article on Docker
Burns et al., "Borg, Omega, and Kubernetes" (ACM Queue Jan/Feb 2016) (DOI)
Openshift 3.11 Architecture

November 28, 2018

"Serverless Computing"

@@ Line 19: / Line 19: @@
 ==Assigned Readings==
-===September 10, 2018===
+===[[DistOS 2018F 2018-09-10|September 10, 2018]]===
 The Early Internet:
@@ Line 25: / Line 25: @@
 * [https://archive.org/details/ComputerNetworks_TheHeraldsOfResourceSharing Computer Networks: The Heralds of Resource Sharing (1972)] - video
-===September 12, 2018===
+===[[DistOS 2018F 2018-09-12|September 12, 2018]]===
 The Mother of All Demos:
@@ Line 31: / Line 31: @@
 * [http://en.wikipedia.org/wiki/The_Mother_of_All_Demos Wikipedia's page on "The Mother of all Demos"]
-===September 17, 2018===
+===[[DistOS 2018F 2018-09-17|September 17, 2018]]===
 The Alto:
 * [https://homeostasis.scs.carleton.ca/~soma/distos/2014w/alto.pdf Thacker et al., "Alto: A Personal computer" (1979)]  ([https://archive.org/details/bitsavers_xeroxparcttoAPersonalComputer_6560658 archive.org])
-===September 19, 2018===
+===[[DistOS 2018F 2018-09-19|September 19, 2018]]===
 Multics & UNIX:
@@ Line 44: / Line 44: @@
 Optional: Browse around [http://www.multicians.org/ the Multicians website].
-===September 24, 2018===
+===[[DistOS 2018F 2018-09-24|September 24, 2018]]===
 LOCUS & Sprite:
@@ Line 50: / Line 50: @@
 * [http://homeostasis.scs.carleton.ca/~soma/distos/2008-01-28/ousterhout-sprite.pdf John Ousterhout et al., "The Sprite Network Operating System" (1987)]
-===September 26, 2018===
+===[[DistOS 2018F 2018-09-26|September 26, 2018]]===
 V, Amoeba, Clouds:
@@ Line 57: / Line 57: @@
 * [http://homeostasis.scs.carleton.ca/~soma/distos/2008-01-28/clouds-dasgupta.pdf Partha Dasgupta et al., "The Clouds Distributed Operating System" (1991)]
-===October 1, 2018===
+===[[DistOS 2018F 2018-10-01|October 1, 2018]]===
 NFS & AFS (+ Literature reviews)
@@ Line 64: / Line 64: @@
 * Harvey, "What Is a Literature Review?" [http://www.cs.cmu.edu/~missy/WritingaLiteratureReview.doc (DOC)] [http://www.cs.cmu.edu/~missy/Writing_a_Literature_Review.ppt (PPT)]
-* [http://www.writing.utoronto.ca/advice/specific-types-of-writing/literature-review Taylor, "The Literature Review: A Few Tips On Conducting It"]
+* [http://advice.writing.utoronto.ca/types-of-writing/literature-review/ Taylor, "The Literature Review: A Few Tips On Conducting It"] [http://homeostasis.scs.carleton.ca/~soma/distos/2018f/taylor-literature-review.pdf (PDF)]
-===October 3, 2018===
+===[[DistOS 2018F 2018-10-03|October 3, 2018]]===
 Farsite & Oceanstore
+* [http://homeostasis.scs.carleton.ca/~soma/distos/fall2008/adya-farsite-intro.pdf Atul Adya et al.,"FARSITE: Federated, Available, and Reliable Storage for an Incompletely Trusted Environment" (2002)]
+* [http://homeostasis.scs.carleton.ca/~soma/distos/fall2008/bolosky-farsite-retro.pdf William J. Bolosky et al., "The Farsite Project: A Retrospective" (2007)]
 * [http://homeostasis.scs.carleton.ca/~soma/distos/fall2008/oceanstore-sigplan.pdf John Kubiatowicz et al., "OceanStore: An Architecture for Global-Scale Persistent Storage" (2000)]
 * [http://homeostasis.scs.carleton.ca/~soma/distos/fall2008/fast2003-pond.pdf Sean Rhea et al., "Pond: the OceanStore Prototype" (2003)]
@@ Line 74: / Line 76: @@
 ===October 8, 2018===
-Thanksgiving!
+'''Thanksgiving!'''
-===October 10, 2018===
+===[[DistOS 2018F 2018-10-10|October 10, 2018]]===
-Farsite & Plan 9
+Plan 9 & Inferno
-* [http://homeostasis.scs.carleton.ca/~soma/distos/fall2008/adya-farsite-intro.pdf Atul Adya et al.,"FARSITE: Federated, Available, and Reliable Storage for an Incompletely Trusted Environment" (2002)]
+* [https://homeostasis.scs.carleton.ca/~soma/distos/2014w/presotto-plan9.pdf Presotto et. al, Plan 9, A Distributed System (1991)]
-* [http://homeostasis.scs.carleton.ca/~soma/distos/fall2008/bolosky-farsite-retro.pdf William J. Bolosky et al., "The Farsite Project: A Retrospective" (2007)]
+* [https://homeostasis.scs.carleton.ca/~soma/distos/2014w/pike-plan9.pdf Pike et al., Plan 9 from Bell Labs (1995)]
-* [http://homeostasis.scs.carleton.ca/~soma/distos/2014w/presotto-plan9.pdf Presotto et. al, Plan 9, A Distributed System (1991)]
+* [https://homeostasis.scs.carleton.ca/~soma/distos/2018f/doward97-inferno.pdf Doward et al., The Inferno Operating System (1997)]
-* [http://homeostasis.scs.carleton.ca/~soma/distos/2014w/pike-plan9.pdf Pike et al., Plan 9 from Bell Labs (1995)]
+* [http://www.inferno-os.info/inferno/ Inferno OS website] (browse)
-===October 15, 2018===
+===[[DistOS 2018F 2018-10-15|October 15, 2018]]===
-Test 1 review
+'''Test 1 review'''
 ===October 17, 2018===
-Test 1
+'''Test 1'''
+===[[DistOS 2018F 2018-10-29|October 29, 2018]]===
+* [http://www.usenix.org/events/osdi06/tech/weil.html Weil et al., Ceph: A Scalable, High-Performance Distributed File System (OSDI 2006)].
+* [http://pdos.csail.mit.edu/~strib/docs/tapestry/tapestry_jsac03.pdf Zhao et al, "Tapestry: A Resilient Global-Scale Overlay for Service Deployment" (JSAC 2003)]
+Background (optional but helpful):
+* [http://en.wikipedia.org/wiki/Distributed_hash_table Wikipedia's article on Distributed Hash Tables]
+* [http://en.wikipedia.org/wiki/Kademlia Wikipedia's article on Kademlia]
+* [http://en.wikipedia.org/wiki/Tapestry_%28DHT%29 Wikipedia's article on Tapestry]
+===[[DistOS 2018F 2018-10-31|October 31, 2018]]===
+'''Project Proposal Due'''
+* [http://research.google.com/archive/gfs-sosp2003.pdf Sanjay Ghemawat et al., "The Google File System" (SOSP 2003)]
+* [https://www.usenix.org/legacy/events/osdi06/tech/burrows.html Burrows, The Chubby Lock Service for Loosely-Coupled Distributed Systems (OSDI 2006)]
+===[[DistOS 2018F 2018-11-05|November 5, 2018]]===
+* [http://research.google.com/archive/bigtable-osdi06.pdf Chang et al., "BigTable: A Distributed Storage System for Structured Data" (OSDI 2006)]
+* [https://www.usenix.org/conference/osdi12/technical-sessions/presentation/corbett Corbett et al., "Spanner: Google’s Globally-Distributed Database" (OSDI 2012)]
+===[[DistOS 2018F 2018-11-07|November 7, 2018]]===
+* [http://research.google.com/archive/mapreduce.html Dean & Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters" (OSDI 2004)]
+* [https://www.usenix.org/conference/osdi16/technical-sessions/presentation/abadi Martin Abadi et al., "TensorFlow: A System for Large-Scale Machine Learning" (OSDI 2016)]
+===[[DistOS 2018F 2018-11-12|November 12, 2018]]===
+* [http://www.allthingsdistributed.com/files/amazon-dynamo-sosp2007.pdf DeCandia et al., "Dynamo: Amazon’s Highly Available Key-value Store" (SOSP 2007)]
+* [http://www.cs.cornell.edu/projects/ladis2009/papers/lakshman-ladis2009.pdf Lakshman & Malik, "Cassandra - A Decentralized Structured Storage System" (LADIS 2009)]
+===[[DistOS 2018F 2018-11-14|November 14, 2018]]===
+* [http://static.usenix.org/legacy/events/osdi10/tech/full_papers/Beaver.pdf Beaver et al., "Finding a needle in Haystack: Facebook’s photo storage" (OSDI 2010)]
+* [https://www.usenix.org/conference/osdi14/technical-sessions/presentation/muralidhar Muralidhar et al., "f4: Facebook's Warm BLOB Storage System" (OSDI 2014)]
+===[[DistOS 2018F 2018-11-19|November 19, 2018]]===
+* Anderson, "BOINC: A System for Public-Resource Computing and Storage" (Grid Computing 2004) [http://dx.doi.org/10.1109/GRID.2004.14 (DOI)] [http://ieeexplore.ieee.org.proxy.library.carleton.ca/stamp/stamp.jsp?tp=&arnumber=1382809 (Proxy)]
+===November 21, 2018===
+Test 2
+===[[DistOS 2018F 2018-11-26|November 26, 2018]]===
+Containers & Orchestration
+* Wikipedia, [https://en.wikipedia.org/wiki/Operating-system-level_virtualization Operating-System-Level Virtualization]
+* [https://en.wikipedia.org/wiki/Docker_(software) Wikipedia article on Docker]
+* Burns et al., "Borg, Omega, and Kubernetes" (ACM Queue Jan/Feb 2016) [https://doi.org/10.1145/2898442.2898444 (DOI)]
+* [https://docs.openshift.com/container-platform/3.11/architecture/index.html Openshift 3.11 Architecture]
+===[[DistOS 2018F 2018-11-28|November 28, 2018]]===
+"Serverless Computing"
+* [https://en.wikipedia.org/wiki/Serverless_computing Wikipedia article on Serverless Computing]
+* [https://en.wikipedia.org/wiki/Google_App_Engine Wikipedia article on Google App Engine]
+* [https://en.wikipedia.org/wiki/AWS_Lambda Wikipedia article on AWS Lambda]
+* [https://cloud.google.com/appengine/ Google App Engine]
+* [https://docs.aws.amazon.com/lambda/latest/dg/welcome.html AWS Lambda Developer Guide]
+* [https://serverless.com/framework/docs/ serverless documentation]