Distributed OS: Fall 2018: Difference between revisions
| (17 intermediate revisions by 2 users not shown) | |||
| Line 105: | Line 105: | ||
===[[DistOS 2018F 2018-10-31|October 31, 2018]]=== | ===[[DistOS 2018F 2018-10-31|October 31, 2018]]=== | ||
'''Project Proposal Due''' | |||
* [http://research.google.com/archive/gfs-sosp2003.pdf Sanjay Ghemawat et al., "The Google File System" (SOSP 2003)] | * [http://research.google.com/archive/gfs-sosp2003.pdf Sanjay Ghemawat et al., "The Google File System" (SOSP 2003)] | ||
* [https://www.usenix.org/legacy/events/osdi06/tech/burrows.html Burrows, The Chubby Lock Service for Loosely-Coupled Distributed Systems (OSDI 2006)] | * [https://www.usenix.org/legacy/events/osdi06/tech/burrows.html Burrows, The Chubby Lock Service for Loosely-Coupled Distributed Systems (OSDI 2006)] | ||
===[[DistOS 2018F 2018- | ===[[DistOS 2018F 2018-11-05|November 5, 2018]]=== | ||
* [http://research.google.com/archive/bigtable-osdi06.pdf Chang et al., "BigTable: A Distributed Storage System for Structured Data" (OSDI 2006)] | * [http://research.google.com/archive/bigtable-osdi06.pdf Chang et al., "BigTable: A Distributed Storage System for Structured Data" (OSDI 2006)] | ||
* [https://www.usenix.org/conference/osdi12/technical-sessions/presentation/corbett Corbett et al., "Spanner: Google’s Globally-Distributed Database" (OSDI 2012)] | * [https://www.usenix.org/conference/osdi12/technical-sessions/presentation/corbett Corbett et al., "Spanner: Google’s Globally-Distributed Database" (OSDI 2012)] | ||
===[[DistOS 2018F 2018- | ===[[DistOS 2018F 2018-11-07|November 7, 2018]]=== | ||
* [http://research.google.com/archive/mapreduce.html Dean & Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters" (OSDI 2004)] | * [http://research.google.com/archive/mapreduce.html Dean & Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters" (OSDI 2004)] | ||
* [https://www.usenix.org/conference/osdi16/technical-sessions/presentation/abadi Martin Abadi et al., "TensorFlow: A System for Large-Scale Machine Learning" (OSDI 2016)] | * [https://www.usenix.org/conference/osdi16/technical-sessions/presentation/abadi Martin Abadi et al., "TensorFlow: A System for Large-Scale Machine Learning" (OSDI 2016)] | ||
===[[DistOS 2018F 2018- | ===[[DistOS 2018F 2018-11-12|November 12, 2018]]=== | ||
* [http://www.allthingsdistributed.com/files/amazon-dynamo-sosp2007.pdf DeCandia et al., "Dynamo: Amazon’s Highly Available Key-value Store" (SOSP 2007)] | * [http://www.allthingsdistributed.com/files/amazon-dynamo-sosp2007.pdf DeCandia et al., "Dynamo: Amazon’s Highly Available Key-value Store" (SOSP 2007)] | ||
* [http://www.cs.cornell.edu/projects/ladis2009/papers/lakshman-ladis2009.pdf Lakshman & Malik, "Cassandra - A Decentralized Structured Storage System" (LADIS 2009)] | * [http://www.cs.cornell.edu/projects/ladis2009/papers/lakshman-ladis2009.pdf Lakshman & Malik, "Cassandra - A Decentralized Structured Storage System" (LADIS 2009)] | ||
===[[DistOS 2018F 2018- | ===[[DistOS 2018F 2018-11-14|November 14, 2018]]=== | ||
* [http://static.usenix.org/legacy/events/osdi10/tech/full_papers/Beaver.pdf Beaver et al., "Finding a needle in Haystack: Facebook’s photo storage" (OSDI 2010)] | * [http://static.usenix.org/legacy/events/osdi10/tech/full_papers/Beaver.pdf Beaver et al., "Finding a needle in Haystack: Facebook’s photo storage" (OSDI 2010)] | ||
* [https://www.usenix.org/conference/osdi14/technical-sessions/presentation/muralidhar Muralidhar et al., "f4: Facebook's Warm BLOB Storage System" (OSDI 2014)] | * [https://www.usenix.org/conference/osdi14/technical-sessions/presentation/muralidhar Muralidhar et al., "f4: Facebook's Warm BLOB Storage System" (OSDI 2014)] | ||
===[[DistOS 2018F 2018- | ===[[DistOS 2018F 2018-11-19|November 19, 2018]]=== | ||
* Anderson, "BOINC: A System for Public-Resource Computing and Storage" (Grid Computing 2004) [http://dx.doi.org/10.1109/GRID.2004.14 (DOI)] [http://ieeexplore.ieee.org.proxy.library.carleton.ca/stamp/stamp.jsp?tp=&arnumber=1382809 (Proxy)] | * Anderson, "BOINC: A System for Public-Resource Computing and Storage" (Grid Computing 2004) [http://dx.doi.org/10.1109/GRID.2004.14 (DOI)] [http://ieeexplore.ieee.org.proxy.library.carleton.ca/stamp/stamp.jsp?tp=&arnumber=1382809 (Proxy)] | ||
| Line 137: | Line 139: | ||
Test 2 | Test 2 | ||
===[[DistOS 2018F 2018-10- | ===[[DistOS 2018F 2018-11-26|November 26, 2018]]=== | ||
Containers & Orchestration | |||
* Wikipedia, [https://en.wikipedia.org/wiki/Operating-system-level_virtualization Operating-System-Level Virtualization] | |||
* [https://en.wikipedia.org/wiki/Docker_(software) Wikipedia article on Docker] | |||
* Burns et al., "Borg, Omega, and Kubernetes" (ACM Queue Jan/Feb 2016) [https://doi.org/10.1145/2898442.2898444 (DOI)] | |||
* [https://docs.openshift.com/container-platform/3.11/architecture/index.html Openshift 3.11 Architecture] | |||
===[[DistOS 2018F 2018-11-28|November 28, 2018]]=== | |||
"Serverless Computing" | |||
* [https://en.wikipedia.org/wiki/Serverless_computing Wikipedia article on Serverless Computing] | |||
* [https://en.wikipedia.org/wiki/Google_App_Engine Wikipedia article on Google App Engine] | |||
* [https://en.wikipedia.org/wiki/AWS_Lambda Wikipedia article on AWS Lambda] | |||
* [https://cloud.google.com/appengine/ Google App Engine] | |||
* [https://docs.aws.amazon.com/lambda/latest/dg/welcome.html AWS Lambda Developer Guide] | |||
* [https://serverless.com/framework/docs/ serverless documentation] | |||
Latest revision as of 16:02, 21 November 2018
Course Outline
Here is the course outline.
Project Help
To develop your literature review or research proposal, start with a single research paper that you find interesting and that is related to distributed operating systems in some way.
To begin selecting a paper, I suggest that you:
- search on Google Scholar using keywords relating to your interests, and/or
- browse the proceedings of major conferences that publish work related to distributed operating systems.
The main operating system conferences are OSDI and ACM SOSP (sosp.org,ACM DL). Note that not all the work here is on distributed operating systems! Also, many other conferences publish some work related to distributed operating systems, e.g. NSDI.
To help you write a literature review or the background of a research paper, read the following:
- Harvey, "What Is a Literature Review?" (DOC) (PPT)
- Taylor, "The Literature Review: A Few Tips On Conducting It"
Assigned Readings
September 10, 2018
The Early Internet:
- Robert E. Kahn, "Resource-Sharing Computer Communications Networks" (1972) (DOI)
- Computer Networks: The Heralds of Resource Sharing (1972) - video
September 12, 2018
The Mother of All Demos:
- Doug Engelbart Institute, "Doug's 1968 Demo". You may want to focus on the highlights or the annotated clips.
- Wikipedia's page on "The Mother of all Demos"
September 17, 2018
The Alto:
September 19, 2018
Multics & UNIX:
- Wikipedia article on Multics
- Dennis M. Ritchie and Ken Thompson, "The UNIX Time-Sharing System" (1974)
Optional: Browse around the Multicians website.
September 24, 2018
LOCUS & Sprite:
- Bruce Walker et al., "The LOCUS Distributed Operating System." (1983)
- John Ousterhout et al., "The Sprite Network Operating System" (1987)
September 26, 2018
V, Amoeba, Clouds:
- David R. Cheriton, "The V Distributed System." (1988)
- Andrew Tannenbaum et al., "The Amoeba System" (1990)
- Partha Dasgupta et al., "The Clouds Distributed Operating System" (1991)
October 1, 2018
NFS & AFS (+ Literature reviews)
- Russel Sandberg et al., "Design and Implementation of the Sun Network Filesystem" (1985)
- John H. Howard et al., "Scale and Performance in a Distributed File System" (1988)
- Harvey, "What Is a Literature Review?" (DOC) (PPT)
- Taylor, "The Literature Review: A Few Tips On Conducting It" (PDF)
October 3, 2018
Farsite & Oceanstore
- Atul Adya et al.,"FARSITE: Federated, Available, and Reliable Storage for an Incompletely Trusted Environment" (2002)
- William J. Bolosky et al., "The Farsite Project: A Retrospective" (2007)
- John Kubiatowicz et al., "OceanStore: An Architecture for Global-Scale Persistent Storage" (2000)
- Sean Rhea et al., "Pond: the OceanStore Prototype" (2003)
October 8, 2018
Thanksgiving!
October 10, 2018
Plan 9 & Inferno
- Presotto et. al, Plan 9, A Distributed System (1991)
- Pike et al., Plan 9 from Bell Labs (1995)
- Doward et al., The Inferno Operating System (1997)
- Inferno OS website (browse)
October 15, 2018
Test 1 review
October 17, 2018
Test 1
October 29, 2018
- Weil et al., Ceph: A Scalable, High-Performance Distributed File System (OSDI 2006).
- Zhao et al, "Tapestry: A Resilient Global-Scale Overlay for Service Deployment" (JSAC 2003)
Background (optional but helpful):
- Wikipedia's article on Distributed Hash Tables
- Wikipedia's article on Kademlia
- Wikipedia's article on Tapestry
October 31, 2018
Project Proposal Due
- Sanjay Ghemawat et al., "The Google File System" (SOSP 2003)
- Burrows, The Chubby Lock Service for Loosely-Coupled Distributed Systems (OSDI 2006)
November 5, 2018
- Chang et al., "BigTable: A Distributed Storage System for Structured Data" (OSDI 2006)
- Corbett et al., "Spanner: Google’s Globally-Distributed Database" (OSDI 2012)
November 7, 2018
- Dean & Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters" (OSDI 2004)
- Martin Abadi et al., "TensorFlow: A System for Large-Scale Machine Learning" (OSDI 2016)
November 12, 2018
- DeCandia et al., "Dynamo: Amazon’s Highly Available Key-value Store" (SOSP 2007)
- Lakshman & Malik, "Cassandra - A Decentralized Structured Storage System" (LADIS 2009)
November 14, 2018
- Beaver et al., "Finding a needle in Haystack: Facebook’s photo storage" (OSDI 2010)
- Muralidhar et al., "f4: Facebook's Warm BLOB Storage System" (OSDI 2014)
November 19, 2018
- Anderson, "BOINC: A System for Public-Resource Computing and Storage" (Grid Computing 2004) (DOI) (Proxy)
November 21, 2018
Test 2
November 26, 2018
Containers & Orchestration
- Wikipedia, Operating-System-Level Virtualization
- Wikipedia article on Docker
- Burns et al., "Borg, Omega, and Kubernetes" (ACM Queue Jan/Feb 2016) (DOI)
- Openshift 3.11 Architecture
November 28, 2018
"Serverless Computing"