Distributed OS: Fall 2021: Difference between revisions
| Line 54: | Line 54: | ||
* [https://www.usenix.org/system/files/login/articles/963-galvin.pdf Galvin, "Solaris 10 Containers" (;LOGIN 2005)] | * [https://www.usenix.org/system/files/login/articles/963-galvin.pdf Galvin, "Solaris 10 Containers" (;LOGIN 2005)] | ||
===October 5, 2021=== | ===[[DistOS 2021F 2021-10-05|October 5, 2021]]=== | ||
NASD & GFS | NASD & GFS | ||
| Line 60: | Line 60: | ||
* [https://research.google.com/archive/gfs-sosp2003.pdf Sanjay Ghemawat et al., "The Google File System" (SOSP 2003)] | * [https://research.google.com/archive/gfs-sosp2003.pdf Sanjay Ghemawat et al., "The Google File System" (SOSP 2003)] | ||
===October 7, 2021=== | ===[[DistOS 2021F 2021-10-07|October 7, 2021]]=== | ||
Chubby & ZooKeeper | Chubby & ZooKeeper | ||
| Line 66: | Line 66: | ||
* [http://static.usenix.org/event/atc10/tech/full_papers/Hunt.pdf Hunt et al., "ZooKeeper: Wait-free coordination for Internet-scale systems" (USENIX ATC 2010)] [https://www.usenix.org/legacy/multimedia/atc10hunt (video)] | * [http://static.usenix.org/event/atc10/tech/full_papers/Hunt.pdf Hunt et al., "ZooKeeper: Wait-free coordination for Internet-scale systems" (USENIX ATC 2010)] [https://www.usenix.org/legacy/multimedia/atc10hunt (video)] | ||
===October 12, 2021=== | ===[[DistOS 2021F 2021-10-12|October 12, 2021]]=== | ||
BigTable & MapReduce | BigTable & MapReduce | ||
| Line 72: | Line 72: | ||
* [https://research.google.com/archive/mapreduce.html Dean & Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters" (OSDI 2004)] (be sure to read paper) | * [https://research.google.com/archive/mapreduce.html Dean & Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters" (OSDI 2004)] (be sure to read paper) | ||
===October 14, 2021=== | ===[[DistOS 2021F 2021-10-14|October 14, 2021]]=== | ||
Omega & Borg | Omega & Borg | ||
Revision as of 02:18, 13 October 2021
Course Outline
Here is the course outline.
Experiences
- Experience 1, due November 2, 2021
- Experience 2, due November 30, 2021
Using Openstack
The experiences (and potentially your project) will involve using the SCS Openstack cluster:
- How to use Openstack (for COMP 4000/5102)
- SCS Openstack web console (only available from the Carleton network)
Classes
More information will be posted here by the first class.
Note: If you don't have access to the course information on brightspace, please email Prof. Somayaji, you may need to be manually added. (If you're at UofO or you recently added COMP 5102, you probably need to be added manually.) On Brightspace the course should show up as COMP 4000 no matter whether you enrolled in it or COMP 5102.
Readings & Classes
September 9, 2021
Introduction
September 14, 2021
UNIX
- The UNIX System: Making Computers More Productive (1982), video
- Dennis M. Ritchie and Ken Thompson, "The UNIX Time-Sharing System" (1974)
Note that the video covers the main points of the paper.
September 16, 2021
LOCUS
September 21, 2021
NFS
September 23, 2021
Distributed Shared Memory
September 28, 2021
Plan 9
September 30, 2021
Solaris Zones
- Price & Tucker, "Solaris Zones: Operating System Support for Consolidating Commercial Workloads" (LISA 2004)
- Galvin, "Solaris 10 Containers" (;LOGIN 2005)
October 5, 2021
NASD & GFS
- Garth A. Gibson et al., "A Cost-Effective, High-Bandwidth Storage Architecture" (1998)
- Sanjay Ghemawat et al., "The Google File System" (SOSP 2003)
October 7, 2021
Chubby & ZooKeeper
- Burrows, The Chubby Lock Service for Loosely-Coupled Distributed Systems (OSDI 2006)
- Hunt et al., "ZooKeeper: Wait-free coordination for Internet-scale systems" (USENIX ATC 2010) (video)
October 12, 2021
BigTable & MapReduce
- Chang et al., "BigTable: A Distributed Storage System for Structured Data" (OSDI 2006)
- Dean & Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters" (OSDI 2004) (be sure to read paper)
October 14, 2021
Omega & Borg
- Schwarzkopf et al., "Omega: flexible, scalable schedulers for large compute clusters" (EuroSys 2013)
- Verma et al., "Large-scale cluster management at Google with Borg" (EuroSys 2015)
October 19, 2021
Midterm Review
October 21, 2021
Midterm