Distributed OS: Winter 2023: Difference between revisions

From Soma-notes
No edit summary
 
(2 intermediate revisions by the same user not shown)
Line 106: Line 106:
Project Proposal due March 3rd
Project Proposal due March 3rd


===March 6, 2023===
===[[DistOS 2023W 2023-03-06|March 6, 2023]]===


NASD & Tapestry
NASD & Tapestry
Line 115: Line 115:
* [https://en.wikipedia.org/wiki/Distributed_hash_table Wikipedia's article on Distributed Hash Tables]
* [https://en.wikipedia.org/wiki/Distributed_hash_table Wikipedia's article on Distributed Hash Tables]


===March 8, 2023===
===[[DistOS 2023W 2023-03-08|March 8, 2023]]===


Chubby & GFS
Chubby & GFS
Line 121: Line 121:
* [https://research.google.com/archive/gfs-sosp2003.pdf Sanjay Ghemawat et al., "The Google File System" (SOSP 2003)]
* [https://research.google.com/archive/gfs-sosp2003.pdf Sanjay Ghemawat et al., "The Google File System" (SOSP 2003)]


===March 13, 2023===
===[[DistOS 2023W 2023-03-13|March 13, 2023]]===


Ceph
Ceph
Line 127: Line 127:
* [https://homeostasis.scs.carleton.ca/~soma/distos/2021f/papers/weil2006-crush.pdf Weil et al., CRUSH: Controlled, Scalable, Decentralized Placement of Replicated Data (SC 2006)]
* [https://homeostasis.scs.carleton.ca/~soma/distos/2021f/papers/weil2006-crush.pdf Weil et al., CRUSH: Controlled, Scalable, Decentralized Placement of Replicated Data (SC 2006)]


===March 15, 2023===
===[[DistOS 2023W 2023-03-15|March 15, 2023]]===


BigTable & MapReduce
BigTable & MapReduce
Line 133: Line 133:
* [https://research.google.com/archive/mapreduce.html Dean & Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters" (OSDI 2004)] (be sure to read paper)
* [https://research.google.com/archive/mapreduce.html Dean & Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters" (OSDI 2004)] (be sure to read paper)


===March 20, 2023===
===[[DistOS 2023W 2023-03-20|March 20, 2023]]===


Omega & Borg
Omega & Borg
Line 139: Line 139:
* [https://research.google/pubs/pub43438.pdf Verma et al., "Large-scale cluster management at Google with Borg" (EuroSys 2015)]
* [https://research.google/pubs/pub43438.pdf Verma et al., "Large-scale cluster management at Google with Borg" (EuroSys 2015)]


===March 22, 2023===
===[[DistOS 2023W 2023-03-22|March 22, 2023]]===


Cassandra & Dynamo
Cassandra & Dynamo
Line 145: Line 145:
* [http://www.allthingsdistributed.com/files/amazon-dynamo-sosp2007.pdf DeCandia et al., "Dynamo: Amazon’s Highly Available Key-value Store" (SOSP 2007)]
* [http://www.allthingsdistributed.com/files/amazon-dynamo-sosp2007.pdf DeCandia et al., "Dynamo: Amazon’s Highly Available Key-value Store" (SOSP 2007)]


===March 27, 2023===
===[[DistOS 2023W 2023-03-27|March 27, 2023]]===


Zookeeper & Delos
Zookeeper & Delos
Line 151: Line 151:
* [http://static.usenix.org/event/atc10/tech/full_papers/Hunt.pdf Hunt et al., "ZooKeeper: Wait-free coordination for Internet-scale systems" (USENIX ATC 2010)] [https://www.usenix.org/legacy/multimedia/atc10hunt (video)]
* [http://static.usenix.org/event/atc10/tech/full_papers/Hunt.pdf Hunt et al., "ZooKeeper: Wait-free coordination for Internet-scale systems" (USENIX ATC 2010)] [https://www.usenix.org/legacy/multimedia/atc10hunt (video)]


===March 29, 2023===
===[[DistOS 2023W 2023-03-29|March 29, 2023]]===


Haystack & F4
Haystack & F4
Line 157: Line 157:
* [https://www.usenix.org/conference/osdi14/technical-sessions/presentation/muralidhar Muralidhar et al., "f4: Facebook's Warm BLOB Storage System" (OSDI 2014)]
* [https://www.usenix.org/conference/osdi14/technical-sessions/presentation/muralidhar Muralidhar et al., "f4: Facebook's Warm BLOB Storage System" (OSDI 2014)]


===April 3, 2023===
===[[DistOS 2023W 2023-04-03|April 3, 2023]]===


Spanner & Tensorflow
Spanner & Tensorflow
Line 163: Line 163:
* [https://www.usenix.org/conference/osdi16/technical-sessions/presentation/abadi Martin Abadi et al., "TensorFlow: A System for Large-Scale Machine Learning" (OSDI 2016)]
* [https://www.usenix.org/conference/osdi16/technical-sessions/presentation/abadi Martin Abadi et al., "TensorFlow: A System for Large-Scale Machine Learning" (OSDI 2016)]


===April 5, 2023===
===[[DistOS 2023W 2023-04-05|April 5, 2023]]===


TBD
Class wrap up, final exam review


===April 10, 2023===
===April 10, 2023===
Project Presentations
===April 12, 2023===


Project Presentations
Project Presentations

Latest revision as of 15:53, 3 April 2023

Course Outline

Here is the course outline.

Project Help

To develop a literature review or research proposal, start with a single research paper that you find interesting and that is related to distributed operating systems in some way.

To begin selecting a paper, I suggest that you:

  • search on Google Scholar using keywords relating to your interests, and/or
  • browse the proceedings of major conferences that publish work related to distributed operating systems.

The main operating system conferences are OSDI and ACM SOSP (sosp.org,ACM DL). Note that not all the work here is on distributed operating systems! Also, many other conferences publish some work related to distributed operating systems, e.g. NSDI.

To help you write a literature review or the background of a research paper, read the following:

Class Schedule & Readings

January 9, 2023

Introduction

January 11, 2023

Designing a distributed operating system

January 16, 2023

The Early Internet & Multics:

Optional: Browse around the Multicians website.

January 18, 2023

UNIX

Note that the video covers the main points of the UNIX paper.

January 23, 2023

The Mother of All Demos:

The Alto:

January 25, 2023

Distributed Shared Memory

January 30, 2023

Remote Procedure Calls

February 1, 2023

LOCUS & NFS

February 6, 2023

Sprite, AFS

February 8, 2023

Plan 9 & Inferno

February 13, 2023

Midterm review

February 15, 2023

Midterm exam

February 27, 2023

"Web Scale" discussion

March 1, 2023

OceanStore & BOINC

Project Proposal due March 3rd

March 6, 2023

NASD & Tapestry

Background (optional but helpful):

March 8, 2023

Chubby & GFS

March 13, 2023

Ceph

March 15, 2023

BigTable & MapReduce

March 20, 2023

Omega & Borg

March 22, 2023

Cassandra & Dynamo

March 27, 2023

Zookeeper & Delos

March 29, 2023

Haystack & F4

April 3, 2023

Spanner & Tensorflow

April 5, 2023

Class wrap up, final exam review

April 10, 2023

Project Presentations