Operating Systems (Fall 2014): Difference between revisions

From Soma-notes
Created page with "The outline and notes for COMP 3000, Operating Systems, will be here by early September 2014. The course will be using the textbook [http://pages.cs.wisc.edu/~remzi/OSTEP/ Op..."
 
 
(40 intermediate revisions by 2 users not shown)
Line 1: Line 1:
The outline and notes for COMP 3000, Operating Systems, will be here by early September 2014.
==Course Outline==


The course will be using the textbook [http://pages.cs.wisc.edu/~remzi/OSTEP/ Operating Systems: Three Easy Pieces].  The chapters of this textbook are available for free online; you can also buy a full epub, PDF, or paper copy if you wish.
[[Operating Systems (Fall 2014) Course Outline|Here]] is the course outline for COMP 3000: Operating Systems.
 
==Lectures and Exams==
 
Note that the topics below are primarily chapters from the class textbook, [http://pages.cs.wisc.edu/~remzi/OSTEP/ Operating Systems: Three Easy Pieces].  Note that while introductory and summary dialogues are not linked below, they are worth reading for an informal take on the material.
 
<table style="width: 100%;" border="1" cellpadding="4" cellspacing="0">
  <tr valign="top">
    <th>
    <p align="left">Date</p>
    </th>
    <th>
    <p align="left">Topic</p>
    </th>
  </tr>
    <tr>
      <td>
      <p>Sept. 5
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 1|Lecture 1]]: [http://pages.cs.wisc.edu/~remzi/OSTEP/intro.pdf Introduction]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Sept. 10
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 2|Lecture 2]]: [http://pages.cs.wisc.edu/~remzi/OSTEP/cpu-intro.pdf Processes], [http://pages.cs.wisc.edu/~remzi/OSTEP/cpu-api.pdf Process API]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Sept. 12
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 3|Lecture 3]]: [http://pages.cs.wisc.edu/~remzi/OSTEP/cpu-mechanisms.pdf Limited Direct Execution]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Sept. 17
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 4|Lecture 4]]:
[http://pages.cs.wisc.edu/~remzi/OSTEP/cpu-sched.pdf CPU Scheduling],
[http://pages.cs.wisc.edu/~remzi/OSTEP/cpu-sched-mlfq.pdf MLFQ]  </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Sept. 19
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 5|Lecture 5]]: [http://pages.cs.wisc.edu/~remzi/OSTEP/cpu-sched-lottery.pdf Lottery Scheduling], [http://pages.cs.wisc.edu/~remzi/OSTEP/cpu-sched-multi.pdf Multi-CPU scheduling]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Sept. 24
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 6|Lecture 6]]: [http://pages.cs.wisc.edu/~remzi/OSTEP/vm-intro.pdf Address Spaces], [http://pages.cs.wisc.edu/~remzi/OSTEP/vm-api.pdf Memory API]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Sept. 26
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 7|Lecture 7]]: [http://pages.cs.wisc.edu/~remzi/OSTEP/vm-mechanism.pdf Address Translation], [http://pages.cs.wisc.edu/~remzi/OSTEP/vm-segmentation.pdf Segmentation]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Oct. 1
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 8|Lecture 8]]: [http://pages.cs.wisc.edu/~remzi/OSTEP/vm-freespace.pdf Free space management], [http://pages.cs.wisc.edu/~remzi/OSTEP/vm-paging.pdf Paging]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Oct. 3
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 9|Lecture 9]]: [http://pages.cs.wisc.edu/~remzi/OSTEP/threads-intro.pdf Concurrency and Threads], [http://pages.cs.wisc.edu/~remzi/OSTEP/threads-locks.pdf Locks]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Oct. 8
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 10|Lecture 10]]: [http://pages.cs.wisc.edu/~remzi/OSTEP/threads-locks-usage.pdf Concurrent Data Structures], [http://pages.cs.wisc.edu/~remzi/OSTEP/threads-api.pdf Thread API]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Oct. 10
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 11|Lecture 11]]: [http://pages.cs.wisc.edu/~remzi/OSTEP/threads-cv.pdf Condition Variables], [http://pages.cs.wisc.edu/~remzi/OSTEP/threads-sema.pdf Semaphores], [http://pages.cs.wisc.edu/~remzi/OSTEP/threads-bugs.pdf Concurrency Problems]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Oct. 15
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 12|Lecture 12]]: [http://pages.cs.wisc.edu/~remzi/OSTEP/vm-tlbs.pdf TLBs], [http://pages.cs.wisc.edu/~remzi/OSTEP/vm-smalltables.pdf Smaller Tables]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Oct. 17
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 13|Lecture 13]]: Midterm Review
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Oct. 22
      </p>
      </td>
      <td>
      <p>Midterm (in class)
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Oct. 24
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Midterm solutions|Midterm solutions]]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Nov. 5
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 14|Lecture 14]]: [http://pages.cs.wisc.edu/~remzi/OSTEP/file-disks.pdf Hard Disk Drives],
[http://pages.cs.wisc.edu/~remzi/OSTEP/file-intro.pdf File and Directories]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Nov. 7
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 15|Lecture 15]]: [http://pages.cs.wisc.edu/~remzi/OSTEP/file-journaling.pdf FSCK and Journaling]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Nov. 12
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 16|Lecture 16]]: [http://pages.cs.wisc.edu/~remzi/OSTEP/file-devices.pdf I/O Devices]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Nov. 14
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 17|Lecture 17]]: [http://pages.cs.wisc.edu/~remzi/OSTEP/file-implementation.pdf File System Implementation], [http://pages.cs.wisc.edu/~remzi/OSTEP/file-ffs.pdf FFS]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Nov. 19
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 18|Lecture 18]]: [http://pages.cs.wisc.edu/~remzi/OSTEP/file-raid.pdf RAID], [http://pages.cs.wisc.edu/~remzi/OSTEP/file-lfs.pdf Log-structured FS] (optional readings)
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Nov. 21
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 19|Lecture 19]]: [http://pages.cs.wisc.edu/~remzi/OSTEP/file-integrity.pdf Data Integrity and Protection]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Nov. 26
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 20|Lecture 20]]: [http://pages.cs.wisc.edu/~remzi/OSTEP/dist-intro.pdf Distributed Systems], [http://pages.cs.wisc.edu/~remzi/OSTEP/vm-beyondphys.pdf Swapping: Mechanisms], [http://pages.cs.wisc.edu/~remzi/OSTEP/vm-beyondphys-policy.pdf Swapping: Policies]
 
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Nov. 28
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 21|Lecture 21]]: [http://pages.cs.wisc.edu/~remzi/OSTEP/dist-nfs.pdf NFS], [http://pages.cs.wisc.edu/~remzi/OSTEP/dist-afs.pdf AFS] (optional readings)
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Dec. 3
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 22|Lecture 22]]: Assignment Solutions 1
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Dec. 5
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Lecture 23|Lecture 23]]: Assignment Solutions 2
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Dec. 9, 1 PM
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F Final Exam Review|Review Session]] in ME 3275
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Dec. 14, 2 PM
      </p>
      </td>
      <td>
      <p>Final Exam in FH rows 20-25 ([http://homeostasis.scs.carleton.ca/~soma/os-2014f/solutions/comp3000-final-2014F-sol.pdf solutions])
      </p>
      </td>
    </tr>
</table>
 
==Tutorials==
 
Each week you will get a progress grade from 0-4, given to you by a TA.  If you are being diligent, you should be able to get 4's every week.  The easiest way to get your grade is to come to tutorial and meet with your TA; alternately, you can meet a TA in their office hours or, at their discretion, discuss things with them online.
 
<table style="width: 100%;" border="1" cellpadding="4" cellspacing="0">
  <tr valign="top">
    <th>
    <p align="left">Date</p>
    </th>
    <th>
    <p align="left">Tutorials</p>
    </th>
  </tr>
    <tr>
      <td>
      <p>Sept. 5,8
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F: Tutorial 1|UNIX Introduction]]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Sept. 12, 15
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F: Tutorial 2|Simple Shell]]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Sept. 19, 22
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F: Tutorial 3|Scheduler]]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Sept. 26, 29
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F: Tutorial 4|ELF, dynamic libraries]]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Oct. 3, 6
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F: Tutorial 5|Paging, Threads, Concurrency]]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Oct. 10
      </p>
      </td>
      <td>
      <p>(Optional) Continue Tutorial 5 and help with Assignment 5
      </p>
      </td>
    </tr>
        <tr>
      <td>
      <p>Oct. 17, 20
      </p>
      </td>
      <td>
      <p>Review
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Nov. 7, 10
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F: Tutorial 6|Block devices, Filesystems]]
      </p>
      </td>
    </tr>
    <tr>
    <tr>
      <td>
      <p>Nov. 14, 17
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F: Tutorial 7|Devices and Modules]]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Nov. 21, 24
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F: Tutorial 8|User-mode Filesystems]]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Nov. 28, Dec. 1
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F: Tutorial 9|Networking, Network Filesystems]]
      </p>
      </td>
    </tr>
</table>
 
==Assignments==
<table style="width: 100%;" border="1" cellpadding="4" cellspacing="0">
  <tr valign="top">
    <th>
    <p align="left">Due Date</p>
    </th>
    <th>
    <p align="left">Assignments</p>
    </th>
  </tr>
    <tr>
      <td>
      <p>Sept. 10
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F: Assignment 1|Assignment 1]]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Sept. 17
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F: Assignment 2|Assignment 2]]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Sept. 24
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F: Assignment 3|Assignment 3]]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>'''Oct. 4''' (extended)
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F: Assignment 4|Assignment 4]]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Oct. 16 (Thurs.)
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F: Assignment 5|Assignment 5]]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Nov. 12
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F: Assignment 6|Assignment 6]]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Nov. 20
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F: Assignment 7|Assignment 7]]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Nov. 27
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F: Assignment 8|Assignment 8]]
      </p>
      </td>
    </tr>
    <tr>
      <td>
      <p>Dec. 4
      </p>
      </td>
      <td>
      <p>[[Operating Systems 2014F: Assignment 9|Assignment 9]]
      </p>
      </td>
    </tr>
</table>
 
==Course Software==
 
In this course we will primarily working with [http://www.lubuntu.net/ Lubuntu], a low-resource variant of [http://www.ubuntu.com/ Ubuntu] Linux distribution.  You may use other Linux distributions in the tutorials to complete the assigned work; there will be differences, however, in some aspects (such as installing software), particularly if you use a distribution not based on Ubuntu or Debian.
 
===In the labs===
 
In the SCS labs you should be able to run the course VM by starting Virtualbox (listed in the Applications menu) and selecting the COMP 2406/3000 virtual machine image.  After the VM has fully booted you will be automatically logged into the student account; this account has admin privileges and its password is "tneduts!".
 
We highly recommend running your VM in full-screen mode (select from the menu, not by maximizing the window).  Do all of your work inside of the VM; it should be fast enough and you won't have any issues with sharing files or with firewalls/network connectivity.
 
You can save the work you do from the course VM (in the student account) to your SCS account and restore it to any other copy of the class VM (on your machines or in the labs) by running using the following commands:
 
  save3000 <SCS username>
  restore3000 <SCS username>
  compare3000 <SCS username>
 
If you use these commands, '''use them consistently'''.  That means run <tt>restore3000</tt> when you first log in, and run <tt>save3000</tt> just before logging out.  If you don't do this, you will '''erase''' the work that you had done previously when you save.
 
If you forgot to restore and you want to save, try running this:
 
  rsync -a -v --progress ~/ <SCS username>@access.scs.carleton.ca:COMP3000/
 
This is the same as the <tt>save3000</tt> command minus the options (--delete and --force) that deletes files in the destination that don't exist in the source.  As a check, you may want to add the <tt>-n</tt> option to do a dry run.
 
===Running the VM on your own machines===
 
If you want to run the VM appliance on your own system (running essentially any desktop operating system you want), just download the [http://homeostasis.scs.carleton.ca/~soma/VMs/COMP%202406-3000%20Fall%202014.ova virtual appliance file] and import.  The SHA1 hash of this file is:
 
  e5613881b28be41f49b82730282d40093388ee71  [http://homeostasis.scs.carleton.ca/~soma/VMs/COMP%202406-3000%20Fall%202014.ova COMP 2406-3000 Fall 2014.ova]
 
On Windows you can compute this hash for your downloaded file using the command [http://support.microsoft.com/kb/889768 <tt>FCIV -sha1 COMP 2406-3000 Fall 2014.ova</tt>].  If the hash is different from above, your download has been corrupted.
 
If the application is not VirtualBox, you'll need to:
* Have the VM platform ignore any errors in the structure of the appliance found during the import process;
* Uninstall the VirtualBox guest additions by typing starting a terminal application and running
  sudo apt-get purge virtualbox-guest-x11 virtualbox-guest-utils
* Install your platform's own Linux guest additions, if available.

Latest revision as of 17:09, 16 December 2014

Course Outline

Here is the course outline for COMP 3000: Operating Systems.

Lectures and Exams

Note that the topics below are primarily chapters from the class textbook, Operating Systems: Three Easy Pieces. Note that while introductory and summary dialogues are not linked below, they are worth reading for an informal take on the material.

Date

Topic

Sept. 5

Lecture 1: Introduction

Sept. 10

Lecture 2: Processes, Process API

Sept. 12

Lecture 3: Limited Direct Execution

Sept. 17

Lecture 4: CPU Scheduling, MLFQ

Sept. 19

Lecture 5: Lottery Scheduling, Multi-CPU scheduling

Sept. 24

Lecture 6: Address Spaces, Memory API

Sept. 26

Lecture 7: Address Translation, Segmentation

Oct. 1

Lecture 8: Free space management, Paging

Oct. 3

Lecture 9: Concurrency and Threads, Locks

Oct. 8

Lecture 10: Concurrent Data Structures, Thread API

Oct. 10

Lecture 11: Condition Variables, Semaphores, Concurrency Problems

Oct. 15

Lecture 12: TLBs, Smaller Tables

Oct. 17

Lecture 13: Midterm Review

Oct. 22

Midterm (in class)

Oct. 24

Midterm solutions

Nov. 5

Lecture 14: Hard Disk Drives, File and Directories

Nov. 7

Lecture 15: FSCK and Journaling

Nov. 12

Lecture 16: I/O Devices

Nov. 14

Lecture 17: File System Implementation, FFS

Nov. 19

Lecture 18: RAID, Log-structured FS (optional readings)

Nov. 21

Lecture 19: Data Integrity and Protection

Nov. 26

Lecture 20: Distributed Systems, Swapping: Mechanisms, Swapping: Policies

Nov. 28

Lecture 21: NFS, AFS (optional readings)

Dec. 3

Lecture 22: Assignment Solutions 1

Dec. 5

Lecture 23: Assignment Solutions 2

Dec. 9, 1 PM

Review Session in ME 3275

Dec. 14, 2 PM

Final Exam in FH rows 20-25 (solutions)

Tutorials

Each week you will get a progress grade from 0-4, given to you by a TA. If you are being diligent, you should be able to get 4's every week. The easiest way to get your grade is to come to tutorial and meet with your TA; alternately, you can meet a TA in their office hours or, at their discretion, discuss things with them online.

Date

Tutorials

Sept. 5,8

UNIX Introduction

Sept. 12, 15

Simple Shell

Sept. 19, 22

Scheduler

Sept. 26, 29

ELF, dynamic libraries

Oct. 3, 6

Paging, Threads, Concurrency

Oct. 10

(Optional) Continue Tutorial 5 and help with Assignment 5

Oct. 17, 20

Review

Nov. 7, 10

Block devices, Filesystems

Nov. 14, 17

Devices and Modules

Nov. 21, 24

User-mode Filesystems

Nov. 28, Dec. 1

Networking, Network Filesystems

Assignments

Due Date

Assignments

Sept. 10

Assignment 1

Sept. 17

Assignment 2

Sept. 24

Assignment 3

Oct. 4 (extended)

Assignment 4

Oct. 16 (Thurs.)

Assignment 5

Nov. 12

Assignment 6

Nov. 20

Assignment 7

Nov. 27

Assignment 8

Dec. 4

Assignment 9

Course Software

In this course we will primarily working with Lubuntu, a low-resource variant of Ubuntu Linux distribution. You may use other Linux distributions in the tutorials to complete the assigned work; there will be differences, however, in some aspects (such as installing software), particularly if you use a distribution not based on Ubuntu or Debian.

In the labs

In the SCS labs you should be able to run the course VM by starting Virtualbox (listed in the Applications menu) and selecting the COMP 2406/3000 virtual machine image. After the VM has fully booted you will be automatically logged into the student account; this account has admin privileges and its password is "tneduts!".

We highly recommend running your VM in full-screen mode (select from the menu, not by maximizing the window). Do all of your work inside of the VM; it should be fast enough and you won't have any issues with sharing files or with firewalls/network connectivity.

You can save the work you do from the course VM (in the student account) to your SCS account and restore it to any other copy of the class VM (on your machines or in the labs) by running using the following commands: 

 save3000 <SCS username>
 restore3000 <SCS username>
 compare3000 <SCS username>

If you use these commands, use them consistently. That means run restore3000 when you first log in, and run save3000 just before logging out. If you don't do this, you will erase the work that you had done previously when you save.

If you forgot to restore and you want to save, try running this: 

  rsync -a -v --progress ~/ <SCS username>@access.scs.carleton.ca:COMP3000/

This is the same as the save3000 command minus the options (--delete and --force) that deletes files in the destination that don't exist in the source. As a check, you may want to add the -n option to do a dry run.

Running the VM on your own machines

If you want to run the VM appliance on your own system (running essentially any desktop operating system you want), just download the virtual appliance file and import. The SHA1 hash of this file is: 

 e5613881b28be41f49b82730282d40093388ee71  COMP 2406-3000 Fall 2014.ova

On Windows you can compute this hash for your downloaded file using the command FCIV -sha1 COMP 2406-3000 Fall 2014.ova. If the hash is different from above, your download has been corrupted.

If the application is not VirtualBox, you'll need to:

  • Have the VM platform ignore any errors in the structure of the appliance found during the import process;
  • Uninstall the VirtualBox guest additions by typing starting a terminal application and running
  sudo apt-get purge virtualbox-guest-x11 virtualbox-guest-utils
  • Install your platform's own Linux guest additions, if available.
Retrieved from "https://homeostasis.scs.carleton.ca/wiki/index.php?title=Operating_Systems_(Fall_2014)&oldid=19570"