WebFund 2016W: Assignment 4 - Revision history

Soma at 00:35, 16 March 2016

2016-03-16T00:35:12Z

← Older revision		Revision as of 00:35, 16 March 2016
Line 57:		Line 57:

	Good luck!		Good luck!

			===Solutions===

			[http://homeostasis.scs.carleton.ca/~soma/webfund-2016w/code/queryLogs.js Download]

			<source lang="javascript" line>
			// queryLogs.js
			// solutions to Assignment 4
			// Carleton University COMP 2406, 2016W

			var fs = require('fs');
			var mc = require('mongodb').MongoClient;
			var db, logs;

			var matches;
			var argRE = /--(\w+)=(.+)/;

			var options = {
			results: '',
			maxcount: '0',
			service: '',
			message: ''
			}

			for (i=2; i<process.argv.length; i++) {
			matches = process.argv[i].match(argRE);

			if (matches) {
			options[matches[1]] = matches[2];
			}
			}

			var reportResults = function(err, results) {
			var lines = [];

			if (err) {
			throw err;
			}

			results.forEach(function(entry) {
			var s = [entry.date, entry.time, entry.host, entry.service + ":",
			entry.message];
			lines.push(s.join(' '));
			});

			if (options.results ==='') {
			console.log(lines.join('\n'));
			} else {
			fs.writeFileSync(options.results, lines.join('\n'), 'utf-8');
			}
			db.close();
			}

			var connectCallback = function(err, returnedDB) {
			if (err) {
			throw err;
			}

			db = returnedDB;
			logs = db.collection('logs');
			logs.find({service: {$regex: options.service},
			message: {$regex: options.message}}
			).limit(parseInt(options.maxcount)).toArray(reportResults);
			}

			mc.connect('mongodb://localhost/log-demo', connectCallback);
			</source>

Soma: /* Syntax */

2016-03-02T16:13:51Z

Syntax

← Older revision		Revision as of 16:13, 2 March 2016
Line 18:		Line 18:
	node queryLogs.js --results=out.txt --maxcount=10 --service="systemd" --message="[Ss]tarted"		node queryLogs.js --results=out.txt --maxcount=10 --service="systemd" --message="[Ss]tarted"

	The above would return at most 10 matching log messages and output them to out.txt. The log lines should be outputted as lines, not as objects (i.~~e., they~~ should appear as they were before being stored in the database). The service and message queries should both be regular expressions and should be combined with a logical and if both are present.		The above would return at most 10 matching log messages and output them to out.txt. Key points:
			* The log lines should be outputted as lines, not as objects.
	~~Note that all~~ arguments are optional. If neither --service or --message are specified, all stored log messages should be returned (up to --maxcount, if specified). If no --maxcount is specified, all matching records should be output. If no --results is specified, the output should go to standard out. Thus, node queryLogs.js can be called with no arguments and should just dump all of the log messages (albeit potentially in an arbitrary order).		* The output lines should appear as they were before being stored in the database. (Please do not include the file or ID fields.)
			* Be sure not to forget the colon after the service! However, it is okay if multiple spaces are converted to one space in your output. The ordering of the outputted lines is likely to be different, especially as the lines may come from multiple log files that were stored.
			* The service and message queries should both be regular expressions and should be combined with a logical and if both are present.
			* All arguments are optional. If neither --service or --message are specified, all stored log messages should be returned (up to --maxcount, if specified). If no --maxcount is specified, all matching records should be output. If no --results is specified, the output should go to standard out. Thus, node queryLogs.js can be called with no arguments and should just dump all of the log messages (albeit potentially in an arbitrary order).

	In order to query anything you'll need a working version of storeLogs.js from [[WebFund 2016W: Tutorial 5\|Tutorial 5]]. be sure to store the logs in the logs collection in the log-demo database, just as storeLogLine.js does.		In order to query anything you'll need a working version of storeLogs.js from [[WebFund 2016W: Tutorial 5\|Tutorial 5]]. be sure to store the logs in the logs collection in the log-demo database, just as storeLogLine.js does.

Soma: /* Hints */

2016-03-02T05:27:47Z

Hints

← Older revision		Revision as of 05:27, 2 March 2016
Line 50:		Line 50:

	* The mongodb syntax is different in the version 1 and version 2 of the node driver. I suggest using the version 2 interface as it is cleaner.		* The mongodb syntax is different in the version 1 and version 2 of the node driver. I suggest using the version 2 interface as it is cleaner.

			* The regular expression /--(\w+)=(.+)/ plus the string match method is very helpful for parsing command line arguments.

	Good luck!		Good luck!

Soma at 05:26, 2 March 2016

2016-03-02T05:26:05Z

← Older revision		Revision as of 05:26, 2 March 2016
Line 35:		Line 35:

	Note that if your code exits with an error you may get 0 points. Make sure you test your code with log files other than the one supplied (look at /var/log/syslog for more entries!).		Note that if your code exits with an error you may get 0 points. Make sure you test your code with log files other than the one supplied (look at /var/log/syslog for more entries!).

			===Hints===

			* You'll be using the find() as we did in class with mongodb (see examforms-mongodb that we did in Lecture 12). For the query object, the properties are the fields you want to query and the value is an object that describes the query. MongoDB supports many operators; here you'll want the $regex operator. So for example, to search for any names that start with "Bel", and are in a city with a name ending in "ville" you'd do something like this:

			var customersCollection = db.collection("customers");
			var cursor = customersCollection.find({name: {$regex: "^Bel"}, city: {$regex: "ville$"}});

			* You can change how the cursor object acts using many operators. One is the limit method. So if you wanted any find operation on this cursor to only return 5 results, run:

			cursor.limit(5);

			* To actually get all the results at once, run the toArray method for cursor objects. See examforms-mongodb for an example.

			* The mongodb syntax is different in the version 1 and version 2 of the node driver. I suggest using the version 2 interface as it is cleaner.

			Good luck!

Soma at 17:12, 29 February 2016

2016-02-29T17:12:18Z

← Older revision		Revision as of 17:12, 29 February 2016
Line 5:		Line 5:
	In total, there are 10 points. '''The questions below will be automatically graded, so please follow the directions carefully.'''		In total, there are 10 points. '''The questions below will be automatically graded, so please follow the directions carefully.'''

	This assignment is due March 2, 2016.		This assignment is due March 3, 2016.

	===Syntax===		===Syntax===

Soma at 16:57, 29 February 2016

2016-02-29T16:57:40Z

← Older revision		Revision as of 16:57, 29 February 2016
Line 1:		Line 1:
	In this assignment you will create <tt>queryLogs.js</tt>, a program that will query the logs collection in the log-demo database for matching log entries. Please submit your answers as a single JavaScript source file called "<username>-queryLogs.js" (where username is your MyCarletonOne username). Please do not submit a zip file (i.e., no need for a node_modules directory). Note that this means your code should not use any modules beyond standard node modules and mongodb.		In this assignment you will create <tt>queryLogs.js</tt>, a program that will query the logs collection in the log-demo database for matching log entries. Please submit your answers as a single JavaScript source file called "<username>-queryLogs.js" (where username is your MyCarletonOne username). Please do not submit a zip file (i.e., no need for a node_modules directory). Note that this means your code should not use any modules beyond standard node modules and mongodb.

			Please list any collaborators and resources you used as comments in your source file.

	In total, there are 10 points. '''The questions below will be automatically graded, so please follow the directions carefully.'''		In total, there are 10 points. '''The questions below will be automatically graded, so please follow the directions carefully.'''

Soma at 16:53, 29 February 2016

2016-02-29T16:53:47Z

← Older revision		Revision as of 16:53, 29 February 2016
Line 19:		Line 19:

	Note that all arguments are optional. If neither --service or --message are specified, all stored log messages should be returned (up to --maxcount, if specified). If no --maxcount is specified, all matching records should be output. If no --results is specified, the output should go to standard out. Thus, node queryLogs.js can be called with no arguments and should just dump all of the log messages (albeit potentially in an arbitrary order).		Note that all arguments are optional. If neither --service or --message are specified, all stored log messages should be returned (up to --maxcount, if specified). If no --maxcount is specified, all matching records should be output. If no --results is specified, the output should go to standard out. Thus, node queryLogs.js can be called with no arguments and should just dump all of the log messages (albeit potentially in an arbitrary order).

			In order to query anything you'll need a working version of storeLogs.js from [[WebFund 2016W: Tutorial 5\|Tutorial 5]]. be sure to store the logs in the logs collection in the log-demo database, just as storeLogLine.js does.

	===Scoring===		===Scoring===
Line 31:		Line 33:

	Note that if your code exits with an error you may get 0 points. Make sure you test your code with log files other than the one supplied (look at /var/log/syslog for more entries!).		Note that if your code exits with an error you may get 0 points. Make sure you test your code with log files other than the one supplied (look at /var/log/syslog for more entries!).

	In order to query anything you'll need a working version of storeLogs.js from [[WebFund 2016W: Tutorial 5\|Tutorial 5]]. be sure to store the logs in the logs collection in the log-demo database, just as storeLogLine.js does.

Soma at 16:53, 29 February 2016

2016-02-29T16:53:13Z

← Older revision		Revision as of 16:53, 29 February 2016
Line 29:		Line 29:
	* 2 for functionality with missing arguments		* 2 for functionality with missing arguments
	Total: 10 points		Total: 10 points

			Note that if your code exits with an error you may get 0 points. Make sure you test your code with log files other than the one supplied (look at /var/log/syslog for more entries!).

			In order to query anything you'll need a working version of storeLogs.js from [[WebFund 2016W: Tutorial 5\|Tutorial 5]]. be sure to store the logs in the logs collection in the log-demo database, just as storeLogLine.js does.

Soma at 16:47, 29 February 2016

2016-02-29T16:47:10Z

← Older revision		Revision as of 16:47, 29 February 2016
Line 1:		Line 1:
	In this assignment you will create <tt>queryLogs.js</tt>, a program that will query the logs collection in the log-demo database for matching log entries. Please submit your answers as a single JavaScript source file called "<username>-queryLogs.js" (where username is your MyCarletonOne username). Please do not submit a zip file (i.e., no need for a node_modules directory).		In this assignment you will create <tt>queryLogs.js</tt>, a program that will query the logs collection in the log-demo database for matching log entries. Please submit your answers as a single JavaScript source file called "<username>-queryLogs.js" (where username is your MyCarletonOne username). Please do not submit a zip file (i.e., no need for a node_modules directory). Note that this means your code should not use any modules beyond standard node modules and mongodb.

	In total, there are 10 points. '''The questions below will be automatically graded, so please follow the directions carefully.'''		In total, there are 10 points. '''The questions below will be automatically graded, so please follow the directions carefully.'''

Soma at 16:45, 29 February 2016

2016-02-29T16:45:24Z

← Older revision		Revision as of 16:45, 29 February 2016
Line 1:		Line 1:
	~~'''This assignment is not yet finalized.'''~~

	In this assignment you will create <tt>queryLogs.js</tt>, a program that will query the logs collection in the log-demo database for matching log entries. Please submit your answers as a single JavaScript source file called "<username>-queryLogs.js" (where username is your MyCarletonOne username). Please do not submit a zip file (i.e., no need for a node_modules directory).		In this assignment you will create <tt>queryLogs.js</tt>, a program that will query the logs collection in the log-demo database for matching log entries. Please submit your answers as a single JavaScript source file called "<username>-queryLogs.js" (where username is your MyCarletonOne username). Please do not submit a zip file (i.e., no need for a node_modules directory).