DistOS 2014W Lecture 23 - Revision history

Dkirillov: /* Metadata management in Distributed File System - Sandarbh */

2014-04-23T22:15:25Z

Metadata management in Distributed File System - Sandarbh

Dkirillov: /* Survey on Control Plane Frameworks for Software Defined Networking - Sijo */

2014-04-23T22:07:55Z

Survey on Control Plane Frameworks for Software Defined Networking - Sijo

← Older revision		Revision as of 22:07, 23 April 2014
Line 44:		Line 44:
	- Proposes decoupling of layers into independent layers		- Proposes decoupling of layers into independent layers
	- Network entities or nodes are specialized elements which does the forwarding		- Network entities or nodes are specialized elements which does the forwarding
	- Control applications works on the logical view of the network provided by the controller ~~with out~~ having to worry about		- Control applications works on the logical view of the network provided by the controller without having to worry about
	managing state distribution, ~~toplogy~~ discovery etc.		managing state distribution, topology discovery etc.
	* Theme, Argument Outline		* Theme, Argument Outline
	- Need for using distributed systems design principles, tools in SDN controller design to achieve scalability and reliability		- Need for using distributed systems design principles, tools in SDN controller design to achieve scalability and reliability

Sjoy: /* Survey on Control Plane Frameworks for Software Defined Networking - Sijo */

2014-04-07T20:16:39Z

Survey on Control Plane Frameworks for Software Defined Networking - Sijo

← Older revision		Revision as of 20:16, 7 April 2014
Line 44:		Line 44:
	- Proposes decoupling of layers into independent layers		- Proposes decoupling of layers into independent layers
	- Network entities or nodes are specialized elements which does the forwarding		- Network entities or nodes are specialized elements which does the forwarding
	- Control applications works on the logical view of the network provided by the controller with out having to worry about managing state distribution, toplogy discovery etc.		- Control applications works on the logical view of the network provided by the controller with out having to worry about
			managing state distribution, toplogy discovery etc.
	* Theme, Argument Outline		* Theme, Argument Outline
	- Need for using distributed systems design principles, tools in SDN controller design to achieve scalability and reliability		- Need for using distributed systems design principles, tools in SDN controller design to achieve scalability and reliability

Sjoy: /* Survey on Control Plane Frameworks for Software Defined Networking - Sijo */

2014-04-07T20:16:17Z

Survey on Control Plane Frameworks for Software Defined Networking - Sijo

← Older revision		Revision as of 20:16, 7 April 2014
Line 44:		Line 44:
	- Proposes decoupling of layers into independent layers		- Proposes decoupling of layers into independent layers
	- Network entities or nodes are specialized elements which does the forwarding		- Network entities or nodes are specialized elements which does the forwarding
	- Control applications ~~do not need~~ to worry about ~~installation of the underlying network~~		- Control applications works on the logical view of the network provided by the controller with out having to worry about managing state distribution, toplogy discovery etc.
	* Theme, Argument Outline		* Theme, Argument Outline
	- Need for using distributed systems design principles, tools in SDN controller design to achieve scalability and reliability		- Need for using distributed systems design principles, tools in SDN controller design to achieve scalability and reliability

Sjoy: /* Survey on Control Plane Frameworks for Software Defined Networking - Sijo */

2014-04-07T20:14:09Z

Survey on Control Plane Frameworks for Software Defined Networking - Sijo

← Older revision		Revision as of 20:14, 7 April 2014
Line 46:		Line 46:
	- Control applications do not need to worry about installation of the underlying network		- Control applications do not need to worry about installation of the underlying network
	* Theme, Argument Outline		* Theme, Argument Outline
	- ~~Look at various control frameworks proposed~~		- Need for using distributed systems design principles, tools in SDN controller design to achieve scalability and reliability
	* Controller Platforms		* Controller Platforms
	- Centralized and Distributed approaches		- Centralized and Distributed approaches

Nelaturuk: /* Distributed Stream Processing - Ronak Chaudhari */

2014-04-03T15:18:36Z

Distributed Stream Processing - Ronak Chaudhari

← Older revision		Revision as of 15:18, 3 April 2014
Line 122:		Line 122:
	- High availability		- High availability
	- Benefits		- Benefits
			* References

Nelaturuk: /* Ronak Chaudhari */

2014-04-03T15:18:18Z

Ronak Chaudhari

← Older revision		Revision as of 15:18, 3 April 2014
Line 95:		Line 95:
	- Summarize learnings with expected trends		- Summarize learnings with expected trends

	===Ronak Chaudhari===		===Distributed Stream Processing - Ronak Chaudhari===
			* About Stream processing
			- Data streams
			- DBMS vs Stream processing
			* Applications
			- Monitoring applications
			- Militia applications
			- Financial analysis
			- Tracking applications
			* Aurora
			- Process incoming streams
			- It has its own query algebra
			- System Model - Query Model - Runtime Architecture
			- QOS criteria
			- SQuAL - Query algebra
			- Aurora GUI
			- Challenges in distribute operation
			* Aurora vs Medusa
			* Medusa
			- Architecture
			- Addition to Aurora - Lookup and Brain
			- Failure detection
			- Transfer of processing
			- System API
			- Load management
			- High availability
			- Benefits

Nelaturuk: /* Sandarbh */

2014-04-03T15:05:08Z

Sandarbh

@@ Line 58: / Line 58: @@
 * References
-===Sandarbh===
+===Metadata management in Distributed File System - Sandarbh===
 ===Ronak Chaudhari===

Nelaturuk: /* Survey on Control Plane Frameworks for Software Defined Networking - Sijo */

2014-04-03T14:50:12Z

Survey on Control Plane Frameworks for Software Defined Networking - Sijo

← Older revision		Revision as of 14:50, 3 April 2014
Line 55:		Line 55:
	* In detail about two systems:		* In detail about two systems:
	** ONIX		** ONIX
	** ONOS		** ONOS
	* References		* References

	===Sandarbh===		===Sandarbh===
	===Ronak Chaudhari===		===Ronak Chaudhari===

Nelaturuk: /* Sijo */

2014-04-03T14:47:34Z

Sijo

@@ Line 38: / Line 38: @@
 * Conclusion
-===Sijo===
+===Survey on Control Plane Frameworks for Software Defined Networking - Sijo===
 ===Sandarbh===
 ===Ronak Chaudhari===

← Older revision		Revision as of 22:15, 23 April 2014
Line 61:		Line 61:
	===Metadata management in Distributed File System - Sandarbh===		===Metadata management in Distributed File System - Sandarbh===
	* What is metadata?		* What is metadata?
	- ~~Define~~ by bare-minimum functions for MDS (Metadata Server)		- Defined by bare-minimum functions for MDS (Metadata Server)
	- Monitor the performance of DFS so that it can be used further		- Monitor the performance of DFS so that it can be used further
	- Structure of metadata in Paper		- Structure of metadata in Paper
	* Why is Metadata management difficult?		* Why is Metadata management difficult?
	- 50% file operations are metadata operations		- 50% of file operations are metadata operations
	- Size of metadata		- Size of metadata
	- Distribute the load evenly across all MDS		- Distribute the load evenly across all MDS
Line 72:		Line 72:
	- Recover data if some MDS goes down		- Recover data if some MDS goes down
	- Be POSIX compliant		- Be POSIX compliant
	- Be able to scale- addition of new MDS ~~shoudn~~'t cause ripples		- Be able to scale- addition of new MDS shouldn't cause ripples
	- Contrasting goals - replication and consistency - Average case improvements vs guaranteed performance for each access		- Contrasting goals - replication and consistency - Average case improvements vs guaranteed performance for each access
	* Static sub-tree partitioning		* Static sub-tree partitioning
Line 78:		Line 78:
	- Disadvantage - Directory hot spot formation		- Disadvantage - Directory hot spot formation
	* Static hashing based partitioning		* Static hashing based partitioning
	- Hash the filename or File identifier and assign to MDS		- Hash the filename or File identifier and assign it to MDS
	- Advantage - Distributes load evenly - Gets rid of hotpsot info		- Advantage - Distributes load evenly - Gets rid of hotpsot info
	- Disadvantage		- Disadvantage
	* Don't ask me where your server is approach		* "Don't ask me where your server is" approach
	- Ex : Ceph , GlusterFS, OceanStore, Hierarchical Bloom filters, Cassandra		- Ex : Ceph , GlusterFS, OceanStore, Hierarchical Bloom filters, Cassandra
	- Responsibilities - Replica ~~mgmt~~, Consistency, Access control, Recover metadata in case of crash, Talk to each ~~other~~ to handle the load dynamically		- Responsibilities - Replica management, Consistency, Access control, Recover metadata in case of crash, Talk to each others to handle the load dynamically
	* What's not in the slides		* What's not in the slides
	- Not focused on replication of metadata		- Not focused on replication of metadata
Line 92:		Line 92:
	- Metadata approach of the file systems designed for specific goals 0 GFS, Haystack etcs		- Metadata approach of the file systems designed for specific goals 0 GFS, Haystack etcs
	- Evolution history		- Evolution history
	- Comparison ~~with in ctageory~~		- Comparison within category
	- Cover reliability and consistency part		- Cover reliability and consistency part
	- Summarize learnings with expected trends		- Summarize learnings with expected trends