CSE 503S Performance Evaluation Study

Students enrolled in CSE 530S will complete a performance analysis study as part of their final project. The goal of this analysis is to measure the performance of your web application. An additional goal is to increase the performance of your web application after we have completed a baseline measurement.

Reading

The following article will contain information that will help you with this assignment.

• Performance Evaluation in Linux and AWS

Project

You may work alone or with a partner on this assignment.

Requirements

• Choose at least two types of experiments to perform on your web server. The types of experiments you should run are largely dependent on type web application you are developing. Ask the instructor if you are unclear on what types of experiments you should perform. Below is a small list of potential experiments to perform.
  • Apache web server performance evaluation on different AWS instance types [1] [2] [3][4]
  • MySQL Performance evaluation on different AWS instance types[5]
  • Apache and Nginx comparison on the same AWS instance type[6]
  • MongoDB performance on different instance types [7]
  • Node and Apache+PHP comparison on the same AWS instance type [8]
  • Apache Web Server performance with and without optimizations and tuning[9][10][11]
  • PHP performance with and without caching[12]
  • Elastic Load Balancing (ELB) evaluation using several smaller instances vs a single larger instance[13][14]

• • Benchmark your current ec2 instance's web server's performance using the tool ab from a separate ec2 instance (m4.large)

• Graph to performance of your web server, specifically the requests per second and time per request

• Select two additional metrics that are important for your web application and measure them as well to establish a base line performance (see list of examples)

• Determine three improvements you will make on your web server to improve these key metrics. (one of them may be to use a faster instance)

• Benchmark the performance of the improved system

• Graph the performance of the improved

• Create a report that contains a description of your app, the metrics you are interested in, the baseline and improved performance.

• Provide a discussion of the proposed improvements and the benefits it offered. (is an instance that costs 10x worth it?)

Grading

This assignment is worth 60 points in total.

________

1. Baseline performance (20 Points):
   • ab benchmark executed results of website
   • measurements of two other initial metrics
   • graph of initial performance
2. Upgraded performance (20 Points):
   • Benchmark each improvement individually
   • Graph the results
3. Performance Analysis Report (20 Points)