Project

General

Profile

Actions
Copy link

Idea #4754

closed

[Tests] Establish performance test benchmarks.

Added by Radhika Chippada over 9 years ago. Updated over 9 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Radhika Chippada
Category:
-
Target version:
2015-01-07 sprint
Start date:
12/09/2014
Due date:
Story points:
0.5

Description

Add a performance test task to jenkins testing.

Establish performance testing benchmarks for home page and search.

Subtasks 6 (0 open — 6 closed)

Task #4822: Review 4754-performance-TCResolvedTim Pierce12/09/2014Actions
Task #4757: Do what is needed to run the browsing_test.rb (and also add search_test)ResolvedRadhika Chippada12/09/2014Actions
Task #4758: Add a jenkins task to run workbench performance testsResolvedRadhika Chippada12/09/2014Actions
Task #4765: Add "performance" configuration similar to that of "diagnostics" so that performance benchmarking can be run against other environments such as production.ResolvedRadhika Chippada12/10/2014Actions
Task #4796: Configure a jenkins task to run workbench performance test against production workbenchResolvedWard Vandewege12/11/2014Actions
Task #4797: Review branches: 4754-performance-benchmarks (arvados) and 4754-add-workbench-performance-test (arvados-dev)ResolvedTom Clegg12/11/2014Actions
Actions
Copy link
 #1

Updated by Radhika Chippada over 9 years ago

  • Tracker changed from Bug to Idea
  • Description updated (diff)
  • Status changed from New to In Progress
  • Assigned To set to Radhika Chippada
  • Target version set to 2014-12-10 sprint
Actions
Copy link
 #2

Updated by Radhika Chippada over 9 years ago

  • Use the following command to run the performance test
RAILS_ENV=test bundle exec rake test:benchmark
  • The following is the benchmark report after running the tests
BrowsingTest#test_homepage (9.95 sec warmup)
           wall_time: 2.01 sec
SearchTest#test_search (3.65 sec warmup)
           wall_time: 3.64 sec
Actions
Copy link
 #3

Updated by Ward Vandewege over 9 years ago

  • Story points set to 0.5
Actions
Copy link
 #4

Updated by Ward Vandewege over 9 years ago

  • Target version changed from 2014-12-10 sprint to 2015-01-07 sprint
Actions
Copy link
 #5

Updated by Radhika Chippada over 9 years ago

There are two modes in which performance benchmark testing can be done: one to run in test mode and one to run against a running workbench instance (such as production).

  1. Similar to other integration tests using the following command. This will run tests located in the arvados/apps/workbench/test/performance directory in RAILS_ENV=test mode. A jenkins task is also added for this.
    RAILS_ENV=test bundle exec rake test:benchmark
  2. Against a configured workbench url using "RAILS_ENV=performance". Edit the performance block in application.default.yml to configure the workbench url and user token to be used.
    RAILS_ENV=performance bundle exec rake TEST=test/performance/*.rb
  • After test is completed, the benchmark data will be stored in tmp/performance directory.
Actions
Copy link
 #6

Updated by Radhika Chippada over 9 years ago

Merged code into master after getting Ward's green signal on the arvados-dev update.

Actions
Copy link
 #7

Updated by Tim Pierce over 9 years ago

4754-performance-TC LGTM at 0b2005c4d

Actions
Copy link
 #8

Updated by Anonymous over 9 years ago

  • Status changed from In Progress to Resolved
  • % Done changed from 83 to 100

Applied in changeset arvados|commit:896d01ea7b3fed8b621ff930893d3ec806931dc9.

Actions
Copy link

Also available in: Atom PDF