Monday, July 16, 2012

Jmeter:Understanding Summary Report

The summary report shows values about the measurement Jmeter has done while calling the same page as if many users are calling the page. It gives the result in tabular format which you can save as .csv file.
These are some main headings in the summary result listener. Lets understand them in detail: Label, Samples, Average, Max, Min, Std.Dev, Error%, Throughput, KB/Sec, Avg.Bytes.
  
Label: In the label section you will able to see all the recorded http request, during test run or after test run.

Samples: Samples denote to the number of http request ran for given thread. Like we have one http request and we run it with 5 users, than the number of samples will be 5x1=5.
Same if the sample ran two times for the single user, than the number of samples for 5 users will be 5x2=10.

Average:  Average is the average response time for that particular http request. This response time is in millisecond. Like in the image you can see for first label, in which the number of sample is 4 because that sample run 2 time for single user and i ran the test with 2 user. So for 4 samples the average response time is 401 ms.

Min: Min denotes to the minimum response time taken by the http request. Like for the above image the minimum response time for first four samples is 266 ms. It means one http request responded in 266 ms out of four samples.

Max: Max denotes to the maximum response time taken by the http request. Like for the above image the maximum response time for first four samples is 552 ms. It means one http request responded in 552 ms out of four samples.

Std.Deviation: This shows how many exceptional cases were found which were deviating from the average value of the receiving time.   The lesser this value more consistent the time pattern is assumed.

Error %: This denotes the error percentage in samples during run. This error can be of 404(file not found), or may be exception or any kind of error during test run will be shown in Error %. In the above image the error % is zero, because all the requests ran successfully.

ThroughputThe throughput is the number of requests per unit of time (seconds, minutes, hours) that are sent to your server during the test.

These are the main term for Summary report. Hope it will help you.


37 comments:

  1. Thank you for good tutorial. Recently I've found another JMeter Library, have you seen it?

    http://blazemeter.com/blog
    http://community.blazemeter.com/knowledgebase

    ReplyDelete
    Replies
    1. Dzmitry, are you not from Blazemeter itself..nevertheless, I find the resource on the website really helpful

      Delete
  2. Hi, Thanks for the blog!
    I have few questions on the results captured in Aggregate report
    What does the values in the 'Total' row shows?how it is projected?
    Particularly as we concentrate more on the aggregate_report_rate(QPS) field,
    Is the value of the aggregate_report_rate in the 'Total' row, calculate the exact QPS?
    Is that value is what all we need to say as the exact QPS?

    ReplyDelete
  3. Thanks. 'Total' row shows u the total number of samples ran in jmeter, and rest are average. Like for one sample the response tiem is 45ms and for second is 47ms, then the total will show you 46ms. So whenever you analyze the response try to analyze it with individual samples, and by prioritization of which sample is much important.

    ReplyDelete
  4. Very nice and simple explanation,saved my time

    ReplyDelete
  5. I have a summary report generated though which I would like to know the exact time that the server has taken to find a particular search. While recording in JMeter, it adds up with lots of sub-elements to the search element. So do we have to consider the Maximum time out of this entire group of elements to convey the exact time taken to search ?

    Any help on this would be greatly appreciated, thanks in advance

    ReplyDelete
    Replies
    1. Hi, each page has multiple requests like, image, css, js query. If you want to gather the response of all the requests then do not exclue thises, else to find the page load time just exclude the images, css, js or disable them, and then see the summary report. You will get the response what you are looking for.

      Delete
  6. where the summary result get stored on disk while jmeter is jmeter is running.

    ReplyDelete
    Replies
    1. In Jmeter bin, or in specified path from jmeter GUI.

      Delete
  7. Thanks Digvijay Bisht!
    I hope you don't mind mentioning your blog reference in mince one. I already did that in http://thitenitin.wordpress.com Thanks for your useful post!

    ReplyDelete
  8. Thanks so much..Can u give me many tutorial to know Jmeter?..I have just learn it in near here..:)..have fun to all

    ReplyDelete
  9. can you please tell me the maximum limit of users for that we can test through JMeter.

    ReplyDelete
  10. Can any one tell me is the response time in Jmeter is page load time.

    Pleae let me know if it is different.

    ReplyDelete
    Replies
    1. Hi! Page load time is same as response time which means the time for when the first request is sent and the the first response of the request is received.

      In a page these are so many requests (Like, image, css, js etc..) to which you can ignore. So just exclude those requests and run the test for important request.

      Delete
    2. Hi Digvijay,

      Please help me out

      What does "90% line = 75 signify. i am getting the final the total report as below:

      Samples, Avg time in Mili Sec, Median, 90% Line, Min, Max, Error %, Throughput, Kb/sec
      TOTAL 133 43 13 75 9 883 0 22.51184834 126.5288129

      Please help me out, I did the performance test for 1 user.

      Delete
  11. What does "90% line = 75 signify. i am getting the final the total report as below:

    Samples, Avg time in Mili Sec, Median, 90% Line, Min, Max, Error %, Throughput, Kb/sec
    TOTAL 133 43 13 75 9 883 0 22.51184834 126.5288129

    Please help me out, I did the performance test for 1 user.


    ReplyDelete
  12. The 90% line tells you that 90% of the samples fell at or below that number.

    The 90th percentile response time value is the value for which 90% of the data points are small and 10% are big.

    Calculating 90th%:
    1.Sort transaction instances by their value.
    2.Remove the top 10% instances.
    3.The highest value left is the 90th percentile.
    Consider the below example:
    5 sec, 7 sec, 9 sec, 11 sec, 13 sec, 15, sec, 17 sec, 19, sec, 21 sec, 23 sec.

    Now remove the 10% above the 90% line. Which means remove 23 sec. So the highest value under 90% line is 23 sec.

    ReplyDelete
  13. haii Digvijay Bisht im new in jmeter, can you help me, how to calculation std.dev and average in smmary result??
    thannks

    ReplyDelete
  14. Hi guys,

    I'm executing LnP tests with jmeter and have been encountered with a very strange issue.
    The issue is weird since i see few peaks that happens twice or three times during the execution.
    The gap between minimum and maximum is very big 25ms – 42000ms .

    ReplyDelete
  15. Can you please help to understand why that happens ? And whether you are familiar where jmeter reads the transaction time from ?

    ReplyDelete
  16. hi i am kumaran,
    how to get cpu and memory usage details of server in jmeter

    ReplyDelete
  17. hi i have one doubt,
    Two tester generate summary report for same web application in different computer.they are get same report values or different values?if differ means plz Explain?

    ReplyDelete
  18. How to decide that application performance is acceptable or not from the summary report in jmeter?

    ReplyDelete
  19. please let me clear what is standard deviation in summary report??

    ReplyDelete
  20. This comment has been removed by the author.

    ReplyDelete
  21. This comment has been removed by the author.

    ReplyDelete
  22. I have written some of the Jmeter Tutorials, please look into it and let me know if there are any mistakes. Thanks for this tutorial
    My Website:
    http://www.jmeter.info/

    ReplyDelete
  23. Hi..
    I am new into Jmeter. Can anyone tell me what is the exact result and how we test the our application.And what will be the result of load,performance or stress testing. Please help me out. I am working with one travel domain i have to test performance and load of the application. I need your help.

    ReplyDelete
  24. I want to know what is the time taken to load the page for 2 users. TOTAL 14 641 196 1622 540.4925616358411 0.0 2.8231498285944747 1.2656517821133293 459.07142857142856

    ReplyDelete
  25. THE IMAGE UPLOADED IS NOT DISPLAYED. IT WILL BE MORE HELPFUL IF IMG IS THERE.

    ReplyDelete
  26. Harrah's Cherokee Casino Resort Launches First-ever
    The 광명 출장마사지 Cherokee 김해 출장샵 Casino 목포 출장안마 Resort has launched 제주도 출장마사지 the first-ever first-ever casino-reservation-themed event to hit 오산 출장샵 the gaming floor. The $1.5-million

    ReplyDelete
  27. Best casinos in the world to play blackjack, slots and video
    hari-hari-hari-hotel-casino-online-casinos-in-us · blackjack (blackjack) · 바카라 roulette 1xbet 먹튀 (no Blackjack 출장안마 Video Poker · Video https://jancasino.com/review/merit-casino/ Poker · Video Poker · gri-go.com Video poker

    ReplyDelete