iSQI CTFL-PT Quiz 1 Topic 3 Questions 1-5

Question: 1

You have been asked to test the performance of a software and system update to a North American mobile trivia quiz game application The quiz app is available on major app stores serving English-speaking users. The number of concurrent users planned for is 5 million Winning quiz participants are promised a share of an allocated cash prize Once participants start playing, their quiz sessions must not be lost especially if all previous questions were answered correctly. The application owner wants to ensure that 99% of quiz sessions are maintained (up to 4.95 million sessions) until the last answer has been successfully recorded.

You performed 100 test runs that provided 5 million virtual concurrent users. You have measurements of participant concurrency at the last question for each test run In your analysis, you order all the concurrency test results by measured concurrency value from best to worst. You determine 85%. 90%. 95% and 100% values by selecting the 85th. 90th. 95th and 100th (last and worst) measured values by counting list positions starting from the best value going towards the worst until you reach the desired list position (ex. 85). Keep in mind, the results in lower list positions are as good or better than the results chosen for reporting.

After analyzing the results of the performance tests, you present the following results

85% 4.92 million valid concurrent users

90% 4.90 million valid concurrent users

95%: 4.0 million valid concurrent users

100%. 3.8 million valid concurrent users

Based on these results, what should you report to the stakeholders?

AThe performance tests clearly have failed to produce a realistic and compatible load. The results should confirm the test oracle in that the 99% of five million participants concurrency objective has been achieved. If the performance test plan had worked correctly, the reported values should have been 85% 4.95, 90% 4.95, 95% 4 95 and 100% 4.95 million valid concurrent users.

BThese results clearly show that the system update successfully supports 99% of five million participants

CFour samples from the first fifteen ordered test results are presented. The system update performed much worse than what is presented here. The system update has failed to meet the 99% of five million participants concurrency objective.

DIf we pick 85 out of 100 test runs as the minimum level of reliability, the system update does not reliability meet the 99% of five million participants concurrency target, However not all results are as bad as these

Show Answer

Question: 2

Which of the following Is a valid reason for aggregating performance test results?

ABusiness stakeholders work with detailed technical status indicators when evaluating an application's performance

BBusiness stakeholders can evaluate an application's overall performance status.

CTechnical stakeholders work with aggregated data when isolating causes of performance problems

DTechnical stakeholders work with detailed technical status indicators when evaluating an application's performance

Show Answer

Question: 3

What is normally performed within the principal performance testing activity called Test Planning and Control?

i. Determine scope of performance testing

ii. Organize test cases into performance test procedures

iii. Create the test environment

iv. Identify risks to the performance tests

v. Determine load levels, timing parameters, and transactions to be tested

Aiii true i, ii, iv, v false

Bi. iv true ii, iii, v false

Ci, ii, v true iii, iv false

Diii, iv, v true i, ii false

Show Answer

Question: 4

You have been asked to test the performance of a software and system update to a North American mobile trivia quiz game application. The quiz app is available on major app stores serving English-speaking users. The number of concurrent users planned for is 5 million. Winning quiz participants are promised a share of an allocated cash prize Once participants start playing, their quiz sessions must not be lost especially if all previous questions were answered correctly. The application owner wants to ensure that 99% of quiz sessions are maintained (up to 4.95 million sessions) until the last answer has been successfully recorded

Before your team begins testing, the team needs to present the performance test plan to technical stakeholders

Which of the following sets of plan attributes would you recommend be included in this presentation?

i. Sales has indicated that quiz events for Sponsor A offering $65,000. Sponsor B offering $45,500. Sponsor C offering $25,000

will be taking place during the first week of performance testing.

ii. Simultaneous session tests are focused on the backend. and are not end-to-end. Variability in user behavior, mobile devices and mobile communications introduces session drop opportunities outside application control. Using load generators located

in 5 high availability data centers in North America will ensure session drops are most likely caused by application issues, thus allowing us to isolate the root cause of any concurrency issues that arise

iii. Test scripts based on replaying recorded communication will take 30 hours each to write and test due to the extensive parameterization required to

respond to quiz questions Development has agreed to share client code that can be scripted to authenticate and respond to quiz questions

automatically. The fully programmed script will likely take 18 hours each to write

and test Fully programmed scripts will utilize the identical communications stack of the actual client avoiding missed communication nuances.

iv The U S Federal Trade Commission has recently sued SmartyBogusFauxApp and OutSmartMe example com over promises of prizes and unreliability

v The upgrade being tested was paid for by the latest round of venture funding Supporting 5 million users is requirement that was a condition of their funding.

Ai. ii include iii. iv, v exclude

Bii, iii include i, iv, v exclude

Cii, v include i, ii, iv exclude

Diii. iv, v include i, ii exclude

Show Answer

Question: 5

You have been asked to test the performance of a software and system update to a North American mobile trivia quiz game application. The quiz app is available on major app stores serving English-speaking users. The number of concurrent users planned for is 5 million Winning quiz participants are promised a share of an allocated cash prize Once participants start playing, their quiz sessions must not be lost especially if all previous questions were answered correctly. The application owner wants to ensure that 99% of quiz sessions are maintained (up to 4.95 million sessions) until the last answer has been successfully recorded.

An essential operational profile you identified is the quiz participant Your operational profile discovery efforts have yielded a number of profile attributes A quiz participant will answer twelve questions if they manage to answer the first eleven correctly Every user is made aware of a new question nearly simultaneously. The quiz user has limited time to respond using a mobile application. They are unable to respond to subsequent questions after they incorrectly answer a question. However, the quiz participant continues to see new questions even though they may have responded incorrectly to a previous question. If they manage to answer all twelve questions correctly, the quiz application notifies them that they have tentatively won (subject to formal verification) an equal share of a cash prize of an amount set for the particular quiz event In addition to this individualized interaction, a broadcast video stream is presented in the quiz app providing entertaining commentary, quiz event coordination event status and answer explanations.

Given this information, what is missing to construct the operational profile for the quiz participant?

AThe network bandwidth requirements of the video stream intermissions between questions is unknown. The network bandwidth requirements of the video stream intermissions between questions is unknown

BNo survey results from past quiz winners that explore how they won No survey results from past quiz winners that explore how they won.

CThe quiz response time limit is not specified. The quiz response time limit is not specified

DThe design maximum number of users within quiz participant user class is unknown. The design maximum number of users within quiz participant user class is unknown

Show Answer

iSQI CTFL-PT Quiz:1 Topic:3 Questions:1-5