Showing posts with label software testing. Show all posts
Showing posts with label software testing. Show all posts

Thursday, April 19, 2012

Questions worth finding answers for, before you start to test.

I have drafted below the list of questions that are worth to ask before you start your testing tasks.
Answers to few questions can be got from the stakeholders & few by yourself. These are not focused on security or performance or any form of testing, they are generic to any project.

I hope to get few more from you once you skim through them.

Phase-1:
  • What is the objective of the project?
  • What is the scope of the project?
  • What are the risks involved in the project?
  • What is the objective & scope of testing this project?
  • Who are the real users of the product that is under test?
  • Which quality criteria must be the testing activity focused on?
  • Will I get a demo or overview of the project?
Phase-2:
  • Will I get access to the code?
  • Is there any kind of documentation available, if not who are the stakeholders of the project?
  • Will I get the contact details of them?
  • What is the configuration of test environment?
  • What is the configuration of production environment?
  • Which features are more riskier than others?
  • How often can I get the builds?
  • Have I spoken to the audience of my test reports for what is expected?
  • What is the expected frequency of status reports by the stakeholders?
  • What are the deliverables expected from me?

Friday, April 13, 2012

As a tester learn to learn before you learn to teach.

This blog post is about how you could learn about a product or rather a project before you are confident of making a fresh mind understand the aspects of what you will be working or have worked upon.

Once you are into any project, its either your project lead/ team lead does the honor of making you understand what the product/project is about. Yes, I understand the frustration few would have gone through while getting trained in a class room based training for days together & sometimes months together. It would be quick run of a slideshow or a senior most person blabbering about only achievements that they have made in the project. And hence trying to put on the onus on the young minds as if a war is about be fought with situation being - "Crititcal critical critical....." until the project halts. I myself have undergone such situations in organisations that I had worked earlier, that those words (critical...) being used atleast thrice daily throughout the year.
  • Below is the extract of what I & Yagnesh have prepared after being inspired by Dhanasekar on using the mindmap tool.
  • The view of this can ascertain the level of understanding one has before starting the project.
  • This mindmap covers most of the aspects that one has to learn about the project before anyone steps into it.
  • This can be used even as a training material for any fresh mind coming into the project. 
  • This shall also tell us about the aspects that are missed which can be covered to test the product better.
  • This could well be expanded into more minute details based on contexts.





Wednesday, March 14, 2012

Test ideas for Video Player V1.0


How do you plan to test any given feature/ page element? Do you sit alone & start testing OR do you start writing the the test cases based on the requirements OR do you copy paste the plan done by your erstwhile colleagues?

Well, this is how we did: Me, Santhosh Tuppad & Yagnesh H Shah decided to list the ideas that we would get to test any online video player in general. We then based on the context modified few for the specific player that we were testing. Later we did what we do best (strictly not kidding :D), TEST! Below is the gist of ideas that we came up with during our brainstorming session.

Functionality 

  1. Video should starts automatically without clicking on “Play” button initially
  2. Video should pause when click on “Pause” button
  3. “Resume” option must be shown in the video canvas when the mouse over event occurs
  4. Check if the video is continues to play when clicked on “Resume” option from the video canvas
  5. Pause the video and go to full screen, check if video is paused or not
  6. Pause a video for a while (Let us say 30 minutes) and later resume the video
  7. Total video length should be shown on the right hand side of the end-user at the end of progress bar
  8. Time elapsed in watching the video should be shown on the left hand side of the end-user beside the progress bar
  9. Time should be shown in MM:SS – Are you planning to have even the videos which last for hours? If yes, then would it be in HH:MM:SS or still MM:SS (Example: 90:30 which is 1 hour 30 minutes 30 seconds)
  10. Elapsed time of the video must be same as the total time of video length

Usability and Accessibility 
  1. Tooltips should exist for Play / Pause / Resume & other video controls
  2. Check if any keyboard shortcuts exist for the video controls
Ads (If an Ad is being shown before the actual video)
  1. Before starting the video the sponsor ad should be shown with Mute set to off.
  2. Check if clicking on “Mute” mutes the audio.
  3. Provide option to skip the Ad.
  4. Does skip Ad option really skip the Ad when clicked.
  5. Does the user has the option to look at the Ad again.
  6. No video controls must be given during Ad is played (This could change based on the business context).
  7. A countdown is present at the top which displays the time that the advertisement video will be completing
  8. Once the Ad is completed, the video should start automatically
  9. In any way end-user should not be able to bypass the Ad  nor the system should not bypass sponsor message due to some malfunctioning
  10. Can the Ads repeat when played different videos? In our opinion yes they can
  11. Zoom In / Zoom Out, Pause, Play, Resume controls should not be provided in the right-click controls
  12. Right-click on the Ad video and go to full screen
Volume Controls 
  1. When end-user chooses “Menu” option, the volume controls should be not disabled
  2. Using mouse end-user should be able to use the slider to increase / decrease volume
Video Streaming / Buffering 
  1. Check if the buffering is being done while the video is paused
  2. While buffering, loading component in clockwise direction should be shown between elapsed time component and progress bar
  3. Let us say the video has played till 01:30 and end-user drags it to 00:30 – Check if the video is again buffering or it is playing from the cache because it has been already buffered
  4. What message is shown when internet connectivity breaks down during the middle of the video viewing
  5. While watching the video disconnect the internet and again connect to the internet. Does the video again start playing the video from where it stopped?
Resolution and cross browser compatibility 
  1. Change the resolution of browser to various sizes (Example: 100% which is default, less than 100%) and then see if anything affects the video player
  2. All the controls should work seamlessly in all the major web browsers like Google Chrome, Apple Safari, Internet Explorer, Mozilla Firefox.

 Full Screen View & Exit Full screen
  1. 'Go Full screen' button must have a tool tip as “Go Full Screen”.
  2. Once the full screen view is active, the normal view space must not be left blank.
  3. The video shouldn't hang once if we have clicked on full screen when the video is being played.
  4. The video must occupy the entire screen, it shouldn't be cramped.
  5. “Press Esc to exit Full screen mode” message must be shown once the full screen view is activated. The message should disappear after few seconds.
  6. The video should continue playing from the point at which we click the full screen button during normal view.
  7. The video should not start rendering from the start, once the full screen view is activated.
  8. Quality of the video should not differ significantly from the normal view.
  9. Video controls must be shown at the bottom of the screen.
  10. Video controls must hide after few seconds once the full screen is activated.
  11. Video controls must be shown once we mouse hover the video.
  12. The video must play(resume)/pause when we left click anywhere on the screen.
  13. Play(resume)/pause buttons should change while select the respective options.
  14. Volume control must have '+' & '-' symbols to indicate increase or decrease volume.
  15. The time elapsed time should change as you drag the progress bar accordingly.
  16. All the video controls function must be in sync with the normal view. Eg: Volume controls, pause/resume must be same before or after returning to the normal view mode OR vice versa.
  17. All the video controls must have a tool tip.
  18. Title of the video must be shown completely.
  19. Title of video must be shown in a single line.
  20. Full screen view must exit either when we press 'Esc' key or click the 'Exit full screen' button or when right click & select 'Exit full screen'.
Video Ordering:
  1. Check if the first video being played by the player is displayed as the first video in the list.
  2. Once video is finished playing it should automatically start next video from the list.
  3. Video being played currently should be highlighted in the list for user reference.
  4. If a playlist is being shown, each slideshow of the list contains specific number of videos listed (Let us say 3 videos/slideshow). Now player finishes playing 3rd video from the slideshow then it should start playing 4th video from the list along with refreshing the slideshow of the list to next three videos.
Functionality – Video sharing options:
  1. Social networking widgets. ( Eg Facebook, twitter, blogs).
  2. Default video resolution in the when the video is shared & shown in any of the social networking sites.
  3. Relevancy of the video being shared & the one that is being shown.
  4. Should the video which is embedded in other users website/blog should also embed advertisement along with the video?
  5. Let us say video number 2 is being played currently. Now on selecting any other related video from the menu option starts playing that video. Check if we can still play video number 2 on selecting it again or not.

Thursday, February 2, 2012

Pre-thoughts of BBST 'two'dot'O'

It had been a while since I had planned to take up this course. Having heard, read, and met people who had done this course the eagerness to learn and attend this was way too high. The wait period of 2 months i.e from the time of registering to the actual start time of the course was like an year passed by.

The very reason I wanted to join this course is that it offers a chance to interact with like minded people around the globe and share your ideas & thoughts with them. And it surely has given me this opportunity even before 4 days of the scheduled start date.

BBST 2.0 Foundation course has been designed in such way that we will be learning about testing as well as improving the academic skills. Academic skills in this context refers to online collaboration, effective communication, better peer reviews and many other aspects which will help us to work smartly using different sources of information.
Under learning about testing we shall be made familiar with 5 different challenges, that being:
  • Information objectives drive the testing mission and strategy
  • Oracles are heuristic
  • Coverage is multidimensional
  • Complete testing is impossible
  • Measurement is important, but hard

One of the testimonial at BBST.info says "Without question, the BBST Foundations 2.0 class is one of the most challenging Foundations level classes in software testing you will take..". Now, how challenging it would that be for me is something that I need to wait and watch. Having Michael Larsen as the instructor for our batch is something amazing by itself.

This being my first stint in an online course, I am really looking forward for a great time ahead.