Product quality - Dev & QA synergy.

Quality is a problem which every software development team has to deal with.
We have the usual bell curves etc which we use to gain confidence regarding overall stability before we ship.
But, here are some observations based on the timelines of the curve & potential dev/qa synergy.

There are some projects where many bugs are found after the 'code freeze'. This is a clear indication that the dev & qa team had issues.
It is possible dev didn't unit test properly or many changes were made late in the cycle and either QA took time to ramp up and understand the changes or were busy with other things.

There are some projects where many bugs are found immediately after 'code complete' and then taper off quickly. This may be the case with many projects and might be a good thing. It means the QA team was able to understand the changes quickly and cover new areas thoroughly.
It might also mean that the Dev team didn't have enough time to unit test or didn't do it properly also in some cases depending on the severity of bugs found. Otherwise, it is a healthy indicator.

There are some cases where bugs are not found after 'code complete'. It is too good to be true and in many cases it ends up being the case that QA was testing the product before code complete and doing a full test pass.
It might also mean that there is a problem where QA & Dev worked too closely that all problems are explained in dev terms which don't end up in bug tracking system which is obviously not good for the user..

Then obviously, you have the worst case scenario where the curve never tapers off. If you ship a product without being aware of such trends, then you need help & it may have nothing to do with synergy.

Finally, there is a tendency to blame QA for bugs found. But, obviously developers who take pride in their code, thinks about the design first, unit tests, thinks about multi-threading issues, supporting the feature after release & follows best practices make less mistakes. I'd leave the 'who to blame' issue as an open question then.. ;-)

Comments

Post a Comment

Popular posts from this blog

Google Appengine

It was good while it lasted, Google AppEngine gave developers an easy way to create web applications without worrying about scaling it or being a sysadmin. There were numerous startups that built their products on Google Appengine. Even after beta, there was a fairly large free quota that made it a reasonable choice. But, the current pricing seems a bit ridiculous for those who are looking for a free or cheap solution or for those enjoyed the initial quotas. Perhaps, we were spoiled and Google’s goal is to get rid of free-riders which is not exactly evil from Google’s perspective. So, it is 2012 and welcome to reality since Google can’t maintain those quotas forever and the current free quotas are intended to only test your application before you go live. If for some strange reason, your application becomes popular and gets more than 1,000 users, you would end up scrambling for an alternate solution since you will find yourself paying through the nose. The quota system is complica...
Read more

Blackberry Playbook

RIM introduced the "Playbook" tablet computer with much fanfare yesterday.It relies on Flash & HTML5 as the key development platforms. RIM was able to build the compatibility for existing apps on top of QNX which is good. It was smart to rely on the HTML5 platform given the poor UI capabilities in the existing Java framework, it wasn't clear if the tablet supported native game development despite the support for OpenGL in QNX platform. The specs are great compared to the existing iPad, RIM did need some +ve hype at this point after the Torch fiasco. It is just 10mm thick compared to 13.4mm for the iPad and I thought iPad was thin. It has a 7" screen, but the resolution is 1024x600 whereas it is 1024x768 for the 9.7" iPad. Playbook also comes with a dual core 1GHZ processor compared to the single core CPU in iPad. Playbook also comes with front and back cameras and HD display with HDMI output compared with none for iPad. It also tethers with the Blackberr...
Read more

What is up with RIM?

RIM is one of the leading technology companies in Canada and one of the largest employers in Waterloo. There are a few strategic mistakes that seem obvious in hindsight, but it is easier to list them now than to predict in advance. RIM is losing market share in North America, but surprisingly the execs were focusing on developing markets for growth. Obviously, profit margins from developing countries are minimal when compared to the lucrative NA market. RIM’s strength is in the enterprise market. The primary growth is happening in consumer market, but RIM has had trouble gaining traction there. RIM will continue to rule the enterprise for now, because changes come at a slow pace there. Still, the consumerization of IT is the biggest threat for RIM in this area. The current instability doesn't help them advance in enterprise either. RIM is losing the high end smart phone market which is ruled by Apple and Android devices, but instead is happy with the wins in mid-low end ...
Read more