The online community for software testing & quality assurance professionals
 
 
Calendar   Today's Topics
Sponsors:




Lost Password?

Home
BetaSoft
Blogs
Jobs
Training
News
Links
Downloads



Miscellaneous Forums >> General Discussion

Pages: 1
duke_8
Newbie


Reged: 01/28/07
Posts: 17
Loc: Montreal
How often do you get your software builds?
      #718512 - 10/22/12 06:18 AM

I'm managing a QA department of 15 testers. Usually, the team leads create the test schedule which includes about 7 -9 test cycles (2 weeks per cycle). Engineering tries to provide a build on every cycle. The problem I see is that if bugs are found, it takes 2 weeks before there are fixed and retested. After a 2 week period, the testers have about 25-30 bugs to close all at once. I find this way too long to judge the stability of the product.

I would like to hear from others about how often they get their software builds (daily, weekly, etc) and does it matter if you work in an Agile environment or not?


Post Extras: Print Post   Remind Me!   Notify Moderator  
Joe Strazzere
Moderator


Reged: 05/15/00
Posts: 12344
Loc: Massachusetts, USA
Re: How often do you get your software builds? [Re: duke_8]
      #718515 - 10/22/12 06:42 AM

In my shop, each project involves negotiations about the build schedules.

Typically, we get builds once each week in the earlier phases of the development cycle. As we near the end of the project, we'll sometimes build more often, perhaps twice per week.

We usually reserve the right to ask for a build whenever a blocking bug occurs.

--------------------
- Joe
Visit AllThingsQuality.com to learn more about quality, testing, and QA!

I speak only for me. I do not speak for my employer, nor for anyone else.


Post Extras: Print Post   Remind Me!   Notify Moderator  
swt88
Active Member


Reged: 05/13/03
Posts: 1193
Loc: Massachusetts
Re: How often do you get your software builds? [Re: Joe Strazzere]
      #718518 - 10/22/12 08:07 AM

We usually get them every one or two days -- sometimes multiple in a day as we get closer to release/end of sprint.

I'd be concerned about too much time between releases as there's risk for testing being stopped because of blocking issues.

--------------------
Mary


Post Extras: Print Post   Remind Me!   Notify Moderator  
duke_8
Newbie


Reged: 01/28/07
Posts: 17
Loc: Montreal
Re: How often do you get your software builds? [Re: swt88]
      #718524 - 10/22/12 09:25 AM

ok, so far I'm hearing about builds being released to QA once a week or less. Now do you try to sychronize the builds with your schedule or it doesn't matter?
For me, there's not much value in that sort of synchronization. What are your feelings?


Post Extras: Print Post   Remind Me!   Notify Moderator  
swt88
Active Member


Reged: 05/13/03
Posts: 1193
Loc: Massachusetts
Re: How often do you get your software builds? [Re: duke_8]
      #718525 - 10/22/12 09:33 AM

sync builds to a schedule??? What schedule are you referring to?

My test schedule? <- Then I'd want a build with fixes at least daily or twice a day (depending on how long it takes to deploy). Give me fresh a code with bug fixes at the beginning of the day and again while I'm at lunch and I might actually be able to finish my work on time!

--------------------
Mary


Post Extras: Print Post   Remind Me!   Notify Moderator  
duke_8
Newbie


Reged: 01/28/07
Posts: 17
Loc: Montreal
Re: How often do you get your software builds? [Re: swt88]
      #718529 - 10/22/12 10:02 AM

Yes, I was referring to your test schedule. Since I'm now the new QA Manager I see that it takes 2 weeks to conduct 1 full pass. They schedule at least 7 passes. For example
June 1, June 15, June 29 ,etc. And they expect development to give them a build on those dates also. I find getting a new build with new features and bug fixes every 2 weeks is absurd.


Post Extras: Print Post   Remind Me!   Notify Moderator  
Joe Strazzere
Moderator


Reged: 05/15/00
Posts: 12344
Loc: Massachusetts, USA
Re: How often do you get your software builds? [Re: duke_8]
      #718531 - 10/22/12 10:10 AM

It might be interesting to be able to plan out a project and have testing schedules and builds align so perfectly.

In my shop, that never happens. I don't expect it ever will.

--------------------
- Joe
Visit AllThingsQuality.com to learn more about quality, testing, and QA!

I speak only for me. I do not speak for my employer, nor for anyone else.


Post Extras: Print Post   Remind Me!   Notify Moderator  
duke_8
Newbie


Reged: 01/28/07
Posts: 17
Loc: Montreal
Re: How often do you get your software builds? [Re: Joe Strazzere]
      #718533 - 10/22/12 10:52 AM

But does it seem to be a good stragegy or a failure waiting to happen. I must add that we expect a build on those days, but we don't actually get it. As you know you can plan so precise like that. But my argument is that there's no need to plan like that.
1. Just keep testing
2. When the new build is out, close the bugs by regression tests, test around the broken area.
3. Continue testing from where you left off.


Post Extras: Print Post   Remind Me!   Notify Moderator  
michaeljf
Veteran


Reged: 09/17/01
Posts: 3979
Loc: Yankee Land
Re: How often do you get your software builds? [Re: duke_8]
      #718535 - 10/22/12 11:50 AM

I guess it depends on your product, generally I am working in the web app space (either SAAS or production site is a suite of products) so we do builds/testing on a continual basis. When DEV has something that needs to get out I adjust my schedule, if I am in the middle of trying to get a build out we either reset and push the new build out - depending on what is in there, or I finish the one I am working on then start on the next right away. My Testing department is just me, but when I had staff before we tried for weekly builds.

Even now I still do weekly builds, or at least try to. I rarely get on a set schedule so adjusting doesn't really hamper me, at most we have times when we can't release due to large conferences and such when we want to keep the site up and stable.

Personally, as was noted, if I had to wait too long between builds then I'd be more worried than getting quicker ones. When I do get a new build I run my Test Framework (Regression Test) to cover the main areas then I test other changes according to the SCS change log and interviews with the DEV's.

--------------------
- M

Nothing learns better than experience.

"So as I struggle with this issue I am confronted with the reality that noting is perfect."
- Unknown

Now wasting blog space at QAForums Blogs - The Lookout


Post Extras: Print Post   Remind Me!   Notify Moderator  
Joe Strazzere
Moderator


Reged: 05/15/00
Posts: 12344
Loc: Massachusetts, USA
Re: How often do you get your software builds? [Re: duke_8]
      #718543 - 10/22/12 12:28 PM

Quote:

But my argument is that there's no need to plan like that.



I agree.

--------------------
- Joe
Visit AllThingsQuality.com to learn more about quality, testing, and QA!

I speak only for me. I do not speak for my employer, nor for anyone else.


Post Extras: Print Post   Remind Me!   Notify Moderator  
Squamry
Member


Reged: 01/22/07
Posts: 145
Loc: UK
Re: How often do you get your software builds? [Re: Joe Strazzere]
      #718590 - 10/23/12 05:11 AM

I agree there is no need to align build avialability to test cycles/phases. It is worth agreeing a build schedule in the plan that:

a) Provides development with known delvery targets. I've experienced that agreeing build deliveries actually improves the quality of the fixes as developers feel less rushed knowing the next build is not for a day or two.
b) Provides QA enough updates to verify defects are resolved and complete testing.

One of the projects I currently work on has an automated build avialable for QA each day and it is a QA decision if they want to use that build or not.

--------------------
The story so far:
In the beginning the Universe was created.
This has made a lot of people very angry and been widely regarded as a bad move.


Post Extras: Print Post   Remind Me!   Notify Moderator  
Pages: 1



Extra information
0 registered and 8 anonymous users are browsing this forum.

Moderator:  Rich W., AJ, blueinatl 

Print Topic

Forum Permissions
      You cannot start new topics
      You cannot reply to topics
      HTML is disabled
      UBBCode is enabled

Rating:
Topic views: 4121

Rate this topic

Jump to

Contact Us | Privacy statement SQAForums

Powered by UBB.threads™ 6.5.5