selenium - TestNG particular tests in isolation -


i have test suite of 6 classes, total of 120 tests between them.

the issue face tests cannot run when other tests running. example, tests a,b,c,d,e,f:

  • a cannot run b or c
  • b cannot run or c
  • c cannot run or b
  • d cannot run f
  • e can run anything
  • f cannot run d

this small example, illustrates point. still want exploit parallelism possible, example d , e running @ same time. still learning testng, have tried following things:

grouping tests cannot run single group - couldn't find way run testng in 'parallel="groups"' mode, 'parallel="classes"' tests in group run in same thread. putting each test cannot run in single class allow 'parallel="classes"' work, mean tests not arranged test functionality, are.

put dependencies around tests - considered having each test depend on 1 other (possibly groups?), forming chain such a->b->c. issue these run in order, might hide issues. problem here test maintainence becomes issue, have ensure chain singular , doesn't break!

creating method interceptor sorts list group - i'm not entirely sure on one, don't think prevent having test running whilst incompatible test selected 'next run'.

i've seen testng & selenium: separate tests "groups", run ordered inside each group seems attempting same goal, different reasons, solution reached there isn't suitable not dependency issue, isolation issue.

is there me?

thanks much,

phil

you refactor tests such current list of classes no longer marked tests. instead, introduce new test proxy classes methods call testing procedures in original classes. way, maintaining code in functional area straightforward. alternatively, since proxy classes based on type of resources use, put them separate tests within suite , use parallel="tests".

in fact, don't have introduce proxy classes. specify tests 

<test name="boiler">    <classes>       <class name="org.example.a">          <methods>             <include name="a1"/>             <include name="a2"/>          </methods       </class>       ... <!-- list of methods use boiler -->    </classes> </test> <test name="waterheater">     <classes>       <class name="org.example.b">          <methods>             <include name="b"/>          </methods>       </class>        ... <!-- list of methods use waterheater -->    </classes> </test>

the advantage of using proxy classes listing out tests can done @ class level instead of method level. mileage may vary.

<test name="boiler">    <classes>       <class name="org.example.boilerproxy"/>    </classes> </test> <test name="waterheater">    <classes>        <class name="org.example.waterheaterproxy"/>    </classes> </test> ...

the issue these run in order, might hide issues.

testng run sequence of tests in same order each time. believe flaw in design if uncover bugs when things run in different orders, using facilities of testng. there no shortcuts mapping out combinations of sequences might occur , explicitly test them, or @ least manageable subset of them. in light, setting proxy tests, described in first paragraph may best bet, can repeat , re-order them needed.

testing parallelism, asynchrony , race conditions hard. there no shortcuts except, perhaps, design.

i have created blog posting based on answer: http://ancient-marinator.blogspot.com/2013/05/on-testing-scheduling-your-tests.html


Comments

Post a Comment

Popular posts from this blog

Why does Ruby on Rails generate add a blank line to the end of a file? -

running rails generate controller foo home results in: class foocontroller < application controller def home end end (there's nothing on line in actual file, blank line) is there purpose blank line? it's common use newline indicate end of line, last line. many editors (like vi, use) add in newline silently. consensus text files (especially in unix world) should end in newline, , there have been problems historically if wasn't present. why should text files end newline? the tool used count lines in file "wc" counts newlines in file, without trailing newline show 3 instead of 4. it improves readability of templates used in generator. consider: https://github.com/rails/rails/blob/master/railties/lib/rails/generators/rails/controller/templates/controller.rb to remove trailing newline, template have last line of: end<% end -%> instead of: end <% end -%> that seems less readable me. the discussion below refers ...
Read more

keyboard - Smiles and long press feature in Android -

i've created android keyboard. how add features inserting smilies, , using long keypresses display symbols? to create long-press behavior allows select several options pop-up menu, follow guide (specifically pop-up menu section): http://developer.android.com/guide/topics/ui/menus.html smileys (also known emoticons) combination of keys, understood programs , parsed same way. have do, when clicks smiley face on keyboard, simulate pressing of key combination matching emoticon. example, when clicks smiley, should simulate key presses ':' , ')' :). here's list of emoticons: http://en.wikipedia.org/wiki/list_of_emoticons
Read more

node.js - Bad Request - node js ajax post -

i'm using express 3.0 , node v0.11.0. have button submits form , i'm using ajax post data json object node server. client code is: $('#contact').submit(function(e) { console.log('submit called'); var formdata = json.stringify($('form').serializeobject()); console.log(formdata); $.ajax({ url: "http://localhost:3000/savedata/", type: "post", datatype: 'json', data: {objectdata: formdata}, contenttype: "application/json", complete: function() { console.log('process complete'); }, success: function(data) { console.log('process sucess'); }, error: function() { console.log('process error'); }, }); return false; }); then on server: var express = require('express'); var app = express(); app.set('views', __dirname + '/views'); app.set('view engine', 'jade'); app.use(express.bodyparser());...
Read more