Provisions in @test Decorator

Skipping a Test

You can mark a test as skipped:

from arjuna import *

@test(skip=True)
def check_test_name(request):
    pass

You can also do a conditional skipping:

from arjuna import *

@test(skip=skip("abc > 2", reason="Foo bar"))
def check_test_name(request):
    pass

Handling Expected Failures in Tests

You can mark a test as a test which is expected to fail:

from arjuna import *

@test(xfail=True)
def check_test_name(request):
    pass

You can also specify advanced conditional expected failures:

from arjuna import *

@test(xfail=xfail("abc > 2", reason="Foo bar", raises=SomeException, run=True, strict=True))
def check_test_name(request):
    pass

Such a test is reported as XFailed. If it passes, it is reported as XPassed.

Specifying Built-in Test Attributes

Arjuna tests have many built-in attributes, which can be specified as an argument in @test, for example:

from arjuna import *

@test(id="SomeID", priority=3)
def check_test_name(request):
    pass

Following is the complete list:

  • Overridable Attributes:
    • id: Alnum string representing an ID which you want to associate with the test.

    • priority: An integer value 1-5 depicting priority of this test, 1 being highest, 5 being lowest.

    • author: Author of this test

    • idea: The idea describing this test

    • component: Primary software component that this test targets.

    • app_version: Version of SUT that this test targets

    • level: Level of this test.

    • reviewed: Has this test been reviewed?

    • unstable: Is this test unstable?

  • Non-overridable Attributes:
    • package: Full qualified package

    • module: Name of module containing this test

    • name: Name of this test function

    • qual_name: Full qualified name of this test function <package>.<module>.<function>

User-Defined Test Attributes

You can define any number of your own attributes for a test:

from arjuna import *

@test(policy="Some policy")
def check_test_name(request):
    pass

Specifying Tags, Bugs, Environments

Arjuna tests have built-in tag containers (sets), which can be specified as an argument in @test, for example:

from arjuna import *

@test(tags={'t1', 't2'}, bugs={'b1','b2'}, envs={'e1','e2'})
def check_test_name(request):
    pass
Following are the containers:
  • bugs: Set of bugs associated with this test

  • envs: Set of Environment names on which this test is supposed to run.

  • tags: Set of arbitrary tags for this test