I am trying to write performance tests with the Performance extention to Arquillian, but I've run into a problem: The tests never seem to fail. I've condensed my tests to the simplest possible test that should fail:

@PerformanceTest

@RunWith(Arquillian.class)

public class ShouldFail {

          public static Archive<?> createDeployment() {

                    return ShrinkWrap.create(WebArchive.class, "performance-tests.war");

          }

          @Performance(time=10)

          @Test

          public void shouldTimeOut() throws Exception {

                    Thread.sleep(1000);

          }

}

From what I can understand this should give me some sort of test failed exception after 10 milliseconds, yet it runs green as anything.

I use arquillian-junit-container-1.0.0.CR2, jboss-as-arquillian-container-managed-7.0.0.Final, arquillian-performance-1.0.0.Alpha5.

Am I doing something wrong?