是否可以在testng中为测试类而不是单个方法创建套件级别的超时？

Question

我正在研究testng中的一个问题。我想知道是否有办法在测试类级别指定超时，而不是单个方法。我知道套件xml级别的“超时”，但这适用于每个测试类中的每个测试方法。

我真的希望能够指定一个适用于xml中每个类的超时，这样我们就可以研究如何改进这些类。

Answer 1

这是不支持的开箱即用。但是TestNG确实为您提供了一些功能，您应该能够使用这些功能自行构建它，而无需付出多少努力。[我使用TestNG7.0.0-beta7，这是发布此答案时TestNG的最新版本]

1. 首先需要创建一个自定义注释，用于定义类级别的超时

这里有一个完整的例子来说明这一点。

自定义注释如下所示：

import static java.lang.annotation.ElementType.TYPE;

import java.lang.annotation.Retention;
import java.lang.annotation.Target;

@Retention(java.lang.annotation.RetentionPolicy.RUNTIME)
@Target({TYPE})
public @interface Timeout {
  long inMs() default 0;
}

使用上述自定义注释的测试类如下所示

import java.util.concurrent.TimeUnit;
import org.testng.annotations.Test;

@Timeout(inMs = 15)
public class TestClass1 {

  @Test
  public void sleepFor10Ms() throws InterruptedException {
    TimeUnit.MILLISECONDS.sleep(10);
  }

  @Test
  public void sleepFor20Ms() throws InterruptedException {
    TimeUnit.MILLISECONDS.sleep(20);
  }
}

import java.util.concurrent.TimeUnit;
import org.testng.annotations.Test;

@Timeout(inMs = 5)
public class TestClass2 {

  @Test
  public void sleepFor10Ms() throws InterruptedException {
    TimeUnit.MILLISECONDS.sleep(10);
  }

  @Test
  public void sleepFor20Ms() throws InterruptedException {
    TimeUnit.MILLISECONDS.sleep(20);
  }
}

注释变压器如下所示

import java.lang.reflect.Constructor;
import java.lang.reflect.Method;
import org.testng.IAnnotationTransformer;
import org.testng.annotations.ITestAnnotation;

public class TimeoutSetter implements IAnnotationTransformer {

  @Override
  public void transform(
      ITestAnnotation annotation, Class testClass, Constructor testConstructor, Method testMethod) {
    if (testMethod == null) {
      return;
    }

    Timeout timeout = testMethod.getDeclaringClass().getAnnotation(Timeout.class);
    if (timeout == null) {
      return;
    }
    annotation.setTimeOut(timeout.inMs());
  }
}

套房文件是这样的

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE suite SYSTEM "http://testng.org/testng-1.0.dtd">
<suite name="Suite" verbose="2">
  <listeners>
    <listener class-name="com.rationaleemotions.stackoverflow.qn57307245.TimeoutSetter"/>
  </listeners>
  <test name="Test">
    <classes>
      <class name="com.rationaleemotions.stackoverflow.qn57307245.TestClass1"/>
      <class name="com.rationaleemotions.stackoverflow.qn57307245.TestClass2"/>
    </classes>
  </test>
</suite>

执行输出

... TestNG 7.0.0-beta7 by Cédric Beust ([e-mail])
...









org.testng.internal.thread.ThreadTimeoutException: Method com.rationaleemotions.stackoverflow.qn57307245.TestClass1.sleepFor20Ms() didn't finish within the time-out 15

    at java.util.concurrent.ThreadPoolExecutor$Worker.unlock(ThreadPoolExecutor.java:652)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1162)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)






org.testng.internal.thread.ThreadTimeoutException: Method com.rationaleemotions.stackoverflow.qn57307245.TestClass2.sleepFor10Ms() didn't finish within the time-out 5

    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
    at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:51)
    at org.testng.internal.InvokeMethodRunnable.run(InvokeMethodRunnable.java:41)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)





org.testng.internal.thread.ThreadTimeoutException: Method com.rationaleemotions.stackoverflow.qn57307245.TestClass2.sleepFor20Ms() didn't finish within the time-out 5

    at sun.misc.Unsafe.compareAndSwapInt(Native Method)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer.compareAndSetWaitStatus(AbstractQueuedSynchronizer.java:2303)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer.transferForSignal(AbstractQueuedSynchronizer.java:1674)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.doSignalAll(AbstractQueuedSynchronizer.java:1888)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.signalAll(AbstractQueuedSynchronizer.java:1957)
    at java.util.concurrent.ThreadPoolExecutor.tryTerminate(ThreadPoolExecutor.java:716)
    at java.util.concurrent.ThreadPoolExecutor.processWorkerExit(ThreadPoolExecutor.java:1014)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)

PASSED: sleepFor10Ms
FAILED: sleepFor20Ms
org.testng.internal.thread.ThreadTimeoutException: Method com.rationaleemotions.stackoverflow.qn57307245.TestClass1.sleepFor20Ms() didn't finish within the time-out 15
    at java.util.concurrent.ThreadPoolExecutor$Worker.unlock(ThreadPoolExecutor.java:652)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1162)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)

FAILED: sleepFor10Ms
org.testng.internal.thread.ThreadTimeoutException: Method com.rationaleemotions.stackoverflow.qn57307245.TestClass2.sleepFor10Ms() didn't finish within the time-out 5
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
    at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:51)
    at org.testng.internal.InvokeMethodRunnable.run(InvokeMethodRunnable.java:41)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)

FAILED: sleepFor20Ms
org.testng.internal.thread.ThreadTimeoutException: Method com.rationaleemotions.stackoverflow.qn57307245.TestClass2.sleepFor20Ms() didn't finish within the time-out 5
    at sun.misc.Unsafe.compareAndSwapInt(Native Method)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer.compareAndSetWaitStatus(AbstractQueuedSynchronizer.java:2303)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer.transferForSignal(AbstractQueuedSynchronizer.java:1674)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.doSignalAll(AbstractQueuedSynchronizer.java:1888)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.signalAll(AbstractQueuedSynchronizer.java:1957)
    at java.util.concurrent.ThreadPoolExecutor.tryTerminate(ThreadPoolExecutor.java:716)
    at java.util.concurrent.ThreadPoolExecutor.processWorkerExit(ThreadPoolExecutor.java:1014)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)


===============================================
    Test
    Tests run: 7, Failures: 3, Skips: 0
===============================================


===============================================
Suite
Total tests run: 4, Passes: 1, Failures: 3, Skips: 0
===============================================


Process finished with exit code 0

Answer 2

超时只能通过两种方式进行配置。1） 在每种试验方法水平上

本质上，testng中的测试类包含您的testng方法，这些方法是您对测试条件的断言（在您的例子中是基于超时的），所以它们只是普通的java类。

您可以尝试为每个testng类保留一个测试方法，并为该方法添加超时，也可以创建一个外部方法，该方法将根据方法执行所需的时间做出通过或失败的决定。