如何在java selenium中将失败测试数据传递给软断言

Question

我在json文件中有一个测试数据，如下所示-

{
    "alerts" : [
    {
        "alert_name" : "employee",
        "sql_query" : "select * from employee",
        "description" : "Query with Variables",
        "default_interval" : "10 minutes",
        "default_priority" : "Critical",
        "variables" : [{
                            "variable" : "failurereason",
                            "value" : "INVALID USER"
                            },
                            {
                            "variable" : "count",
                            "value" : "1"
                    }]
        },
    {
        "alert_name" : "employee2",
        "sql_query" : "select * from employee2",
        "description" : "Query with Variables",
        "default_interval" : "10 minutes",
        "default_priority" : "Critical",
        "variables" : [{
                            "variable" : "failurereason",
                            "value" : "INVALID USER"
                            },
                            {
                            "variable" : "count",
                            "value" : "1"
                    }]
        }

我在java selenium中有一个测试方法，它将遍历json，并用实际数据检查数据是否存在。下面是Java selenium方法。

public boolean createAlert(String jsonFile,String Host, String Port) {
        boolean success = true;
        String logStr = "Unable to create Alert";
        
        JSONObject readJsonFilePath = rjf.readJsonFilePath(jsonFile);
        JSONArray alertsJsonArray = readJsonFilePath.getJSONArray("alerts");
        
        System.out.println("+++++ Number of Test Cases to be run are : " + alertsJsonArray.length() + " +++++");
        
        for(int i = 0; i < alertsJsonArray.length(); i++)
        {
            JSONObject alertJsonObject = alertsJsonArray.getJSONObject(i);
            String description = alertJsonObject.getString("description");
            System.out.println("+++++++++++Test Case : " + i + " Running : " + description + " ++++++++++++++");
            
            String alert_name = alertJsonObject.getString("alert_name");
            String sql_query = alertJsonObject.getString("sql_query");
            String defaultInterval = alertJsonObject.getString("default_interval");
            String defaultPriority = alertJsonObject.getString("default_priority");
            
            if (
                    this.clickUponCreate(alert_name,sql_query) &&
                    this.setVariablesInVariableBar(alertJsonObject,"variables") &&
                    this.runQueryCreateAlertAndVerifyIsAlertCreated(alert_name, Host, Port, defaultInterval, defaultPriority))
            {   
                logStr = "Able to set the values ";
            }
            else {
                System.out.println(TEXT_RED +  alert_name + description + "Test Case : " + i + " Failed");
                success=false;
            }
          }
        System.out.println(logStr);
        return success;
    }

上面的代码循环了两次，因为json对象有两个测试数据，现在如果其中一个测试在最后失败，它只会提到测试失败，因为它是在else条件中添加的。

我使用了如下软断言-

softassert.assertTrue(page.createAlert(jsonFile,Host,Port),
                "test11.1: Verified combinations of Alerts");

我不知道json文件中的两个测试数据集中哪一个失败了。运行后，如果其中一个失败，它只会提到“验证的测试应该是真的，但它是假的”

假设我有100个测试数据，类似地，如何从json测试数据集中识别失败的测试数据。有办法吗？

Answer 1

实现这一点有两种方法：

1） 使用软断言。

您可以在软断言中添加一条消息以识别哪个测试用例失败。根据代码，我可以看到您正在打印测试用例编号和描述。

  softassert.assertTrue(page.createAlert(jsonFile,Host,Port),
                "test11.1: Verified combinations of Alerts", 
                "Test Case : " + i + " Failed : " + description);

2） 正确的方法是使用dataprovider：通过使用dataprovider，您可以根据可用的测试数据执行测试方法，即使一个测试方法失败，也会执行另一个测试方法。因此，您的代码不会中断。

注意：请更改并更正代码

@DataProvider
    public Object[][] getJsonData(){
       return createAlert("","","");
    }


 @Test(dataProvider = "jsonData")
    public void testJson(String alert_name, String sql_query, String defaultInterval, String defaultPriority){
        //Add your logic here
    }



 public Object[][] createAlert(String jsonFile, String Host, String Port) {
        boolean success = true;
        String logStr = "Unable to create Alert";

        JSONObject readJsonFilePath = rjf.readJsonFilePath(jsonFile);
        JSONArray alertsJsonArray = readJsonFilePath.getJSONArray("alerts");


        System.out.println("+++++ Number of Test Cases to be run are : " + alertsJsonArray.length() + " +++++");

        Object[][] jsonData = new Object[alertsJsonArray.length()][4];

        for(int i = 0; i < alertsJsonArray.length(); i++)
        {
            JSONObject alertJsonObject = alertsJsonArray.getJSONObject(i);
            String description = alertJsonObject.getString("description");
            System.out.println("+++++++++++Test Case : " + i + " Running : " + description + " ++++++++++++++");

            String alert_name = alertJsonObject.getString("alert_name");
            String sql_query = alertJsonObject.getString("sql_query");
            String defaultInterval = alertJsonObject.getString("default_interval");
            String defaultPriority = alertJsonObject.getString("default_priority");

            jsonData[i][0] = alert_name;
            jsonData[i][1] = sql_query;
            jsonData[i][2] = defaultInterval;
            jsonData[i][3] = defaultPriority;

        }
        System.out.println(logStr);
        return jsonData;
    }