在Scala中读取带有模式的json文件时出错

Question

读取ArrayType值（phoneNumbers）时出错，没有ArrayType值，我可以读取其余值。

{
    "firstName": "Rack",
    "lastName": "Jackon",
    "gender": "man",
    "age": 24,
    "address": {
        "streetAddress": 126,
        "city": "San Jone",
        "state": "CA",
        "postalCode": 394221
    },
    "phoneNumbers": [
        { "type": "home", "number": 7383627627}
    ]
}

My schema ->
val schema=StructType(List(
      StructField("firstName",StringType),
      StructField("lastName",StringType),
      StructField("gender",StringType),
      StructField("age",IntegerType),
      StructField("address",StructType(List(
        StructField("streetAddress",StringType),
        StructField("city",StringType),
        StructField("state",StringType),
        StructField("postalCode",IntegerType)))),
      StructField("phoneNumbers",ArrayType(StructType(List(
      StructField("type",StringType),
      StructField("number",IntegerType))))),
    ))

json_df.selectExpr("firstName","lastName",
      "gender","age","address.streetAddress","address.city",
      "address.state","address.postalCode",
      "explode(phoneNumbers) as phone","phone.type","phone.number").drop("phone").show()

当我这样做时。show，它只显示列名，没有值，但当我不使用“phoneNumbers”数组时，它可以正常工作。

Answer 1

IntegerType表示4字节有符号整数，最大值为2147483647，不能容纳电话号码。电话号码可以使用LongType或StringType。

您的选择查询没有结果，因为您正在爆炸一个空的电话号码数组，该数组返回0行。该数组为空，因为电话号码无法保存在ENTgerType列中。