Description
Well formed JSON doesn't work with the 1.5.1 version while using sqlContext.read.json("<json-file>"):
{
"employees": {
"employee": [
,
,
{ "name": "Bindy",<newline> "surname": "Kvuls",<newline> "mobile": "5033828845",<newline> "email": "bindykk@sparky.com" } ]
}
}
For the above following error is obtained:
ERROR Executor: Exception in task 0.0 in stage 1.0 (TID 2)
scala.MatchError: (VALUE_STRING,StructType()) (of class scala.Tuple2)
Where as, this works fine because all components are in the same line:
[
,
,
{"name": "Bindy","surname": "Kvuls","mobile": "5033828845","email": "bindykk@sparky.com"}]
Attachments
Issue Links
- duplicates
-
SPARK-18352 Parse normal, multi-line JSON files (not just JSON Lines)
- Resolved