How to split single row into multiple rows in Spark DataFrame using Java

Question

I have a table as shown:

---

I want to transform it into the following table using Spark Java or Spark Scala

Answer 1

make sure you have unique column names, denn you can do :

import or.apache.spark.sql.functions._

table
  .select("id","movie",explode(array("cast1", "cast2", "cast3", "cast4")).as("cast"))
  .where(col("cast").isNotNull)