Fix Spark SQL core flow tests

Spark sql core flow tests don't run in CI  and when I ran them recently many are no longer passing. Part of the problem is incorrect caching of dataframes. Additionally bulk insert was not actually being used. Finally there is an issue with global indexing.