In many practical applications of using joblibspark I find I already have a SparkSession available and it doesn't make sense to me to close that and create a new one within the parallel backend. Perhaps the user could supply a spark session optionally? Created a PR at #41
In many practical applications of using joblibspark I find I already have a
SparkSessionavailable and it doesn't make sense to me to close that and create a new one within the parallel backend. Perhaps the user could supply a spark session optionally? Created a PR at #41