Optimizing the data reads in Spark: Part 1 — PySpark 2.4+Number of jobs created while reading a CSV file:Jan 15, 2021Jan 15, 2021
Slowly Changing Dimensions (SCD)Type-2 : PySpark Implementation in 2.4+By Definition of Oracle …Dec 19, 2020Dec 19, 2020