Adaptive Query Execution in Spark: What AQE Does and How to Tune It
AQE re-plans your query while it runs, using real numbers instead of estimates. Here are its three optimisations, every setting that controls them, and the default that quietly ignores your tuning.
Read More