ConfigurationΒΆ Contents: How to Select Compute Nodes Storage Speed Requirements Storage Options (Best to Worst) Recommendations by Workload Configuring Shuffle Storage Location Capacity Planning Checking Node Storage Network Considerations Heterogeneous Slurm jobs Interactive job Batch job How to handle compute node failures How to use a custom spark-default.conf file How to Set a Custom Spark Log Level Reducing Log Verbosity Available Log Levels Recommendations Example Output Comparison Per-Logger Configuration