Executor time duration change#440

Open

hjha1 wants to merge 16 commits into

linkedin:customSHSWorkfrom

hjha1:executorTimeDurationChange

Commits on May 21, 2018

Spark Executor Spill Heuristic - (Depends on Custom SHS - Requires totalMemoryBytesSpilled metric) (#310)

skakker
authored and
akshayrai
committed
Spark Stages with Failed tasks Heuristic - (Depends on Custom SHS - Requires stages/failedTasks Rest API) (#288)

skakker
authored and
akshayrai
committed
Spark Peak jvm memory Heuristic - (Depends on Custom SHS - Requires peakJvmUsedMemory metric) (#318)

skakker
authored and
akshayrai
committed
Peak Unified Memory Heuristic - (Depends on Custom SHS - Requires peakUnifiedMemory metric) (#281)

skakker
authored and
akshayrai
committed
Fixed resources used/wasted computation for spark jobs - (Depends on Custom SHS - Requires peakJvmUsedMemory metric) (#287)

skakker
authored and
akshayrai
committed
Changing GC thresholds and calculation in spill heuristic (#319)

skakker
authored and
akshayrai
committed
Spark Heuristic Fixes for Dr. Elephant (#324)

skakker
authored and
akshayrai
committed
Removing blocking keyword so as to prevent a large number of threads being spawned (#362)

skakker
authored and
akshayrai
committed

Commits on Jul 11, 2018

Commits on Aug 9, 2018

Spark heuristic modification (#407)

ShubhamGupta29
authored and
pralabhkumar
committed

Commits on Sep 24, 2018

Total Duration changed to difference of executor add and remover time
Himani Jha
committed
Indent changes
Himani Jha
committed
Update SparkExecutorData.java
hjha1
authored