3.3.0-amzn-1

paxus_etl application UI

Details for Stage 506 (Attempt 0)

DAG Visualization
Show Additional Metrics
Event Timeline

Summary Metrics for 10 Completed Tasks

MetricMin25th percentileMedian75th percentileMax
Duration20 s21 s21 s22 s22 s
Scheduler Delay 6 ms7 ms7 ms8 ms9 ms
Task Deserialization Time 17 ms18 ms19 ms19 ms28 ms
GC Time 9 ms15 ms24 ms25 ms34 ms
Result Serialization Time 0 ms0 ms1 ms1 ms1 ms
Getting Result Time 0 ms0 ms0 ms0 ms0 ms
Peak Execution Memory 0.0 B0.0 B0.0 B0.0 B0.0 B
Output Size / Records23.0 MB / 693574223.0 MB / 693574523.1 MB / 693575827.9 MB / 693576227.9 MB / 6935775
Shuffle Read Blocked Time 0 ms0 ms0 ms0 ms0 ms
Shuffle Read Size / Records 179.0 MB / 6935742179.1 MB / 6935745179.1 MB / 6935758179.2 MB / 6935762179.2 MB / 6935775
Shuffle Remote Reads 176.5 MB176.8 MB176.9 MB177.2 MB177.5 MB

Aggregated Metrics by Executor

Executor ID Address Task Time Total Tasks Failed Tasks Killed Tasks Succeeded Tasks Output Size / Records Shuffle Read Size / Records Blacklisted
16
 172.36.34.187:36159 22 s 1 0 0 1 23.1 MB / 6935742 179.0 MB / 6935742 false
17
 172.35.201.106:41779 22 s 1 0 0 1 23.1 MB / 6935759 179.1 MB / 6935759 false
28
 172.36.44.196:35143 20 s 1 0 0 1 27.9 MB / 6935747 179.1 MB / 6935747 false
34
 172.36.86.13:43127 20 s 1 0 0 1 23.0 MB / 6935753 179.2 MB / 6935753 false
36
 172.34.204.55:37841 22 s 1 0 0 1 23.0 MB / 6935762 179.1 MB / 6935762 false
42
 172.34.196.104:43675 21 s 1 0 0 1 27.9 MB / 6935775 179.1 MB / 6935775 false
45
 172.34.155.50:45693 22 s 1 0 0 1 27.9 MB / 6935745 179.1 MB / 6935745 false
68
 172.35.191.142:35213 21 s 1 0 0 1 23.0 MB / 6935772 179.1 MB / 6935772 false
75
 172.36.81.40:44401 21 s 1 0 0 1 23.1 MB / 6935742 179.2 MB / 6935742 false
9
 172.34.190.70:38685 21 s 1 0 0 1 23.0 MB / 6935758 179.2 MB / 6935758 false

Tasks (10)

Index  ▴ ID Attempt Status Locality Level Executor ID Host Launch Time Duration Scheduler Delay Task Deserialization Time GC Time Result Serialization Time Getting Result Time Peak Execution Memory Output Size / Records Shuffle Read Blocked Time Shuffle Read Size / Records Shuffle Remote Reads Errors
0 103999 0 SUCCESS PROCESS_LOCAL 9
172.34.190.70
 2023/05/03 17:25:31 21 s 7 ms 19 ms 34 ms 0 ms 0 ms 0.0 B 23.0 MB / 6935758 0 ms 179.2 MB / 6935758 177.2 MB
1 104000 0 SUCCESS PROCESS_LOCAL 45
172.34.155.50
 2023/05/03 17:25:31 22 s 8 ms 19 ms 12 ms 1 ms 0 ms 0.0 B 27.9 MB / 6935745 0 ms 179.1 MB / 6935745 176.7 MB
2 104001 0 SUCCESS PROCESS_LOCAL 75
172.36.81.40
 2023/05/03 17:25:31 21 s 6 ms 28 ms 24 ms 1 ms 0 ms 0.0 B 23.1 MB / 6935742 0 ms 179.2 MB / 6935742 176.5 MB
3 104002 0 SUCCESS PROCESS_LOCAL 16
172.36.34.187
 2023/05/03 17:25:31 22 s 7 ms 18 ms 9 ms 1 ms 0 ms 0.0 B 23.1 MB / 6935742 0 ms 179.0 MB / 6935742 177.0 MB
4 104003 0 SUCCESS PROCESS_LOCAL 34
172.36.86.13
 2023/05/03 17:25:31 20 s 7 ms 19 ms 15 ms 1 ms 0 ms 0.0 B 23.0 MB / 6935753 0 ms 179.2 MB / 6935753 177.3 MB
5 104004 0 SUCCESS PROCESS_LOCAL 28
172.36.44.196
 2023/05/03 17:25:31 20 s 7 ms 18 ms 33 ms 0 ms 0 ms 0.0 B 27.9 MB / 6935747 0 ms 179.1 MB / 6935747 176.8 MB
6 104005 0 SUCCESS PROCESS_LOCAL 17
172.35.201.106
 2023/05/03 17:25:31 22 s 7 ms 17 ms 25 ms 0 ms 0 ms 0.0 B 23.1 MB / 6935759 0 ms 179.1 MB / 6935759 176.8 MB
7 104006 0 SUCCESS PROCESS_LOCAL 42
172.34.196.104
 2023/05/03 17:25:31 21 s 9 ms 18 ms 21 ms 0 ms 0 ms 0.0 B 27.9 MB / 6935775 0 ms 179.1 MB / 6935775 177.5 MB
8 104007 0 SUCCESS PROCESS_LOCAL 68
172.35.191.142
 2023/05/03 17:25:31 21 s 8 ms 17 ms 23 ms 0 ms 0 ms 0.0 B 23.0 MB / 6935772 0 ms 179.1 MB / 6935772 176.9 MB
9 104008 0 SUCCESS PROCESS_LOCAL 36
172.34.204.55
 2023/05/03 17:25:31 21 s 8 ms 19 ms 25 ms 1 ms 0 ms 0.0 B 23.0 MB / 6935762 0 ms 179.1 MB / 6935762 176.9 MB