3.3.0-amzn-1

paxus_etl application UI

Details for Stage 63 (Attempt 0)

DAG Visualization
Show Additional Metrics
Event Timeline

Summary Metrics for 22 Completed Tasks

MetricMin25th percentileMedian75th percentileMax
Duration53 ms70 ms0.1 s0.2 s0.8 s
Scheduler Delay 3 ms4 ms5 ms5 ms37 ms
Task Deserialization Time 7 ms40 ms45 ms49 ms62 ms
GC Time 0 ms0 ms0 ms0 ms16 ms
Result Serialization Time 0 ms0 ms0 ms0 ms0 ms
Getting Result Time 0 ms0 ms0 ms0 ms0 ms
Peak Execution Memory 0.0 B0.0 B0.0 B0.0 B0.0 B
Shuffle Read Blocked Time 0 ms0 ms0 ms0 ms0 ms
Shuffle Read Size / Records 0.0 B / 0159.5 KB / 2764225.8 KB / 3948525.5 KB / 112535.0 MB / 237721
Shuffle Remote Reads 0.0 B154.2 KB202.9 KB518.1 KB4.9 MB
Shuffle Write Size / Records0.0 B / 0351.0 B / 2177.7 KB / 3428467.5 KB / 103755.0 MB / 237720

Aggregated Metrics by Executor

Executor ID Address Task Time Total Tasks Failed Tasks Killed Tasks Succeeded Tasks Shuffle Read Size / Records Shuffle Write Size / Records Blacklisted
1
 172.35.180.128:43367 0.1 s 1 0 0 1 154.3 KB / 3948 337.0 B / 2 false
10
 172.35.102.173:39557 0.2 s 1 0 0 1 638.2 KB / 14484 664.2 KB / 14483 false
13
 172.34.94.1:40477 90 ms 1 0 0 1 159.5 KB / 3377 166.7 KB / 3374 false
14
 172.35.55.72:35709 0.2 s 1 0 0 1 448.8 KB / 10376 467.5 KB / 10375 false
15
 172.36.245.141:43219 0.2 s 1 0 0 1 525.5 KB / 11253 552.6 KB / 11250 false
18
 172.35.86.57:44189 0.2 s 2 0 0 2 239.7 KB / 3365 1331.0 B / 13 false
19
 172.34.2.139:37587 0.2 s 1 0 0 1 202.9 KB / 4199 215.9 KB / 4191 false
21
 172.34.162.104:37523 0.2 s 1 0 0 1 977.5 KB / 26090 449.3 KB / 9678 false
23
 172.34.102.247:42387 0.1 s 1 0 0 1 0.0 B / 0 0.0 B / 0 false
29
 172.36.65.227:41261 0.3 s 1 0 0 1 1164.1 KB / 36333 1168.6 KB / 36332 false
30
 172.36.235.1:36611 0.2 s 1 0 0 1 173.4 KB / 3194 133.3 KB / 2653 false
32
 172.35.67.158:44261 0.2 s 2 0 0 2 828.0 KB / 16836 689.7 KB / 14451 false
33
 172.36.137.227:41941 0.1 s 1 0 0 1 204.1 KB / 2714 351.0 B / 2 false
42
 172.34.196.104:43675 0.8 s 1 0 0 1 5.0 MB / 237721 5.0 MB / 237720 false
46
 172.34.225.29:38447 0.1 s 1 0 0 1 249.2 KB / 0 0.0 B / 0 false
49
 172.36.30.153:40685 0.2 s 1 0 0 1 403.9 KB / 7755 369.7 KB / 7065 false
50
 172.35.85.79:46415 0.1 s 1 0 0 1 0.0 B / 0 0.0 B / 0 false
67
 172.35.32.230:44859 0.1 s 1 0 0 1 171.8 KB / 3431 177.7 KB / 3428 false
69
 172.36.112.205:44513 0.2 s 1 0 0 1 403.9 KB / 8153 426.8 KB / 8149 false
74
 172.36.106.85:39117 0.1 s 1 0 0 1 225.8 KB / 3910 162.1 KB / 3142 false

Tasks (22)

Index  ▴ ID Attempt Status Locality Level Executor ID Host Launch Time Duration Scheduler Delay Task Deserialization Time GC Time Result Serialization Time Getting Result Time Peak Execution Memory Shuffle Read Blocked Time Shuffle Read Size / Records Shuffle Remote Reads Write Time Shuffle Write Size / Records Errors
0 32099 0 SUCCESS PROCESS_LOCAL 32
172.35.67.158
 2023/05/03 17:03:58 76 ms 5 ms 49 ms 0 ms 0 ms 0.0 B 0 ms 151.9 KB / 2764 150.3 KB 100.0 KB / 1944
1 32100 0 SUCCESS PROCESS_LOCAL 14
172.35.55.72
 2023/05/03 17:03:58 0.2 s 5 ms 43 ms 0 ms 0 ms 0.0 B 0 ms 448.8 KB / 10376 443.9 KB 1 ms467.5 KB / 10375
2 32101 0 SUCCESS PROCESS_LOCAL 19
172.34.2.139
 2023/05/03 17:03:58 0.2 s 3 ms 38 ms 0 ms 0 ms 0.0 B 0 ms 202.9 KB / 4199 202.9 KB 215.9 KB / 4191
3 32102 0 SUCCESS PROCESS_LOCAL 18
172.35.86.57
 2023/05/03 17:03:58 79 ms 3 ms 40 ms 0 ms 0 ms 0.0 B 0 ms 37.9 KB / 0 0.0 B 0.0 B / 0
4 32103 0 SUCCESS PROCESS_LOCAL 30
172.36.235.1
 2023/05/03 17:03:58 0.1 s 5 ms 41 ms 0 ms 0 ms 0.0 B 0 ms 173.4 KB / 3194 167.1 KB 133.3 KB / 2653
5 32104 0 SUCCESS PROCESS_LOCAL 29
172.36.65.227
 2023/05/03 17:03:58 0.2 s 5 ms 62 ms 0 ms 0 ms 0.0 B 0 ms 1164.1 KB / 36333 1164.1 KB 1 ms1168.6 KB / 36332
6 32105 0 SUCCESS PROCESS_LOCAL 1
172.35.180.128
 2023/05/03 17:03:58 58 ms 5 ms 50 ms 0 ms 0 ms 0.0 B 0 ms 154.3 KB / 3948 154.3 KB 337.0 B / 2
7 32106 0 SUCCESS PROCESS_LOCAL 10
172.35.102.173
 2023/05/03 17:03:58 0.1 s 4 ms 49 ms 0 ms 0 ms 0.0 B 0 ms 638.2 KB / 14484 631.2 KB 1 ms664.2 KB / 14483
8 32107 0 SUCCESS PROCESS_LOCAL 15
172.36.245.141
 2023/05/03 17:03:58 0.2 s 5 ms 46 ms 16 ms 0 ms 0 ms 0.0 B 0 ms 525.5 KB / 11253 518.1 KB 2 ms552.6 KB / 11250
9 32108 0 SUCCESS PROCESS_LOCAL 18
172.35.86.57
 2023/05/03 17:03:58 66 ms 4 ms 7 ms 0 ms 0 ms 0.0 B 0 ms 201.8 KB / 3365 201.8 KB 1331.0 B / 13
10 32109 0 SUCCESS PROCESS_LOCAL 67
172.35.32.230
 2023/05/03 17:03:58 85 ms 4 ms 46 ms 0 ms 0 ms 0.0 B 0 ms 171.8 KB / 3431 168.4 KB 177.7 KB / 3428
11 32110 0 SUCCESS PROCESS_LOCAL 21
172.34.162.104
 2023/05/03 17:03:58 0.2 s 37 ms 48 ms 0 ms 0 ms 0.0 B 0 ms 977.5 KB / 26090 932.3 KB 1 ms449.3 KB / 9678
12 32111 0 SUCCESS PROCESS_LOCAL 49
172.36.30.153
 2023/05/03 17:03:58 0.1 s 4 ms 54 ms 0 ms 0 ms 0.0 B 0 ms 403.9 KB / 7755 399.8 KB 1 ms369.7 KB / 7065
13 32112 0 SUCCESS PROCESS_LOCAL 42
172.34.196.104
 2023/05/03 17:03:58 0.8 s 24 ms 20 ms 0 ms 0 ms 0.0 B 0 ms 5.0 MB / 237721 4.9 MB 4 ms5.0 MB / 237720
14 32113 0 SUCCESS PROCESS_LOCAL 69
172.36.112.205
 2023/05/03 17:03:58 0.1 s 4 ms 62 ms 0 ms 0 ms 0.0 B 0 ms 403.9 KB / 8153 395.2 KB 1 ms426.8 KB / 8149
15 32114 0 SUCCESS PROCESS_LOCAL 46
172.34.225.29
 2023/05/03 17:03:58 84 ms 12 ms 42 ms 0 ms 0 ms 0.0 B 0 ms 249.2 KB / 0 0.0 B 0.0 B / 0
16 32115 0 SUCCESS PROCESS_LOCAL 50
172.35.85.79
 2023/05/03 17:03:58 56 ms 18 ms 44 ms 0 ms 0 ms 0.0 B 0 ms 0.0 B / 0 0.0 B 0.0 B / 0
17 32116 0 SUCCESS PROCESS_LOCAL 33
172.36.137.227
 2023/05/03 17:03:58 70 ms 4 ms 51 ms 0 ms 0 ms 0.0 B 0 ms 204.1 KB / 2714 196.2 KB 351.0 B / 2
18 32117 0 SUCCESS PROCESS_LOCAL 23
172.34.102.247
 2023/05/03 17:03:58 53 ms 5 ms 45 ms 0 ms 0 ms 0.0 B 0 ms 0.0 B / 0 0.0 B 0.0 B / 0
19 32118 0 SUCCESS PROCESS_LOCAL 13
172.34.94.1
 2023/05/03 17:03:58 68 ms 4 ms 18 ms 0 ms 0 ms 0.0 B 0 ms 159.5 KB / 3377 154.2 KB 166.7 KB / 3374
20 32119 0 SUCCESS PROCESS_LOCAL 74
172.36.106.85
 2023/05/03 17:03:58 0.1 s 3 ms 41 ms 0 ms 0 ms 0.0 B 0 ms 225.8 KB / 3910 222.9 KB 162.1 KB / 3142
21 32120 0 SUCCESS PROCESS_LOCAL 32
172.35.67.158
 2023/05/03 17:03:58 86 ms 4 ms 9 ms 0 ms 0 ms 0.0 B 0 ms 676.1 KB / 14072 674.4 KB 2 ms589.8 KB / 12507