3.3.0-amzn-1

paxus_etl application UI

Details for Stage 247 (Attempt 0)

DAG Visualization
Show Additional Metrics
Event Timeline

Summary Metrics for 28 Completed Tasks

MetricMin25th percentileMedian75th percentileMax
Duration0.7 s0.9 s1.0 s1 s3 s
Scheduler Delay 3 ms4 ms5 ms5 ms14 ms
Task Deserialization Time 3 ms9 ms10 ms11 ms30 ms
GC Time 0 ms0 ms0 ms0 ms12 ms
Result Serialization Time 0 ms0 ms0 ms0 ms0 ms
Getting Result Time 0 ms0 ms0 ms0 ms0 ms
Peak Execution Memory 0.0 B0.0 B0.0 B0.0 B0.0 B
Shuffle Read Blocked Time 0.6 s0.8 s0.8 s1 s3 s
Shuffle Read Size / Records 535.4 KB / 6587547.9 KB / 6630557.5 KB / 6659565.7 KB / 6723692.7 KB / 8117
Shuffle Remote Reads 525.7 KB537.6 KB546.5 KB559.6 KB682.1 KB
Shuffle Write Size / Records12.6 KB / 7015.4 KB / 8417.2 KB / 9418.2 KB / 10023.3 KB / 128

Aggregated Metrics by Executor

Executor ID Address Task Time Total Tasks Failed Tasks Killed Tasks Succeeded Tasks Shuffle Read Size / Records Shuffle Write Size / Records Blacklisted
10
 172.35.102.173:39557 1 s 2 0 0 2 1127.2 KB / 13372 35.4 KB / 193 false
11
 172.35.73.34:37153 1 s 1 0 0 1 560.9 KB / 6736 16.3 KB / 89 false
15
 172.36.245.141:43219 1 s 1 0 0 1 544.9 KB / 6606 23.3 KB / 128 false
16
 172.36.34.187:36159 0.7 s 1 0 0 1 562.7 KB / 6648 13.7 KB / 75 false
18
 172.35.86.57:44189 1 s 1 0 0 1 557.5 KB / 6594 19.8 KB / 110 false
19
 172.34.2.139:37587 2 s 2 0 0 2 1101.9 KB / 13254 31.2 KB / 172 false
20
 172.35.174.8:33783 0.8 s 1 0 0 1 553.1 KB / 6631 15.2 KB / 83 false
23
 172.34.102.247:42387 3 s 3 0 0 3 1687.4 KB / 20097 54.7 KB / 301 false
24
 172.35.203.8:39801 2 s 2 0 0 2 1093.8 KB / 13300 35.8 KB / 195 false
31
 172.34.158.18:33121 1 s 1 0 0 1 563.1 KB / 6626 17.7 KB / 98 false
34
 172.36.86.13:43127 1.0 s 1 0 0 1 547.0 KB / 6661 17.3 KB / 95 false
38
 172.35.226.91:33967 1 s 1 0 0 1 538.7 KB / 6587 13.0 KB / 70 false
39
 172.34.231.250:37863 1 s 1 0 0 1 548.9 KB / 6670 12.6 KB / 70 false
42
 172.34.196.104:43675 2 s 2 0 0 2 1114.3 KB / 13321 32.2 KB / 177 false
47
 172.35.188.77:34369 1 s 1 0 0 1 692.7 KB / 8117 18.6 KB / 102 false
55
 172.34.169.101:41737 2 s 1 0 0 1 571.7 KB / 6735 15.7 KB / 85 false
6
 172.36.166.74:39225 3 s 1 0 0 1 565.7 KB / 6735 17.7 KB / 98 false
63
 172.35.203.199:46073 0.8 s 1 0 0 1 559.5 KB / 6620 18.9 KB / 103 false
66
 172.34.157.6:46227 1.0 s 1 0 0 1 567.4 KB / 6723 14.2 KB / 79 false
69
 172.36.112.205:44513 1 s 1 0 0 1 535.4 KB / 6649 16.9 KB / 94 false
71
 172.35.46.22:46653 1 s 1 0 0 1 554.1 KB / 6741 14.2 KB / 79 false
76
 172.34.157.254:37391 2 s 1 0 0 1 547.9 KB / 6636 15.4 KB / 84 false

Tasks (28)

Index  ▴ ID Attempt Status Locality Level Executor ID Host Launch Time Duration Scheduler Delay Task Deserialization Time GC Time Result Serialization Time Getting Result Time Peak Execution Memory Shuffle Read Blocked Time Shuffle Read Size / Records Shuffle Remote Reads Write Time Shuffle Write Size / Records Errors
0 86385 0 SUCCESS PROCESS_LOCAL 34
172.36.86.13
 2023/05/03 17:14:54 1.0 s 3 ms 9 ms 0 ms 0 ms 0.0 B 0.8 s 547.0 KB / 6661 537.6 KB 17.3 KB / 95
1 86386 0 SUCCESS PROCESS_LOCAL 23
172.34.102.247
 2023/05/03 17:14:54 0.9 s 5 ms 11 ms 0 ms 0 ms 0.0 B 0.8 s 570.2 KB / 6651 565.8 KB 18.2 KB / 100
2 86387 0 SUCCESS PROCESS_LOCAL 55
172.34.169.101
 2023/05/03 17:14:54 2 s 5 ms 9 ms 10 ms 0 ms 0 ms 0.0 B 2 s 571.7 KB / 6735 546.5 KB 15.7 KB / 85
3 86388 0 SUCCESS PROCESS_LOCAL 42
172.34.196.104
 2023/05/03 17:14:54 0.8 s 6 ms 21 ms 0 ms 0 ms 0.0 B 0.7 s 553.1 KB / 6612 550.6 KB 15.4 KB / 84
4 86389 0 SUCCESS PROCESS_LOCAL 38
172.35.226.91
 2023/05/03 17:14:54 1 s 4 ms 10 ms 0 ms 0 ms 0.0 B 1 s 538.7 KB / 6587 529.2 KB 13.0 KB / 70
5 86390 0 SUCCESS PROCESS_LOCAL 19
172.34.2.139
 2023/05/03 17:14:54 1 s 5 ms 10 ms 0 ms 0 ms 0.0 B 1.0 s 546.5 KB / 6634 528.7 KB 14.3 KB / 80
6 86391 0 SUCCESS PROCESS_LOCAL 20
172.35.174.8
 2023/05/03 17:14:54 0.7 s 4 ms 15 ms 0 ms 0 ms 0.0 B 0.6 s 553.1 KB / 6631 545.7 KB 15.2 KB / 83
7 86392 0 SUCCESS PROCESS_LOCAL 18
172.35.86.57
 2023/05/03 17:14:54 1 s 3 ms 9 ms 0 ms 0 ms 0.0 B 1 s 557.5 KB / 6594 531.5 KB 19.8 KB / 110
8 86393 0 SUCCESS PROCESS_LOCAL 24
172.35.203.8
 2023/05/03 17:14:54 1.0 s 5 ms 12 ms 0 ms 0 ms 0.0 B 0.8 s 547.1 KB / 6630 546.0 KB 17.5 KB / 95
9 86394 0 SUCCESS PROCESS_LOCAL 39
172.34.231.250
 2023/05/03 17:14:54 1 s 4 ms 10 ms 0 ms 0 ms 0.0 B 1 s 548.9 KB / 6670 536.2 KB 12.6 KB / 70
10 86395 0 SUCCESS PROCESS_LOCAL 69
172.36.112.205
 2023/05/03 17:14:54 1 s 5 ms 11 ms 12 ms 0 ms 0 ms 0.0 B 0.9 s 535.4 KB / 6649 525.7 KB 16.9 KB / 94
11 86396 0 SUCCESS PROCESS_LOCAL 42
172.34.196.104
 2023/05/03 17:14:54 0.8 s 5 ms 5 ms 0 ms 0 ms 0.0 B 0.7 s 561.3 KB / 6709 558.6 KB 16.8 KB / 93
12 86397 0 SUCCESS PROCESS_LOCAL 66
172.34.157.6
 2023/05/03 17:14:54 1.0 s 5 ms 11 ms 12 ms 0 ms 0 ms 0.0 B 0.8 s 567.4 KB / 6723 551.6 KB 14.2 KB / 79
13 86398 0 SUCCESS PROCESS_LOCAL 19
172.34.2.139
 2023/05/03 17:14:54 1 s 5 ms 3 ms 0 ms 0 ms 0.0 B 1.0 s 555.4 KB / 6620 537.4 KB 16.9 KB / 92
14 86399 0 SUCCESS PROCESS_LOCAL 23
172.34.102.247
 2023/05/03 17:14:54 0.9 s 10 ms 4 ms 0 ms 0 ms 0.0 B 0.8 s 549.8 KB / 6659 544.1 KB 17.3 KB / 95
15 86400 0 SUCCESS PROCESS_LOCAL 16
172.36.34.187
 2023/05/03 17:14:54 0.7 s 5 ms 11 ms 0 ms 0 ms 0.0 B 0.6 s 562.7 KB / 6648 562.7 KB 13.7 KB / 75
16 86401 0 SUCCESS PROCESS_LOCAL 15
172.36.245.141
 2023/05/03 17:14:54 1 s 4 ms 30 ms 0 ms 0 ms 0.0 B 0.9 s 544.9 KB / 6606 535.8 KB 23.3 KB / 128
17 86402 0 SUCCESS PROCESS_LOCAL 71
172.35.46.22
 2023/05/03 17:14:54 1 s 14 ms 8 ms 10 ms 0 ms 0 ms 0.0 B 0.8 s 554.1 KB / 6741 541.7 KB 14.2 KB / 79
18 86403 0 SUCCESS PROCESS_LOCAL 76
172.34.157.254
 2023/05/03 17:14:54 2 s 6 ms 9 ms 10 ms 0 ms 0 ms 0.0 B 2 s 547.9 KB / 6636 543.9 KB 15.4 KB / 84
19 86404 0 SUCCESS PROCESS_LOCAL 10
172.35.102.173
 2023/05/03 17:14:54 0.7 s 4 ms 11 ms 0 ms 0 ms 0.0 B 0.6 s 567.3 KB / 6685 559.6 KB 18.2 KB / 100
20 86405 0 SUCCESS PROCESS_LOCAL 23
172.34.102.247
 2023/05/03 17:14:54 0.9 s 7 ms 4 ms 0 ms 0 ms 0.0 B 0.8 s 567.4 KB / 6787 563.1 KB 19.1 KB / 106
21 86406 0 SUCCESS PROCESS_LOCAL 10
172.35.102.173
 2023/05/03 17:14:54 0.7 s 3 ms 4 ms 0 ms 0 ms 0.0 B 0.6 s 559.9 KB / 6687 551.0 KB 17.2 KB / 93
22 86407 0 SUCCESS PROCESS_LOCAL 11
172.35.73.34
 2023/05/03 17:14:54 1 s 4 ms 10 ms 0 ms 0 ms 0.0 B 1 s 560.9 KB / 6736 554.2 KB 16.3 KB / 89
23 86408 0 SUCCESS PROCESS_LOCAL 24
172.35.203.8
 2023/05/03 17:14:54 0.9 s 4 ms 7 ms 0 ms 0 ms 0.0 B 0.8 s 546.7 KB / 6670 545.9 KB 18.3 KB / 100
24 86409 0 SUCCESS PROCESS_LOCAL 31
172.34.158.18
 2023/05/03 17:14:54 1.0 s 12 ms 16 ms 0 ms 0 ms 0.0 B 0.8 s 563.1 KB / 6626 561.7 KB 17.7 KB / 98
25 86410 0 SUCCESS PROCESS_LOCAL 63
172.35.203.199
 2023/05/03 17:14:54 0.8 s 4 ms 12 ms 0 ms 0 ms 0.0 B 0.6 s 559.5 KB / 6620 559.2 KB 18.9 KB / 103
26 86411 0 SUCCESS PROCESS_LOCAL 6
172.36.166.74
 2023/05/03 17:14:54 3 s 4 ms 11 ms 11 ms 0 ms 0 ms 0.0 B 3 s 565.7 KB / 6735 565.7 KB 17.7 KB / 98
27 86412 0 SUCCESS PROCESS_LOCAL 47
172.35.188.77
 2023/05/03 17:14:54 1 s 5 ms 10 ms 0 ms 0 ms 0.0 B 0.9 s 692.7 KB / 8117 682.1 KB 18.6 KB / 102