3.3.0-amzn-1

paxus_etl application UI

Details for Stage 577 (Attempt 0)

DAG Visualization
Show Additional Metrics
Event Timeline

Summary Metrics for 50 Completed Tasks

MetricMin25th percentileMedian75th percentileMax
Duration3 s3 s4 s4 s5 s
Scheduler Delay 9 ms10 ms12 ms27 ms44 ms
Task Deserialization Time 30 ms32 ms34 ms36 ms57 ms
GC Time 0 ms0 ms0 ms0 ms39 ms
Result Serialization Time 0 ms0 ms0 ms1 ms1 ms
Getting Result Time 0 ms0 ms0 ms0 ms0 ms
Peak Execution Memory 0.0 B0.0 B0.0 B0.0 B0.0 B
Output Size / Records392.5 KB / 21045406.2 KB / 22510431.8 KB / 25360437.4 KB / 26092446.5 KB / 27289
Shuffle Read Blocked Time 0 ms1 ms16 ms25 ms55 ms
Shuffle Read Size / Records 5.5 MB / 431285.7 MB / 445426.5 MB / 511306.6 MB / 517006.9 MB / 54273
Shuffle Remote Reads 5.4 MB5.6 MB6.4 MB6.5 MB6.8 MB

Aggregated Metrics by Executor

Executor ID Address Task Time Total Tasks Failed Tasks Killed Tasks Succeeded Tasks Output Size / Records Shuffle Read Size / Records Blacklisted
1
 172.35.180.128:43367 3 s 1 0 0 1 431.9 KB / 25684 6.5 MB / 51391 false
10
 172.35.102.173:39557 4 s 1 0 0 1 433.0 KB / 25666 6.5 MB / 51290 false
11
 172.35.73.34:37153 4 s 1 0 0 1 406.5 KB / 22510 5.7 MB / 44782 false
12
 172.35.7.65:34993 4 s 1 0 0 1 433.6 KB / 26749 6.6 MB / 52374 false
13
 172.34.94.1:40477 4 s 1 0 0 1 401.8 KB / 22569 5.7 MB / 44837 false
15
 172.36.245.141:43219 4 s 1 0 0 1 441.0 KB / 26667 6.6 MB / 52304 false
18
 172.35.86.57:44189 3 s 1 0 0 1 439.9 KB / 26752 6.6 MB / 52426 false
19
 172.34.2.139:37587 4 s 1 0 0 1 431.2 KB / 25500 6.5 MB / 51099 false
20
 172.35.174.8:33783 4 s 1 0 0 1 435.7 KB / 26195 6.6 MB / 51999 false
21
 172.34.162.104:37523 3 s 1 0 0 1 429.4 KB / 25847 6.5 MB / 51280 false
22
 172.34.107.71:39147 4 s 1 0 0 1 440.2 KB / 26699 6.6 MB / 52382 false
24
 172.35.203.8:39801 5 s 1 0 0 1 442.9 KB / 27103 6.7 MB / 52986 false
26
 172.36.235.141:34279 4 s 1 0 0 1 440.0 KB / 26992 6.7 MB / 52770 false
27
 172.34.165.40:33701 4 s 1 0 0 1 434.4 KB / 25280 6.5 MB / 51054 false
3
 172.35.58.125:43297 4 s 1 0 0 1 404.8 KB / 21832 5.6 MB / 43864 false
30
 172.36.235.1:36611 4 s 1 0 0 1 436.5 KB / 25360 6.5 MB / 51152 false
33
 172.36.137.227:41941 4 s 1 0 0 1 439.0 KB / 26092 6.6 MB / 51690 false
34
 172.36.86.13:43127 4 s 1 0 0 1 402.0 KB / 22698 5.6 MB / 44464 false
35
 172.35.29.117:33321 4 s 1 0 0 1 409.7 KB / 22323 5.6 MB / 44332 false
36
 172.34.204.55:37841 4 s 1 0 0 1 439.2 KB / 25896 6.6 MB / 51590 false
38
 172.35.226.91:33967 3 s 1 0 0 1 400.8 KB / 21794 5.6 MB / 43839 false
40
 172.35.54.139:39117 4 s 1 0 0 1 403.1 KB / 21440 5.5 MB / 43440 false
42
 172.34.196.104:43675 4 s 1 0 0 1 410.3 KB / 22437 5.7 MB / 44542 false
44
 172.34.157.116:41019 3 s 1 0 0 1 398.2 KB / 22126 5.6 MB / 44074 false
45
 172.34.155.50:45693 4 s 1 0 0 1 424.6 KB / 25356 6.5 MB / 51130 false
46
 172.34.225.29:38447 3 s 1 0 0 1 397.7 KB / 21583 5.5 MB / 43522 false
49
 172.36.30.153:40685 4 s 1 0 0 1 437.4 KB / 27289 6.9 MB / 54273 false
5
 172.34.23.97:37071 4 s 1 0 0 1 432.8 KB / 25102 6.5 MB / 50887 false
50
 172.35.85.79:46415 4 s 1 0 0 1 430.5 KB / 25929 6.5 MB / 51512 false
52
 172.35.207.183:39881 4 s 1 0 0 1 426.9 KB / 25111 6.5 MB / 50958 false
53
 172.34.68.117:35467 5 s 1 0 0 1 396.4 KB / 21478 5.5 MB / 43467 false
54
 172.34.47.38:40403 3 s 1 0 0 1 397.5 KB / 21687 5.5 MB / 43353 false
55
 172.34.169.101:41737 4 s 1 0 0 1 392.5 KB / 21045 5.5 MB / 43128 false
58
 172.34.224.147:33331 4 s 1 0 0 1 442.8 KB / 26362 6.6 MB / 52204 false
59
 172.34.181.128:39043 4 s 1 0 0 1 399.9 KB / 22349 5.6 MB / 44424 false
61
 172.36.12.202:44709 4 s 1 0 0 1 431.0 KB / 24306 6.3 MB / 49937 false
62
 172.36.70.168:42481 4 s 1 0 0 1 433.3 KB / 25951 6.6 MB / 51700 false
63
 172.35.203.199:46073 4 s 1 0 0 1 439.3 KB / 25228 6.5 MB / 51116 false
64
 172.35.48.7:36951 4 s 1 0 0 1 429.3 KB / 25779 6.5 MB / 51580 false
65
 172.36.193.230:35367 4 s 1 0 0 1 436.0 KB / 25525 6.5 MB / 51588 false
68
 172.35.191.142:35213 4 s 1 0 0 1 446.5 KB / 26836 6.7 MB / 52552 false
70
 172.36.39.171:42213 4 s 1 0 0 1 431.8 KB / 26470 6.6 MB / 52297 false
71
 172.35.46.22:46653 3 s 1 0 0 1 406.2 KB / 22230 5.6 MB / 44459 false
72
 172.34.28.43:41949 4 s 1 0 0 1 417.5 KB / 22908 5.7 MB / 45235 false
73
 172.34.119.145:40771 4 s 1 0 0 1 438.9 KB / 24924 6.4 MB / 50422 false
74
 172.36.106.85:39117 4 s 1 0 0 1 433.0 KB / 26308 6.6 MB / 51933 false
75
 172.36.81.40:44401 4 s 1 0 0 1 432.0 KB / 25273 6.5 MB / 51026 false
77
 172.35.104.133:43995 3 s 1 0 0 1 401.5 KB / 23033 5.7 MB / 45022 false
79
 172.35.66.37:42779 3 s 1 0 0 1 427.1 KB / 25611 6.5 MB / 51370 false
8
 172.34.185.61:33589 4 s 1 0 0 1 438.8 KB / 25707 6.5 MB / 51442 false

Tasks (50)

Index  ▴ ID Attempt Status Locality Level Executor ID Host Launch Time Duration Scheduler Delay Task Deserialization Time GC Time Result Serialization Time Getting Result Time Peak Execution Memory Output Size / Records Shuffle Read Blocked Time Shuffle Read Size / Records Shuffle Remote Reads Errors
0 111733 0 SUCCESS PROCESS_LOCAL 53
172.34.68.117
 2023/05/03 17:26:46 5 s 38 ms 36 ms 33 ms 1 ms 0 ms 0.0 B 396.4 KB / 21478 13 ms 5.5 MB / 43467 5.5 MB
1 111734 0 SUCCESS PROCESS_LOCAL 27
172.34.165.40
 2023/05/03 17:26:46 4 s 15 ms 34 ms 1 ms 0 ms 0.0 B 434.4 KB / 25280 19 ms 6.5 MB / 51054 6.4 MB
2 111735 0 SUCCESS PROCESS_LOCAL 71
172.35.46.22
 2023/05/03 17:26:46 3 s 40 ms 32 ms 0 ms 0 ms 0.0 B 406.2 KB / 22230 0 ms 5.6 MB / 44459 5.6 MB
3 111736 0 SUCCESS PROCESS_LOCAL 18
172.35.86.57
 2023/05/03 17:26:46 3 s 14 ms 33 ms 1 ms 0 ms 0.0 B 439.9 KB / 26752 7 ms 6.6 MB / 52426 6.5 MB
4 111737 0 SUCCESS PROCESS_LOCAL 5
172.34.23.97
 2023/05/03 17:26:46 4 s 14 ms 35 ms 0 ms 0 ms 0.0 B 432.8 KB / 25102 24 ms 6.5 MB / 50887 6.4 MB
5 111738 0 SUCCESS PROCESS_LOCAL 72
172.34.28.43
 2023/05/03 17:26:46 4 s 15 ms 40 ms 0 ms 0 ms 0.0 B 417.5 KB / 22908 38 ms 5.7 MB / 45235 5.7 MB
6 111739 0 SUCCESS PROCESS_LOCAL 36
172.34.204.55
 2023/05/03 17:26:46 4 s 35 ms 32 ms 0 ms 0 ms 0.0 B 439.2 KB / 25896 22 ms 6.6 MB / 51590 6.5 MB
7 111740 0 SUCCESS PROCESS_LOCAL 12
172.35.7.65
 2023/05/03 17:26:46 4 s 13 ms 30 ms 0 ms 0 ms 0.0 B 433.6 KB / 26749 14 ms 6.6 MB / 52374 6.6 MB
8 111741 0 SUCCESS PROCESS_LOCAL 59
172.34.181.128
 2023/05/03 17:26:46 4 s 27 ms 57 ms 17 ms 1 ms 0 ms 0.0 B 399.9 KB / 22349 17 ms 5.6 MB / 44424 5.5 MB
9 111742 0 SUCCESS PROCESS_LOCAL 33
172.36.137.227
 2023/05/03 17:26:46 4 s 14 ms 37 ms 0 ms 0 ms 0.0 B 439.0 KB / 26092 4 ms 6.6 MB / 51690 6.5 MB
10 111743 0 SUCCESS PROCESS_LOCAL 68
172.35.191.142
 2023/05/03 17:26:46 4 s 13 ms 31 ms 0 ms 0 ms 0.0 B 446.5 KB / 26836 5 ms 6.7 MB / 52552 6.6 MB
11 111744 0 SUCCESS PROCESS_LOCAL 46
172.34.225.29
 2023/05/03 17:26:46 3 s 14 ms 33 ms 0 ms 0 ms 0.0 B 397.7 KB / 21583 0 ms 5.5 MB / 43522 5.5 MB
12 111745 0 SUCCESS PROCESS_LOCAL 63
172.35.203.199
 2023/05/03 17:26:46 4 s 12 ms 33 ms 1 ms 0 ms 0.0 B 439.3 KB / 25228 44 ms 6.5 MB / 51116 6.4 MB
13 111746 0 SUCCESS PROCESS_LOCAL 30
172.36.235.1
 2023/05/03 17:26:46 3 s 33 ms 30 ms 1 ms 0 ms 0.0 B 436.5 KB / 25360 23 ms 6.5 MB / 51152 6.4 MB
14 111747 0 SUCCESS PROCESS_LOCAL 55
172.34.169.101
 2023/05/03 17:26:46 3 s 14 ms 37 ms 1 ms 0 ms 0.0 B 392.5 KB / 21045 0 ms 5.5 MB / 43128 5.4 MB
15 111748 0 SUCCESS PROCESS_LOCAL 24
172.35.203.8
 2023/05/03 17:26:46 5 s 13 ms 39 ms 25 ms 0 ms 0 ms 0.0 B 442.9 KB / 27103 20 ms 6.7 MB / 52986 6.6 MB
16 111749 0 SUCCESS PROCESS_LOCAL 65
172.36.193.230
 2023/05/03 17:26:46 4 s 39 ms 31 ms 0 ms 0 ms 0.0 B 436.0 KB / 25525 31 ms 6.5 MB / 51588 6.4 MB
17 111750 0 SUCCESS PROCESS_LOCAL 77
172.35.104.133
 2023/05/03 17:26:46 3 s 44 ms 35 ms 0 ms 0 ms 0.0 B 401.5 KB / 23033 35 ms 5.7 MB / 45022 5.6 MB
18 111751 0 SUCCESS PROCESS_LOCAL 79
172.35.66.37
 2023/05/03 17:26:46 3 s 11 ms 37 ms 0 ms 0 ms 0.0 B 427.1 KB / 25611 16 ms 6.5 MB / 51370 6.4 MB
19 111752 0 SUCCESS PROCESS_LOCAL 1
172.35.180.128
 2023/05/03 17:26:46 3 s 11 ms 32 ms 1 ms 0 ms 0.0 B 431.9 KB / 25684 1 ms 6.5 MB / 51391 6.5 MB
20 111753 0 SUCCESS PROCESS_LOCAL 44
172.34.157.116
 2023/05/03 17:26:46 3 s 12 ms 34 ms 0 ms 0 ms 0.0 B 398.2 KB / 22126 1 ms 5.6 MB / 44074 5.5 MB
21 111754 0 SUCCESS PROCESS_LOCAL 8
172.34.185.61
 2023/05/03 17:26:46 4 s 39 ms 33 ms 0 ms 0 ms 0.0 B 438.8 KB / 25707 17 ms 6.5 MB / 51442 6.5 MB
22 111755 0 SUCCESS PROCESS_LOCAL 74
172.36.106.85
 2023/05/03 17:26:46 4 s 13 ms 31 ms 21 ms 0 ms 0 ms 0.0 B 433.0 KB / 26308 46 ms 6.6 MB / 51933 6.5 MB
23 111756 0 SUCCESS PROCESS_LOCAL 11
172.35.73.34
 2023/05/03 17:26:46 4 s 12 ms 31 ms 1 ms 0 ms 0.0 B 406.5 KB / 22510 2 ms 5.7 MB / 44782 5.6 MB
24 111757 0 SUCCESS PROCESS_LOCAL 64
172.35.48.7
 2023/05/03 17:26:46 4 s 36 ms 30 ms 0 ms 0 ms 0.0 B 429.3 KB / 25779 25 ms 6.5 MB / 51580 6.4 MB
25 111758 0 SUCCESS PROCESS_LOCAL 50
172.35.85.79
 2023/05/03 17:26:46 4 s 11 ms 31 ms 0 ms 0 ms 0.0 B 430.5 KB / 25929 26 ms 6.5 MB / 51512 6.4 MB
26 111759 0 SUCCESS PROCESS_LOCAL 38
172.35.226.91
 2023/05/03 17:26:46 3 s 11 ms 39 ms 1 ms 0 ms 0.0 B 400.8 KB / 21794 0 ms 5.6 MB / 43839 5.5 MB
27 111760 0 SUCCESS PROCESS_LOCAL 61
172.36.12.202
 2023/05/03 17:26:46 4 s 11 ms 32 ms 1 ms 0 ms 0.0 B 431.0 KB / 24306 49 ms 6.3 MB / 49937 6.3 MB
28 111761 0 SUCCESS PROCESS_LOCAL 22
172.34.107.71
 2023/05/03 17:26:46 4 s 11 ms 34 ms 1 ms 0 ms 0.0 B 440.2 KB / 26699 2 ms 6.6 MB / 52382 6.6 MB
29 111762 0 SUCCESS PROCESS_LOCAL 13
172.34.94.1
 2023/05/03 17:26:46 4 s 38 ms 38 ms 0 ms 0 ms 0.0 B 401.8 KB / 22569 0 ms 5.7 MB / 44837 5.6 MB
30 111763 0 SUCCESS PROCESS_LOCAL 73
172.34.119.145
 2023/05/03 17:26:46 4 s 11 ms 38 ms 1 ms 0 ms 0.0 B 438.9 KB / 24924 21 ms 6.4 MB / 50422 6.3 MB
31 111764 0 SUCCESS PROCESS_LOCAL 70
172.36.39.171
 2023/05/03 17:26:46 3 s 37 ms 35 ms 1 ms 0 ms 0.0 B 431.8 KB / 26470 37 ms 6.6 MB / 52297 6.5 MB
32 111765 0 SUCCESS PROCESS_LOCAL 3
172.35.58.125
 2023/05/03 17:26:46 4 s 11 ms 33 ms 1 ms 0 ms 0.0 B 404.8 KB / 21832 0 ms 5.6 MB / 43864 5.5 MB
33 111766 0 SUCCESS PROCESS_LOCAL 20
172.35.174.8
 2023/05/03 17:26:46 4 s 10 ms 31 ms 0 ms 0 ms 0.0 B 435.7 KB / 26195 34 ms 6.6 MB / 51999 6.5 MB
34 111767 0 SUCCESS PROCESS_LOCAL 58
172.34.224.147
 2023/05/03 17:26:46 4 s 10 ms 35 ms 1 ms 0 ms 0.0 B 442.8 KB / 26362 28 ms 6.6 MB / 52204 6.5 MB
35 111768 0 SUCCESS PROCESS_LOCAL 40
172.35.54.139
 2023/05/03 17:26:46 4 s 10 ms 35 ms 0 ms 0 ms 0.0 B 403.1 KB / 21440 12 ms 5.5 MB / 43440 5.5 MB
36 111769 0 SUCCESS PROCESS_LOCAL 26
172.36.235.141
 2023/05/03 17:26:46 4 s 31 ms 38 ms 39 ms 1 ms 0 ms 0.0 B 440.0 KB / 26992 0 ms 6.7 MB / 52770 6.6 MB
37 111770 0 SUCCESS PROCESS_LOCAL 75
172.36.81.40
 2023/05/03 17:26:46 3 s 10 ms 30 ms 24 ms 0 ms 0 ms 0.0 B 432.0 KB / 25273 7 ms 6.5 MB / 51026 6.4 MB
38 111771 0 SUCCESS PROCESS_LOCAL 42
172.34.196.104
 2023/05/03 17:26:46 4 s 10 ms 35 ms 0 ms 0 ms 0.0 B 410.3 KB / 22437 0 ms 5.7 MB / 44542 5.6 MB
39 111772 0 SUCCESS PROCESS_LOCAL 52
172.35.207.183
 2023/05/03 17:26:46 4 s 9 ms 31 ms 1 ms 0 ms 0.0 B 426.9 KB / 25111 25 ms 6.5 MB / 50958 6.4 MB
40 111773 0 SUCCESS PROCESS_LOCAL 45
172.34.155.50
 2023/05/03 17:26:46 4 s 10 ms 51 ms 0 ms 0 ms 0.0 B 424.6 KB / 25356 24 ms 6.5 MB / 51130 6.4 MB
41 111774 0 SUCCESS PROCESS_LOCAL 35
172.35.29.117
 2023/05/03 17:26:46 4 s 9 ms 35 ms 0 ms 0 ms 0.0 B 409.7 KB / 22323 3 ms 5.6 MB / 44332 5.6 MB
42 111775 0 SUCCESS PROCESS_LOCAL 15
172.36.245.141
 2023/05/03 17:26:46 4 s 10 ms 36 ms 1 ms 0 ms 0.0 B 441.0 KB / 26667 25 ms 6.6 MB / 52304 6.6 MB
43 111776 0 SUCCESS PROCESS_LOCAL 62
172.36.70.168
 2023/05/03 17:26:46 4 s 10 ms 34 ms 1 ms 0 ms 0.0 B 433.3 KB / 25951 15 ms 6.6 MB / 51700 6.5 MB
44 111777 0 SUCCESS PROCESS_LOCAL 54
172.34.47.38
 2023/05/03 17:26:46 3 s 10 ms 39 ms 0 ms 0 ms 0.0 B 397.5 KB / 21687 14 ms 5.5 MB / 43353 5.4 MB
45 111778 0 SUCCESS PROCESS_LOCAL 19
172.34.2.139
 2023/05/03 17:26:46 4 s 10 ms 33 ms 28 ms 0 ms 0 ms 0.0 B 431.2 KB / 25500 0 ms 6.5 MB / 51099 6.4 MB
46 111779 0 SUCCESS PROCESS_LOCAL 10
172.35.102.173
 2023/05/03 17:26:46 3 s 9 ms 32 ms 0 ms 0 ms 0.0 B 433.0 KB / 25666 0 ms 6.5 MB / 51290 6.4 MB
47 111780 0 SUCCESS PROCESS_LOCAL 34
172.36.86.13
 2023/05/03 17:26:46 4 s 10 ms 35 ms 0 ms 0 ms 0.0 B 402.0 KB / 22698 0 ms 5.6 MB / 44464 5.6 MB
48 111781 0 SUCCESS PROCESS_LOCAL 21
172.34.162.104
 2023/05/03 17:26:46 3 s 35 ms 35 ms 0 ms 0 ms 0.0 B 429.4 KB / 25847 55 ms 6.5 MB / 51280 6.4 MB
49 111782 0 SUCCESS PROCESS_LOCAL 49
172.36.30.153
 2023/05/03 17:26:46 4 s 11 ms 31 ms 0 ms 0 ms 0.0 B 437.4 KB / 27289 27 ms 6.9 MB / 54273 6.8 MB