3.3.0-amzn-1

paxus_etl application UI

Details for Stage 1062 (Attempt 0)

DAG Visualization
Show Additional Metrics
Event Timeline

Summary Metrics for 50 Completed Tasks

MetricMin25th percentileMedian75th percentileMax
Duration3 s4 s4 s4 s5 s
Scheduler Delay 15 ms0.3 s0.6 s0.7 s1 s
Task Deserialization Time 56 ms77 ms0.7 s0.8 s0.8 s
GC Time 0 ms0 ms0 ms0 ms32 ms
Result Serialization Time 0 ms0 ms0 ms0 ms1 ms
Getting Result Time 0 ms0 ms0 ms0 ms0 ms
Peak Execution Memory 0.0 B0.0 B0.0 B0.0 B0.0 B
Output Size / Records349.3 KB / 4362359.3 KB / 4495366.0 KB / 4535476.7 KB / 8931538.7 KB / 12201
Shuffle Read Blocked Time 0 ms0 ms0 ms0 ms0 ms
Shuffle Read Size / Records 932.7 KB / 4362968.0 KB / 4495977.9 KB / 45351923.9 KB / 89312.6 MB / 12201
Shuffle Remote Reads 923.6 KB954.9 KB966.2 KB1902.7 KB2.6 MB

Aggregated Metrics by Executor

Executor ID Address Task Time Total Tasks Failed Tasks Killed Tasks Succeeded Tasks Output Size / Records Shuffle Read Size / Records Blacklisted
10
 172.35.102.173:39557 5 s 1 0 0 1 363.0 KB / 4456 963.2 KB / 4456 false
14
 172.35.55.72:35709 5 s 1 0 0 1 485.0 KB / 9115 1965.2 KB / 9115 false
15
 172.36.245.141:43219 5 s 1 0 0 1 362.9 KB / 4375 944.7 KB / 4375 false
16
 172.36.34.187:36159 5 s 1 0 0 1 358.7 KB / 4502 973.2 KB / 4502 false
21
 172.34.162.104:37523 5 s 1 0 0 1 476.7 KB / 8976 1930.1 KB / 8976 false
23
 172.34.102.247:42387 5 s 1 0 0 1 365.4 KB / 4497 975.2 KB / 4497 false
24
 172.35.203.8:39801 5 s 1 0 0 1 360.0 KB / 4423 960.5 KB / 4423 false
26
 172.36.235.141:34279 5 s 1 0 0 1 356.2 KB / 4528 976.2 KB / 4528 false
27
 172.34.165.40:33701 5 s 1 0 0 1 485.4 KB / 8931 1921.5 KB / 8931 false
28
 172.36.44.196:35143 5 s 1 0 0 1 471.5 KB / 8910 1923.9 KB / 8910 false
29
 172.36.65.227:41261 5 s 1 0 0 1 352.8 KB / 4454 958.6 KB / 4454 false
31
 172.34.158.18:33121 5 s 1 0 0 1 353.3 KB / 4531 977.9 KB / 4531 false
32
 172.35.67.158:44261 5 s 1 0 0 1 358.4 KB / 4480 964.2 KB / 4480 false
34
 172.36.86.13:43127 5 s 1 0 0 1 355.6 KB / 4521 971.9 KB / 4521 false
36
 172.34.204.55:37841 5 s 1 0 0 1 477.0 KB / 8949 1927.5 KB / 8949 false
38
 172.35.226.91:33967 5 s 1 0 0 1 357.9 KB / 4535 972.8 KB / 4535 false
39
 172.34.231.250:37863 5 s 1 0 0 1 479.5 KB / 8983 1936.2 KB / 8983 false
40
 172.35.54.139:39117 5 s 1 0 0 1 360.7 KB / 4500 970.1 KB / 4500 false
41
 172.34.202.43:41159 5 s 1 0 0 1 360.5 KB / 4455 958.8 KB / 4455 false
44
 172.34.157.116:41019 5 s 1 0 0 1 353.4 KB / 4362 932.7 KB / 4362 false
45
 172.34.155.50:45693 5 s 1 0 0 1 366.5 KB / 4607 987.9 KB / 4607 false
46
 172.34.225.29:38447 5 s 1 0 0 1 349.3 KB / 4395 944.3 KB / 4395 false
47
 172.35.188.77:34369 5 s 1 0 0 1 471.6 KB / 9098 1955.1 KB / 9098 false
48
 172.36.38.76:46429 5 s 1 0 0 1 365.0 KB / 4542 987.6 KB / 4542 false
49
 172.36.30.153:40685 5 s 1 0 0 1 357.3 KB / 4460 958.2 KB / 4460 false
5
 172.34.23.97:37071 5 s 1 0 0 1 482.0 KB / 9161 1968.4 KB / 9161 false
50
 172.35.85.79:46415 5 s 1 0 0 1 482.2 KB / 8879 1913.1 KB / 8879 false
51
 172.34.210.117:41447 5 s 1 0 0 1 365.3 KB / 4508 968.0 KB / 4508 false
52
 172.35.207.183:39881 5 s 1 0 0 1 356.6 KB / 4475 961.0 KB / 4475 false
53
 172.34.68.117:35467 5 s 1 0 0 1 480.9 KB / 9136 1960.3 KB / 9136 false
55
 172.34.169.101:41737 5 s 1 0 0 1 366.1 KB / 4552 983.9 KB / 4552 false
56
 172.34.43.241:39725 5 s 1 0 0 1 366.3 KB / 4642 995.3 KB / 4642 false
57
 172.35.18.176:41109 5 s 1 0 0 1 362.5 KB / 4515 975.3 KB / 4515 false
58
 172.34.224.147:33331 5 s 1 0 0 1 366.6 KB / 4667 998.2 KB / 4667 false
6
 172.36.166.74:39225 5 s 1 0 0 1 359.9 KB / 4464 964.0 KB / 4464 false
60
 172.36.40.168:38319 5 s 1 0 0 1 486.7 KB / 9116 1969.6 KB / 9116 false
61
 172.36.12.202:44709 5 s 1 0 0 1 355.0 KB / 4564 986.9 KB / 4564 false
63
 172.35.203.199:46073 5 s 1 0 0 1 484.1 KB / 8912 1922.2 KB / 8912 false
64
 172.35.48.7:36951 5 s 1 0 0 1 368.5 KB / 4495 969.2 KB / 4495 false
65
 172.36.193.230:35367 5 s 1 0 0 1 366.0 KB / 4626 989.3 KB / 4626 false
66
 172.34.157.6:46227 5 s 1 0 0 1 368.7 KB / 4522 977.6 KB / 4522 false
67
 172.35.32.230:44859 5 s 1 0 0 1 371.9 KB / 4513 970.3 KB / 4513 false
69
 172.36.112.205:44513 5 s 1 0 0 1 364.8 KB / 4478 963.8 KB / 4478 false
70
 172.36.39.171:42213 5 s 1 0 0 1 359.3 KB / 4514 975.0 KB / 4514 false
74
 172.36.106.85:39117 5 s 1 0 0 1 369.6 KB / 4564 978.8 KB / 4564 false
76
 172.34.157.254:37391 5 s 1 0 0 1 366.0 KB / 4501 972.1 KB / 4501 false
78
 172.36.55.34:45127 5 s 1 0 0 1 487.9 KB / 9060 1949.2 KB / 9060 false
79
 172.35.66.37:42779 5 s 1 0 0 1 482.3 KB / 9057 1957.9 KB / 9057 false
8
 172.34.185.61:33589 5 s 1 0 0 1 538.7 KB / 12201 2.6 MB / 12201 false
9
 172.34.190.70:38685 5 s 1 0 0 1 474.6 KB / 8944 1929.4 KB / 8944 false

Tasks (50)

Index  ▴ ID Attempt Status Locality Level Executor ID Host Launch Time Duration Scheduler Delay Task Deserialization Time GC Time Result Serialization Time Getting Result Time Peak Execution Memory Output Size / Records Shuffle Read Blocked Time Shuffle Read Size / Records Shuffle Remote Reads Errors
0 135584 0 SUCCESS PROCESS_LOCAL 66
172.34.157.6
 2023/05/03 17:29:19 4 s 0.5 s 0.8 s 1 ms 0 ms 0.0 B 368.7 KB / 4522 0 ms 977.6 KB / 4522 960.5 KB
1 135585 0 SUCCESS PROCESS_LOCAL 56
172.34.43.241
 2023/05/03 17:29:19 4 s 0.6 s 0.8 s 0 ms 0 ms 0.0 B 366.3 KB / 4642 0 ms 995.3 KB / 4642 982.4 KB
2 135586 0 SUCCESS PROCESS_LOCAL 67
172.35.32.230
 2023/05/03 17:29:19 4 s 0.6 s 0.8 s 0 ms 0 ms 0.0 B 371.9 KB / 4513 0 ms 970.3 KB / 4513 954.9 KB
3 135587 0 SUCCESS PROCESS_LOCAL 78
172.36.55.34
 2023/05/03 17:29:19 4 s 0.4 s 0.8 s 0 ms 0 ms 0.0 B 487.9 KB / 9060 0 ms 1949.2 KB / 9060 1924.7 KB
4 135588 0 SUCCESS PROCESS_LOCAL 29
172.36.65.227
 2023/05/03 17:29:19 3 s 1 s 0.8 s 1 ms 0 ms 0.0 B 352.8 KB / 4454 0 ms 958.6 KB / 4454 945.7 KB
5 135589 0 SUCCESS PROCESS_LOCAL 46
172.34.225.29
 2023/05/03 17:29:19 4 s 0.8 s 61 ms 0 ms 0 ms 0.0 B 349.3 KB / 4395 0 ms 944.3 KB / 4395 929.7 KB
6 135590 0 SUCCESS PROCESS_LOCAL 28
172.36.44.196
 2023/05/03 17:29:19 4 s 0.7 s 0.8 s 0 ms 0 ms 0.0 B 471.5 KB / 8910 0 ms 1923.9 KB / 8910 1897.7 KB
7 135591 0 SUCCESS PROCESS_LOCAL 6
172.36.166.74
 2023/05/03 17:29:19 4 s 0.6 s 0.8 s 0 ms 0 ms 0.0 B 359.9 KB / 4464 0 ms 964.0 KB / 4464 953.9 KB
8 135592 0 SUCCESS PROCESS_LOCAL 57
172.35.18.176
 2023/05/03 17:29:19 5 s 0.3 s 73 ms 0 ms 0 ms 0.0 B 362.5 KB / 4515 0 ms 975.3 KB / 4515 965.5 KB
9 135593 0 SUCCESS PROCESS_LOCAL 53
172.34.68.117
 2023/05/03 17:29:19 5 s 20 ms 60 ms 0 ms 0 ms 0.0 B 480.9 KB / 9136 0 ms 1960.3 KB / 9136 1929.9 KB
10 135594 0 SUCCESS PROCESS_LOCAL 44
172.34.157.116
 2023/05/03 17:29:19 4 s 0.4 s 0.7 s 0 ms 0 ms 0.0 B 353.4 KB / 4362 0 ms 932.7 KB / 4362 923.6 KB
11 135595 0 SUCCESS PROCESS_LOCAL 58
172.34.224.147
 2023/05/03 17:29:19 4 s 0.6 s 0.7 s 0 ms 0 ms 0.0 B 366.6 KB / 4667 0 ms 998.2 KB / 4667 986.8 KB
12 135596 0 SUCCESS PROCESS_LOCAL 14
172.35.55.72
 2023/05/03 17:29:19 5 s 74 ms 74 ms 0 ms 0 ms 0.0 B 485.0 KB / 9115 0 ms 1965.2 KB / 9115 1948.9 KB
13 135597 0 SUCCESS PROCESS_LOCAL 34
172.36.86.13
 2023/05/03 17:29:19 4 s 0.7 s 62 ms 0 ms 0 ms 0.0 B 355.6 KB / 4521 0 ms 971.9 KB / 4521 965.7 KB
14 135598 0 SUCCESS PROCESS_LOCAL 15
172.36.245.141
 2023/05/03 17:29:19 4 s 0.7 s 58 ms 0 ms 0 ms 0.0 B 362.9 KB / 4375 0 ms 944.7 KB / 4375 936.4 KB
15 135599 0 SUCCESS PROCESS_LOCAL 9
172.34.190.70
 2023/05/03 17:29:19 4 s 0.5 s 0.7 s 0 ms 0 ms 0.0 B 474.6 KB / 8944 0 ms 1929.4 KB / 8944 1910.3 KB
16 135600 0 SUCCESS PROCESS_LOCAL 51
172.34.210.117
 2023/05/03 17:29:19 4 s 0.4 s 0.8 s 0 ms 0 ms 0.0 B 365.3 KB / 4508 0 ms 968.0 KB / 4508 960.6 KB
17 135601 0 SUCCESS PROCESS_LOCAL 24
172.35.203.8
 2023/05/03 17:29:19 4 s 0.7 s 61 ms 0 ms 0 ms 0.0 B 360.0 KB / 4423 0 ms 960.5 KB / 4423 952.2 KB
18 135602 0 SUCCESS PROCESS_LOCAL 50
172.35.85.79
 2023/05/03 17:29:19 5 s 18 ms 56 ms 0 ms 0 ms 0.0 B 482.2 KB / 8879 0 ms 1913.1 KB / 8879 1895.4 KB
19 135603 0 SUCCESS PROCESS_LOCAL 16
172.36.34.187
 2023/05/03 17:29:19 4 s 0.6 s 0.8 s 0 ms 0 ms 0.0 B 358.7 KB / 4502 0 ms 973.2 KB / 4502 963.8 KB
20 135604 0 SUCCESS PROCESS_LOCAL 45
172.34.155.50
 2023/05/03 17:29:19 4 s 0.7 s 67 ms 0 ms 0 ms 0.0 B 366.5 KB / 4607 0 ms 987.9 KB / 4607 979.0 KB
21 135605 0 SUCCESS PROCESS_LOCAL 60
172.36.40.168
 2023/05/03 17:29:19 5 s 0.3 s 77 ms 1 ms 0 ms 0.0 B 486.7 KB / 9116 0 ms 1969.6 KB / 9116 1946.8 KB
22 135606 0 SUCCESS PROCESS_LOCAL 49
172.36.30.153
 2023/05/03 17:29:19 4 s 0.7 s 62 ms 0 ms 0 ms 0.0 B 357.3 KB / 4460 0 ms 958.2 KB / 4460 942.2 KB
23 135607 0 SUCCESS PROCESS_LOCAL 61
172.36.12.202
 2023/05/03 17:29:19 4 s 0.8 s 61 ms 0 ms 0 ms 0.0 B 355.0 KB / 4564 0 ms 986.9 KB / 4564 971.4 KB
24 135608 0 SUCCESS PROCESS_LOCAL 36
172.34.204.55
 2023/05/03 17:29:19 4 s 0.6 s 0.7 s 0 ms 0 ms 0.0 B 477.0 KB / 8949 0 ms 1927.5 KB / 8949 1909.3 KB
25 135609 0 SUCCESS PROCESS_LOCAL 74
172.36.106.85
 2023/05/03 17:29:19 4 s 0.7 s 60 ms 0 ms 0 ms 0.0 B 369.6 KB / 4564 0 ms 978.8 KB / 4564 966.2 KB
26 135610 0 SUCCESS PROCESS_LOCAL 26
172.36.235.141
 2023/05/03 17:29:19 4 s 0.6 s 0.7 s 0 ms 0 ms 0.0 B 356.2 KB / 4528 0 ms 976.2 KB / 4528 972.0 KB
27 135611 0 SUCCESS PROCESS_LOCAL 48
172.36.38.76
 2023/05/03 17:29:19 4 s 0.4 s 0.7 s 1 ms 0 ms 0.0 B 365.0 KB / 4542 0 ms 987.6 KB / 4542 977.4 KB
28 135612 0 SUCCESS PROCESS_LOCAL 27
172.34.165.40
 2023/05/03 17:29:19 4 s 0.5 s 0.7 s 0 ms 0 ms 0.0 B 485.4 KB / 8931 0 ms 1921.5 KB / 8931 1902.7 KB
29 135613 0 SUCCESS PROCESS_LOCAL 23
172.34.102.247
 2023/05/03 17:29:19 4 s 17 ms 0.8 s 0 ms 0 ms 0.0 B 365.4 KB / 4497 0 ms 975.2 KB / 4497 958.1 KB
30 135614 0 SUCCESS PROCESS_LOCAL 10
172.35.102.173
 2023/05/03 17:29:19 4 s 0.4 s 0.7 s 0 ms 0 ms 0.0 B 363.0 KB / 4456 0 ms 963.2 KB / 4456 951.8 KB
31 135615 0 SUCCESS PROCESS_LOCAL 21
172.34.162.104
 2023/05/03 17:29:19 4 s 0.7 s 0.7 s 0 ms 0 ms 0.0 B 476.7 KB / 8976 0 ms 1930.1 KB / 8976 1904.5 KB
32 135616 0 SUCCESS PROCESS_LOCAL 76
172.34.157.254
 2023/05/03 17:29:19 4 s 0.4 s 0.8 s 1 ms 0 ms 0.0 B 366.0 KB / 4501 0 ms 972.1 KB / 4501 956.4 KB
33 135617 0 SUCCESS PROCESS_LOCAL 40
172.35.54.139
 2023/05/03 17:29:19 4 s 0.3 s 0.7 s 0 ms 0 ms 0.0 B 360.7 KB / 4500 0 ms 970.1 KB / 4500 964.5 KB
34 135618 0 SUCCESS PROCESS_LOCAL 47
172.35.188.77
 2023/05/03 17:29:19 4 s 70 ms 0.8 s 1 ms 0 ms 0.0 B 471.6 KB / 9098 0 ms 1955.1 KB / 9098 1928.3 KB
35 135619 0 SUCCESS PROCESS_LOCAL 69
172.36.112.205
 2023/05/03 17:29:19 5 s 16 ms 0.8 s 0 ms 0 ms 0.0 B 364.8 KB / 4478 0 ms 963.8 KB / 4478 952.1 KB
36 135620 0 SUCCESS PROCESS_LOCAL 64
172.35.48.7
 2023/05/03 17:29:19 4 s 0.1 s 0.7 s 0 ms 0 ms 0.0 B 368.5 KB / 4495 0 ms 969.2 KB / 4495 954.9 KB
37 135621 0 SUCCESS PROCESS_LOCAL 5
172.34.23.97
 2023/05/03 17:29:19 4 s 81 ms 0.7 s 0 ms 0 ms 0.0 B 482.0 KB / 9161 0 ms 1968.4 KB / 9161 1951.7 KB
38 135622 0 SUCCESS PROCESS_LOCAL 31
172.34.158.18
 2023/05/03 17:29:19 3 s 0.9 s 0.7 s 1 ms 0 ms 0.0 B 353.3 KB / 4531 0 ms 977.9 KB / 4531 963.6 KB
39 135623 0 SUCCESS PROCESS_LOCAL 65
172.36.193.230
 2023/05/03 17:29:19 3 s 0.8 s 0.7 s 0 ms 0 ms 0.0 B 366.0 KB / 4626 0 ms 989.3 KB / 4626 974.4 KB
40 135624 0 SUCCESS PROCESS_LOCAL 79
172.35.66.37
 2023/05/03 17:29:19 4 s 16 ms 0.7 s 0 ms 0 ms 0.0 B 482.3 KB / 9057 0 ms 1957.9 KB / 9057 1940.1 KB
41 135625 0 SUCCESS PROCESS_LOCAL 38
172.35.226.91
 2023/05/03 17:29:19 4 s 0.5 s 0.7 s 0 ms 0 ms 0.0 B 357.9 KB / 4535 0 ms 972.8 KB / 4535 963.9 KB
42 135626 0 SUCCESS PROCESS_LOCAL 70
172.36.39.171
 2023/05/03 17:29:19 4 s 0.6 s 0.7 s 0 ms 0 ms 0.0 B 359.3 KB / 4514 0 ms 975.0 KB / 4514 963.7 KB
43 135627 0 SUCCESS PROCESS_LOCAL 63
172.35.203.199
 2023/05/03 17:29:19 4 s 0.6 s 0.7 s 0 ms 0 ms 0.0 B 484.1 KB / 8912 0 ms 1922.2 KB / 8912 1890.3 KB
44 135628 0 SUCCESS PROCESS_LOCAL 52
172.35.207.183
 2023/05/03 17:29:19 3 s 0.8 s 0.7 s 0 ms 0 ms 0.0 B 356.6 KB / 4475 0 ms 961.0 KB / 4475 950.0 KB
45 135629 0 SUCCESS PROCESS_LOCAL 55
172.34.169.101
 2023/05/03 17:29:19 4 s 0.5 s 0.7 s 0 ms 0 ms 0.0 B 366.1 KB / 4552 0 ms 983.9 KB / 4552 976.9 KB
46 135630 0 SUCCESS PROCESS_LOCAL 39
172.34.231.250
 2023/05/03 17:29:19 4 s 0.3 s 0.7 s 1 ms 0 ms 0.0 B 479.5 KB / 8983 0 ms 1936.2 KB / 8983 1915.6 KB
47 135631 0 SUCCESS PROCESS_LOCAL 41
172.34.202.43
 2023/05/03 17:29:19 4 s 0.6 s 0.7 s 0 ms 0 ms 0.0 B 360.5 KB / 4455 0 ms 958.8 KB / 4455 947.2 KB
48 135632 0 SUCCESS PROCESS_LOCAL 32
172.35.67.158
 2023/05/03 17:29:19 4 s 0.6 s 0.7 s 32 ms 1 ms 0 ms 0.0 B 358.4 KB / 4480 0 ms 964.2 KB / 4480 953.0 KB
49 135633 0 SUCCESS PROCESS_LOCAL 8
172.34.185.61
 2023/05/03 17:29:19 4 s 15 ms 0.7 s 0 ms 0 ms 0.0 B 538.7 KB / 12201 0 ms 2.6 MB / 12201 2.6 MB