2024-11-23 17:39:48,304 - Epoch 1/100, Loss: 2.2279
2024-11-23 17:40:02,027 - Epoch 2/100, Loss: 0.4299
2024-11-23 17:40:15,741 - Epoch 3/100, Loss: 0.2759
2024-11-23 17:40:29,730 - Epoch 4/100, Loss: 0.1054
2024-11-23 17:40:43,374 - Epoch 5/100, Loss: 0.0507
2024-11-23 17:40:56,815 - Epoch 6/100, Loss: 0.0365
2024-11-23 17:41:10,319 - Epoch 7/100, Loss: 0.0311
2024-11-23 17:41:23,942 - Epoch 8/100, Loss: 0.0279
2024-11-23 17:41:37,469 - Epoch 9/100, Loss: 0.0258
2024-11-23 17:41:51,094 - Epoch 10/100, Loss: 0.0243
2024-11-23 17:42:04,590 - Epoch 11/100, Loss: 0.0231
2024-11-23 17:42:18,194 - Epoch 12/100, Loss: 0.0221
2024-11-23 17:42:31,676 - Epoch 13/100, Loss: 0.0215
2024-11-23 17:42:45,225 - Epoch 14/100, Loss: 0.0209
2024-11-23 17:42:58,842 - Epoch 15/100, Loss: 0.0201
2024-11-23 17:43:12,504 - Epoch 16/100, Loss: 0.0196
2024-11-23 17:43:26,273 - Epoch 17/100, Loss: 0.0191
2024-11-23 17:43:39,796 - Epoch 18/100, Loss: 0.0188
2024-11-23 17:43:53,342 - Epoch 19/100, Loss: 0.0187
2024-11-23 17:44:07,010 - Epoch 20/100, Loss: 0.0182
2024-11-23 17:44:20,568 - Epoch 21/100, Loss: 0.0181
2024-11-23 17:44:34,209 - Epoch 22/100, Loss: 0.0177
2024-11-23 17:44:47,887 - Epoch 23/100, Loss: 0.0175
2024-11-23 17:45:01,520 - Epoch 24/100, Loss: 0.0173
2024-11-23 17:45:15,173 - Epoch 25/100, Loss: 0.0171
2024-11-23 17:45:28,788 - Epoch 26/100, Loss: 0.0168
2024-11-23 17:45:42,201 - Epoch 27/100, Loss: 0.0167
2024-11-23 17:45:55,868 - Epoch 28/100, Loss: 0.0169
2024-11-23 17:46:06,722 - Epoch 29/100, Loss: 0.0169
2024-11-23 17:46:17,571 - Epoch 30/100, Loss: 0.0165
2024-11-23 17:46:31,311 - Epoch 31/100, Loss: 0.0162
2024-11-23 17:46:44,997 - Epoch 32/100, Loss: 0.0162
2024-11-23 17:46:58,697 - Epoch 33/100, Loss: 0.0160
2024-11-23 17:47:12,253 - Epoch 34/100, Loss: 0.0160
2024-11-23 17:47:23,099 - Epoch 35/100, Loss: 0.0156
2024-11-23 17:47:36,784 - Epoch 36/100, Loss: 0.0154
2024-11-23 17:47:50,300 - Epoch 37/100, Loss: 0.0155
2024-11-23 17:48:01,133 - Epoch 38/100, Loss: 0.0155
2024-11-23 17:48:11,983 - Epoch 39/100, Loss: 0.0154
2024-11-23 17:48:25,532 - Epoch 40/100, Loss: 0.0154
2024-11-23 17:48:39,114 - Epoch 41/100, Loss: 0.0151
2024-11-23 17:48:52,603 - Epoch 42/100, Loss: 0.0152
2024-11-23 17:49:03,445 - Epoch 43/100, Loss: 0.0149
2024-11-23 17:49:16,942 - Epoch 44/100, Loss: 0.0150
2024-11-23 17:49:27,780 - Epoch 45/100, Loss: 0.0148
2024-11-23 17:49:41,261 - Epoch 46/100, Loss: 0.0146
2024-11-23 17:49:54,807 - Epoch 47/100, Loss: 0.0148
2024-11-23 17:50:05,660 - Epoch 48/100, Loss: 0.0145
2024-11-23 17:50:19,374 - Epoch 49/100, Loss: 0.0148
2024-11-23 17:50:30,234 - Epoch 50/100, Loss: 0.0145
2024-11-23 17:50:44,078 - Epoch 51/100, Loss: 0.0144
2024-11-23 17:50:58,205 - Epoch 52/100, Loss: 0.0147
2024-11-23 17:51:09,055 - Epoch 53/100, Loss: 0.0147
2024-11-23 17:51:19,921 - Epoch 54/100, Loss: 0.0142
2024-11-23 17:51:33,539 - Epoch 55/100, Loss: 0.0141
2024-11-23 17:51:47,034 - Epoch 56/100, Loss: 0.0141
2024-11-23 17:52:00,677 - Epoch 57/100, Loss: 0.0140
2024-11-23 17:52:14,130 - Epoch 58/100, Loss: 0.0144
2024-11-23 17:52:24,977 - Epoch 59/100, Loss: 0.0142
2024-11-23 17:52:35,827 - Epoch 60/100, Loss: 0.0139
2024-11-23 17:52:49,364 - Epoch 61/100, Loss: 0.0138
2024-11-23 17:53:02,941 - Epoch 62/100, Loss: 0.0137
2024-11-23 17:53:16,591 - Epoch 63/100, Loss: 0.0136
2024-11-23 17:53:30,053 - Epoch 64/100, Loss: 0.0136
2024-11-23 17:53:40,893 - Epoch 65/100, Loss: 0.0137
2024-11-23 17:53:51,753 - Epoch 66/100, Loss: 0.0134
2024-11-23 17:54:05,324 - Epoch 67/100, Loss: 0.0136
2024-11-23 17:54:16,188 - Epoch 68/100, Loss: 0.0136
2024-11-23 17:54:27,051 - Epoch 69/100, Loss: 0.0134
2024-11-23 17:54:40,685 - Epoch 70/100, Loss: 0.0135
2024-11-23 17:54:51,544 - Epoch 71/100, Loss: 0.0134
2024-11-23 17:55:05,110 - Epoch 72/100, Loss: 0.0133
2024-11-23 17:55:18,581 - Epoch 73/100, Loss: 0.0133
2024-11-23 17:55:32,072 - Epoch 74/100, Loss: 0.0135
2024-11-23 17:55:42,925 - Epoch 75/100, Loss: 0.0132
2024-11-23 17:55:56,422 - Epoch 76/100, Loss: 0.0131
2024-11-23 17:56:09,919 - Epoch 77/100, Loss: 0.0129
2024-11-23 17:56:23,448 - Epoch 78/100, Loss: 0.0131
2024-11-23 17:56:34,297 - Epoch 79/100, Loss: 0.0128
2024-11-23 17:56:48,177 - Epoch 80/100, Loss: 0.0129
2024-11-23 17:56:59,036 - Epoch 81/100, Loss: 0.0130
2024-11-23 17:57:09,884 - Epoch 82/100, Loss: 0.0131
2024-11-23 17:57:20,742 - Epoch 83/100, Loss: 0.0128
2024-11-23 17:57:31,591 - Epoch 84/100, Loss: 0.0126
2024-11-23 17:57:45,135 - Epoch 85/100, Loss: 0.0128
2024-11-23 17:57:55,982 - Epoch 86/100, Loss: 0.0131
2024-11-23 17:58:06,820 - Epoch 87/100, Loss: 0.0127
2024-11-23 17:58:17,660 - Epoch 88/100, Loss: 0.0125
2024-11-23 17:58:31,098 - Epoch 89/100, Loss: 0.0125
2024-11-23 17:58:41,941 - Epoch 90/100, Loss: 0.0126
2024-11-23 17:58:52,783 - Epoch 91/100, Loss: 0.0125
2024-11-23 17:59:03,627 - Epoch 92/100, Loss: 0.0123
2024-11-23 17:59:17,078 - Epoch 93/100, Loss: 0.0122
2024-11-23 17:59:30,555 - Epoch 94/100, Loss: 0.0123
2024-11-23 17:59:41,397 - Epoch 95/100, Loss: 0.0123
2024-11-23 17:59:52,246 - Epoch 96/100, Loss: 0.0124
2024-11-23 18:00:03,098 - Epoch 97/100, Loss: 0.0123
2024-11-23 18:00:13,941 - Epoch 98/100, Loss: 0.0123
2024-11-23 18:00:24,776 - Epoch 99/100, Loss: 0.0123
2024-11-23 18:00:35,613 - Epoch 100/100, Loss: 0.0123
2024-11-23 18:00:35,613 - Training completed.
2024-11-23 18:00:35,613 - Starting inference...
2024-11-23 18:00:35,707 - Sample 1: Step Time: 0.0692s, Memory Used: 7738.94 MB, Power Usage: 80.41 W
2024-11-23 18:00:35,737 - Sample 2: Step Time: 0.0044s, Memory Used: 7738.94 MB, Power Usage: 80.41 W
2024-11-23 18:00:35,766 - Sample 3: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 80.46 W
2024-11-23 18:00:35,795 - Sample 4: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 80.46 W
2024-11-23 18:00:35,823 - Sample 5: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 80.46 W
2024-11-23 18:00:35,852 - Sample 6: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 80.46 W
2024-11-23 18:00:35,881 - Sample 7: Step Time: 0.0044s, Memory Used: 7738.94 MB, Power Usage: 80.85 W
2024-11-23 18:00:35,910 - Sample 8: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 80.85 W
2024-11-23 18:00:35,939 - Sample 9: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 80.85 W
2024-11-23 18:00:35,968 - Sample 10: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 81.08 W
2024-11-23 18:00:35,996 - Sample 11: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 81.08 W
2024-11-23 18:00:36,025 - Sample 12: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 81.08 W
2024-11-23 18:00:36,053 - Sample 13: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 81.08 W
2024-11-23 18:00:36,082 - Sample 14: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 81.47 W
2024-11-23 18:00:36,111 - Sample 15: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 81.47 W
2024-11-23 18:00:36,139 - Sample 16: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 81.47 W
2024-11-23 18:00:36,168 - Sample 17: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 69.79 W
2024-11-23 18:00:36,197 - Sample 18: Step Time: 0.0041s, Memory Used: 7738.94 MB, Power Usage: 69.79 W
2024-11-23 18:00:36,225 - Sample 19: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 69.79 W
2024-11-23 18:00:36,254 - Sample 20: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 69.79 W
2024-11-23 18:00:36,283 - Sample 21: Step Time: 0.0043s, Memory Used: 7738.94 MB, Power Usage: 70.19 W
2024-11-23 18:00:36,312 - Sample 22: Step Time: 0.0041s, Memory Used: 7738.94 MB, Power Usage: 70.19 W
2024-11-23 18:00:36,340 - Sample 23: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 70.19 W
2024-11-23 18:00:36,369 - Sample 24: Step Time: 0.0041s, Memory Used: 7738.94 MB, Power Usage: 70.48 W
2024-11-23 18:00:36,398 - Sample 25: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 70.48 W
2024-11-23 18:00:36,426 - Sample 26: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 70.48 W
2024-11-23 18:00:36,455 - Sample 27: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 70.98 W
2024-11-23 18:00:36,484 - Sample 28: Step Time: 0.0044s, Memory Used: 7738.94 MB, Power Usage: 70.98 W
2024-11-23 18:00:36,513 - Sample 29: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 70.98 W
2024-11-23 18:00:36,541 - Sample 30: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 70.98 W
2024-11-23 18:00:36,570 - Sample 31: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 71.40 W
2024-11-23 18:00:36,599 - Sample 32: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 71.40 W
2024-11-23 18:00:36,628 - Sample 33: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 71.40 W
2024-11-23 18:00:36,657 - Sample 34: Step Time: 0.0043s, Memory Used: 7738.94 MB, Power Usage: 71.83 W
2024-11-23 18:00:36,686 - Sample 35: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 71.83 W
2024-11-23 18:00:36,714 - Sample 36: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 71.83 W
2024-11-23 18:00:36,743 - Sample 37: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 71.83 W
2024-11-23 18:00:36,772 - Sample 38: Step Time: 0.0045s, Memory Used: 7738.94 MB, Power Usage: 63.29 W
2024-11-23 18:00:36,801 - Sample 39: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.29 W
2024-11-23 18:00:36,830 - Sample 40: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.29 W
2024-11-23 18:00:36,859 - Sample 41: Step Time: 0.0044s, Memory Used: 7738.94 MB, Power Usage: 63.52 W
2024-11-23 18:00:36,888 - Sample 42: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.52 W
2024-11-23 18:00:36,917 - Sample 43: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.52 W
2024-11-23 18:00:36,946 - Sample 44: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.52 W
2024-11-23 18:00:36,975 - Sample 45: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.50 W
2024-11-23 18:00:37,004 - Sample 46: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.50 W
2024-11-23 18:00:37,032 - Sample 47: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.50 W
2024-11-23 18:00:37,061 - Sample 48: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.48 W
2024-11-23 18:00:37,090 - Sample 49: Step Time: 0.0041s, Memory Used: 7738.94 MB, Power Usage: 63.48 W
2024-11-23 18:00:37,119 - Sample 50: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.48 W
2024-11-23 18:00:37,148 - Sample 51: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.48 W
2024-11-23 18:00:37,176 - Sample 52: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.49 W
2024-11-23 18:00:37,205 - Sample 53: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.49 W
2024-11-23 18:00:37,234 - Sample 54: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.49 W
2024-11-23 18:00:37,263 - Sample 55: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.56 W
2024-11-23 18:00:37,292 - Sample 56: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.56 W
2024-11-23 18:00:37,320 - Sample 57: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.56 W
2024-11-23 18:00:37,349 - Sample 58: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.56 W
2024-11-23 18:00:37,377 - Sample 59: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.61 W
2024-11-23 18:00:37,406 - Sample 60: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.61 W
2024-11-23 18:00:37,435 - Sample 61: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.61 W
2024-11-23 18:00:37,463 - Sample 62: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.62 W
2024-11-23 18:00:37,492 - Sample 63: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.62 W
2024-11-23 18:00:37,521 - Sample 64: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.62 W
2024-11-23 18:00:37,550 - Sample 65: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.62 W
2024-11-23 18:00:37,578 - Sample 66: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.61 W
2024-11-23 18:00:37,607 - Sample 67: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.61 W
2024-11-23 18:00:37,636 - Sample 68: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.61 W
2024-11-23 18:00:37,664 - Sample 69: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.59 W
2024-11-23 18:00:37,693 - Sample 70: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.59 W
2024-11-23 18:00:37,722 - Sample 71: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.59 W
2024-11-23 18:00:37,750 - Sample 72: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.59 W
2024-11-23 18:00:37,779 - Sample 73: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.67 W
2024-11-23 18:00:37,808 - Sample 74: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.67 W
2024-11-23 18:00:37,837 - Sample 75: Step Time: 0.0043s, Memory Used: 7738.94 MB, Power Usage: 63.67 W
2024-11-23 18:00:37,866 - Sample 76: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.50 W
2024-11-23 18:00:37,895 - Sample 77: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.50 W
2024-11-23 18:00:37,923 - Sample 78: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.50 W
2024-11-23 18:00:37,952 - Sample 79: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.50 W
2024-11-23 18:00:37,980 - Sample 80: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.60 W
2024-11-23 18:00:38,009 - Sample 81: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.60 W
2024-11-23 18:00:38,038 - Sample 82: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.60 W
2024-11-23 18:00:38,067 - Sample 83: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.49 W
2024-11-23 18:00:38,095 - Sample 84: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.49 W
2024-11-23 18:00:38,124 - Sample 85: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.49 W
2024-11-23 18:00:38,153 - Sample 86: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.49 W
2024-11-23 18:00:38,182 - Sample 87: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.61 W
2024-11-23 18:00:38,211 - Sample 88: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.61 W
2024-11-23 18:00:38,239 - Sample 89: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.61 W
2024-11-23 18:00:38,268 - Sample 90: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.50 W
2024-11-23 18:00:38,296 - Sample 91: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.50 W
2024-11-23 18:00:38,325 - Sample 92: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.50 W
2024-11-23 18:00:38,354 - Sample 93: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.59 W
2024-11-23 18:00:38,383 - Sample 94: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.59 W
2024-11-23 18:00:38,412 - Sample 95: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.59 W
2024-11-23 18:00:38,440 - Sample 96: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.59 W
2024-11-23 18:00:38,469 - Sample 97: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.49 W
2024-11-23 18:00:38,498 - Sample 98: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.49 W
2024-11-23 18:00:38,527 - Sample 99: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.49 W
2024-11-23 18:00:38,556 - Sample 100: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.55 W
2024-11-23 18:00:38,584 - Sample 101: Step Time: 0.0041s, Memory Used: 7738.94 MB, Power Usage: 63.55 W
2024-11-23 18:00:38,613 - Sample 102: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.55 W
2024-11-23 18:00:38,642 - Sample 103: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.55 W
2024-11-23 18:00:38,671 - Sample 104: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.50 W
2024-11-23 18:00:38,699 - Sample 105: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.50 W
2024-11-23 18:00:38,728 - Sample 106: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.50 W
2024-11-23 18:00:38,757 - Sample 107: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.51 W
2024-11-23 18:00:38,785 - Sample 108: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.51 W
2024-11-23 18:00:38,815 - Sample 109: Step Time: 0.0043s, Memory Used: 7738.94 MB, Power Usage: 63.51 W
2024-11-23 18:00:38,843 - Sample 110: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.51 W
2024-11-23 18:00:38,872 - Sample 111: Step Time: 0.0042s, Memory Used: 7738.94 MB, Power Usage: 63.53 W
2024-11-23 18:00:38,873 - Inference completed.
2024-11-23 18:00:38,873 - Average First Token Latency: 0.0682s
2024-11-23 18:00:38,873 - Average Token Latency: 0.0038s
2024-11-23 18:00:38,873 - TP50 Token Latency: 0.0032s
2024-11-23 18:00:38,873 - TP99 Token Latency: 0.0034s
2024-11-23 18:00:38,873 - Average Throughput per Token: 20313794.1459 tokens/s
2024-11-23 18:00:38,873 - Average Step Time: 0.0048s
2024-11-23 18:00:38,873 - Average Memory Usage: 7738.94 MB
2024-11-23 18:00:38,873 - Average Power Usage: 67.41 W
2024-11-23 18:00:38,906 - Inference results and GPU metrics saved.