File size: 75,714 Bytes
637183f | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 | 2025-11-26 19:43:29,169 - INFO - ============================================================
2025-11-26 19:43:29,169 - INFO - FAST PRE-COMPUTATION STARTED
2025-11-26 19:43:29,169 - INFO - ============================================================
2025-11-26 19:43:29,169 - INFO - Sample size: 150,000
2025-11-26 19:43:29,169 - INFO - Output directory: precomputed_data
2025-11-26 19:43:29,169 - INFO - Version: v1
2025-11-26 19:43:29,169 - INFO - PCA pre-reduction: True (50 dims)
2025-11-26 19:43:29,169 - INFO - ============================================================
2025-11-26 19:43:29,169 - INFO - Step 1/5: Loading model data...
Repo card metadata block was not found. Setting CardData to empty.
2025-11-26 19:43:29,530 - WARNING - Repo card metadata block was not found. Setting CardData to empty.
2025-11-26 19:43:52,328 - INFO - Loaded 150,000 models in 23.2 seconds
2025-11-26 19:43:52,329 - INFO - Step 2/5: Generating embeddings...
2025-11-26 19:43:52,329 - INFO - Building combined text from model fields...
2025-11-26 19:43:52,878 - INFO - Use pytorch device_name: mps
2025-11-26 19:43:52,878 - INFO - Load pretrained SentenceTransformer: all-MiniLM-L6-v2
Batches: 0%| | 0/586 [00:00<?, ?it/s]
Batches: 0%| | 1/586 [00:06<59:23, 6.09s/it]
Batches: 0%| | 2/586 [00:09<46:45, 4.80s/it]
Batches: 1%| | 3/586 [00:14<44:37, 4.59s/it]
Batches: 1%| | 4/586 [00:18<44:28, 4.59s/it]
Batches: 1%| | 5/586 [00:22<42:14, 4.36s/it]
Batches: 1%| | 6/586 [00:26<39:59, 4.14s/it]
Batches: 1%| | 7/586 [00:29<36:49, 3.82s/it]
Batches: 1%|▏ | 8/586 [00:32<34:23, 3.57s/it]
Batches: 2%|▏ | 9/586 [00:36<34:57, 3.64s/it]
Batches: 2%|▏ | 10/586 [00:39<33:13, 3.46s/it]
Batches: 2%|▏ | 11/586 [00:43<34:03, 3.55s/it]
Batches: 2%|▏ | 12/586 [00:47<35:23, 3.70s/it]
Batches: 2%|▏ | 13/586 [00:51<35:33, 3.72s/it]
Batches: 2%|▏ | 14/586 [00:55<36:46, 3.86s/it]
Batches: 3%|▎ | 15/586 [00:57<32:55, 3.46s/it]
Batches: 3%|▎ | 16/586 [01:00<30:10, 3.18s/it]
Batches: 3%|▎ | 17/586 [01:03<31:03, 3.28s/it]
Batches: 3%|▎ | 18/586 [01:06<29:15, 3.09s/it]
Batches: 3%|▎ | 19/586 [01:09<28:53, 3.06s/it]
Batches: 3%|▎ | 20/586 [01:11<26:58, 2.86s/it]
Batches: 4%|▎ | 21/586 [01:15<29:35, 3.14s/it]
Batches: 4%|▍ | 22/586 [01:17<26:40, 2.84s/it]
Batches: 4%|▍ | 23/586 [01:20<26:41, 2.84s/it]
Batches: 4%|▍ | 24/586 [01:22<24:26, 2.61s/it]
Batches: 4%|▍ | 25/586 [01:24<22:31, 2.41s/it]
Batches: 4%|▍ | 26/586 [01:29<28:29, 3.05s/it]
Batches: 5%|▍ | 27/586 [01:31<25:51, 2.78s/it]
Batches: 5%|▍ | 28/586 [01:33<23:34, 2.53s/it]
Batches: 5%|▍ | 29/586 [01:37<26:29, 2.85s/it]
Batches: 5%|▌ | 30/586 [01:39<24:14, 2.62s/it]
Batches: 5%|▌ | 31/586 [01:43<29:42, 3.21s/it]
Batches: 5%|▌ | 32/586 [01:45<26:22, 2.86s/it]
Batches: 6%|▌ | 33/586 [01:47<24:21, 2.64s/it]
Batches: 6%|▌ | 34/586 [01:50<23:14, 2.53s/it]
Batches: 6%|▌ | 35/586 [01:51<21:00, 2.29s/it]
Batches: 6%|▌ | 36/586 [01:53<19:07, 2.09s/it]
Batches: 6%|▋ | 37/586 [01:55<19:03, 2.08s/it]
Batches: 6%|▋ | 38/586 [01:57<18:12, 1.99s/it]
Batches: 7%|▋ | 39/586 [01:59<19:53, 2.18s/it]
Batches: 7%|▋ | 40/586 [02:01<19:23, 2.13s/it]
Batches: 7%|▋ | 41/586 [02:05<22:39, 2.49s/it]
Batches: 7%|▋ | 42/586 [02:08<25:01, 2.76s/it]
Batches: 7%|▋ | 43/586 [02:10<23:33, 2.60s/it]
Batches: 8%|▊ | 44/586 [02:12<21:38, 2.40s/it]
Batches: 8%|▊ | 45/586 [02:14<19:53, 2.21s/it]
Batches: 8%|▊ | 46/586 [02:16<19:32, 2.17s/it]
Batches: 8%|▊ | 47/586 [02:18<18:47, 2.09s/it]
Batches: 8%|▊ | 48/586 [02:20<17:26, 1.95s/it]
Batches: 8%|▊ | 49/586 [02:21<15:59, 1.79s/it]
Batches: 9%|▊ | 50/586 [02:23<15:20, 1.72s/it]
Batches: 9%|▊ | 51/586 [02:24<14:49, 1.66s/it]
Batches: 9%|▉ | 52/586 [02:26<14:30, 1.63s/it]
Batches: 9%|▉ | 53/586 [02:28<15:41, 1.77s/it]
Batches: 9%|▉ | 54/586 [02:29<14:53, 1.68s/it]
Batches: 9%|▉ | 55/586 [02:32<17:49, 2.01s/it]
Batches: 10%|▉ | 56/586 [02:34<16:44, 1.89s/it]
Batches: 10%|▉ | 57/586 [02:35<15:31, 1.76s/it]
Batches: 10%|▉ | 58/586 [02:37<15:51, 1.80s/it]
Batches: 10%|█ | 59/586 [02:38<14:51, 1.69s/it]
Batches: 10%|█ | 60/586 [02:40<14:51, 1.69s/it]
Batches: 10%|█ | 61/586 [02:42<14:56, 1.71s/it]
Batches: 11%|█ | 62/586 [02:44<14:40, 1.68s/it]
Batches: 11%|█ | 63/586 [02:45<14:54, 1.71s/it]
Batches: 11%|█ | 64/586 [02:47<14:16, 1.64s/it]
Batches: 11%|█ | 65/586 [02:48<13:48, 1.59s/it]
Batches: 11%|█▏ | 66/586 [02:51<15:25, 1.78s/it]
Batches: 11%|█▏ | 67/586 [02:53<16:33, 1.91s/it]
Batches: 12%|█▏ | 68/586 [02:55<17:38, 2.04s/it]
Batches: 12%|█▏ | 69/586 [02:58<18:43, 2.17s/it]
Batches: 12%|█▏ | 70/586 [02:59<17:27, 2.03s/it]
Batches: 12%|█▏ | 71/586 [03:01<16:36, 1.93s/it]
Batches: 12%|█▏ | 72/586 [03:03<15:34, 1.82s/it]
Batches: 12%|█▏ | 73/586 [03:04<15:08, 1.77s/it]
Batches: 13%|█▎ | 74/586 [03:06<14:28, 1.70s/it]
Batches: 13%|█▎ | 75/586 [03:07<14:40, 1.72s/it]
Batches: 13%|█▎ | 76/586 [03:10<16:30, 1.94s/it]
Batches: 13%|█▎ | 77/586 [03:12<18:03, 2.13s/it]
Batches: 13%|█▎ | 78/586 [03:14<17:11, 2.03s/it]
Batches: 13%|█▎ | 79/586 [03:17<18:49, 2.23s/it]
Batches: 14%|█▎ | 80/586 [03:19<17:57, 2.13s/it]
Batches: 14%|█▍ | 81/586 [03:20<16:05, 1.91s/it]
Batches: 14%|█▍ | 82/586 [03:22<15:01, 1.79s/it]
Batches: 14%|█▍ | 83/586 [03:26<21:32, 2.57s/it]
Batches: 14%|█▍ | 84/586 [03:29<21:33, 2.58s/it]
Batches: 15%|█▍ | 85/586 [03:30<19:23, 2.32s/it]
Batches: 15%|█▍ | 86/586 [03:32<18:03, 2.17s/it]
Batches: 15%|█▍ | 87/586 [03:38<26:29, 3.18s/it]
Batches: 15%|█▌ | 88/586 [03:41<25:04, 3.02s/it]
Batches: 15%|█▌ | 89/586 [03:43<23:45, 2.87s/it]
Batches: 15%|█▌ | 90/586 [03:46<22:50, 2.76s/it]
Batches: 16%|█▌ | 91/586 [03:48<21:28, 2.60s/it]
Batches: 16%|█▌ | 92/586 [03:50<19:54, 2.42s/it]
Batches: 16%|█▌ | 93/586 [03:51<17:15, 2.10s/it]
Batches: 16%|█▌ | 94/586 [03:53<16:28, 2.01s/it]
Batches: 16%|█▌ | 95/586 [03:54<14:49, 1.81s/it]
Batches: 16%|█▋ | 96/586 [03:57<18:03, 2.21s/it]
Batches: 17%|█▋ | 97/586 [03:59<17:10, 2.11s/it]
Batches: 17%|█▋ | 98/586 [04:01<15:40, 1.93s/it]
Batches: 17%|█▋ | 99/586 [04:02<14:29, 1.79s/it]
Batches: 17%|█▋ | 100/586 [04:04<13:32, 1.67s/it]
Batches: 17%|█▋ | 101/586 [04:06<15:19, 1.90s/it]
Batches: 17%|█▋ | 102/586 [04:08<14:35, 1.81s/it]
Batches: 18%|█▊ | 103/586 [04:09<13:10, 1.64s/it]
Batches: 18%|█▊ | 104/586 [04:12<16:02, 2.00s/it]
Batches: 18%|█▊ | 105/586 [04:13<14:11, 1.77s/it]
Batches: 18%|█▊ | 106/586 [04:15<15:13, 1.90s/it]
Batches: 18%|█▊ | 107/586 [04:17<14:01, 1.76s/it]
Batches: 18%|█▊ | 108/586 [04:18<14:02, 1.76s/it]
Batches: 19%|█▊ | 109/586 [04:19<12:20, 1.55s/it]
Batches: 19%|█▉ | 110/586 [04:21<11:55, 1.50s/it]
Batches: 19%|█▉ | 111/586 [04:22<11:52, 1.50s/it]
Batches: 19%|█▉ | 112/586 [04:23<10:58, 1.39s/it]
Batches: 19%|█▉ | 113/586 [04:25<12:15, 1.55s/it]
Batches: 19%|█▉ | 114/586 [04:27<13:32, 1.72s/it]
Batches: 20%|█▉ | 115/586 [04:29<12:21, 1.58s/it]
Batches: 20%|█▉ | 116/586 [04:30<11:21, 1.45s/it]
Batches: 20%|█▉ | 117/586 [04:31<10:55, 1.40s/it]
Batches: 20%|██ | 118/586 [04:33<11:53, 1.52s/it]
Batches: 20%|██ | 119/586 [04:37<17:32, 2.25s/it]
Batches: 20%|██ | 120/586 [04:42<24:10, 3.11s/it]
Batches: 21%|██ | 121/586 [04:53<43:19, 5.59s/it]
Batches: 21%|██ | 122/586 [05:05<55:59, 7.24s/it]
Batches: 21%|██ | 123/586 [05:17<1:07:13, 8.71s/it]
Batches: 21%|██ | 124/586 [05:25<1:05:24, 8.49s/it]
Batches: 21%|██▏ | 125/586 [06:04<2:16:08, 17.72s/it]
Batches: 22%|██▏ | 126/586 [06:08<1:44:53, 13.68s/it]
Batches: 22%|██▏ | 127/586 [06:11<1:18:53, 10.31s/it]
Batches: 22%|██▏ | 128/586 [06:12<58:48, 7.70s/it]
Batches: 22%|██▏ | 129/586 [06:13<43:57, 5.77s/it]
Batches: 22%|██▏ | 130/586 [06:15<33:41, 4.43s/it]
Batches: 22%|██▏ | 131/586 [06:16<25:55, 3.42s/it]
Batches: 23%|██▎ | 132/586 [06:17<21:16, 2.81s/it]
Batches: 23%|██▎ | 133/586 [06:19<18:53, 2.50s/it]
Batches: 23%|██▎ | 134/586 [06:20<15:54, 2.11s/it]
Batches: 23%|██▎ | 135/586 [06:21<13:33, 1.80s/it]
Batches: 23%|██▎ | 136/586 [06:24<14:39, 1.95s/it]
Batches: 23%|██▎ | 137/586 [06:26<16:21, 2.19s/it]
Batches: 24%|██▎ | 138/586 [06:28<14:49, 1.98s/it]
Batches: 24%|██▎ | 139/586 [06:29<13:09, 1.77s/it]
Batches: 24%|██▍ | 140/586 [06:31<13:05, 1.76s/it]
Batches: 24%|██▍ | 141/586 [06:33<14:57, 2.02s/it]
Batches: 24%|██▍ | 142/586 [06:35<14:33, 1.97s/it]
Batches: 24%|██▍ | 143/586 [06:37<12:49, 1.74s/it]
Batches: 25%|██▍ | 144/586 [06:38<11:37, 1.58s/it]
Batches: 25%|██▍ | 145/586 [06:39<10:12, 1.39s/it]
Batches: 25%|██▍ | 146/586 [06:41<11:57, 1.63s/it]
Batches: 25%|██▌ | 147/586 [06:42<10:41, 1.46s/it]
Batches: 25%|██▌ | 148/586 [06:43<09:47, 1.34s/it]
Batches: 25%|██▌ | 149/586 [06:45<11:36, 1.59s/it]
Batches: 26%|██▌ | 150/586 [06:48<13:27, 1.85s/it]
Batches: 26%|██▌ | 151/586 [06:48<11:11, 1.54s/it]
Batches: 26%|██▌ | 152/586 [06:51<13:59, 1.93s/it]
Batches: 26%|██▌ | 153/586 [06:52<11:30, 1.59s/it]
Batches: 26%|██▋ | 154/586 [06:53<10:21, 1.44s/it]
Batches: 26%|██▋ | 155/586 [06:54<09:44, 1.36s/it]
Batches: 27%|██▋ | 156/586 [07:03<25:47, 3.60s/it]
Batches: 27%|██▋ | 157/586 [07:04<20:47, 2.91s/it]
Batches: 27%|██▋ | 158/586 [07:07<18:57, 2.66s/it]
Batches: 27%|██▋ | 159/586 [07:08<15:59, 2.25s/it]
Batches: 27%|██▋ | 160/586 [07:09<13:15, 1.87s/it]
Batches: 27%|██▋ | 161/586 [07:10<11:17, 1.59s/it]
Batches: 28%|██▊ | 162/586 [07:11<10:03, 1.42s/it]
Batches: 28%|██▊ | 163/586 [07:12<08:52, 1.26s/it]
Batches: 28%|██▊ | 164/586 [07:13<08:30, 1.21s/it]
Batches: 28%|██▊ | 165/586 [07:14<07:39, 1.09s/it]
Batches: 28%|██▊ | 166/586 [07:15<07:28, 1.07s/it]
Batches: 28%|██▊ | 167/586 [07:16<09:09, 1.31s/it]
Batches: 29%|██▊ | 168/586 [07:19<12:25, 1.78s/it]
Batches: 29%|██▉ | 169/586 [07:21<11:04, 1.59s/it]
Batches: 29%|██▉ | 170/586 [07:22<10:17, 1.49s/it]
Batches: 29%|██▉ | 171/586 [07:23<09:40, 1.40s/it]
Batches: 29%|██▉ | 172/586 [07:25<09:52, 1.43s/it]
Batches: 30%|██▉ | 173/586 [07:26<09:51, 1.43s/it]
Batches: 30%|██▉ | 174/586 [07:27<08:57, 1.30s/it]
Batches: 30%|██▉ | 175/586 [07:28<08:41, 1.27s/it]
Batches: 30%|███ | 176/586 [07:30<10:14, 1.50s/it]
Batches: 30%|███ | 177/586 [07:31<09:09, 1.34s/it]
Batches: 30%|███ | 178/586 [07:32<08:45, 1.29s/it]
Batches: 31%|███ | 179/586 [07:33<08:35, 1.27s/it]
Batches: 31%|███ | 180/586 [07:34<07:39, 1.13s/it]
Batches: 31%|███ | 181/586 [07:35<07:06, 1.05s/it]
Batches: 31%|███ | 182/586 [07:36<06:50, 1.02s/it]
Batches: 31%|███ | 183/586 [07:37<07:04, 1.05s/it]
Batches: 31%|███▏ | 184/586 [07:39<08:14, 1.23s/it]
Batches: 32%|███▏ | 185/586 [07:40<08:50, 1.32s/it]
Batches: 32%|███▏ | 186/586 [07:53<31:41, 4.75s/it]
Batches: 32%|███▏ | 187/586 [07:55<25:36, 3.85s/it]
Batches: 32%|███▏ | 188/586 [07:56<20:11, 3.04s/it]
Batches: 32%|███▏ | 189/586 [07:57<16:28, 2.49s/it]
Batches: 32%|███▏ | 190/586 [07:58<13:42, 2.08s/it]
Batches: 33%|███▎ | 191/586 [07:59<11:44, 1.78s/it]
Batches: 33%|███▎ | 192/586 [08:01<11:26, 1.74s/it]
Batches: 33%|███▎ | 193/586 [08:04<13:00, 1.99s/it]
Batches: 33%|███▎ | 194/586 [08:05<11:31, 1.76s/it]
Batches: 33%|███▎ | 195/586 [08:07<12:37, 1.94s/it]
Batches: 33%|███▎ | 196/586 [08:09<11:55, 1.83s/it]
Batches: 34%|███▎ | 197/586 [08:10<10:33, 1.63s/it]
Batches: 34%|███▍ | 198/586 [08:11<09:44, 1.51s/it]
Batches: 34%|███▍ | 199/586 [08:12<08:40, 1.35s/it]
Batches: 34%|███▍ | 200/586 [08:13<07:52, 1.22s/it]
Batches: 34%|███▍ | 201/586 [08:15<08:37, 1.35s/it]
Batches: 34%|███▍ | 202/586 [08:16<07:51, 1.23s/it]
Batches: 35%|███▍ | 203/586 [08:17<07:20, 1.15s/it]
Batches: 35%|███▍ | 204/586 [08:18<07:09, 1.13s/it]
Batches: 35%|███▍ | 205/586 [08:19<06:45, 1.07s/it]
Batches: 35%|███▌ | 206/586 [08:20<06:22, 1.01s/it]
Batches: 35%|███▌ | 207/586 [08:20<06:09, 1.03it/s]
Batches: 35%|███▌ | 208/586 [08:21<06:12, 1.01it/s]
Batches: 36%|███▌ | 209/586 [08:22<05:53, 1.07it/s]
Batches: 36%|███▌ | 210/586 [08:23<05:43, 1.10it/s]
Batches: 36%|███▌ | 211/586 [08:25<06:55, 1.11s/it]
Batches: 36%|███▌ | 212/586 [08:26<06:38, 1.07s/it]
Batches: 36%|███▋ | 213/586 [08:27<07:22, 1.19s/it]
Batches: 37%|███▋ | 214/586 [08:28<07:14, 1.17s/it]
Batches: 37%|███▋ | 215/586 [08:29<06:44, 1.09s/it]
Batches: 37%|███▋ | 216/586 [08:33<11:43, 1.90s/it]
Batches: 37%|███▋ | 217/586 [08:34<10:07, 1.65s/it]
Batches: 37%|███▋ | 218/586 [08:37<11:42, 1.91s/it]
Batches: 37%|███▋ | 219/586 [08:37<09:50, 1.61s/it]
Batches: 38%|███▊ | 220/586 [08:39<08:56, 1.47s/it]
Batches: 38%|███▊ | 221/586 [08:40<08:27, 1.39s/it]
Batches: 38%|███▊ | 222/586 [08:41<07:40, 1.26s/it]
Batches: 38%|███▊ | 223/586 [08:42<07:11, 1.19s/it]
Batches: 38%|███▊ | 224/586 [08:47<14:20, 2.38s/it]
Batches: 38%|███▊ | 225/586 [08:48<12:02, 2.00s/it]
Batches: 39%|███▊ | 226/586 [08:49<10:06, 1.68s/it]
Batches: 39%|███▊ | 227/586 [08:50<08:50, 1.48s/it]
Batches: 39%|███▉ | 228/586 [08:51<07:35, 1.27s/it]
Batches: 39%|███▉ | 229/586 [08:52<06:36, 1.11s/it]
Batches: 39%|███▉ | 230/586 [08:52<06:00, 1.01s/it]
Batches: 39%|███▉ | 231/586 [08:53<05:23, 1.10it/s]
Batches: 40%|███▉ | 232/586 [08:54<04:58, 1.18it/s]
Batches: 40%|███▉ | 233/586 [08:54<04:39, 1.26it/s]
Batches: 40%|███▉ | 234/586 [08:56<05:26, 1.08it/s]
Batches: 40%|████ | 235/586 [08:56<05:08, 1.14it/s]
Batches: 40%|████ | 236/586 [08:57<04:50, 1.21it/s]
Batches: 40%|████ | 237/586 [08:58<04:39, 1.25it/s]
Batches: 41%|████ | 238/586 [08:59<04:34, 1.27it/s]
Batches: 41%|████ | 239/586 [08:59<04:22, 1.32it/s]
Batches: 41%|████ | 240/586 [09:00<04:27, 1.29it/s]
Batches: 41%|████ | 241/586 [09:01<05:34, 1.03it/s]
Batches: 41%|████▏ | 242/586 [09:02<04:57, 1.15it/s]
Batches: 41%|████▏ | 243/586 [09:03<04:45, 1.20it/s]
Batches: 42%|████▏ | 244/586 [09:04<04:25, 1.29it/s]
Batches: 42%|████▏ | 245/586 [09:04<04:24, 1.29it/s]
Batches: 42%|████▏ | 246/586 [09:05<04:09, 1.36it/s]
Batches: 42%|████▏ | 247/586 [09:06<04:20, 1.30it/s]
Batches: 42%|████▏ | 248/586 [09:07<05:02, 1.12it/s]
Batches: 42%|████▏ | 249/586 [09:08<05:01, 1.12it/s]
Batches: 43%|████▎ | 250/586 [09:10<06:59, 1.25s/it]
Batches: 43%|████▎ | 251/586 [09:11<05:53, 1.05s/it]
Batches: 43%|████▎ | 252/586 [09:11<05:32, 1.01it/s]
Batches: 43%|████▎ | 253/586 [09:12<05:28, 1.01it/s]
Batches: 43%|████▎ | 254/586 [09:13<05:01, 1.10it/s]
Batches: 44%|████▎ | 255/586 [09:15<06:19, 1.15s/it]
Batches: 44%|████▎ | 256/586 [09:16<05:59, 1.09s/it]
Batches: 44%|████▍ | 257/586 [09:17<05:29, 1.00s/it]
Batches: 44%|████▍ | 258/586 [09:17<05:14, 1.04it/s]
Batches: 44%|████▍ | 259/586 [09:19<05:59, 1.10s/it]
Batches: 44%|████▍ | 260/586 [09:22<10:05, 1.86s/it]
Batches: 45%|████▍ | 261/586 [09:24<09:03, 1.67s/it]
Batches: 45%|████▍ | 262/586 [09:26<09:48, 1.82s/it]
Batches: 45%|████▍ | 263/586 [09:27<08:31, 1.58s/it]
Batches: 45%|████▌ | 264/586 [09:29<08:35, 1.60s/it]
Batches: 45%|████▌ | 265/586 [09:30<08:05, 1.51s/it]
Batches: 45%|████▌ | 266/586 [09:32<08:41, 1.63s/it]
Batches: 46%|████▌ | 267/586 [09:33<08:20, 1.57s/it]
Batches: 46%|████▌ | 268/586 [09:34<07:36, 1.44s/it]
Batches: 46%|████▌ | 269/586 [09:36<07:18, 1.38s/it]
Batches: 46%|████▌ | 270/586 [09:36<06:17, 1.20s/it]
Batches: 46%|████▌ | 271/586 [09:37<05:48, 1.11s/it]
Batches: 46%|████▋ | 272/586 [09:38<05:21, 1.02s/it]
Batches: 47%|████▋ | 273/586 [09:39<04:49, 1.08it/s]
Batches: 47%|████▋ | 274/586 [09:39<04:24, 1.18it/s]
Batches: 47%|████▋ | 275/586 [09:40<04:05, 1.27it/s]
Batches: 47%|████▋ | 276/586 [09:41<03:54, 1.32it/s]
Batches: 47%|████▋ | 277/586 [09:42<04:16, 1.21it/s]
Batches: 47%|████▋ | 278/586 [09:43<04:10, 1.23it/s]
Batches: 48%|████▊ | 279/586 [09:43<04:00, 1.28it/s]
Batches: 48%|████▊ | 280/586 [09:52<15:46, 3.09s/it]
Batches: 48%|████▊ | 281/586 [09:59<22:02, 4.34s/it]
Batches: 48%|████▊ | 282/586 [10:00<17:38, 3.48s/it]
Batches: 48%|████▊ | 283/586 [10:02<14:12, 2.81s/it]
Batches: 48%|████▊ | 284/586 [10:02<11:05, 2.20s/it]
Batches: 49%|████▊ | 285/586 [10:03<09:03, 1.81s/it]
Batches: 49%|████▉ | 286/586 [10:04<07:25, 1.49s/it]
Batches: 49%|████▉ | 287/586 [10:05<06:09, 1.24s/it]
Batches: 49%|████▉ | 288/586 [10:05<05:21, 1.08s/it]
Batches: 49%|████▉ | 289/586 [10:06<05:11, 1.05s/it]
Batches: 49%|████▉ | 290/586 [10:07<04:51, 1.01it/s]
Batches: 50%|████▉ | 291/586 [10:08<04:42, 1.04it/s]
Batches: 50%|████▉ | 292/586 [10:09<04:30, 1.09it/s]
Batches: 50%|█████ | 293/586 [10:10<05:04, 1.04s/it]
Batches: 50%|█████ | 294/586 [10:11<04:44, 1.03it/s]
Batches: 50%|█████ | 295/586 [10:12<04:20, 1.12it/s]
Batches: 51%|█████ | 296/586 [10:13<04:03, 1.19it/s]
Batches: 51%|█████ | 297/586 [10:15<06:08, 1.27s/it]
Batches: 51%|█████ | 298/586 [10:15<05:05, 1.06s/it]
Batches: 51%|█████ | 299/586 [10:16<04:34, 1.04it/s]
Batches: 51%|█████ | 300/586 [10:17<04:10, 1.14it/s]
Batches: 51%|█████▏ | 301/586 [10:17<03:50, 1.24it/s]
Batches: 52%|█████▏ | 302/586 [10:18<03:41, 1.28it/s]
Batches: 52%|█████▏ | 303/586 [10:19<03:36, 1.31it/s]
Batches: 52%|█████▏ | 304/586 [10:20<03:54, 1.20it/s]
Batches: 52%|█████▏ | 305/586 [10:20<03:34, 1.31it/s]
Batches: 52%|█████▏ | 306/586 [10:22<04:19, 1.08it/s]
Batches: 52%|█████▏ | 307/586 [10:23<04:26, 1.05it/s]
Batches: 53%|█████▎ | 308/586 [10:24<04:16, 1.08it/s]
Batches: 53%|█████▎ | 309/586 [10:25<04:32, 1.02it/s]
Batches: 53%|█████▎ | 310/586 [10:26<04:18, 1.07it/s]
Batches: 53%|█████▎ | 311/586 [10:30<09:41, 2.12s/it]
Batches: 53%|█████▎ | 312/586 [10:32<08:54, 1.95s/it]
Batches: 53%|█████▎ | 313/586 [10:35<09:47, 2.15s/it]
Batches: 54%|█████▎ | 314/586 [10:36<09:15, 2.04s/it]
Batches: 54%|█████▍ | 315/586 [10:37<07:30, 1.66s/it]
Batches: 54%|█████▍ | 316/586 [10:38<06:26, 1.43s/it]
Batches: 54%|█████▍ | 317/586 [10:39<05:38, 1.26s/it]
Batches: 54%|█████▍ | 318/586 [10:41<06:34, 1.47s/it]
Batches: 54%|█████▍ | 319/586 [10:56<25:00, 5.62s/it]
Batches: 55%|█████▍ | 320/586 [10:58<19:20, 4.36s/it]
Batches: 55%|█████▍ | 321/586 [11:09<28:20, 6.42s/it]
Batches: 55%|█████▍ | 322/586 [11:10<21:35, 4.91s/it]
Batches: 55%|█████▌ | 323/586 [11:11<16:37, 3.79s/it]
Batches: 55%|█████▌ | 324/586 [11:12<12:40, 2.90s/it]
Batches: 55%|█████▌ | 325/586 [11:14<10:46, 2.48s/it]
Batches: 56%|█████▌ | 326/586 [11:17<11:06, 2.56s/it]
Batches: 56%|█████▌ | 327/586 [11:18<09:57, 2.31s/it]
Batches: 56%|█████▌ | 328/586 [11:19<08:13, 1.91s/it]
Batches: 56%|█████▌ | 329/586 [11:20<06:57, 1.63s/it]
Batches: 56%|█████▋ | 330/586 [11:21<06:03, 1.42s/it]
Batches: 56%|█████▋ | 331/586 [11:23<06:26, 1.52s/it]
Batches: 57%|█████▋ | 332/586 [11:24<05:33, 1.31s/it]
Batches: 57%|█████▋ | 333/586 [11:25<05:04, 1.21s/it]
Batches: 57%|█████▋ | 334/586 [11:26<05:44, 1.37s/it]
Batches: 57%|█████▋ | 335/586 [11:27<05:09, 1.23s/it]
Batches: 57%|█████▋ | 336/586 [11:28<04:37, 1.11s/it]
Batches: 58%|█████▊ | 337/586 [11:30<04:57, 1.19s/it]
Batches: 58%|█████▊ | 338/586 [11:31<05:15, 1.27s/it]
Batches: 58%|█████▊ | 339/586 [11:32<04:46, 1.16s/it]
Batches: 58%|█████▊ | 340/586 [11:33<04:40, 1.14s/it]
Batches: 58%|█████▊ | 341/586 [11:35<05:42, 1.40s/it]
Batches: 58%|█████▊ | 342/586 [11:36<05:28, 1.35s/it]
Batches: 59%|█████▊ | 343/586 [11:37<04:41, 1.16s/it]
Batches: 59%|█████▊ | 344/586 [11:38<04:13, 1.05s/it]
Batches: 59%|█████▉ | 345/586 [11:39<04:19, 1.08s/it]
Batches: 59%|█████▉ | 346/586 [11:40<04:28, 1.12s/it]
Batches: 59%|█████▉ | 347/586 [11:41<03:47, 1.05it/s]
Batches: 59%|█████▉ | 348/586 [11:41<03:37, 1.09it/s]
Batches: 60%|█████▉ | 349/586 [11:43<04:15, 1.08s/it]
Batches: 60%|█████▉ | 350/586 [11:44<04:07, 1.05s/it]
Batches: 60%|█████▉ | 351/586 [11:45<03:53, 1.00it/s]
Batches: 60%|██████ | 352/586 [11:45<03:07, 1.25it/s]
Batches: 60%|██████ | 353/586 [11:46<02:41, 1.45it/s]
Batches: 60%|██████ | 354/586 [11:47<03:37, 1.07it/s]
Batches: 61%|██████ | 355/586 [11:48<03:29, 1.10it/s]
Batches: 61%|██████ | 356/586 [11:51<05:31, 1.44s/it]
Batches: 61%|██████ | 357/586 [11:56<10:20, 2.71s/it]
Batches: 61%|██████ | 358/586 [11:58<09:00, 2.37s/it]
Batches: 61%|██████▏ | 359/586 [11:59<06:59, 1.85s/it]
Batches: 61%|██████▏ | 360/586 [11:59<05:37, 1.49s/it]
Batches: 62%|██████▏ | 361/586 [12:00<04:35, 1.22s/it]
Batches: 62%|██████▏ | 362/586 [12:01<04:01, 1.08s/it]
Batches: 62%|██████▏ | 363/586 [12:01<03:32, 1.05it/s]
Batches: 62%|██████▏ | 364/586 [12:02<03:04, 1.20it/s]
Batches: 62%|██████▏ | 365/586 [12:02<02:35, 1.42it/s]
Batches: 62%|██████▏ | 366/586 [12:03<02:19, 1.58it/s]
Batches: 63%|██████▎ | 367/586 [12:04<02:47, 1.31it/s]
Batches: 63%|██████▎ | 368/586 [12:04<02:24, 1.51it/s]
Batches: 63%|██████▎ | 369/586 [12:05<02:36, 1.38it/s]
Batches: 63%|██████▎ | 370/586 [12:06<02:55, 1.23it/s]
Batches: 63%|██████▎ | 371/586 [12:06<02:34, 1.39it/s]
Batches: 63%|██████▎ | 372/586 [12:07<02:12, 1.61it/s]
Batches: 64%|██████▎ | 373/586 [12:08<02:17, 1.55it/s]
Batches: 64%|██████▍ | 374/586 [12:08<02:20, 1.51it/s]
Batches: 64%|██████▍ | 375/586 [12:09<02:29, 1.41it/s]
Batches: 64%|██████▍ | 376/586 [12:10<02:14, 1.57it/s]
Batches: 64%|██████▍ | 377/586 [12:12<04:11, 1.20s/it]
Batches: 65%|██████▍ | 378/586 [12:12<03:08, 1.10it/s]
Batches: 65%|██████▍ | 379/586 [12:13<02:57, 1.17it/s]
Batches: 65%|██████▍ | 380/586 [12:14<03:07, 1.10it/s]
Batches: 65%|██████▌ | 381/586 [12:15<02:56, 1.16it/s]
Batches: 65%|██████▌ | 382/586 [12:15<02:26, 1.39it/s]
Batches: 65%|██████▌ | 383/586 [12:16<02:37, 1.29it/s]
Batches: 66%|██████▌ | 384/586 [12:17<02:28, 1.36it/s]
Batches: 66%|██████▌ | 385/586 [12:17<02:28, 1.35it/s]
Batches: 66%|██████▌ | 386/586 [12:18<02:21, 1.41it/s]
Batches: 66%|██████▌ | 387/586 [12:18<01:56, 1.71it/s]
Batches: 66%|██████▌ | 388/586 [12:19<01:39, 1.99it/s]
Batches: 66%|██████▋ | 389/586 [12:19<01:33, 2.11it/s]
Batches: 67%|██████▋ | 390/586 [12:20<01:31, 2.15it/s]
Batches: 67%|██████▋ | 391/586 [12:20<01:49, 1.78it/s]
Batches: 67%|██████▋ | 392/586 [12:21<01:36, 2.00it/s]
Batches: 67%|██████▋ | 393/586 [12:21<01:21, 2.36it/s]
Batches: 67%|██████▋ | 394/586 [12:21<01:18, 2.46it/s]
Batches: 67%|██████▋ | 395/586 [12:22<01:04, 2.96it/s]
Batches: 68%|██████▊ | 396/586 [12:22<01:17, 2.44it/s]
Batches: 68%|██████▊ | 397/586 [12:22<01:09, 2.72it/s]
Batches: 68%|██████▊ | 398/586 [12:23<01:40, 1.86it/s]
Batches: 68%|██████▊ | 399/586 [12:24<01:27, 2.14it/s]
Batches: 68%|██████▊ | 400/586 [12:24<01:34, 1.97it/s]
Batches: 68%|██████▊ | 401/586 [12:25<01:35, 1.93it/s]
Batches: 69%|██████▊ | 402/586 [12:25<01:27, 2.09it/s]
Batches: 69%|██████▉ | 403/586 [12:26<01:32, 1.98it/s]
Batches: 69%|██████▉ | 404/586 [12:26<01:43, 1.75it/s]
Batches: 69%|██████▉ | 405/586 [12:27<01:29, 2.02it/s]
Batches: 69%|██████▉ | 406/586 [12:27<01:35, 1.88it/s]
Batches: 69%|██████▉ | 407/586 [12:28<01:21, 2.19it/s]
Batches: 70%|██████▉ | 408/586 [12:28<01:07, 2.62it/s]
Batches: 70%|██████▉ | 409/586 [12:28<01:01, 2.89it/s]
Batches: 70%|██████▉ | 410/586 [12:28<00:53, 3.27it/s]
Batches: 70%|███████ | 411/586 [12:29<00:53, 3.25it/s]
Batches: 70%|███████ | 412/586 [12:36<07:13, 2.49s/it]
Batches: 70%|███████ | 413/586 [12:36<05:11, 1.80s/it]
Batches: 71%|███████ | 414/586 [12:37<03:45, 1.31s/it]
Batches: 71%|███████ | 415/586 [12:37<02:46, 1.03it/s]
Batches: 71%|███████ | 416/586 [12:37<02:08, 1.32it/s]
Batches: 71%|███████ | 417/586 [12:37<01:47, 1.58it/s]
Batches: 71%|███████▏ | 418/586 [12:38<01:34, 1.77it/s]
Batches: 72%|███████▏ | 419/586 [12:38<01:20, 2.07it/s]
Batches: 72%|███████▏ | 420/586 [12:38<01:10, 2.36it/s]
Batches: 72%|███████▏ | 421/586 [12:39<01:04, 2.57it/s]
Batches: 72%|███████▏ | 422/586 [12:39<00:59, 2.74it/s]
Batches: 72%|███████▏ | 423/586 [12:39<00:57, 2.86it/s]
Batches: 72%|███████▏ | 424/586 [12:40<01:10, 2.29it/s]
Batches: 73%|███████▎ | 425/586 [12:40<01:02, 2.59it/s]
Batches: 73%|███████▎ | 426/586 [12:40<00:52, 3.06it/s]
Batches: 73%|███████▎ | 427/586 [12:41<00:50, 3.13it/s]
Batches: 73%|███████▎ | 428/586 [12:41<00:48, 3.25it/s]
Batches: 73%|███████▎ | 429/586 [12:41<00:44, 3.54it/s]
Batches: 73%|███████▎ | 430/586 [12:41<00:41, 3.77it/s]
Batches: 74%|███████▎ | 431/586 [12:42<00:42, 3.62it/s]
Batches: 74%|███████▎ | 432/586 [12:42<00:39, 3.89it/s]
Batches: 74%|███████▍ | 433/586 [12:42<00:52, 2.90it/s]
Batches: 74%|███████▍ | 434/586 [12:43<01:00, 2.50it/s]
Batches: 74%|███████▍ | 435/586 [12:43<01:03, 2.36it/s]
Batches: 74%|███████▍ | 436/586 [12:44<00:55, 2.72it/s]
Batches: 75%|███████▍ | 437/586 [12:44<00:48, 3.04it/s]
Batches: 75%|███████▍ | 438/586 [12:44<00:44, 3.33it/s]
Batches: 75%|███████▍ | 439/586 [12:44<00:37, 3.91it/s]
Batches: 75%|███████▌ | 440/586 [12:45<00:37, 3.90it/s]
Batches: 75%|███████▌ | 441/586 [12:45<00:36, 4.02it/s]
Batches: 75%|███████▌ | 442/586 [12:45<00:34, 4.16it/s]
Batches: 76%|███████▌ | 443/586 [12:46<00:55, 2.59it/s]
Batches: 76%|███████▌ | 444/586 [12:46<00:47, 2.99it/s]
Batches: 76%|███████▌ | 445/586 [12:46<00:47, 3.00it/s]
Batches: 76%|███████▌ | 446/586 [12:47<00:52, 2.67it/s]
Batches: 76%|███████▋ | 447/586 [12:47<00:56, 2.44it/s]
Batches: 76%|███████▋ | 448/586 [12:48<01:03, 2.18it/s]
Batches: 77%|███████▋ | 449/586 [12:48<01:06, 2.06it/s]
Batches: 77%|███████▋ | 450/586 [12:49<01:02, 2.18it/s]
Batches: 77%|███████▋ | 451/586 [12:55<05:06, 2.27s/it]
Batches: 77%|███████▋ | 452/586 [12:56<03:53, 1.74s/it]
Batches: 77%|███████▋ | 453/586 [12:56<02:51, 1.29s/it]
Batches: 77%|███████▋ | 454/586 [12:56<02:04, 1.06it/s]
Batches: 78%|███████▊ | 455/586 [12:56<01:31, 1.43it/s]
Batches: 78%|███████▊ | 456/586 [12:56<01:09, 1.88it/s]
Batches: 78%|███████▊ | 457/586 [12:57<00:56, 2.28it/s]
Batches: 78%|███████▊ | 458/586 [12:57<00:48, 2.64it/s]
Batches: 78%|███████▊ | 459/586 [12:57<00:44, 2.83it/s]
Batches: 78%|███████▊ | 460/586 [12:57<00:41, 3.01it/s]
Batches: 79%|███████▊ | 461/586 [12:58<00:39, 3.16it/s]
Batches: 79%|███████▉ | 462/586 [12:59<01:07, 1.85it/s]
Batches: 79%|███████▉ | 463/586 [12:59<00:57, 2.12it/s]
Batches: 79%|███████▉ | 464/586 [13:00<00:55, 2.20it/s]
Batches: 79%|███████▉ | 465/586 [13:00<00:49, 2.44it/s]
Batches: 80%|███████▉ | 466/586 [13:01<01:01, 1.96it/s]
Batches: 80%|███████▉ | 467/586 [13:01<00:47, 2.50it/s]
Batches: 80%|███████▉ | 468/586 [13:01<00:38, 3.05it/s]
Batches: 80%|████████ | 469/586 [13:01<00:44, 2.61it/s]
Batches: 80%|████████ | 470/586 [13:02<00:38, 3.05it/s]
Batches: 80%|████████ | 471/586 [13:02<00:30, 3.76it/s]
Batches: 81%|████████ | 472/586 [13:02<00:43, 2.65it/s]
Batches: 81%|████████ | 473/586 [13:07<03:10, 1.69s/it]
Batches: 81%|████████ | 474/586 [13:08<02:30, 1.35s/it]
Batches: 81%|████████ | 476/586 [13:08<01:23, 1.32it/s]
Batches: 82%|████████▏ | 478/586 [13:08<00:51, 2.08it/s]
Batches: 82%|████████▏ | 479/586 [13:08<00:43, 2.49it/s]
Batches: 82%|████████▏ | 480/586 [13:08<00:36, 2.93it/s]
Batches: 82%|████████▏ | 482/586 [13:08<00:23, 4.34it/s]
Batches: 83%|████████▎ | 484/586 [13:09<00:20, 4.87it/s]
Batches: 83%|████████▎ | 485/586 [13:09<00:19, 5.21it/s]
Batches: 83%|████████▎ | 486/586 [13:09<00:17, 5.62it/s]
Batches: 83%|████████▎ | 487/586 [13:09<00:16, 6.12it/s]
Batches: 83%|████████▎ | 488/586 [13:09<00:15, 6.41it/s]
Batches: 83%|████████▎ | 489/586 [13:09<00:19, 5.10it/s]
Batches: 84%|████████▎ | 490/586 [13:10<00:16, 5.69it/s]
Batches: 84%|████████▍ | 492/586 [13:10<00:12, 7.35it/s]
Batches: 84%|████████▍ | 493/586 [13:10<00:13, 6.75it/s]
Batches: 84%|████████▍ | 494/586 [13:10<00:13, 7.05it/s]
Batches: 84%|████████▍ | 495/586 [13:10<00:14, 6.32it/s]
Batches: 85%|████████▍ | 496/586 [13:10<00:14, 6.34it/s]
Batches: 85%|████████▍ | 498/586 [13:11<00:11, 7.65it/s]
Batches: 85%|████████▌ | 500/586 [13:11<00:11, 7.65it/s]
Batches: 86%|████████▌ | 502/586 [13:11<00:10, 8.13it/s]
Batches: 86%|████████▌ | 503/586 [13:11<00:10, 8.27it/s]
Batches: 86%|████████▌ | 505/586 [13:11<00:09, 8.16it/s]
Batches: 86%|████████▋ | 506/586 [13:12<00:10, 7.49it/s]
Batches: 87%|████████▋ | 507/586 [13:12<00:10, 7.68it/s]
Batches: 87%|████████▋ | 508/586 [13:12<00:10, 7.22it/s]
Batches: 87%|████████▋ | 509/586 [13:12<00:10, 7.09it/s]
Batches: 87%|████████▋ | 510/586 [13:12<00:10, 7.37it/s]
Batches: 87%|████████▋ | 511/586 [13:12<00:10, 6.97it/s]
Batches: 87%|████████▋ | 512/586 [13:13<00:10, 6.84it/s]
Batches: 88%|████████▊ | 513/586 [13:13<00:12, 6.01it/s]
Batches: 88%|████████▊ | 514/586 [13:13<00:10, 6.73it/s]
Batches: 88%|████████▊ | 516/586 [13:13<00:09, 7.24it/s]
Batches: 88%|████████▊ | 517/586 [13:13<00:09, 7.40it/s]
Batches: 89%|████████▊ | 519/586 [13:13<00:07, 8.56it/s]
Batches: 89%|████████▉ | 521/586 [13:14<00:07, 8.56it/s]
Batches: 89%|████████▉ | 522/586 [13:14<00:07, 8.70it/s]
Batches: 89%|████████▉ | 523/586 [13:14<00:08, 7.60it/s]
Batches: 89%|████████▉ | 524/586 [13:14<00:08, 6.89it/s]
Batches: 90%|████████▉ | 525/586 [13:14<00:08, 6.84it/s]
Batches: 90%|████████▉ | 527/586 [13:14<00:07, 7.99it/s]
Batches: 90%|█████████ | 528/586 [13:15<00:07, 8.17it/s]
Batches: 90%|█████████ | 530/586 [13:15<00:06, 8.66it/s]
Batches: 91%|█████████ | 531/586 [13:15<00:06, 8.37it/s]
Batches: 91%|█████████ | 532/586 [13:15<00:06, 8.18it/s]
Batches: 91%|█████████ | 533/586 [13:15<00:06, 8.01it/s]
Batches: 91%|█████████ | 534/586 [13:16<00:16, 3.16it/s]
Batches: 91%|█████████▏| 535/586 [13:16<00:14, 3.56it/s]
Batches: 91%|█████████▏| 536/586 [13:16<00:12, 4.09it/s]
Batches: 92%|█████████▏| 537/586 [13:17<00:13, 3.67it/s]
Batches: 92%|█████████▏| 538/586 [13:17<00:12, 3.87it/s]
Batches: 92%|█████████▏| 539/586 [13:17<00:10, 4.35it/s]
Batches: 92%|█████████▏| 540/586 [13:17<00:11, 3.90it/s]
Batches: 92%|█████████▏| 541/586 [13:18<00:13, 3.45it/s]
Batches: 92%|█████████▏| 542/586 [13:18<00:10, 4.01it/s]
Batches: 93%|█████████▎| 543/586 [13:18<00:12, 3.35it/s]
Batches: 93%|█████████▎| 544/586 [13:18<00:10, 3.97it/s]
Batches: 93%|█████████▎| 545/586 [13:19<00:10, 3.90it/s]
Batches: 93%|█████████▎| 546/586 [13:19<00:11, 3.55it/s]
Batches: 93%|█████████▎| 547/586 [13:20<00:13, 2.89it/s]
Batches: 94%|█████████▎| 548/586 [13:20<00:12, 3.15it/s]
Batches: 94%|█████████▎| 549/586 [13:20<00:12, 2.90it/s]
Batches: 94%|█████████▍| 550/586 [13:21<00:11, 3.05it/s]
Batches: 94%|█████████▍| 551/586 [13:21<00:10, 3.26it/s]
Batches: 94%|█████████▍| 552/586 [13:21<00:11, 3.03it/s]
Batches: 94%|█████████▍| 553/586 [13:21<00:09, 3.64it/s]
Batches: 95%|█████████▍| 554/586 [13:22<00:08, 3.85it/s]
Batches: 95%|█████████▍| 555/586 [13:22<00:07, 4.37it/s]
Batches: 95%|█████████▍| 556/586 [13:22<00:06, 4.30it/s]
Batches: 95%|█████████▌| 557/586 [13:22<00:06, 4.40it/s]
Batches: 95%|█████████▌| 558/586 [13:22<00:06, 4.25it/s]
Batches: 95%|█████████▌| 559/586 [13:23<00:06, 4.47it/s]
Batches: 96%|█████████▌| 561/586 [13:23<00:04, 5.82it/s]
Batches: 96%|█████████▌| 562/586 [13:23<00:03, 6.24it/s]
Batches: 96%|█████████▌| 563/586 [13:23<00:03, 6.53it/s]
Batches: 96%|█████████▌| 564/586 [13:23<00:03, 5.83it/s]
Batches: 96%|█████████▋| 565/586 [13:23<00:03, 5.92it/s]
Batches: 97%|█████████▋| 566/586 [13:24<00:03, 5.30it/s]
Batches: 97%|█████████▋| 567/586 [13:24<00:04, 3.87it/s]
Batches: 97%|█████████▋| 568/586 [13:24<00:03, 4.58it/s]
Batches: 97%|█████████▋| 569/586 [13:24<00:03, 4.58it/s]
Batches: 97%|█████████▋| 570/586 [13:25<00:03, 5.13it/s]
Batches: 97%|█████████▋| 571/586 [13:25<00:03, 4.87it/s]
Batches: 98%|█████████▊| 573/586 [13:25<00:02, 5.57it/s]
Batches: 98%|█████████▊| 574/586 [13:25<00:02, 5.86it/s]
Batches: 98%|█████████▊| 575/586 [13:25<00:01, 6.37it/s]
Batches: 98%|█████████▊| 576/586 [13:26<00:01, 6.08it/s]
Batches: 98%|█████████▊| 577/586 [13:26<00:01, 6.25it/s]
Batches: 99%|█████████▊| 578/586 [13:26<00:01, 5.48it/s]
Batches: 99%|█████████▉| 579/586 [13:26<00:01, 5.99it/s]
Batches: 99%|█████████▉| 580/586 [13:26<00:00, 6.31it/s]
Batches: 99%|█████████▉| 581/586 [13:26<00:00, 6.56it/s]
Batches: 99%|█████████▉| 582/586 [13:27<00:00, 5.91it/s]
Batches: 99%|█████████▉| 583/586 [13:27<00:00, 6.27it/s]
Batches: 100%|█████████▉| 584/586 [13:27<00:00, 6.22it/s]
Batches: 100%|█████████▉| 585/586 [13:27<00:00, 5.14it/s]
Batches: 100%|██████████| 586/586 [13:29<00:00, 1.81it/s]
Batches: 100%|██████████| 586/586 [13:29<00:00, 1.38s/it]
2025-11-26 19:57:31,904 - INFO - Generated embeddings: (150000, 384) in 13.7 minutes
2025-11-26 19:57:31,906 - INFO - Step 2.5/5: PCA reduction (384 -> 50 dims)...
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/sklearn/decomposition/_pca.py:604: RuntimeWarning: divide by zero encountered in matmul
C = X.T @ X
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/sklearn/decomposition/_pca.py:604: RuntimeWarning: overflow encountered in matmul
C = X.T @ X
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/sklearn/decomposition/_pca.py:604: RuntimeWarning: invalid value encountered in matmul
C = X.T @ X
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/sklearn/decomposition/_base.py:148: RuntimeWarning: divide by zero encountered in matmul
X_transformed = X @ self.components_.T
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/sklearn/decomposition/_base.py:148: RuntimeWarning: overflow encountered in matmul
X_transformed = X @ self.components_.T
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/sklearn/decomposition/_base.py:148: RuntimeWarning: invalid value encountered in matmul
X_transformed = X @ self.components_.T
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/sklearn/decomposition/_base.py:155: RuntimeWarning: divide by zero encountered in matmul
X_transformed -= xp.reshape(self.mean_, (1, -1)) @ self.components_.T
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/sklearn/decomposition/_base.py:155: RuntimeWarning: overflow encountered in matmul
X_transformed -= xp.reshape(self.mean_, (1, -1)) @ self.components_.T
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/sklearn/decomposition/_base.py:155: RuntimeWarning: invalid value encountered in matmul
X_transformed -= xp.reshape(self.mean_, (1, -1)) @ self.components_.T
2025-11-26 19:57:32,249 - INFO - PCA complete in 0.3s (preserved 93.3% variance)
2025-11-26 19:57:32,250 - INFO - Reduced embeddings: (150000, 50)
2025-11-26 19:57:32,250 - INFO - Step 3/5: Running OPTIMIZED UMAP for 3D coordinates...
UMAP(low_memory=False, n_components=3, spread=1.5, verbose=True)
Wed Nov 26 19:57:32 2025 Construct fuzzy simplicial set
Wed Nov 26 19:57:32 2025 Finding Nearest Neighbors
Wed Nov 26 19:57:32 2025 Building RP forest with 24 trees
Wed Nov 26 19:57:43 2025 NN descent for 17 iterations
1 / 17
2 / 17
3 / 17
4 / 17
Stopping threshold met -- exiting after 4 iterations
Wed Nov 26 19:58:03 2025 Finished Nearest Neighbor Search
Wed Nov 26 19:58:07 2025 Construct embedding
Epochs completed: 0%| 0/200 [00:00]
Epochs completed: 0%| 1/200 [00:04]
Epochs completed: 1%| 2/200 [00:05]
Epochs completed: 2%| ▏ 3/200 [00:05]
Epochs completed: 2%| ▏ 4/200 [00:06]
Epochs completed: 2%| ▎ 5/200 [00:06]
Epochs completed: 3%| ▎ 6/200 [00:07]
Epochs completed: 4%| ▎ 7/200 [00:07]
Epochs completed: 4%| ▍ 8/200 [00:08]
Epochs completed: 4%| ▍ 9/200 [00:08]
Epochs completed: 5%| ▌ 10/200 [00:08]
Epochs completed: 6%| ▌ 11/200 [00:09]
Epochs completed: 6%| ▌ 12/200 [00:09]
Epochs completed: 6%| ▋ 13/200 [00:09]
Epochs completed: 7%| ▋ 14/200 [00:09]
Epochs completed: 8%| ▊ 15/200 [00:10]
Epochs completed: 8%| ▊ 16/200 [00:10]
Epochs completed: 8%| ▊ 17/200 [00:10]
Epochs completed: 9%| ▉ 18/200 [00:11]
Epochs completed: 10%| ▉ 19/200 [00:11]
Epochs completed: 10%| █ 20/200 [00:11]
Epochs completed: 10%| █ 21/200 [00:12]
Epochs completed: 11%| █ 22/200 [00:12]
Epochs completed: 12%| █▏ 23/200 [00:13]
Epochs completed: 12%| █▏ 24/200 [00:13]
Epochs completed: 12%| █▎ 25/200 [00:13]
Epochs completed: 13%| █▎ 26/200 [00:13]
Epochs completed: 14%| █▎ 27/200 [00:13]
Epochs completed: 14%| █▍ 28/200 [00:14]
Epochs completed: 14%| █▍ 29/200 [00:14]
Epochs completed: 15%| █▌ 30/200 [00:14]
Epochs completed: 16%| █▌ 31/200 [00:14]
Epochs completed: 16%| █▌ 32/200 [00:15]
Epochs completed: 16%| █▋ 33/200 [00:15]
Epochs completed: 17%| █▋ 34/200 [00:15]
Epochs completed: 18%| █▊ 35/200 [00:16]
Epochs completed: 18%| █▊ 36/200 [00:16]
Epochs completed: 18%| █▊ 37/200 [00:16]
Epochs completed: 19%| █▉ 38/200 [00:16]
Epochs completed: 20%| █▉ 39/200 [00:17]
Epochs completed: 20%| ██ 40/200 [00:17]
Epochs completed: 20%| ██ 41/200 [00:17]
Epochs completed: 21%| ██ 42/200 [00:18]
Epochs completed: 22%| ██▏ 43/200 [00:18]
Epochs completed: 22%| ██▏ 44/200 [00:18]
Epochs completed: 22%| ██▎ 45/200 [00:18]
Epochs completed: 23%| ██▎ 46/200 [00:19]
Epochs completed: 24%| ██▎ 47/200 [00:19]
Epochs completed: 24%| ██▍ 48/200 [00:19]
Epochs completed: 24%| ██▍ 49/200 [00:20]
Epochs completed: 25%| ██▌ 50/200 [00:20]
Epochs completed: 26%| ██▌ 51/200 [00:20]
Epochs completed: 26%| ██▌ 52/200 [00:20]
Epochs completed: 26%| ██▋ 53/200 [00:21]
Epochs completed: 27%| ██▋ 54/200 [00:21]
Epochs completed: 28%| ██▊ 55/200 [00:21]
Epochs completed: 28%| ██▊ 56/200 [00:21]
Epochs completed: 28%| ██▊ 57/200 [00:22]
Epochs completed: 29%| ██▉ 58/200 [00:22]
Epochs completed: 30%| ██▉ 59/200 [00:22]
Epochs completed: 30%| ███ 60/200 [00:23]
Epochs completed: 30%| ███ 61/200 [00:23]
Epochs completed: 31%| ███ 62/200 [00:23]
Epochs completed: 32%| ███▏ 63/200 [00:23]
Epochs completed: 32%| ███▏ 64/200 [00:24]
Epochs completed: 32%| ███▎ 65/200 [00:24]
Epochs completed: 33%| ███▎ 66/200 [00:25]
Epochs completed: 34%| ███▎ 67/200 [00:25]
Epochs completed: 34%| ███▍ 68/200 [00:25]
Epochs completed: 34%| ███▍ 69/200 [00:26]
Epochs completed: 35%| ███▌ 70/200 [00:26]
Epochs completed: 36%| ███▌ 71/200 [00:26]
Epochs completed: 36%| ███▌ 72/200 [00:27]
Epochs completed: 36%| ███▋ 73/200 [00:28]
Epochs completed: 37%| ███▋ 74/200 [00:29]
Epochs completed: 38%| ███▊ 75/200 [00:29]
Epochs completed: 38%| ███▊ 76/200 [00:29]
Epochs completed: 38%| ███▊ 77/200 [00:30]
Epochs completed: 39%| ███▉ 78/200 [00:31]
Epochs completed: 40%| ███▉ 79/200 [00:31]
Epochs completed: 40%| ████ 80/200 [00:32]
Epochs completed: 40%| ████ 81/200 [00:32]
Epochs completed: 41%| ████ 82/200 [00:32]
Epochs completed: 42%| ████▏ 83/200 [00:33]
Epochs completed: 42%| ████▏ 84/200 [00:34]
Epochs completed: 42%| ████▎ 85/200 [00:34]
Epochs completed: 43%| ████▎ 86/200 [00:35]
Epochs completed: 44%| ████▎ 87/200 [00:36]
Epochs completed: 44%| ████▍ 88/200 [00:36]
Epochs completed: 44%| ████▍ 89/200 [00:37]
Epochs completed: 45%| ████▌ 90/200 [00:38]
Epochs completed: 46%| ████▌ 91/200 [00:39]
Epochs completed: 46%| ████▌ 92/200 [00:39]
Epochs completed: 46%| ████▋ 93/200 [00:40]
Epochs completed: 47%| ████▋ 94/200 [00:41]
Epochs completed: 48%| ████▊ 95/200 [00:41]
Epochs completed: 48%| ████▊ 96/200 [00:42]
Epochs completed: 48%| ████▊ 97/200 [00:42]
Epochs completed: 49%| ████▉ 98/200 [00:43]
Epochs completed: 50%| ████▉ 99/200 [00:43]
Epochs completed: 50%| █████ 100/200 [00:44]
Epochs completed: 50%| █████ 101/200 [00:45]
Epochs completed: 51%| █████ 102/200 [00:46]
Epochs completed: 52%| █████▏ 103/200 [00:46]
Epochs completed: 52%| █████▏ 104/200 [00:48]
Epochs completed: 52%| █████▎ 105/200 [00:48]
Epochs completed: 53%| █████▎ 106/200 [00:49]
Epochs completed: 54%| █████▎ 107/200 [00:50]
Epochs completed: 54%| █████▍ 108/200 [00:50]
Epochs completed: 55%| █████▍ 109/200 [00:51]
Epochs completed: 55%| █████▌ 110/200 [00:51]
Epochs completed: 56%| █████▌ 111/200 [00:52]
Epochs completed: 56%| █████▌ 112/200 [00:52]
Epochs completed: 56%| █████▋ 113/200 [00:52]
Epochs completed: 57%| █████▋ 114/200 [00:53]
Epochs completed: 57%| █████▊ 115/200 [00:53]
Epochs completed: 58%| █████▊ 116/200 [00:54]
Epochs completed: 58%| █████▊ 117/200 [00:54]
Epochs completed: 59%| █████▉ 118/200 [00:54]
Epochs completed: 60%| █████▉ 119/200 [00:55]
Epochs completed: 60%| ██████ 120/200 [00:55]
Epochs completed: 60%| ██████ 121/200 [00:56]
Epochs completed: 61%| ██████ 122/200 [00:56]
Epochs completed: 62%| ██████▏ 123/200 [00:57]
Epochs completed: 62%| ██████▏ 124/200 [00:57]
Epochs completed: 62%| ██████▎ 125/200 [00:58]
Epochs completed: 63%| ██████▎ 126/200 [00:58]
Epochs completed: 64%| ██████▎ 127/200 [00:59]
Epochs completed: 64%| ██████▍ 128/200 [00:59]
Epochs completed: 64%| ██████▍ 129/200 [00:59]
Epochs completed: 65%| ██████▌ 130/200 [01:00]
Epochs completed: 66%| ██████▌ 131/200 [01:00]
Epochs completed: 66%| ██████▌ 132/200 [01:00]
Epochs completed: 66%| ██████▋ 133/200 [01:01]
Epochs completed: 67%| ██████▋ 134/200 [01:01]
Epochs completed: 68%| ██████▊ 135/200 [01:02]
Epochs completed: 68%| ██████▊ 136/200 [01:02]
Epochs completed: 68%| ██████▊ 137/200 [01:02]
Epochs completed: 69%| ██████▉ 138/200 [01:02]
Epochs completed: 70%| ██████▉ 139/200 [01:03]
Epochs completed: 70%| ███████ 140/200 [01:03]
Epochs completed: 70%| ███████ 141/200 [01:04]
Epochs completed: 71%| ███████ 142/200 [01:04]
Epochs completed: 72%| ███████▏ 143/200 [01:04]
Epochs completed: 72%| ███████▏ 144/200 [01:05]
Epochs completed: 72%| ███████▎ 145/200 [01:05]
Epochs completed: 73%| ███████▎ 146/200 [01:05]
Epochs completed: 74%| ███████▎ 147/200 [01:06]
Epochs completed: 74%| ███████▍ 148/200 [01:06]
Epochs completed: 74%| ███████▍ 149/200 [01:07]
Epochs completed: 75%| ███████▌ 150/200 [01:08]
Epochs completed: 76%| ███████▌ 151/200 [01:09]
Epochs completed: 76%| ███████▌ 152/200 [01:09]
Epochs completed: 76%| ███████▋ 153/200 [01:10]
Epochs completed: 77%| ███████▋ 154/200 [01:10]
Epochs completed: 78%| ███████▊ 155/200 [01:11]
Epochs completed: 78%| ███████▊ 156/200 [01:11]
Epochs completed: 78%| ███████▊ 157/200 [01:12]
Epochs completed: 79%| ███████▉ 158/200 [01:12]
Epochs completed: 80%| ███████▉ 159/200 [01:12]
Epochs completed: 80%| ████████ 160/200 [01:13]
Epochs completed: 80%| ████████ 161/200 [01:13]
Epochs completed: 81%| ████████ 162/200 [01:13]
Epochs completed: 82%| ████████▏ 163/200 [01:14]
Epochs completed: 82%| ████████▏ 164/200 [01:14]
Epochs completed: 82%| ████████▎ 165/200 [01:14]
Epochs completed: 83%| ████████▎ 166/200 [01:14]
Epochs completed: 84%| ████████▎ 167/200 [01:15]
Epochs completed: 84%| ████████▍ 168/200 [01:15]
Epochs completed: 84%| ████████▍ 169/200 [01:15]
Epochs completed: 85%| ████████▌ 170/200 [01:15]
Epochs completed: 86%| ████████▌ 171/200 [01:16]
Epochs completed: 86%| ████████▌ 172/200 [01:16]
Epochs completed: 86%| ████████▋ 173/200 [01:17]
Epochs completed: 87%| ████████▋ 174/200 [01:17]
Epochs completed: 88%| ████████▊ 175/200 [01:17]
Epochs completed: 88%| ████████▊ 176/200 [01:17]
Epochs completed: 88%| ████████▊ 177/200 [01:18]
Epochs completed: 89%| ████████▉ 178/200 [01:18]
Epochs completed: 90%| ████████▉ 179/200 [01:18]
Epochs completed: 90%| █████████ 180/200 [01:18]
Epochs completed: 90%| █████████ 181/200 [01:18]
Epochs completed: 91%| █████████ 182/200 [01:19]
Epochs completed: 92%| █████████▏ 183/200 [01:19]
Epochs completed: 92%| █████████▏ 184/200 [01:19]
Epochs completed: 92%| █████████▎ 185/200 [01:19]
Epochs completed: 93%| █████████▎ 186/200 [01:20]
Epochs completed: 94%| █████████▎ 187/200 [01:20]
Epochs completed: 94%| █████████▍ 188/200 [01:20]
Epochs completed: 94%| █████████▍ 189/200 [01:20]
Epochs completed: 95%| █████████▌ 190/200 [01:21]
Epochs completed: 96%| █████████▌ 191/200 [01:21]
Epochs completed: 96%| █████████▌ 192/200 [01:21]
Epochs completed: 96%| █████████▋ 193/200 [01:22]
Epochs completed: 97%| █████████▋ 194/200 [01:22]
Epochs completed: 98%| █████████▊ 195/200 [01:23]
Epochs completed: 98%| █████████▊ 196/200 [01:23]
Epochs completed: 98%| █████████▊ 197/200 [01:23]
Epochs completed: 99%| █████████▉ 198/200 [01:24]
Epochs completed: 100%| █████████▉ 199/200 [01:24]
Epochs completed: 100%| ██████████ 200/200 [01:25]
Epochs completed: 100%| ██████████ 200/200 [01:25]
2025-11-26 20:06:05,835 - INFO - Generated 3D coordinates: (150000, 3) in 8.6 minutes
2025-11-26 20:06:05,856 - INFO - Step 4/5: Running OPTIMIZED UMAP for 2D coordinates...
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/umap/spectral.py:548: UserWarning: Spectral initialisation failed! The eigenvector solver
failed. This is likely due to too small an eigengap. Consider
adding some noise or jitter to your data.
Falling back to random initialisation!
warn(
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/umap/spectral.py:548: UserWarning: Spectral initialisation failed! The eigenvector solver
failed. This is likely due to too small an eigengap. Consider
adding some noise or jitter to your data.
Falling back to random initialisation!
warn(
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/umap/spectral.py:548: UserWarning: Spectral initialisation failed! The eigenvector solver
failed. This is likely due to too small an eigengap. Consider
adding some noise or jitter to your data.
Falling back to random initialisation!
warn(
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/umap/spectral.py:548: UserWarning: Spectral initialisation failed! The eigenvector solver
failed. This is likely due to too small an eigengap. Consider
adding some noise or jitter to your data.
Falling back to random initialisation!
warn(
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/umap/spectral.py:548: UserWarning: Spectral initialisation failed! The eigenvector solver
failed. This is likely due to too small an eigengap. Consider
adding some noise or jitter to your data.
Falling back to random initialisation!
warn(
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/umap/spectral.py:548: UserWarning: Spectral initialisation failed! The eigenvector solver
failed. This is likely due to too small an eigengap. Consider
adding some noise or jitter to your data.
Falling back to random initialisation!
warn(
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/umap/spectral.py:548: UserWarning: Spectral initialisation failed! The eigenvector solver
failed. This is likely due to too small an eigengap. Consider
adding some noise or jitter to your data.
Falling back to random initialisation!
warn(
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/umap/spectral.py:548: UserWarning: Spectral initialisation failed! The eigenvector solver
failed. This is likely due to too small an eigengap. Consider
adding some noise or jitter to your data.
Falling back to random initialisation!
warn(
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/umap/spectral.py:548: UserWarning: Spectral initialisation failed! The eigenvector solver
failed. This is likely due to too small an eigengap. Consider
adding some noise or jitter to your data.
Falling back to random initialisation!
warn(
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/umap/spectral.py:548: UserWarning: Spectral initialisation failed! The eigenvector solver
failed. This is likely due to too small an eigengap. Consider
adding some noise or jitter to your data.
Falling back to random initialisation!
warn(
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/umap/spectral.py:548: UserWarning: Spectral initialisation failed! The eigenvector solver
failed. This is likely due to too small an eigengap. Consider
adding some noise or jitter to your data.
Falling back to random initialisation!
warn(
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/umap/spectral.py:548: UserWarning: Spectral initialisation failed! The eigenvector solver
failed. This is likely due to too small an eigengap. Consider
adding some noise or jitter to your data.
Falling back to random initialisation!
warn(
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/umap/spectral.py:548: UserWarning: Spectral initialisation failed! The eigenvector solver
failed. This is likely due to too small an eigengap. Consider
adding some noise or jitter to your data.
Falling back to random initialisation!
warn(
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/umap/spectral.py:548: UserWarning: Spectral initialisation failed! The eigenvector solver
failed. This is likely due to too small an eigengap. Consider
adding some noise or jitter to your data.
Falling back to random initialisation!
warn(
/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/umap/spectral.py:548: UserWarning: Spectral initialisation failed! The eigenvector solver
failed. This is likely due to too small an eigengap. Consider
adding some noise or jitter to your data.
Falling back to random initialisation!
warn(
completed 0 / 200 epochs
completed 20 / 200 epochs
completed 40 / 200 epochs
completed 60 / 200 epochs
completed 80 / 200 epochs
completed 100 / 200 epochs
completed 120 / 200 epochs
completed 140 / 200 epochs
completed 160 / 200 epochs
completed 180 / 200 epochs
Wed Nov 26 20:06:05 2025 Finished embedding
UMAP(low_memory=False, spread=1.5, verbose=True)
Wed Nov 26 20:06:06 2025 Construct fuzzy simplicial set
Wed Nov 26 20:06:06 2025 Finding Nearest Neighbors
Wed Nov 26 20:06:06 2025 Building RP forest with 24 trees
Wed Nov 26 20:06:08 2025 NN descent for 17 iterations
1 / 17
2 / 17
3 / 17
4 / 17
Stopping threshold met -- exiting after 4 iterations
Wed Nov 26 20:06:21 2025 Finished Nearest Neighbor Search
Wed Nov 26 20:06:22 2025 Construct embedding
Epochs completed: 0%| 0/200 [00:00]
Epochs completed: 1%| 2/200 [00:00]
Epochs completed: 2%| ▏ 4/200 [00:00]
Epochs completed: 3%| ▎ 6/200 [00:00]
Epochs completed: 4%| ▎ 7/200 [00:00]
Epochs completed: 4%| ▍ 8/200 [00:01]
Epochs completed: 4%| ▍ 9/200 [00:01]
Epochs completed: 5%| ▌ 10/200 [00:01]
Epochs completed: 6%| ▌ 11/200 [00:01]
Epochs completed: 6%| ▌ 12/200 [00:01]
Epochs completed: 6%| ▋ 13/200 [00:01]
Epochs completed: 7%| ▋ 14/200 [00:02]
Epochs completed: 8%| ▊ 15/200 [00:02]
Epochs completed: 8%| ▊ 16/200 [00:02]
Epochs completed: 8%| ▊ 17/200 [00:02]
Epochs completed: 9%| ▉ 18/200 [00:02]
Epochs completed: 10%| ▉ 19/200 [00:02]
Epochs completed: 10%| █ 20/200 [00:02]
Epochs completed: 10%| █ 21/200 [00:03]
Epochs completed: 11%| █ 22/200 [00:03]
Epochs completed: 12%| █▏ 23/200 [00:03]
Epochs completed: 12%| █▏ 24/200 [00:03]
Epochs completed: 12%| █▎ 25/200 [00:03]
Epochs completed: 13%| █▎ 26/200 [00:03]
Epochs completed: 14%| █▎ 27/200 [00:03]
Epochs completed: 14%| █▍ 28/200 [00:04]
Epochs completed: 14%| █▍ 29/200 [00:04]
Epochs completed: 15%| █▌ 30/200 [00:04]
Epochs completed: 16%| █▌ 31/200 [00:04]
Epochs completed: 16%| █▌ 32/200 [00:04]
Epochs completed: 16%| █▋ 33/200 [00:04]
Epochs completed: 17%| █▋ 34/200 [00:05]
Epochs completed: 18%| █▊ 35/200 [00:05]
Epochs completed: 18%| █▊ 36/200 [00:05]
Epochs completed: 18%| █▊ 37/200 [00:05]
Epochs completed: 19%| █▉ 38/200 [00:05]
Epochs completed: 20%| █▉ 39/200 [00:05]
Epochs completed: 20%| ██ 40/200 [00:05]
Epochs completed: 20%| ██ 41/200 [00:06]
Epochs completed: 21%| ██ 42/200 [00:06]
Epochs completed: 22%| ██▏ 43/200 [00:06]
Epochs completed: 22%| ██▏ 44/200 [00:06]
Epochs completed: 22%| ██▎ 45/200 [00:06]
Epochs completed: 23%| ██▎ 46/200 [00:07]
Epochs completed: 24%| ██▎ 47/200 [00:07]
Epochs completed: 24%| ██▍ 48/200 [00:07]
Epochs completed: 24%| ██▍ 49/200 [00:08]
Epochs completed: 25%| ██▌ 50/200 [00:08]
Epochs completed: 26%| ██▌ 51/200 [00:08]
Epochs completed: 26%| ██▌ 52/200 [00:08]
Epochs completed: 26%| ██▋ 53/200 [00:09]
Epochs completed: 27%| ██▋ 54/200 [00:09]
Epochs completed: 28%| ██▊ 55/200 [00:09]
Epochs completed: 28%| ██▊ 56/200 [00:09]
Epochs completed: 28%| ██▊ 57/200 [00:10]
Epochs completed: 29%| ██▉ 58/200 [00:10]
Epochs completed: 30%| ██▉ 59/200 [00:10]
Epochs completed: 30%| ███ 60/200 [00:10]
Epochs completed: 30%| ███ 61/200 [00:10]
Epochs completed: 31%| ███ 62/200 [00:11]
Epochs completed: 32%| ███▏ 63/200 [00:11]
Epochs completed: 32%| ███▏ 64/200 [00:11]
Epochs completed: 32%| ███▎ 65/200 [00:11]
Epochs completed: 33%| ███▎ 66/200 [00:12]
Epochs completed: 34%| ███▎ 67/200 [00:12]
Epochs completed: 34%| ███▍ 68/200 [00:12]
Epochs completed: 34%| ███▍ 69/200 [00:12]
Epochs completed: 35%| ███▌ 70/200 [00:12]
Epochs completed: 36%| ███▌ 71/200 [00:12]
Epochs completed: 36%| ███▌ 72/200 [00:13]
Epochs completed: 36%| ███▋ 73/200 [00:13]
Epochs completed: 37%| ███▋ 74/200 [00:13]
Epochs completed: 38%| ███▊ 75/200 [00:13]
Epochs completed: 38%| ███▊ 76/200 [00:13]
Epochs completed: 38%| ███▊ 77/200 [00:14]
Epochs completed: 39%| ███▉ 78/200 [00:14]
Epochs completed: 40%| ███▉ 79/200 [00:14]
Epochs completed: 40%| ████ 80/200 [00:14]
Epochs completed: 40%| ████ 81/200 [00:15]
Epochs completed: 41%| ████ 82/200 [00:15]
Epochs completed: 42%| ████▏ 83/200 [00:15]
Epochs completed: 42%| ████▏ 84/200 [00:15]
Epochs completed: 42%| ████▎ 85/200 [00:15]
Epochs completed: 43%| ████▎ 86/200 [00:15]
Epochs completed: 44%| ████▎ 87/200 [00:16]
Epochs completed: 44%| ████▍ 88/200 [00:16]
Epochs completed: 44%| ████▍ 89/200 [00:16]
Epochs completed: 45%| ████▌ 90/200 [00:16]
Epochs completed: 46%| ████▌ 91/200 [00:16]
Epochs completed: 46%| ████▌ 92/200 [00:16]
Epochs completed: 46%| ████▋ 93/200 [00:17]
Epochs completed: 47%| ████▋ 94/200 [00:17]
Epochs completed: 48%| ████▊ 95/200 [00:17]
Epochs completed: 48%| ████▊ 96/200 [00:17]
Epochs completed: 48%| ████▊ 97/200 [00:18]
Epochs completed: 49%| ████▉ 98/200 [00:18]
Epochs completed: 50%| ████▉ 99/200 [00:18]
Epochs completed: 50%| █████ 100/200 [00:18]
Epochs completed: 50%| █████ 101/200 [00:19]
Epochs completed: 51%| █████ 102/200 [00:19]
Epochs completed: 52%| █████▏ 103/200 [00:19]
Epochs completed: 52%| █████▏ 104/200 [00:19]
Epochs completed: 52%| █████▎ 105/200 [00:19]
Epochs completed: 53%| █████▎ 106/200 [00:20]
Epochs completed: 54%| █████▎ 107/200 [00:20]
Epochs completed: 54%| █████▍ 108/200 [00:20]
Epochs completed: 55%| █████▍ 109/200 [00:20]
Epochs completed: 55%| █████▌ 110/200 [00:20]
Epochs completed: 56%| █████▌ 111/200 [00:21]
Epochs completed: 56%| █████▌ 112/200 [00:21]
Epochs completed: 56%| █████▋ 113/200 [00:21]
Epochs completed: 57%| █████▋ 114/200 [00:21]
Epochs completed: 57%| █████▊ 115/200 [00:21]
Epochs completed: 58%| █████▊ 116/200 [00:21]
Epochs completed: 58%| █████▊ 117/200 [00:21]
Epochs completed: 59%| █████▉ 118/200 [00:22]
Epochs completed: 60%| █████▉ 119/200 [00:22]
Epochs completed: 60%| ██████ 120/200 [00:22]
Epochs completed: 60%| ██████ 121/200 [00:22]
Epochs completed: 61%| ██████ 122/200 [00:22]
Epochs completed: 62%| ██████▏ 123/200 [00:22]
Epochs completed: 62%| ██████▏ 124/200 [00:23]
Epochs completed: 62%| ██████▎ 125/200 [00:23]
Epochs completed: 63%| ██████▎ 126/200 [00:23]
Epochs completed: 64%| ██████▎ 127/200 [00:23]
Epochs completed: 64%| ██████▍ 128/200 [00:23]
Epochs completed: 64%| ██████▍ 129/200 [00:24]
Epochs completed: 65%| ██████▌ 130/200 [00:24]
Epochs completed: 66%| ██████▌ 131/200 [00:24]
Epochs completed: 66%| ██████▌ 132/200 [00:24]
Epochs completed: 66%| ██████▋ 133/200 [00:24]
Epochs completed: 67%| ██████▋ 134/200 [00:24]
Epochs completed: 68%| ██████▊ 135/200 [00:25]
Epochs completed: 68%| ██████▊ 136/200 [00:25]
Epochs completed: 68%| ██████▊ 137/200 [00:25]
Epochs completed: 69%| ██████▉ 138/200 [00:25]
Epochs completed: 70%| ██████▉ 139/200 [00:25]
Epochs completed: 70%| ███████ 140/200 [00:26]
Epochs completed: 70%| ███████ 141/200 [00:26]
Epochs completed: 71%| ███████ 142/200 [00:26]
Epochs completed: 72%| ███████▏ 143/200 [00:26]
Epochs completed: 72%| ███████▏ 144/200 [00:26]
Epochs completed: 72%| ███████▎ 145/200 [00:27]
Epochs completed: 73%| ███████▎ 146/200 [00:27]
Epochs completed: 74%| ███████▎ 147/200 [00:27]
Epochs completed: 74%| ███████▍ 148/200 [00:27]
Epochs completed: 74%| ███████▍ 149/200 [00:27]
Epochs completed: 75%| ███████▌ 150/200 [00:27]
Epochs completed: 76%| ███████▌ 151/200 [00:28]
Epochs completed: 76%| ███████▌ 152/200 [00:28]
Epochs completed: 76%| ███████▋ 153/200 [00:28]
Epochs completed: 77%| ███████▋ 154/200 [00:28]
Epochs completed: 78%| ███████▊ 155/200 [00:28]
Epochs completed: 78%| ███████▊ 156/200 [00:28]
Epochs completed: 78%| ███████▊ 157/200 [00:28]
Epochs completed: 79%| ███████▉ 158/200 [00:29]
Epochs completed: 80%| ███████▉ 159/200 [00:29]
Epochs completed: 80%| ████████ 160/200 [00:29]
Epochs completed: 80%| ████████ 161/200 [00:29]
Epochs completed: 81%| ████████ 162/200 [00:29]
Epochs completed: 82%| ████████▏ 163/200 [00:30]
Epochs completed: 82%| ████████▏ 164/200 [00:30]
Epochs completed: 82%| ████████▎ 165/200 [00:30]
Epochs completed: 83%| ████████▎ 166/200 [00:30]
Epochs completed: 84%| ████████▎ 167/200 [00:30]
Epochs completed: 84%| ████████▍ 168/200 [00:30]
Epochs completed: 84%| ████████▍ 169/200 [00:31]
Epochs completed: 85%| ████████▌ 170/200 [00:31]
Epochs completed: 86%| ████████▌ 171/200 [00:31]
Epochs completed: 86%| ████████▌ 172/200 [00:31]
Epochs completed: 86%| ████████▋ 173/200 [00:31]
Epochs completed: 87%| ████████▋ 174/200 [00:31]
Epochs completed: 88%| ████████▊ 175/200 [00:31]
Epochs completed: 88%| ████████▊ 176/200 [00:32]
Epochs completed: 88%| ████████▊ 177/200 [00:32]
Epochs completed: 89%| ████████▉ 178/200 [00:32]
Epochs completed: 90%| ████████▉ 179/200 [00:32]
Epochs completed: 90%| █████████ 180/200 [00:32]
Epochs completed: 90%| █████████ 181/200 [00:32]
Epochs completed: 91%| █████████ 182/200 [00:33]
Epochs completed: 92%| █████████▏ 183/200 [00:33]
Epochs completed: 92%| █████████▏ 184/200 [00:33]
Epochs completed: 92%| █████████▎ 185/200 [00:33]
Epochs completed: 93%| █████████▎ 186/200 [00:33]
Epochs completed: 94%| █████████▎ 187/200 [00:33]
Epochs completed: 94%| █████████▍ 188/200 [00:34]
Epochs completed: 94%| █████████▍ 189/200 [00:34]
Epochs completed: 95%| █████████▌ 190/200 [00:34]
Epochs completed: 96%| █████████▌ 191/200 [00:34]
Epochs completed: 96%| █████████▌ 192/200 [00:34]
Epochs completed: 96%| █████████▋ 193/200 [00:34]
Epochs completed: 97%| █████████▋ 194/200 [00:35]
Epochs completed: 98%| █████████▊ 195/200 [00:35]
Epochs completed: 98%| █████████▊ 196/200 [00:35]
Epochs completed: 98%| █████████▊ 197/200 [00:35]
Epochs completed: 99%| █████████▉ 198/200 [00:35]
Epochs completed: 100%| █████████▉ 199/200 [00:35]
Epochs completed: 100%| ██████████ 200/200 [00:36]
Epochs completed: 100%| ██████████ 200/200 [00:36]
2025-11-26 20:18:33,898 - INFO - Generated 2D coordinates: (150000, 2) in 12.5 minutes
2025-11-26 20:18:33,902 - INFO - Step 5/5: Saving to Parquet files...
2025-11-26 20:18:35,549 - INFO - Saved models data: precomputed_data/models_v1.parquet (22.1 MB)
2025-11-26 20:18:35,551 - ERROR - Pre-computation failed: 'modelId'
Traceback (most recent call last):
File "/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/pandas/core/indexes/base.py", line 3812, in get_loc
return self._engine.get_loc(casted_key)
~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^
File "pandas/_libs/index.pyx", line 167, in pandas._libs.index.IndexEngine.get_loc
File "pandas/_libs/index.pyx", line 196, in pandas._libs.index.IndexEngine.get_loc
File "pandas/_libs/hashtable_class_helper.pxi", line 7088, in pandas._libs.hashtable.PyObjectHashTable.get_item
File "pandas/_libs/hashtable_class_helper.pxi", line 7096, in pandas._libs.hashtable.PyObjectHashTable.get_item
KeyError: 'modelId'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/Users/hamidaho/hf_viz/backend/scripts/precompute_fast.py", line 266, in <module>
precompute_fast(
~~~~~~~~~~~~~~~^
sample_size=args.sample_size,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...<3 lines>...
use_pca=not args.no_pca
^^^^^^^^^^^^^^^^^^^^^^^
)
^
File "/Users/hamidaho/hf_viz/backend/scripts/precompute_fast.py", line 187, in precompute_fast
'model_id': df['modelId'].values,
~~^^^^^^^^^^^
File "/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/pandas/core/frame.py", line 4113, in __getitem__
indexer = self.columns.get_loc(key)
File "/Users/hamidaho/hf_viz/venv/lib/python3.13/site-packages/pandas/core/indexes/base.py", line 3819, in get_loc
raise KeyError(key) from err
KeyError: 'modelId'
completed 0 / 200 epochs
completed 20 / 200 epochs
completed 40 / 200 epochs
completed 60 / 200 epochs
completed 80 / 200 epochs
completed 100 / 200 epochs
completed 120 / 200 epochs
completed 140 / 200 epochs
completed 160 / 200 epochs
completed 180 / 200 epochs
Wed Nov 26 20:18:33 2025 Finished embedding
|