File size: 17,525 Bytes
26fbfd4 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 | ======================================================================
JOHANNA-TINY FULL BATTERY DIAGNOSTIC
======================================================================
Loading local: /content/checkpoints/best.pt
Epoch: 10, MSE: 0.06776364320516587
Config: {'V': 256, 'D': 16, 'patch_size': 16, 'hidden': 768, 'depth': 4, 'n_cross_layers': 2, 'target_cv': 0.125, 'dataset': 'curriculum_noise', 'img_size': 64, 'lr': 0.0003}
Loaded 16,942,419 params
======================================================================
TEST 1: Per-Type Reconstruction MSE (100 samples each)
======================================================================
gaussian : 0.068355 ยฑ 0.003237 [0.059153 โ 0.076495]
uniform : 0.034244 ยฑ 0.001081 [0.031722 โ 0.036898]
uniform_scaled : 0.092888 ยฑ 0.003874 [0.084341 โ 0.101410]
poisson : 0.070939 ยฑ 0.027295 [0.032886 โ 0.121031]
pink : 0.462492 ยฑ 0.979842 [0.062882 โ 7.263476]
brown : 0.302245 ยฑ 0.799905 [0.063013 โ 7.263476]
salt_pepper : 0.576325 ยฑ 0.010698 [0.553726 โ 0.601653]
sparse : 0.045705 ยฑ 0.002368 [0.040154 โ 0.051907]
block : 0.072499 ยฑ 0.010697 [0.053181 โ 0.125361]
gradient : 0.201614 ยฑ 0.013891 [0.176683 โ 0.228614]
checkerboard : 0.072973 ยฑ 0.006283 [0.055622 โ 0.093111]
mixed : 0.036839 ยฑ 0.003151 [0.032720 โ 0.048418]
structural : 1.918920 ยฑ 0.054320 [1.851429 โ 2.043337]
cauchy : 0.322844 ยฑ 0.009053 [0.303444 โ 0.352085]
exponential : 0.063573 ยฑ 0.003070 [0.055251 โ 0.071860]
laplace : 0.143409 ยฑ 0.006581 [0.127025 โ 0.158567]
======================================================================
TEST 2: Byte-Level Accuracy (quantized to 256 levels)
======================================================================
gaussian : exact= 4.9% ยฑ1= 14.6%
uniform : exact= 6.8% ยฑ1= 20.2%
uniform_scaled : exact= 4.1% ยฑ1= 12.4%
poisson : exact= 4.8% ยฑ1= 14.5%
pink : exact= 3.2% ยฑ1= 9.8%
brown : exact= 3.5% ยฑ1= 10.4%
salt_pepper : exact= 1.3% ยฑ1= 4.0%
sparse : exact= 6.1% ยฑ1= 17.8%
block : exact= 4.9% ยฑ1= 14.7%
gradient : exact= 4.0% ยฑ1= 11.9%
checkerboard : exact= 4.7% ยฑ1= 13.9%
mixed : exact= 6.6% ยฑ1= 19.5%
structural : exact= 4.2% ยฑ1= 12.4%
cauchy : exact= 2.2% ยฑ1= 6.6%
exponential : exact= 5.1% ยฑ1= 15.2%
laplace : exact= 3.5% ยฑ1= 10.2%
======================================================================
TEST 3: Geometric Fingerprint Per Type
======================================================================
gaussian : Sโ=5.186 SD=3.234 ratio=1.60 erank=15.88
uniform : Sโ=5.254 SD=3.057 ratio=1.72 erank=15.87
uniform_scaled : Sโ=5.172 SD=3.279 ratio=1.58 erank=15.88
poisson : Sโ=5.259 SD=3.020 ratio=1.74 erank=15.87
pink : Sโ=5.147 SD=3.254 ratio=1.58 erank=15.87
brown : Sโ=5.142 SD=3.265 ratio=1.57 erank=15.87
salt_pepper : Sโ=5.156 SD=3.357 ratio=1.54 erank=15.88
sparse : Sโ=5.221 SD=3.147 ratio=1.66 erank=15.87
block : Sโ=5.191 SD=3.209 ratio=1.62 erank=15.87
gradient : Sโ=5.183 SD=3.205 ratio=1.62 erank=15.88
checkerboard : Sโ=5.172 SD=3.278 ratio=1.58 erank=15.88
mixed : Sโ=5.248 SD=3.067 ratio=1.71 erank=15.87
structural : Sโ=5.188 SD=3.220 ratio=1.61 erank=15.88
cauchy : Sโ=5.156 SD=3.354 ratio=1.54 erank=15.88
exponential : Sโ=5.195 SD=3.218 ratio=1.61 erank=15.88
laplace : Sโ=5.165 SD=3.319 ratio=1.56 erank=15.88
======================================================================
TEST 4: Cross-Type Omega Token Similarity
======================================================================
gauss unifo unifo poiss pink brown salt_ spars block gradi check mixed struc cauch expon lapla
gaussian 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
uniform 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
uniform_scaled 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
poisson 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
pink 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
brown 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
salt_pepper 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
sparse 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
block 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
gradient 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
checkerboard 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
mixed 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
structural 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
cauchy 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
exponential 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
laplace 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
======================================================================
TEST 5: Spectrum Profile Per Type
======================================================================
gaussian : S0=5.192(9.2%) S7=4.293(60.1%) S15=3.234(100%)
uniform : S0=5.251(9.4%) S7=4.293(59.8%) S15=3.052(100%)
uniform_scaled : S0=5.173(9.1%) S7=4.294(60.1%) S15=3.278(100%)
poisson : S0=5.259(9.5%) S7=4.296(59.8%) S15=3.020(100%)
pink : S0=5.141(9.0%) S7=4.278(60.3%) S15=3.252(100%)
brown : S0=5.137(9.0%) S7=4.279(60.3%) S15=3.270(100%)
salt_pepper : S0=5.160(9.1%) S7=4.290(60.2%) S15=3.360(100%)
sparse : S0=5.218(9.3%) S7=4.290(60.0%) S15=3.150(100%)
block : S0=5.186(9.2%) S7=4.288(60.1%) S15=3.218(100%)
gradient : S0=5.184(9.2%) S7=4.288(60.0%) S15=3.201(100%)
checkerboard : S0=5.175(9.2%) S7=4.289(60.0%) S15=3.279(100%)
mixed : S0=5.247(9.4%) S7=4.291(59.8%) S15=3.066(100%)
structural : S0=5.192(9.2%) S7=4.293(60.0%) S15=3.218(100%)
cauchy : S0=5.147(9.1%) S7=4.291(60.2%) S15=3.355(100%)
exponential : S0=5.194(9.2%) S7=4.295(60.1%) S15=3.216(100%)
laplace : S0=5.163(9.1%) S7=4.289(60.2%) S15=3.319(100%)
======================================================================
TEST 6: Reconstruction Grid (saved to johanna_diagnostic_grid.png)
======================================================================
Saved: johanna_diagnostic_grid.png
======================================================================
TEST 7: Zero-Shot Real Image Reconstruction
======================================================================
README.md:โ
โ3.90k/?โ[00:00<00:00,โ856kB/s]
dataset_infos.json:โ
โ3.52k/?โ[00:00<00:00,โ1.06MB/s]
TinyImageNet (100 images, 64ร64):
Mean MSE: 0.079425
Std: 0.043693
Min/Max: 0.040186 / 0.319808
Fidelity: 92.058%
======================================================================
TEST 8: Zero-Shot Text Byte Reconstruction
======================================================================
Input: 'Hello, world! This is a test of the Johanna geometric encode'
Output: 'pX๏ฟฝ๏ฟฝ,๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝ` N๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝhJ๏ฟฝt๏ฟฝ๏ฟฝ`g`\๏ฟฝ๏ฟฝQY}Lm๏ฟฝ๏ฟฝx๏ฟฝG๏ฟฝ^g๏ฟฝ๏ฟฝ๏ฟฝ]๏ฟฝ๏ฟฝl๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝ'
MSE: 0.087208
Byte acc: 1.6%
Input: 'The quick brown fox jumps over the lazy dog. 0123456789 ABCD'
Output: '๏ฟฝQY๏ฟฝTn๏ฟฝ๏ฟฝ4๏ฟฝ๏ฟฝ๏ฟฝoh]๏ฟฝ๏ฟฝdX๏ฟฝRp๏ฟฝ๏ฟฝ4๏ฟฝ๏ฟฝ๏ฟฝk#๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝR}K๏ฟฝ|๏ฟฝTa24n_T#llENsX๏ฟฝi'
MSE: 0.087562
Byte acc: 0.0%
Input: 'import torch; model = PatchSVAE(); output = model(x)'
Output: '๏ฟฝ๏ฟฝZ๏ฟฝ๏ฟฝO-๏ฟฝ๏ฟฝ~๏ฟฝ๏ฟฝx!e๏ฟฝ๏ฟฝ๏ฟฝWXqX๏ฟฝ๏ฟฝs๏ฟฝu๏ฟฝ=BeQ[๏ฟฝ๏ฟฝRu๏ฟฝ๏ฟฝ2๏ฟฝF๏ฟฝg^๏ฟฝ๏ฟฝJ]['
MSE: 0.087713
Byte acc: 0.0%
Input: 'E = mcยฒ โ Albert Einstein, theoretical physicist, 1905'
Output: 'r@2W๏ฟฝ@๏ฟฝ๏ฟฝM๏ฟฝสฎ_=c๏ฟฝ๏ฟฝ๏ฟฝ`WwEo๏ฟฝ๏ฟฝr๏ฟฝ๏ฟฝi k๏ฟฝ๏ฟฝ๏ฟฝ]๏ฟฝ๏ฟฝHi๏ฟฝ๏ฟฝ3๏ฟฝ๏ฟฝ๏ฟฝkc๏ฟฝ๏ฟฝ๏ฟฝ[]VH_l'
MSE: 0.087590
Byte acc: 1.8%
Input: 'To be, or not to be, that is the question. โ Shakespeare'
Output: '|๏ฟฝ๏ฟฝ๏ฟฝ-๏ฟฝ๏ฟฝ4๏ฟฝ๏ฟฝ๏ฟฝk๏ฟฝL|SeXRj๏ฟฝ๏ฟฝ5๏ฟฝ๏ฟฝ_jb๏ฟฝL๏ฟฝa๏ฟฝ๏ฟฝSl๏ฟฝ๏ฟฝCt๏ฟฝ๏ฟฝ๏ฟฝ"๏ฟฝ๏ฟฝU๏ฟฝ๏ฟฝFn๏ฟฝ๏ฟฝu'
MSE: 0.087480
Byte acc: 0.0%
======================================================================
TEST 9: Piecemeal 256โ64 Tiled Reconstruction
======================================================================
gaussian : 16 tiles, MSE=0.068466
pink : 16 tiles, MSE=0.090180
salt_pepper : 16 tiles, MSE=0.581173
cauchy : 16 tiles, MSE=0.324597
======================================================================
TEST 10: Signal Energy Survival Rate
======================================================================
gaussian : survival= 92.3% SNR= 11.7dB orig_E=1.001 recon_E=0.923
uniform : survival= 92.5% SNR= 9.9dB orig_E=0.333 recon_E=0.308
uniform_scaled : survival= 88.6% SNR= 11.5dB orig_E=1.334 recon_E=1.182
poisson : survival= 109.8% SNR= 4.6dB orig_E=0.206 recon_E=0.227
pink : survival= 63.1% SNR= 7.4dB orig_E=2.197 recon_E=1.387
brown : survival= 54.2% SNR= 6.3dB orig_E=2.679 recon_E=1.451
salt_pepper : survival= 57.9% SNR= 8.4dB orig_E=4.010 recon_E=2.322
sparse : survival= 93.1% SNR= 11.4dB orig_E=0.634 recon_E=0.590
block : survival= 90.4% SNR= 11.4dB orig_E=0.995 recon_E=0.899
gradient : survival= 71.6% SNR= 9.1dB orig_E=1.628 recon_E=1.166
checkerboard : survival= 92.2% SNR= 11.7dB orig_E=1.090 recon_E=1.005
mixed : survival= 93.1% SNR= 10.0dB orig_E=0.363 recon_E=0.338
structural : survival= 26.7% SNR= 3.8dB orig_E=4.583 recon_E=1.221
cauchy : survival= 68.0% SNR= 9.6dB orig_E=2.958 recon_E=2.013
exponential : survival= 92.4% SNR= 11.7dB orig_E=0.933 recon_E=0.863
laplace : survival= 82.1% SNR= 11.0dB orig_E=1.815 recon_E=1.489
======================================================================
TEST 11: Cross-Attention Alpha Profile
======================================================================
Layer 0: mean=0.0338 max=0.0344 min=0.0328 std=0.000502
ฮฑ[ 0]: 0.03410 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[ 1]: 0.03409 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[ 2]: 0.03431 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[ 3]: 0.03431 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[ 4]: 0.03302 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[ 5]: 0.03354 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[ 6]: 0.03373 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[ 7]: 0.03416 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[ 8]: 0.03415 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[ 9]: 0.03442 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[10]: 0.03340 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[11]: 0.03322 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[12]: 0.03400 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[13]: 0.03384 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[14]: 0.03435 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[15]: 0.03282 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
Layer 1: mean=0.0342 max=0.0357 min=0.0335 std=0.000581
ฮฑ[ 0]: 0.03400 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[ 1]: 0.03407 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[ 2]: 0.03382 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[ 3]: 0.03383 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[ 4]: 0.03510 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[ 5]: 0.03458 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[ 6]: 0.03438 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[ 7]: 0.03390 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[ 8]: 0.03388 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[ 9]: 0.03357 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[10]: 0.03457 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[11]: 0.03471 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[12]: 0.03391 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[13]: 0.03404 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[14]: 0.03349 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
ฮฑ[15]: 0.03566 โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
======================================================================
TEST 12: Compression Metrics
======================================================================
Input: 64ร64ร3 = 12,288 values
Latent: 16ร16 = 256 values (omega tokens)
Ratio: 48.0:1 compression
Patches: 16 of 16ร16
Omega shape: (16, 4, 4)
At 8-bit: input=12.0KB latent=0.2KB ratio=48.0:1
At 16-bit: input=24.0KB latent=0.5KB ratio=48.0:1
At 32-bit: input=48.0KB latent=1.0KB ratio=48.0:1
Results saved: johanna_diagnostic_results.json
======================================================================
DIAGNOSTIC COMPLETE
====================================================================== |