File size: 13,060 Bytes
1491855 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 | ================================================================================
UNIVERSAL SVAE DIAGNOSTIC BATTERY
================================================================================
v16_johanna_omega/checkpoints/best.pt:β100%
β203M/203Mβ[00:07<00:00,β62.8MB/s]
Loading: /root/.cache/huggingface/hub/models--AbstractPhil--geolip-SVAE/snapshots/1befe15db2d45e53868547b00e98659aea6a20b1/v16_johanna_omega/checkpoints/best.pt
Epoch: 40, MSE: 0.019033
Config: {'V': 256, 'D': 16, 'patch_size': 16, 'hidden': 768, 'depth': 4, 'n_cross_layers': 2, 'target_cv': 0.125, 'dataset': 'omega_noise_16types_128', 'pretrained_from': 'v14_noise/epoch_0200.pt', 'img_size': 128, 'lr': 0.0001}
Params: 16,942,419
Resolution: 128Γ128, samples_per_test: 25
================================================================================
IMAGE DATASET BATTERY (128Γ128, n=25)
================================================================================
dataset MSE std min max | S0 SD ratio erank
----------------------------------------------------------------------------------------------------
CIFAR-10β128 0.001462 0.001278 0.000670 0.006966 | 4.745 3.270 1.45 15.92
MNISTβ128 0.001713 0.000479 0.000779 0.002767 | 4.743 3.274 1.45 15.92
TinyImageNetβ128 0.005592 0.007961 0.000530 0.034349 | 4.750 3.275 1.45 15.92
ImageNet-128β128 0.002344 0.002470 0.000976 0.013297 | 4.746 3.265 1.45 15.92
Resolvingβdataβfiles:β100%
β40/40β[00:00<00:00,β12172.40it/s]
Resolvingβdataβfiles:β100%
β40/40β[00:00<00:00,β13518.02it/s]
ImageNet-256β128 0.002214 0.002376 0.000841 0.012717 | 4.746 3.266 1.45 15.92
================================================================================
NOISE TYPE BATTERY (128Γ128, n=25)
================================================================================
type MSE std | S0 SD ratio erank | byte_acc Β±1_acc
----------------------------------------------------------------------------------------------------
gaussian 0.029415 0.001089 | 4.736 3.277 1.45 15.92 | 9.48% 27.57%
uniform 0.010246 0.000487 | 4.735 3.279 1.44 15.92 | 15.65% 43.36%
uniform_scaled 0.041399 0.001460 | 4.736 3.275 1.45 15.92 | 8.02% 23.50%
poisson 0.005948 0.006064 | 4.734 3.280 1.44 15.92 | 23.32% 58.94%
pink 0.000261 0.000349 | 4.775 3.233 1.48 15.91 | 71.06% 99.15%
brown 0.000377 0.000728 | 4.782 3.235 1.48 15.91 | 70.16% 96.65%
salt_pepper 0.023009 0.000825 | 4.735 3.261 1.45 15.92 | 9.70% 28.32%
sparse 0.014341 0.000402 | 4.736 3.278 1.44 15.92 | 14.08% 38.88%
block 0.002015 0.000442 | 4.735 3.278 1.44 15.92 | 31.44% 75.25%
gradient 0.009110 0.000343 | 4.752 3.264 1.46 15.92 | 15.93% 44.27%
checkerboard 0.003647 0.000122 | 4.734 3.269 1.45 15.92 | 23.19% 60.60%
mixed 0.010457 0.003563 | 4.735 3.279 1.44 15.92 | 15.98% 43.97%
structural 0.018725 0.001017 | 4.732 3.230 1.46 15.91 | 28.97% 48.61%
cauchy 0.061531 0.001877 | 4.732 3.269 1.45 15.92 | 6.73% 19.93%
exponential 0.023947 0.000893 | 4.736 3.277 1.45 15.92 | 10.74% 30.75%
laplace 0.052132 0.001897 | 4.737 3.274 1.45 15.92 | 7.62% 21.51%
================================================================================
TEXT BYTE RECONSTRUCTION (128Γ128)
================================================================================
In: 'Hello, world! This is a test of the geometric encoder.'
Out: 'D]be^'jjgg^Meae_bKh^njc_!e_YU\^``jjeT[kZd[]a)'
MSE: 0.001004 Byte: 0.0%
In: 'The quick brown fox jumps over the lazy dog. 0123456789'
Out: 'NbZ_kWZbYland!Yek XkZgheoZe m_X_TocZg`+*,1+,0/)1*'
MSE: 0.001007 Byte: 3.6%
In: 'import torch; model = PatchSVAE(); output = model(x)'
Out: 'befgbhfkf^b0clY]`-?Vl[`OI<>(#1dfi^lj5 ^f]a`%k''
MSE: 0.001005 Byte: 3.8%
In: 'E = mcΒ² β Albert Einstein, theoretical physicist, 1905'
Out: '@5Z\οΏ½οΏ½(ΝοΏ½:caZhh5_\gm\ch#je[eg^c`PXaedjia_^ij(+))0'
MSE: 0.001006 Byte: 0.0%
In: 'To be, or not to be, that is the question. β Shakespeare'
Out: 'PfXW&djdkcikV]&hTZibjfb_cl]bkWeg&"οΏ½yοΏ½!N]Wb]bgTVlZ'
MSE: 0.001006 Byte: 0.0%
In: 'β«β^β e^(-xΒ²) dx = βΟ/2 β Gaussian integral'
Out: 'ΣοΏ½οΏ½stTΞοΏ½!^Q$(uοΏ½οΏ½&Vk-'ΞοΏ½οΏ½y(2οΏ½}οΏ½<Pjlic\__lj[_hRa'
MSE: 0.001008 Byte: 1.9%
In: '01101000 01100101 01101100 01101100 01101111 β binary hello'
Out: '.-,*$)#'(-.&+,0)*+#*#(,(-'++1*'*"+#),*/)οΏ½|οΏ½WbcShc^^dg'
MSE: 0.001002 Byte: 3.3%
In: 'SELECT * FROM models WHERE cv BETWEEN 0.20 AND 0.23;'
Out: 'N@E>5J <LL?cl[YegL9;M<]f:EKM>>>"&.(<C=/')/4'
MSE: 0.001000 Byte: 1.9%
================================================================================
PIECEMEAL 512β128 TILED RECONSTRUCTION
================================================================================
gaussian : 16 tiles, MSE=0.028989
uniform : 16 tiles, MSE=0.010235
pink : 16 tiles, MSE=0.000095
salt_pepper : 16 tiles, MSE=0.022889
cauchy : 16 tiles, MSE=0.062530
================================================================================
SIGNAL ENERGY SURVIVAL
================================================================================
source survival SNR_dB orig_E recon_E
----------------------------------------------------------------------
CIFAR-10β128 101.3% 28.5dB 1.0330 1.0463
MNISTβ128 97.5% 26.5dB 0.7737 0.7547
TinyImageNetβ128 100.0% 21.4dB 0.7748 0.7751
ImageNet-128β128 100.5% 27.7dB 1.3908 1.3980
Resolvingβdataβfiles:β100%
β40/40β[00:00<00:00,β13618.98it/s]
Resolvingβdataβfiles:β100%
β40/40β[00:00<00:00,β15745.86it/s]
ImageNet-256β128 100.6% 27.9dB 1.3549 1.3630
noise/gaussian 96.8% 15.3dB 1.0017 0.9701
noise/pink 100.4% 39.1dB 1.5183 1.5243
noise/salt_pepper 101.7% 22.4dB 4.0096 4.0786
noise/cauchy 98.0% 16.8dB 2.9569 2.8966
================================================================================
ALPHA PROFILE
================================================================================
Layer 0: mean=0.03755 max=0.04310 min=0.03551 std=0.001793
Ξ±[ 0]: 0.03865 ββββββββββββββββββββββββββββββββββββββββββββ
Ξ±[ 1]: 0.03915 βββββββββββββββββββββββββββββββββββββββββββββ
Ξ±[ 2]: 0.03683 ββββββββββββββββββββββββββββββββββββββββββ
Ξ±[ 3]: 0.03551 βββββββββββββββββββββββββββββββββββββββββ
Ξ±[ 4]: 0.04310 βββββββββββββββββββββββββββββββββββββββββββββββββ
Ξ±[ 5]: 0.03675 ββββββββββββββββββββββββββββββββββββββββββ
Ξ±[ 6]: 0.03792 βββββββββββββββββββββββββββββββββββββββββββ
Ξ±[ 7]: 0.03684 ββββββββββββββββββββββββββββββββββββββββββ
Ξ±[ 8]: 0.03733 βββββββββββββββββββββββββββββββββββββββββββ
Ξ±[ 9]: 0.03574 βββββββββββββββββββββββββββββββββββββββββ
Ξ±[10]: 0.03686 ββββββββββββββββββββββββββββββββββββββββββ
Ξ±[11]: 0.03657 ββββββββββββββββββββββββββββββββββββββββββ
Ξ±[12]: 0.03738 βββββββββββββββββββββββββββββββββββββββββββ
Ξ±[13]: 0.03635 ββββββββββββββββββββββββββββββββββββββββββ
Ξ±[14]: 0.03868 ββββββββββββββββββββββββββββββββββββββββββββ
Ξ±[15]: 0.03714 βββββββββββββββββββββββββββββββββββββββββββ
Layer 1: mean=0.04468 max=0.04837 min=0.04178 std=0.001530
Ξ±[ 0]: 0.04363 βββββββββββββββββββββββββββββββββββββββββββββ
Ξ±[ 1]: 0.04572 βββββββββββββββββββββββββββββββββββββββββββββββ
Ξ±[ 2]: 0.04407 βββββββββββββββββββββββββββββββββββββββββββββ
Ξ±[ 3]: 0.04506 ββββββββββββββββββββββββββββββββββββββββββββββ
Ξ±[ 4]: 0.04837 βββββββββββββββββββββββββββββββββββββββββββββββββ
Ξ±[ 5]: 0.04680 ββββββββββββββββββββββββββββββββββββββββββββββββ
Ξ±[ 6]: 0.04377 βββββββββββββββββββββββββββββββββββββββββββββ
Ξ±[ 7]: 0.04445 βββββββββββββββββββββββββββββββββββββββββββββ
Ξ±[ 8]: 0.04391 βββββββββββββββββββββββββββββββββββββββββββββ
Ξ±[ 9]: 0.04413 βββββββββββββββββββββββββββββββββββββββββββββ
Ξ±[10]: 0.04483 ββββββββββββββββββββββββββββββββββββββββββββββ
Ξ±[11]: 0.04178 βββββββββββββββββββββββββββββββββββββββββββ
Ξ±[12]: 0.04583 βββββββββββββββββββββββββββββββββββββββββββββββ
Ξ±[13]: 0.04309 ββββββββββββββββββββββββββββββββββββββββββββ
Ξ±[14]: 0.04433 βββββββββββββββββββββββββββββββββββββββββββββ
Ξ±[15]: 0.04504 ββββββββββββββββββββββββββββββββββββββββββββββ
================================================================================
COMPRESSION METRICS
================================================================================
Input: 128Γ128Γ3 = 49,152 values
Latent: 16Γ64 = 1,024 omega tokens
Ratio: 48.0:1
8-bit: input=48.0KB latent=1.0KB ratio=48.0:1
16-bit: input=96.0KB latent=2.0KB ratio=48.0:1
32-bit: input=192.0KB latent=4.0KB ratio=48.0:1
================================================================================
RECONSTRUCTION GRID
================================================================================
Resolvingβdataβfiles:β100%
β40/40β[00:00<00:00,β13917.23it/s]
Resolvingβdataβfiles:β100%
β40/40β[00:00<00:00,β14231.25it/s]
Saved: universal_diagnostic_grid.png
Results: diagnostic_v16_johanna_omega.json
================================================================================
DIAGNOSTIC COMPLETE
================================================================================ |