Bangchis commited on
Commit
a7f2d52
·
verified ·
1 Parent(s): f0a3194

update model card: best quick_fid_4096=104.922272 step=50000

Browse files
Files changed (1) hide show
  1. README.md +11 -14
README.md CHANGED
@@ -9,7 +9,7 @@ tags:
9
  - jepa
10
  ---
11
 
12
- # Soft-JEPA-Flow (jepa_full_final)
13
 
14
  This repository stores checkpoints automatically uploaded from training.
15
 
@@ -22,27 +22,24 @@ This repository stores checkpoints automatically uploaded from training.
22
  - MLP ratio: `4.0`
23
  - Latent shape: `32x32x4`
24
  - Number of classes: `100`
25
- - Student layer: `3`
26
- - Teacher layer: `7`
27
- - Mask ratio: `0.3`
28
- - Lambda JEPA: `0.15`
29
 
30
  ## Training Objective
31
- - Mode: `jepa`
32
- - Objective: L_total = L_gen + lambda_jepa * L_jepa (teacher-student JEPA objective with EMA teacher).
33
- - Optimizer: `adamw` (lr=`0.0001`, beta1=`0.9`, beta2=`0.99`, weight_decay=`0.02`)
34
- - Timestep schedule: `lognormal` (mean=`-0.4`, std=`1.0`)
35
 
36
  ## Metrics
37
  - Best metric key: `quick_fid_4096`
38
- - Best metric value: `48.418213`
39
- - Best checkpoint step: `150000`
40
 
41
  ## Upload Timing (Automatic)
42
  - Upload policy: upload whenever a **new best metric** is observed.
43
- - Upload timestamp (UTC): `20260306-013603-UTC`
44
- - Run name: `jepa_full_final`
45
- - Path for this artifact: `jepa_full_final/best/step_150000_20260306-013603-UTC`
46
 
47
  ## Evaluation Notes
48
  - FID pipeline uses latent decode with `stabilityai/sd-vae-ft-mse`, then InceptionV3 features.
 
9
  - jepa
10
  ---
11
 
12
+ # Soft-JEPA-Flow (jepa2_run)
13
 
14
  This repository stores checkpoints automatically uploaded from training.
15
 
 
22
  - MLP ratio: `4.0`
23
  - Latent shape: `32x32x4`
24
  - Number of classes: `100`
25
+ - JEPA branch: disabled in baseline mode.
 
 
 
26
 
27
  ## Training Objective
28
+ - Mode: `jepa2`
29
+ - Objective: L_total = L_gen (rectified-flow velocity prediction objective).
30
+ - Optimizer: `adam` (lr=`0.0001`, beta1=`0.9`, beta2=`0.99`, weight_decay=`0.04`)
31
+ - Timestep schedule: `uniform` (mean=`-0.4`, std=`1.0`)
32
 
33
  ## Metrics
34
  - Best metric key: `quick_fid_4096`
35
+ - Best metric value: `104.922272`
36
+ - Best checkpoint step: `50000`
37
 
38
  ## Upload Timing (Automatic)
39
  - Upload policy: upload whenever a **new best metric** is observed.
40
+ - Upload timestamp (UTC): `20260309-213746-UTC`
41
+ - Run name: `jepa2_run`
42
+ - Path for this artifact: `jepa2_run/best/step_50000_20260309-213746-UTC`
43
 
44
  ## Evaluation Notes
45
  - FID pipeline uses latent decode with `stabilityai/sd-vae-ft-mse`, then InceptionV3 features.