# gpt2_l1_16_spatial_16_100k

## Model Details

- Block size: 1024
- Vocabulary size: 50304
- Layers: 12
- Heads: 12
- Embedding size: 768