maxsegan
/

gpt2_l1_16_spatial_16_100k

Model card Files Files and versions

gpt2_l1_16_spatial_16_100k / README.md

maxsegan's picture

Upload folder using huggingface_hub

c71dbc2 verified 12 months ago

|

history blame contribute delete

139 Bytes

	# gpt2_l1_16_spatial_16_100k

	## Model Details

	- Block size: 1024
	- Vocabulary size: 50304
	- Layers: 12
	- Heads: 12
	- Embedding size: 768