How to make the internal activation smaller
#24
by xuruipeng8641 - opened
Hi, thanks a lot for your contribution for sdxl-fp16 !! I have pruned a sdxl decoder in fp32, I wish I can transfer it smoothly to fp16. Could you open-source your training code, because I do not quite know how and what the extent to scale down weights and biases. THANKS !!!