wargreymon@sh.itjust.works to Machine Learning@lemmy.ml · 5 months agoCan gpt generate a gpt model?message-squaremessage-square5fedilinkarrow-up19arrow-down13file-text
arrow-up16arrow-down1message-squareCan gpt generate a gpt model?wargreymon@sh.itjust.works to Machine Learning@lemmy.ml · 5 months agomessage-square5fedilinkfile-text
minus-squareAudalin@lemmy.worldlinkfedilinkEnglisharrow-up5·5 months agoYou can generate synthetic data matching the distribution your transformer learned. You can use this dataset to train another model. As of now, that’s about it.
minus-squareBaldur Nil@programming.devlinkfedilinkarrow-up2·5 months agoYep, this is called model distillation.
You can generate synthetic data matching the distribution your transformer learned. You can use this dataset to train another model. As of now, that’s about it.
Yep, this is called model distillation.