What if diffusion models generates Neural Network weights? Gen AI generate Gen AI [R]
| I'have been dreaming about using a Diffusion Model that will generates Weights instead of pixels. and in the future more complex scenarios! I made, with the help of z.ai zcode and their fantastic GLM model a small POC that i published on my github: It's a very small experimental implementation , but somenthing seems to work! I have not find paper on similar implementation ad I'm asking the community to help me to find one, and to have contribution on this . I also made a small webapp in order to test the trained model (actually i'm only on half training path 3000/4000 steps finished, but i'm using my poor laptop CPU at the moment) This is some screenshot of preliminary results. (the best results achieved, in truth) Italian explanation on my YouTube https://youtu.be/wAMO3Db-JoQ [link] [comments] |