[Question] Locally run

[TimyIsCool]

Hi, would it be possible to have one that runs locally (stable diffusion and oobabooga webui) since it would be fun run for my friends

If anyone does this let me know!

[jhonnyV-V]

Maybe you could create a fork that does this, I don't think it will work as good tho, and you would need a model like llava that has vision capabilities running in local, at least until someone makes Mixtral moe with vision and the bloke makes the quant version

[yk]

sure, the docker-compose already has a local redis and a minio (replacing redis cloud and s3). all you'd need to add are local model servers and then some routing. feel free to fork or PR