Amazing work, thank you!

[Tylersuard]

I have been thinking about putting an LLM on an ESP-32 for a while and I figured it would never work. I am looking forward to getting home and training this.

If I use a training dataset of chats, would this LLM be capable of chatting? You said something about a limitation of a dense core, I am not sure what you mean.

[rizmyabdulla]

@Tylersuard Not really. Training it on chat conversations will make it talk more like a chatbot, but a 28M parameter model is still too small to be a good conversational LLM. It'll still hallucinate a lot because it simply doesn't have enough capacity to learn and retain enough knowledge. The dataset can improve its chat style, but it can't overcome the model's size limitations

[Tylersuard]

Thank you for the quick response. ChatGPT gave me a pretty cool idea, using the LLM to control the ESP32's GPIO pins. For example, "Please turn on the LED on GPIO 12", and then it does that. https://proton.me/mail/home

…

-------- Original Message --------

On Monday, 08/03/26 at 12:28 Rizmy Abdulla ***@***.***> wrote: rizmyabdulla left a comment [(slvDev/esp32-ai#10)](#10 (comment)) ***@***.***(https://github.com/Tylersuard) Not really. Training it on chat conversations will make it talk more like a chatbot, but a 28M parameter model is still too small to be a good conversational LLM. It'll still hallucinate a lot because it simply doesn't have enough capacity to learn and retain enough knowledge. The dataset can improve its chat style, but it can't overcome the model's size limitations — Reply to this email directly, [view it on GitHub](#10?email_source=notifications&email_token=AJ6H6YJ23XZSOLM2LVXGOFD5IAIG3A5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTKMJWGIZTAMZXGQ42M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-5162303749), or [unsubscribe](https://github.com/notifications/unsubscribe-auth/AJ6H6YKIQ5GK6Y5E3LATCYD5IAIG3AVCNFSNUABGKJSXA33TNF2G64TZHMYTGMJQGA2TONRRHE5US43TOVSTWNJQGQ2DKMBWGAYTPILWAI). You are receiving this because you were mentioned.Message ID: ***@***.***>