Discord AI Chatter

• added a feature where the llm generates 2 responses and has the user pick their favourite response
• currently data is being stored but may potentially be used to train a “teacher” model which will allow for unsupervised learning

Probably gonna end the project here because of size restrictions. I might write a custom NN library from scratch and run it on a beefier device next time!

Changes/Updates:

• Updated LLM architecture (expanded capacity)
• found and parsed new training data
• found new testing data
• increased training speed (active cooler on the pi!)

Notes:

• had to retrain due to an architecture change
• it might be a bit schizophrenic (sentient perhaps)

Created the basic transformer architecture, added some basic Discord commands allowing me to interact and monitor with the bot. Currently training the bot on a Pi locally. (It is not very good at writing yet)