AI Chat
Why Create This Page
I want to create this page to test out a simple AI chat system. On this page, you can chat with an AI chatbots similar to other services on the internet. I want to get a good idea of how to handle chatbots in a database and what the prices would look like.
Good text generation models are cheaper to urn through an external service API call, like OpenAI's chat completion API or Google's gemini model, than by running the model on a rented GPU. At least, this is true for sites that don't get much traffic.
You must be logged in to chat with the chatbot. In order to appropriately keep track of chat history, I need to be able to assign chat histories to specific users. Also, users are rate limited with respect to how much they can chat with the chatbot per day.
I haven't implemented AI chat yet. I am still working on it.