I belive it's the same issue in: #2291 (FlowiseAI/Flowise#2291)
Hi guys!
When I'm using the embedded version, the Bot stops answering, some questions. Sometimes it answers.. and other times it doesnt. I can see the animation that the bot is "typing", but it suddently stops sometimes.
Description:
-
I have a bot in Flowizeai.com that is simple: a Conversational Retrieval QA chain with Pinecone as vector DB, OpenAI embeddings, and Redis as memory. It works perfectly — chatting about my RAG content while inside Flowizeai.com.
-
I use the embedded version on my site. I'm using the latest embedded SDK and I believe Flowize.ai is using the latest Flowize.
-
It was working fine until suddenly it became unstable: sometimes it answers correctly and other times it shows the bot as "typing", and moments later it just stops and shows no answer.
-
When I check the messages in Flowize, I can see that the model responded — it just didn't show in the embedded bot.
-
When checking the network session in Chrome DevTools, I can see that in the requests that worked there is data in the stream and response sessions. I can see several messages like this:
message: data:{"event":"token","data":" the answer..."}
-
But when it doesn't work, I see nothing in the stream or response sessions.
-
When I CURL the exact same bot, it ALWAYS works. Every time.
-
I can provide screenshots and help debug it, if you want. I'm available for calls or anything you think is useful.
-
I'm also a programmer and will try to investigate. If you have any direction or links/guides that might help, I'd be very thankful.
-
I see no CORS or error messages. It was working fine for days, and suddenly this started.
-
I suspect it's something related to websockets.
-
I'm not sure whether it's server-side or client/embedded-side issue.
-
One last comment: my site is inside SharePoint Online (Microsoft). I have a lot of experience with it and I don't believe it's at fault, but I can't completely rule it out — I needed to mention it.
-
Do you have any advice or suggestions on how I could help debug this issue?
Thanks a lot.
Marcelo.
Prints and explanation:
In PRINT 1 Label 1, we can see that I type 2 questions.. and the bot answers nothing. When inspecting, I see that there were no data in the Stream and Response Sessions.
In PRINT 1 Label 2, a few seconds later, I type another thing.. but this time, there were a response. And then, I can see data in the Stream and Response Session.
this part I belive is important: Even in the (1) when the bot didnt answer.. I could see that he actualy answered, when I see the messages directly in Flowize. See PRINT 2 bellow
PRINT 1:
PRINT 2:
I belive it's the same issue in: #2291 (FlowiseAI/Flowise#2291)
Hi guys!
When I'm using the embedded version, the Bot stops answering, some questions. Sometimes it answers.. and other times it doesnt. I can see the animation that the bot is "typing", but it suddently stops sometimes.
Description:
I have a bot in Flowizeai.com that is simple: a Conversational Retrieval QA chain with Pinecone as vector DB, OpenAI embeddings, and Redis as memory. It works perfectly — chatting about my RAG content while inside Flowizeai.com.
I use the embedded version on my site. I'm using the latest embedded SDK and I believe Flowize.ai is using the latest Flowize.
It was working fine until suddenly it became unstable: sometimes it answers correctly and other times it shows the bot as "typing", and moments later it just stops and shows no answer.
When I check the messages in Flowize, I can see that the model responded — it just didn't show in the embedded bot.
When checking the network session in Chrome DevTools, I can see that in the requests that worked there is data in the stream and response sessions. I can see several messages like this:
message: data:{"event":"token","data":" the answer..."}
But when it doesn't work, I see nothing in the stream or response sessions.
When I CURL the exact same bot, it ALWAYS works. Every time.
I can provide screenshots and help debug it, if you want. I'm available for calls or anything you think is useful.
I'm also a programmer and will try to investigate. If you have any direction or links/guides that might help, I'd be very thankful.
I see no CORS or error messages. It was working fine for days, and suddenly this started.
I suspect it's something related to websockets.
I'm not sure whether it's server-side or client/embedded-side issue.
One last comment: my site is inside SharePoint Online (Microsoft). I have a lot of experience with it and I don't believe it's at fault, but I can't completely rule it out — I needed to mention it.
Do you have any advice or suggestions on how I could help debug this issue?
Thanks a lot.
Marcelo.
Prints and explanation:
In PRINT 1 Label 1, we can see that I type 2 questions.. and the bot answers nothing. When inspecting, I see that there were no data in the Stream and Response Sessions.
In PRINT 1 Label 2, a few seconds later, I type another thing.. but this time, there were a response. And then, I can see data in the Stream and Response Session.
this part I belive is important: Even in the (1) when the bot didnt answer.. I could see that he actualy answered, when I see the messages directly in Flowize. See PRINT 2 bellow
PRINT 1:
PRINT 2: