At first, there was no output. After maybe 3-4 minutes it displayed "An error occurred ... contact help etc" message. I waited about 30 seconds then tried again and it said that was too fast. So I waited a whole minute and tried again and it immediately spat out the "An error occurred" message. To me, the idea that it crashed stuck with me because of how it streams its output, which was empty for 3-4 minutes on the first try.
EDIT:
To clarify, based on the above sequence of events and timings, I figured the inference instance crashed and the API layer returned and error then cached it.
It has nothing to do with your prompt. The site is just overloaded. It takes the same amout of time for every prompt, no matter it's complexity or simplicity, it's just the length that matters.
Well, I haven't been able to get an answer. It always get stuck at that question and then an error message. Something is definitely wrong but I can't debug it on HN... so
EDIT:
To clarify, based on the above sequence of events and timings, I figured the inference instance crashed and the API layer returned and error then cached it.