Should optimize document upload

Currently the document upload is very buggy. Even if I upload a document without a lot of content (I think the overall length is less than 32K), the webpage automatically get stuck and can never get back to normal until I delete the post. This is so struggling. Also, some of your T1 model claims to support up to 128k context length, but in real application it cannot even support 32k context length. If I upload some documents and ask questions, it would not proceed because the content is too much for it to handle. Please be transparent with the context length each model really support. Otherwise, it is a useless product for me.

Please authenticate to join the conversation.

Upvoters
Status

In Progress

Board

πŸ’‘ Feature Request

Date

5 months ago

Author

Bob Dragon

Subscribe to post

Get notified by email when there are changes.