Skip to content

Commit f492023

Browse files
committed
Grab model data dynamically instead of hardcoded
- Dynamically resolve max token count - Dynamically resolve tokenizers - Use only stream function not both callback and stream and distinguish type of response instead Signed-off-by: Tomas Slusny <slusnucky@gmail.com>
1 parent ae6b0c0 commit f492023

3 files changed

Lines changed: 276 additions & 287 deletions

File tree

0 commit comments

Comments
 (0)