Commit f492023
committed
Grab model data dynamically instead of hardcoded
- Dynamically resolve max token count
- Dynamically resolve tokenizers
- Use only stream function not both callback and stream and distinguish type of response instead
Signed-off-by: Tomas Slusny <slusnucky@gmail.com>1 parent ae6b0c0 commit f492023
3 files changed
Lines changed: 276 additions & 287 deletions
0 commit comments