Make each word from ChatGPT wait for a few milliseconds

intitni · intitni · commit 080372beaf7c · 2023-05-25T23:11:06.000+08:00
Azure OpenAI is incredibly quick in generating each part of its response, but there is a substantial delay between each section of the reply. This delay can make it seem like the streaming is malfunctioning.
diff --git a/Core/Sources/OpenAIService/ChatGPTService.swift b/Core/Sources/OpenAIService/ChatGPTService.swift
@@ -187,6 +187,8 @@ public actor ChatGPTService: ChatGPTServiceType {
                         if let content = delta.content {
                             continuation.yield(content)
                         }
+                        
+                        try await Task.sleep(nanoseconds: 10_000_000)
                     }
 
                     continuation.finish()

Original file line number	Diff line number	Diff line change
`@@ -187,6 +187,8 @@ public actor ChatGPTService: ChatGPTServiceType {`
`187`	`187`	`if let content = delta.content {`
`188`	`188`	`continuation.yield(content)`
`189`	`189`	`}`
	`190`	`+`
	`191`	`+ try await Task.sleep(nanoseconds: 10_000_000)`
`190`	`192`	`}`
`191`	`193`
`192`	`194`	`continuation.finish()`