-
|
Hi dear community, can someone kindly tell me where the variable |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
You were right: punct_default was never imported or defined. It was a latent bug in the add_unicode_punct=True path, not a symbol supplied elsewhere. The same block had two more defects:
All three problems are fixed in merged PR #3238, commit 1d8080af. The implementation now inspects only unique characters present in the input, selects Unicode category P characters that are not already covered by string.punctuation, and extends the punctuation list in place. This also avoids scanning the entire Unicode range for every call. The fix includes regression coverage for both the unchanged ASCII behavior and Chinese Unicode punctuation. Please update to current main or a future release containing 1d8080a. |
Beta Was this translation helpful? Give feedback.
You were right: punct_default was never imported or defined. It was a latent bug in the add_unicode_punct=True path, not a symbol supplied elsewhere.
The same block had two more defects:
All three problems are fixed in merged PR #3238, commit 1d8080af. The implementation now inspects only unique characters present in the input, selects Unicode category P characters that are not already covered by string.punctuation, and extends the punctuation list in place. This also avoids scanning the entire Unicode range for every call.
The fix includes regr…