Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

nil pointer dereference error from tokenizer library from within fastembed-go #46

Closed
alkuma opened this issue Sep 17, 2024 · 3 comments
Closed

Comments

@alkuma
Copy link

alkuma commented Sep 17, 2024

I faced a nil pointer dereference error in tokenizer library when it was being used in a downstream library called fastembed-go and have reported the issue at Anush008/fastembed-go#13

Cross posting here in case this is a known issue with a known workaround.

@alkuma
Copy link
Author

alkuma commented Sep 17, 2024

The error message / stack trace I got seems to indicate that this is a duplicate of #37 which has been fixed in June 2024. Let me investigate some more, hopefully this item can then be closed as a duplicate

@alkuma
Copy link
Author

alkuma commented Sep 17, 2024

Since there was a similar issue reported (and closed via a code change / PR) on the tokenizer side I just forked both tokenizer and fastemebed-go and published the latest master / main branch and used them as dependency, and the error is gone.

Perhaps all that's needed to be done is to publish the latest versions of both?

@sugarme
Copy link
Owner

sugarme commented Dec 13, 2024

@alkuma ,
Thanks for your report.

@sugarme sugarme closed this as completed Dec 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants