Skip to content

Golang migration of `python-wordsegment` (English word segmentation, written in pure-Python, and based on a trillion-word corpus).

License

Notifications You must be signed in to change notification settings

FFengIll/wordsegment

 
 

Repository files navigation

Wordsegment

This is a golang migrate version of python-wordsegment.

See README.rst for more information of python-wordsegment.

Usage

See demo code for more information.

Misc

AI Migration Assistant

Even code migration via AI is a possible solution, but it DOES NOT work well enough.

  • Most of the tests migrated by AI.
  • Main module code is migrated by AI but many logic bugs exist.
  • Though manual check and bugfix cost time, the AI migration help much too.

Totally, it costs around 2 hours to complete all for the migration.

AI code migration works well for strong-type -> weak-type, strong-type -> strong-type.

But it is not good for weak-type -> strong-type.

I think the major reason is leak understand of weak-type logic, especially the closure.

About

Golang migration of `python-wordsegment` (English word segmentation, written in pure-Python, and based on a trillion-word corpus).

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 57.8%
  • Go 42.2%