Skip to content

Add lexicon-free label-synchronous beam-search algorithm #126

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 65 commits into
base: master
Choose a base branch
from
Open

Add lexicon-free label-synchronous beam-search algorithm #126

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
65 commits
Select commit Hold shift + click to select a range
1e7035e
Implement simple lexiconfree time-sync beam search
Feb 19, 2025
bf0a8ce
Add some comments
Feb 19, 2025
d6689b4
Add `createSearchAlgorithm` to Search::Module
Feb 20, 2025
664945c
Fix compilation
Feb 26, 2025
488fb0e
Refactor traceback/lattice building and construct proper (nonlinear) …
Feb 28, 2025
1599302
Factor out time statistics into new Core::StopWatch class
Feb 28, 2025
9a60916
Don't copy sibling from predecessor
Feb 28, 2025
8e96423
Better handling of blank index
Feb 28, 2025
536ac82
Apply suggestions from code review
Feb 28, 2025
f21935e
Implement StopWatch class
Mar 4, 2025
5f82460
Use TIMER_START and TIMER_STOP macros instead
Mar 4, 2025
4779dd5
Simplify AdvancedTreeSearch PerformanceCounter by inheriting from Sto…
Mar 4, 2025
f5a3182
Small fixes in StopWatch class
Mar 4, 2025
97e5bd7
Make StopWatch a member of PerformanceCounter instead of inheriting
Mar 4, 2025
b77cf23
Implement LatticeTrace class
Mar 4, 2025
5fcfff7
Make predecessor and sibling public members
Mar 4, 2025
3152300
Look for initial trace instead of associating empty trace with initia…
Mar 4, 2025
0b676f9
Remove redundant includes
Mar 4, 2025
159fbd8
Add assertions for assumptions in lattice building
Mar 5, 2025
f2f4cf7
Merge remote-tracking branch 'origin/lattice_traces' into lexiconfree…
SimBe195 Mar 5, 2025
0577e79
Remove wrong assertion
SimBe195 Mar 5, 2025
04b6ac4
Merge remote-tracking branch 'origin/lattice_traces' into lexiconfree…
SimBe195 Mar 5, 2025
b454e39
Remove initial item in `performTraceback`
SimBe195 Mar 5, 2025
b3d5f02
Merge remote-tracking branch 'origin/lattice_traces' into lexiconfree…
SimBe195 Mar 5, 2025
d393c7e
Fix arc scores
SimBe195 Mar 5, 2025
b1ed20e
Merge remote-tracking branch 'origin/lattice_traces' into lexiconfree…
SimBe195 Mar 5, 2025
f112113
Merge remote-tracking branch 'origin/stopwatch' into lexiconfree_beam…
SimBe195 Mar 5, 2025
d67cf45
Update traceback/lattice building logic
SimBe195 Mar 5, 2025
54535e6
Make `elapsed` functions const
SimBe195 Mar 5, 2025
f0832f8
Merge branch 'stopwatch' into lexiconfree_beam_search
SimBe195 Mar 5, 2025
a125afa
Merge branch 'stopwatch' into lattice_traces
SimBe195 Mar 5, 2025
46ee1a8
Merge branch 'lattice_traces' into lexiconfree_beam_search
SimBe195 Mar 5, 2025
c86855e
Add RecognizerNodeV2
SimBe195 Mar 5, 2025
1dc47e6
Make `modelCombination_` a ref + some formatting
SimBe195 Mar 6, 2025
600999b
Better readable lattice building function
SimBe195 Mar 6, 2025
e309602
Fix error string
SimBe195 Mar 26, 2025
52dc192
Add DataView class to replace feature input/output of LabelScorer and…
SimBe195 Mar 27, 2025
8dd7251
Rewrite docstring, remove static_ptr cast, add operator[] function
SimBe195 Mar 27, 2025
1cad598
Fix indentation
SimBe195 Apr 1, 2025
540ccf5
Merge branch 'master' into shared_ptr_adapter
SimBe195 Apr 4, 2025
b6ae9d4
Remove unnecessary includes
SimBe195 Apr 4, 2025
6ecb644
Formatting
SimBe195 Apr 4, 2025
b33902d
Fix #define name
SimBe195 Apr 4, 2025
277d09d
Update EncoderDecoderLabelScorer
SimBe195 Apr 9, 2025
815338d
Add cache-cleanup functionality to LabelScorer
SimBe195 Apr 9, 2025
dcf65e5
Introduce function to get input at correct timestep in BufferedLabelS…
SimBe195 Apr 9, 2025
2e5bc56
Extract sub-ScoringContexts from CombineScoringContexts
SimBe195 Apr 16, 2025
4dbe0bf
Merge branch 'master' into cleanup_inactive_contexts
SimBe195 May 9, 2025
b7696e7
Formatting and include fixes
SimBe195 May 9, 2025
f22812b
Add handling of otherRootStates in PersistentStateTree and StaticSear…
curufinwe May 9, 2025
c9e6498
Add new LexiconfreeLabelsyncBeamSearch search algorithm
SimBe195 May 12, 2025
556d5d5
Revert Makefile changes that were produced by configure script
SimBe195 May 12, 2025
02b7e7a
Merge branch 'master' into cleanup_inactive_contexts
SimBe195 May 12, 2025
3386550
Merge branch 'cleanup_inactive_contexts' into lexiconfree_labelsync_s…
SimBe195 May 12, 2025
6bf2d0a
Improve docstrings
SimBe195 May 12, 2025
62c7b8c
Bugfix: Do pruning on newBeam_ instead of beam_
SimBe195 May 19, 2025
cfe3624
Fix comment string
SimBe195 May 19, 2025
872b0ff
Apply suggestions from code review + more verbose step logging
SimBe195 May 28, 2025
fad9928
Add missing include
SimBe195 May 28, 2025
b756a82
Fix typo in year
SimBe195 May 30, 2025
245755a
Merge branch 'master' into lexiconfree_labelsync_search
SimBe195 Jul 28, 2025
311eb8f
Fix pruning order and logging
SimBe195 Jul 28, 2025
a71e729
Remove unnecessary include
SimBe195 Jul 28, 2025
8fc3d7a
Some synchronization with updates from master
SimBe195 Jul 28, 2025
3647314
Use `Nn::invalidLabelIndex` in `LabelHypothesi` constructor
SimBe195 Jul 29, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions Modules.make
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -147,6 +147,7 @@ endif

# ****** Libraries ******
LIBS_SEARCH = src/Search/libSprintSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeLabelsyncBeamSearch/libSprintLexiconfreeLabelsyncBeamSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeTimesyncBeamSearch/libSprintLexiconfreeTimesyncBeamSearch.$(a)
ifdef MODULE_SEARCH_WFST
LIBS_SEARCH += src/Search/Wfst/libSprintSearchWfst.$(a)
Expand Down
1 change: 1 addition & 0 deletions apptainer/2022-10-21_tensorflow-1.15_arm_v1/makefiles/Modules.make
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -142,6 +142,7 @@ endif

# ****** Libraries ******
LIBS_SEARCH = src/Search/libSprintSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeLabelsyncBeamSearch/libSprintLexiconfreeLabelsyncBeamSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeTimesyncBeamSearch/libSprintLexiconfreeTimesyncBeamSearch.$(a)
LIBS_SEARCH += src/Search/TreeTimesyncBeamSearch/libSprintTreeTimesyncBeamSearch.$(a)
ifdef MODULE_SEARCH_WFST
Expand Down
1 change: 1 addition & 0 deletions apptainer/2022-10-21_tensorflow-1.15_v1/makefiles/Modules.make
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -142,6 +142,7 @@ endif

# ****** Libraries ******
LIBS_SEARCH = src/Search/libSprintSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeLabelsyncBeamSearch/libSprintLexiconfreeLabelsyncBeamSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeTimesyncBeamSearch/libSprintLexiconfreeTimesyncBeamSearch.$(a)
LIBS_SEARCH += src/Search/TreeTimesyncBeamSearch/libSprintTreeTimesyncBeamSearch.$(a)
ifdef MODULE_SEARCH_WFST
Expand Down
1 change: 1 addition & 0 deletions apptainer/2023-05-08_tensorflow-2.8_v1/makefiles/Modules.make
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -142,6 +142,7 @@ endif

# ****** Libraries ******
LIBS_SEARCH = src/Search/libSprintSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeLabelsyncBeamSearch/libSprintLexiconfreeLabelsyncBeamSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeTimesyncBeamSearch/libSprintLexiconfreeTimesyncBeamSearch.$(a)
LIBS_SEARCH += src/Search/TreeTimesyncBeamSearch/libSprintTreeTimesyncBeamSearch.$(a)
ifdef MODULE_SEARCH_WFST
Expand Down
1 change: 1 addition & 0 deletions apptainer/2023-08-09_tensorflow-2.8_onnx-1.15_v1/makefiles/Modules.make
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -146,6 +146,7 @@ endif

# ****** Libraries ******
LIBS_SEARCH = src/Search/libSprintSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeLabelsyncBeamSearch/libSprintLexiconfreeLabelsyncBeamSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeTimesyncBeamSearch/libSprintLexiconfreeTimesyncBeamSearch.$(a)
LIBS_SEARCH += src/Search/TreeTimesyncBeamSearch/libSprintTreeTimesyncBeamSearch.$(a)
ifdef MODULE_SEARCH_WFST
Expand Down
1 change: 1 addition & 0 deletions apptainer/2023-11-08_tensorflow-2.14_v1/makefiles/Modules.make
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -147,6 +147,7 @@ endif

# ****** Libraries ******
LIBS_SEARCH = src/Search/libSprintSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeLabelsyncBeamSearch/libSprintLexiconfreeLabelsyncBeamSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeTimesyncBeamSearch/libSprintLexiconfreeTimesyncBeamSearch.$(a)
LIBS_SEARCH += src/Search/TreeTimesyncBeamSearch/libSprintTreeTimesyncBeamSearch.$(a)
ifdef MODULE_SEARCH_WFST
Expand Down
1 change: 1 addition & 0 deletions apptainer/2025-04-23_tensorflow-2.17_onnx-1.20_v1/makefiles/Modules.make
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -147,6 +147,7 @@ endif

# ****** Libraries ******
LIBS_SEARCH = src/Search/libSprintSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeLabelsyncBeamSearch/libSprintLexiconfreeLabelsyncBeamSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeTimesyncBeamSearch/libSprintLexiconfreeTimesyncBeamSearch.$(a)
LIBS_SEARCH += src/Search/TreeTimesyncBeamSearch/libSprintTreeTimesyncBeamSearch.$(a)
ifdef MODULE_SEARCH_WFST
Expand Down
1 change: 1 addition & 0 deletions apptainer/2025-04-23_tensorflow-2.17_onnx-1.20_v2/makefiles/Modules.make
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -147,6 +147,7 @@ endif

# ****** Libraries ******
LIBS_SEARCH = src/Search/libSprintSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeLabelsyncBeamSearch/libSprintLexiconfreeLabelsyncBeamSearch.$(a)
LIBS_SEARCH += src/Search/LexiconfreeTimesyncBeamSearch/libSprintLexiconfreeTimesyncBeamSearch.$(a)
LIBS_SEARCH += src/Search/TreeTimesyncBeamSearch/libSprintTreeTimesyncBeamSearch.$(a)
ifdef MODULE_SEARCH_WFST
Expand Down
1 change: 1 addition & 0 deletions src/Nn/LabelScorer/LabelScorer.hh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -84,6 +84,7 @@ public:
BLANK_LOOP,
INITIAL_LABEL,
INITIAL_BLANK,
SENTENCE_END
};

// Request for scoring or context extension
Expand Down
Loading