Windows support? #692
Open
Windows support? #692
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Open
|
Do you have any wheels regarding python 3.11 and 3.12? |
|
This seems to combine a lot of things. The build/dependence improvements, the changes needed for MSVC to compile the BOOL_SWITCH sections, a whole lot of nitpicking, using the reference implementation rather than CUDA for selective_scan_fn and a bugfix in selective_scan_bwd_kernel.cuh. Does the use of the reference implementation for selective_scan_fn impact speed? |
|
hey @d8ahazard thanks for your windows fork! would you mind updating your code to the latest ssm? and also adding blackwell support to it? here is the code you can use: |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
It builds (CU124), inference on windows (Zonos) works.
Required install of triton to compile.
https://github.com/woct0rdho/triton-windows/releases/download/v3.2.0-windows.post9/triton-3.2.0-cp310-cp310-win_amd64.whl
Pre-built wheels for anybody who wants to play at home:
https://github.com/d8ahazard/AudioLab/releases/download/1.0.0/causal_conv1d-1.5.0.post8-cp310-cp310-win_amd64.whl
https://github.com/d8ahazard/AudioLab/releases/download/1.0.0/mamba_ssm-2.2.4-cp310-cp310-win_amd64.whl