Skip to content

Implement Conch, Kaiko, Musk, PhikonV2 and Hibou tile-level FMs#37

Merged
clemsgrs merged 7 commits intoclemsgrs:mainfrom
leandervaneekelen:main
Oct 28, 2025
Merged

Implement Conch, Kaiko, Musk, PhikonV2 and Hibou tile-level FMs#37
clemsgrs merged 7 commits intoclemsgrs:mainfrom
leandervaneekelen:main

Conversation

@leandervaneekelen
Copy link
Copy Markdown
Contributor

Hi @clemsgrs

I implemented Conch, Kaiko, Musk, PhikonV2 and Hibou as tile-level foundation models for slide2vec. Everything was quite clean to implement, except that for Phikonv2 and Hibou (who draw from huggingface's transformer library) I had to add a slightly ugly if-statement to the TileDataset class to deal with an additional keyword argument that is required for those models their transforms. Let me know if you want to deal with this in another way.

I tested all FMs on a single slide and they seemed to work fine.

Copy link
Copy Markdown
Owner

@clemsgrs clemsgrs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks great, thanks!!
left mostly minor comments / suggestions

Comment thread slide2vec/configs/kaiko.yaml Outdated
Comment thread slide2vec/models/models.py Outdated
Comment thread slide2vec/models/models.py Outdated
Comment thread slide2vec/models/models.py Outdated
Comment thread slide2vec/models/models.py Outdated
Comment thread slide2vec/models/models.py Outdated
Comment thread slide2vec/models/models.py
Comment thread slide2vec/models/models.py Outdated
Comment thread slide2vec/models/models.py Outdated
Comment thread slide2vec/models/models.py Outdated
Comment thread requirements.in Outdated
@clemsgrs clemsgrs merged commit 892ba28 into clemsgrs:main Oct 28, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants