Dear developer, hello! I am a novice developer who has just started working with mamba. I would like to replace the Vision Transformer in my training task with Vision Mamba. Could you please tell me what kind of interface I can use to conveniently call it? The definition of the transformer layer in my model is as follows,which consists of three blocks (layer num = 3):
self.transformer = nn.Sequential(*[
Block(
dim=self.dim,
num_heads=8,
mlp_ratio=4,
drop_path=0.1) for i in range(num_layers)
])
Looking forward to your reply. Thank you.