similar topics has topic -1

[aminathshausan]

Hi
I am using the following function to find similar topics to a given term, and getting Topic -1 listed among the similar topics. Is that possible? If so, why is it included, since its considered as an outlier.

similar_topics, similarity = model.find_topics('my_term', top_n=5)

Is there a way I can ignore Topic -1. Thanks

[MaartenGr]

That is currently not possible but you can adapt the code such that it ignores the outlier:

search_term = "my_search_term"
top_n = 5

topic_list = list(topic_model.topic_representations_.keys())
topic_list.sort()

# Extract search_term embeddings and compare with topic embeddings
search_embedding = topic_model._extract_embeddings([search_term],
                                            method="word",
                                            verbose=False).flatten()
sims = cosine_similarity(search_embedding.reshape(1, -1), topic_model.topic_embeddings_[1:]).flatten()

# Extract topics most similar to search_term
ids = np.argsort(sims)[-top_n:]
similarity = [sims[i] for i in ids][::-1]
similar_topics = [topic_list[1:][index] for index in ids][::-1]

[aminathshausan]

Thanks