Skip to content

Implementing the faiss vector store skill#40

Closed
Driss-Lalami99 wants to merge 1 commit into
AmadeusITGroup:mainfrom
Driss-Lalami99:my-dev-branch
Closed

Implementing the faiss vector store skill#40
Driss-Lalami99 wants to merge 1 commit into
AmadeusITGroup:mainfrom
Driss-Lalami99:my-dev-branch

Conversation

@Driss-Lalami99

Copy link
Copy Markdown
Contributor

Implementing the faiss vector store as an alternative to chromadb vector store

  • Creating the faiss vector store skill
  • updating the necessary files to integrate the faiss vector store
  • Implementing unit tests to test the vector store skill

Comment thread logs/indexer_skills.log Outdated
@@ -0,0 +1,9 @@
2025-07-25 14:27:10,048 - FaissVectorStoreSkill - INFO - Running FaissVectorStoreSkill...

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The log file/folder should not be part of the repository

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should I add the log file/folder to .gitignore ?

Comment thread src/logs/indexer_skills.log Outdated
@@ -0,0 +1,3368 @@
2025-07-09 16:56:07,000 - ScrollWorldExporterSkill - INFO - Running ScrollWorldExporter

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Local execution logs should not be part of the repository

@Driss-Lalami99 Driss-Lalami99 Jul 25, 2025

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should I add the logs to .gitignore ?

Comment thread src/localhost/chroma.sqlite3 Outdated

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This file should not be part of the repository

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should I remove it or add it to the .gitignore ?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, you can add to .gitignore, but be specific with the log file name

Comment thread tests/test_faiss_vector_store.py Outdated

def test_faiss_vector_store_skill() -> None:
db_path = Path("..\\..\\Documents\\docs2vec_ressources\\faissdb_test\\my_index_test.faiss")
files_path = Path("..\\..\\Documents\\MS teams credentials IT change mana.txt")

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This variable is used only for setting the source_link property, so it needs to be a string, not a Path.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will update the db_path to string. Thank you Dorin.

Comment thread tests/test_faiss_vector_store.py Outdated
from pathlib import Path

def test_faiss_vector_store_skill() -> None:
db_path = Path("..\\..\\Documents\\docs2vec_ressources\\faissdb_test\\my_index_test.faiss")

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As per my previous comment, please don't use local hardcoded paths. These unit tests will run in a GitHub runner, so, the path you set here will not be present. You should use local relative paths instead.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

My apologies, I understood that the path should be relative, if my understanding is correct now, I should add the path to the repository, so it is accessible within the repository, Am I right?

Comment thread tests/test_faiss_vector_store.py Outdated


def dummy_embedding_function(text: str) -> list[float]:
# This is a dummy implementation. Replace it with your actual embedding logic.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please rephrase or remove this comment :)

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes I will update it.

Comment thread .github/dependabot.yml Outdated
Comment on lines +11 to +14
- package-ecosystem: "github-actions"
directory: "/"
schedule:
interval: "weekly"

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What is this used for?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

My bad, these lines were not intended to be added into my code I will delete them.

@Driss-Lalami99

Copy link
Copy Markdown
Contributor Author

Thank you Dorin, for the review, I will try fix the issues and submit a new Pull request.

@Driss-Lalami99 Driss-Lalami99 force-pushed the my-dev-branch branch 5 times, most recently from 73b47de to f47650e Compare July 29, 2025 08:42
@Driss-Lalami99 Driss-Lalami99 requested a review from dpomian July 29, 2025 08:44
@Driss-Lalami99

Copy link
Copy Markdown
Contributor Author

I will close the old pull request and send a new one with the same changes .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants