Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] AWS Neptune to OpenSearch Lambda Poller fails with exception: 'Action/metadata line [1] contains an unknown parameter [_type]' #7280

Open
mcuervoe opened this issue Apr 23, 2023 · 1 comment
Labels
bug Something isn't working

Comments

@mcuervoe
Copy link

Describe the bug
The lambda created to ingest Neptune data into OpenSearch fails with exception ''Action/metadata line [1] contains an unknown parameter [_type]' when the OpenSearch engine was migrated from ElasticSearch 7.9 to OpenSearch 2.5

To Reproduce
Steps to reproduce the behavior:

  1. Create an AWS Neptune Instance (version 1.2)
  2. Create an OpenSearch Instance (version 2.5)
  3. Install Amazon Neptune-to-OpenSearch replication setup (python3.9)
  4. Insert data into AWS Neptune
  5. Wait for Step function to kick-off and see error in CloudWatch and/or Step Functions

Expected behavior
No error should happen. Data from Neptune should be indexed in OpenSearch

Plugins
N/A

Screenshots
If applicable, add screenshots to help explain your problem.

Host/Environment (please complete the following information):

  • OS: N/A
  • Version lambda puller python3.9 from s3://aws-neptune-customer-samples-eu-west-1/neptune-stream/lambda/python39/release_2022_07_27/neptune-to-es.zip
    Screenshot_1
    Screenshot_2

Additional context
version ElasticSearch 7.9 worked without issues. The problem appeared when we migrated to OpenSearch 2.5

@mcuervoe mcuervoe added bug Something isn't working untriaged labels Apr 23, 2023
@dblock
Copy link
Member

dblock commented Apr 25, 2023

I think this is because mapping type parameters were removed in 2.x, see https://opensearch.org/docs/2.0/breaking-changes/.

Are you following https://docs.aws.amazon.com/neptune/latest/userguide/full-text-search-cfn-create.html? I imagine we need to go fix it to support OpenSearch 2.x. I opened awslabs/amazon-neptune-tools#316.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants