Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Enhancement] MongoCDC timestamp and array type parsing and judgment are inaccurate #546

Open
3 tasks done
xuqinghuang opened this issue Jan 15, 2025 · 0 comments · May be fixed by #547
Open
3 tasks done

[Enhancement] MongoCDC timestamp and array type parsing and judgment are inaccurate #546

xuqinghuang opened this issue Jan 15, 2025 · 0 comments · May be fixed by #547

Comments

@xuqinghuang
Copy link
Contributor

Search before asking

  • I had searched in the issues and found no similar issues.

Description

mongo data

db.cdc_test.insertOne({
    c_string: "Hello, MongoDB!",
    c_bool: true,
    c_int: 123456,
    c_long: NumberLong("1234567890123456789"),
    c_double: 123.45,
    c_decimal: new Decimal128("12345.67"),
    c_date: new Date(),
    c_timestamp: new Timestamp(1334567890, 1),
    c_object: { "key1": "value1", "key2": "value2" },
    c_array: ["str1","str2", 789]
});

There are 2 questions

  1. The timestamp type of mongo becomes string in doris, and when written to doris, it becomes like this

Image

  1. In the MongoDBType.toDorisType method, the array type of mongo is actually collected as List. And the returned array type should be array.
    Image

Solution

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant