✨Source Youtube Analytics - Migrate Python CDK to Low-code CDK to Manifest-only

[topefolorunso]

What

Migrate Youtube Analytics Python CDK to Low-code CDK to Manifest-only fixes https://github.com/airbytehq/airbyte-internal-issues/issues/8865

How

Developed using UI Builder and the Low-code CDK

Recommended reading order

1. manifest.yaml

🚨 User Impact 🚨

Are there any breaking changes? What is the end result perceived by the user?

For connector PRs, use this section to explain which type of semantic versioning bump occurs as a result of the changes. Refer to our Semantic Versioning for Connectors guidelines for more information. Breaking changes to connectors must be documented by an Airbyte engineer (PR author, or reviewer for community PRs) by using the Breaking Change Release Playbook.

If there are breaking changes, please merge this PR with the 🚨🚨 emoji so changelog authors can further highlight this if needed.

Pre-merge Actions

Expand the relevant checklist and delete the others.

Updating a connector

Community member or Airbyter

• Grant edit access to maintainers (instructions)
• Unit & integration tests added

Airbyter

If this is a community PR, the Airbyte engineer reviewing this PR is responsible for the below items.

• Create a non-forked branch based on this PR and test the below items on it
• Build is successful
• If new credentials are required for use in CI, add them to GSM. Instructions.

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
airbyte-docs	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jan 26, 2025 2:03pm

[natikgadzhi]

/format-fix

Format-fix job started... Check job output.

✅ Changes applied successfully. (b0b5405)

[topefolorunso]

@natikgadzhi Can you confirm the test credentials are valid. ps: I passed the check command in local

[natikgadzhi]

Ummm the screenshot is failing check.

I'll run regression tests once basic CATs pass

[topefolorunso]

I think it's an issue with the test credentials. I tested with mine and check passed

[natikgadzhi]

Ok we sort of have a youtube channel, let me try and update the creds.

[natikgadzhi]

Kicked-off a pre-release build, will try it out and report back. Didn't have time yet.

[natikgadzhi]

With the pre-release build, on my personal account on cloud, I get a check error:

'Cannot attempt to connect to stream channel_annotations_a1 - no stream slices were found, likely because the parent stream is empty.'

It maybe because of the lack of data in my channel, but let me try the current version to verify.

UPD: the current version fails with The Youtube account is not valid. Please make sure you're trying to use the active Youtube Account connected to your Google Account. — my test account is not a very good fit, huh.

@DanyloGL can you help test this to get this over the finish line?

[topefolorunso]

/format-fix

Format-fix job started... Check job output.

✅ Changes applied successfully. (31e535a)

[topefolorunso]

/format-fix

Format-fix job started... Check job output.

✅ Changes applied successfully. (210ee70)

[topefolorunso]

/format-fix

Format-fix job started... Check job output.

✅ Changes applied successfully. (223ffd2)

[topefolorunso]

@natikgadzhi I need help here implementing the async retriever please

[natikgadzhi]

Converting this would indeed be a very big win.

@lazebnyi or @darynaishchenko, would any of you find time this week to take a good look into this and record a loom + provide examples to @topefolorunso on how to impolement async retrievers? Getting another big connector to manifest-only would be lovely.

[lazebnyi]

Need to implement AsyncRetriever and an error handler in the manifest. Everything else looks good.

[lazebnyi]

      error_handler:
        type: DefaultErrorHandler
        backoff_strategies:
          - type: ConstantBackoff
             backoff_time_in_seconds: 30
        response_filters:
                type: HttpResponseFilter
                      action: FAIL
                      http_codes:
                        - 429
                      predicate: >-
                        {{response.get("error", {}).get("details", [])[0].get("reason")  == "RATE_LIMIT_EXCEEDED" and   response.get("error", {}).get("details", [])[0].get("metadata", {}).get("quota_limit") == "FreeQuotaRequestsPerDayPerProject"}}
                      error_message: >-
                        {{ "Exceeded daily quota: " + response.get("error", {}).get("details", [])[0].get('metadata', {}).get('quota_limit_value')} + " reqs/day" }}

It is better to describe error handler in the manifest instead have a custom component.

[lazebnyi]

For this behavior you could use AsyncRetirever to avoid custom component.

[topefolorunso]

I tried implementing the async retriever here @lazebnyi . This custom component is only a component of the async retriever to the best of my understanding. I will watch the loom and be back with questions 🤞🏼

https://github.com/airbytehq/airbyte/pull/42838/files#diff-cb52a8ae8fa55be3587d13879abff80da4c14577466259c5592a2701f3c84735R428-R469