[New]: ZeppelinApplicationConfiguration in aws_kinesisanalyticsv2_application

[Ocramius]

Description

Looking at AWS CloudFormation docs for deploying an AWS::KinesisAnalyticsV2::Application, it is evident that an "ApplicationMode": "INTERACTIVE", requires an AWS::Glue::Database.

In the examples provided at https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-kinesisanalyticsv2-application.html, this is used inside a AWS::KinesisAnalyticsV2::Application as follows:

        "MyApplication": {
            "Type": "AWS::KinesisAnalyticsV2::Application",
            "Properties": {
                "ApplicationMode": "INTERACTIVE",
                "RuntimeEnvironment": "ZEPPELIN-FLINK-3_0",
                "ServiceExecutionRole": {
                    "Fn::GetAtt": [
                        "ServiceExecutionRole",
                        "Arn"
                    ]
                },
                "ApplicationConfiguration": {
                    "FlinkApplicationConfiguration": {
                        "ParallelismConfiguration": {
                            "Parallelism": 4,
                            "ConfigurationType": "CUSTOM"
                        }
                    },
                    "ZeppelinApplicationConfiguration": {
                        "CatalogConfiguration": {
                            "GlueDataCatalogConfiguration": {
                                "DatabaseARN": {
                                    "Fn::Sub": "arn:aws:glue:${AWS::Region}:${AWS::AccountId}:database/${GlueDatabase}"
                                }
                            }
                        },
                        "CustomArtifactsConfiguration": [
                            {
                                "ArtifactType": "DEPENDENCY_JAR",
                                "MavenReference": {
                                    "GroupId": "org.apache.flink",
                                    "ArtifactId": "flink-sql-connector-kinesis",
                                    "Version": "1.15.4"
                                }
                            },
                            {
                                "ArtifactType": "DEPENDENCY_JAR",
                                "MavenReference": {
                                    "GroupId": "org.apache.flink",
                                    "ArtifactId": "flink-connector-kafka",
                                    "Version": "1.15.4"
                                }
                            },
                            {
                                "ArtifactType": "DEPENDENCY_JAR",
                                "MavenReference": {
                                    "GroupId": "software.amazon.msk",
                                    "ArtifactId": "aws-msk-iam-auth",
                                    "Version": "1.1.6"
                                }
                            }
                        ]
                    }
                }
            }
        },

I've searched around, and couldn't find any mentions of zeppeling values anywhere, but firing up a stack without that configuration seems to hang forever / timeout anyway, since an INTERACTIVE application needs to store DDL-related data in Glue.

Requested Resource(s) and/or Data Source(s)

• aws_kinesisanalyticsv2_application

Potential Terraform Configuration

resource "aws_kinesisanalyticsv2_application" "demo-flink" {
  # <SNIP>

  application_configuration {
    # <SNIP>

    zeppelin_application_configuration {
      catalog_configuration {
        glue_data_catalog_configuration {
          database_arn = aws_glue_catalog_database.my-db.arn
        }
      }

      custom_artifacts_configuration {
        artifact_type = "DEPENDENCY"
        maven_reference {
          group_id    = "org.apache.flink",
          artifact_id = "flink-sql-connector-kinesis",
          version     = "1.15.4"
        }
      }
    }
  }

  # <SNIP>
}

References

https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-kinesisanalyticsv2-application.html

Would you like to implement a fix?

None

[github-actions]

Community Note

Voting for Prioritization

• Please vote on this issue by adding a 👍 reaction to the original post to help the community and maintainers prioritize this request.
• Please see our prioritization guide for information on how we prioritize.
• Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request.

Volunteering to Work on This Issue

• If you are interested in working on this issue, please leave a comment.
• If this would be your first contribution, please review the contribution guide.