From 14f5927738614dbe708412583703840c9907672e Mon Sep 17 00:00:00 2001 From: Arne Wouters Date: Wed, 6 May 2026 08:30:55 +0200 Subject: [PATCH 1/5] chore: update folder structure --- .../aws-cleanrooms/SKILL.md | 0 .../aws-cleanrooms/references/custom-model-logging-debugging.md | 0 .../aws-cleanrooms/references/permission-debugging.md | 0 .../connect-to-data-source/SKILL.md | 0 .../connect-to-data-source/references/bigquery-setup.md | 0 .../connect-to-data-source/references/credential-security.md | 0 .../connect-to-data-source/references/discovery.md | 0 .../connect-to-data-source/references/jdbc-setup.md | 0 .../connect-to-data-source/references/network-setup.md | 0 .../connect-to-data-source/references/snowflake-setup.md | 0 .../connect-to-data-source/references/troubleshooting.md | 0 .../creating-data-lake-tables/SKILL.md | 0 .../creating-data-lake-tables/references/access-control.md | 0 .../creating-data-lake-tables/references/athena-ddl-path.md | 0 .../creating-data-lake-tables/references/best-practices.md | 0 .../references/table-creation-glue-etl.md | 0 .../exploring-data-catalog/SKILL.md | 0 .../exploring-data-catalog/references/discovery-checklist.md | 0 .../analytics => analytics-skills}/find-data-lake-assets/SKILL.md | 0 .../find-data-lake-assets/references/search-strategy.md | 0 .../analytics => analytics-skills}/ingest-into-data-lake/SKILL.md | 0 .../ingest-into-data-lake/references/athena-loading.md | 0 .../ingest-into-data-lake/references/bigquery-ingest.md | 0 .../ingest-into-data-lake/references/catalog-migration.md | 0 .../ingest-into-data-lake/references/ctas-patterns.md | 0 .../ingest-into-data-lake/references/data-quality-validation.md | 0 .../ingest-into-data-lake/references/dynamodb-ingest.md | 0 .../ingest-into-data-lake/references/error-handling.md | 0 .../ingest-into-data-lake/references/format-specific-loading.md | 0 .../ingest-into-data-lake/references/glue-etl-migration.md | 0 .../ingest-into-data-lake/references/glue-job-config.md | 0 .../ingest-into-data-lake/references/glue-job-scripts.md | 0 .../references/iceberg-catalog-config-and-usage.md | 0 .../ingest-into-data-lake/references/incremental-loading.md | 0 .../ingest-into-data-lake/references/jdbc-ingest.md | 0 .../ingest-into-data-lake/references/jdbc-performance.md | 0 .../ingest-into-data-lake/references/jdbc-schema-discovery.md | 0 .../ingest-into-data-lake/references/local-upload.md | 0 .../ingest-into-data-lake/references/migration-troubleshooting.md | 0 .../ingest-into-data-lake/references/migration-validation.md | 0 .../ingest-into-data-lake/references/s3-files.md | 0 .../ingest-into-data-lake/references/schema-evolution.md | 0 .../ingest-into-data-lake/references/snowflake-ingest.md | 0 .../ingest-into-data-lake/references/testing-and-scheduling.md | 0 .../ingest-into-data-lake/references/type-transformations.md | 0 .../ingest-into-data-lake/references/upload-options.md | 0 .../analytics => analytics-skills}/query-data-lake/SKILL.md | 0 .../query-data-lake/references/query-patterns.md | 0 .../query-data-lake/references/workgroup-selection.md | 0 .../messaging-and-streaming/SKILL.md | 0 .../aws-billing-and-cost-management/SKILL.md | 0 .../aws-billing-and-cost-management/references/budgets.md | 0 .../aws-billing-and-cost-management/references/cost-audit.md | 0 .../aws-billing-and-cost-management/references/cost-explorer.md | 0 .../references/cost-optimization-hub.md | 0 .../aws-billing-and-cost-management/references/cur-athena.md | 0 .../references/deterministic-calculations.md | 0 .../references/ebs-optimization.md | 0 .../aws-billing-and-cost-management/references/ec2-rightsizing.md | 0 .../aws-billing-and-cost-management/references/free-tier.md | 0 .../references/lambda-optimization.md | 0 .../aws-billing-and-cost-management/references/pricing-lookup.md | 0 .../references/rds-optimization.md | 0 .../references/reserved-instances.md | 0 .../aws-billing-and-cost-management/references/savings-plans.md | 0 .../references/service-optimization.md | 0 .../aws-containers/SKILL.md | 0 .../aws-containers/references/app-runner-guide.md | 0 .../aws-containers/references/ecr-repository-management.md | 0 .../aws-containers/references/ecs-exec-debugging.md | 0 .../aws-containers/references/ecs-infrastructure-patterns.md | 0 .../aws-containers/references/ecs-logging-and-firelens.md | 0 .../aws-containers/references/ecs-troubleshooting-guide.md | 0 .../aws-containers/references/fargate-service-deployment.md | 0 .../aws-containers/references/fargate-spot.md | 0 .../aws-containers/references/service-scaling-and-updates.md | 0 .../aws-containers/references/task-definition-authoring.md | 0 .../serverless => compute-skills}/aws-serverless/SKILL.md | 0 .../aws-serverless/assets/powertools-handler.py | 0 .../aws-serverless/references/api-gateway.md | 0 .../aws-serverless/references/architecture.md | 0 .../aws-serverless/references/concurrency.md | 0 .../aws-serverless/references/deployment.md | 0 .../aws-serverless/references/event-sources.md | 0 .../aws-serverless/references/lambda.md | 0 .../aws-serverless/references/orchestration.md | 0 .../aws-serverless/references/production.md | 0 .../aws-serverless/references/troubleshooting.md | 0 .../connecting-lambda-to-api-gateway/SKILL.md | 0 .../references/lambda-gateway-api.md | 0 .../connecting-lambda-to-dynamodb/SKILL.md | 0 .../references/lambda-dynamodb-connection.md | 0 .../creating-api-gateway-stage/SKILL.md | 0 .../references/create-api-gateway-stage.md | 0 .../creating-ec2-image-builder-pipeline/SKILL.md | 0 .../references/ec2-image-builder-pipeline.md | 0 .../debugging-lambda-timeouts/SKILL.md | 0 .../references/lambda-timeout-debugging.md | 0 .../launching-ec2-instance-with-best-practices/SKILL.md | 0 .../references/launch-ec2-instance-with-best-practices.md | 0 .../routing-traffic-with-route53-and-cloudfront/SKILL.md | 0 .../references/route53-cloudfront-routing.md | 0 .../setting-up-ec2-instance-profiles/SKILL.md | 0 .../references/ec2-instance-profile-setup.md | 0 .../creating-amazon-aurora-db-cluster-with-instances/SKILL.md | 0 .../references/create-amazon-aurora-db-cluster-with-instances.md | 0 .../databases => database-skills}/exporting-rds-to-s3/SKILL.md | 0 .../exporting-rds-to-s3/references/export-rds-to-s3.md | 0 skills/{foundations => developer-tools-skills}/aws-cdk/SKILL.md | 0 .../aws-cdk/references/bootstrap-and-project-setup.md | 0 .../aws-cdk/references/compliance-and-drift.md | 0 .../aws-cdk/references/construct-patterns.md | 0 .../aws-cdk/references/import-and-migrate.md | 0 .../aws-cdk/references/refactor-and-prevent-replacement.md | 0 .../aws-cdk/references/troubleshooting-credentials.md | 0 .../aws-cdk/references/troubleshooting-deployment.md | 0 .../aws-cdk/references/troubleshooting-synth.md | 0 .../aws-cdk/references/v1-to-v2-migration.md | 0 .../aws-sdk-js-v3-usage/SKILL.md | 0 .../aws-sdk-js-v3-usage/references/clients.md | 0 .../aws-sdk-js-v3-usage/references/credentials.md | 0 .../aws-sdk-js-v3-usage/references/dynamodb.md | 0 .../aws-sdk-js-v3-usage/references/effective-practices.md | 0 .../aws-sdk-js-v3-usage/references/error-handling.md | 0 .../aws-sdk-js-v3-usage/references/lambda.md | 0 .../aws-sdk-js-v3-usage/references/performance.md | 0 .../aws-sdk-js-v3-usage/references/s3.md | 0 .../aws-sdk-js-v3-usage/references/schemas.md | 0 .../aws-sdk-js-v3-usage/references/sigv4a.md | 0 .../aws-sdk-js-v3-usage/references/typescript.md | 0 .../aws-sdk-python-usage/SKILL.md | 0 .../aws-sdk-python-usage/references/configuration.md | 0 .../aws-sdk-python-usage/references/credentials.md | 0 .../aws-sdk-python-usage/references/dynamodb.md | 0 .../aws-sdk-python-usage/references/error-handling.md | 0 .../aws-sdk-python-usage/references/pagination.md | 0 .../aws-sdk-python-usage/references/s3.md | 0 .../aws-sdk-python-usage/references/waiters.md | 0 .../aws-sdk-swift-usage/SKILL.md | 0 skills/{foundations => frontend-skills}/aws-amplify/SKILL.md | 0 .../aws-amplify/references/advanced-features.md | 0 .../{foundations => frontend-skills}/aws-amplify/references/ai.md | 0 .../aws-amplify/references/auth-backend.md | 0 .../aws-amplify/references/auth-mobile.md | 0 .../aws-amplify/references/auth-web.md | 0 .../aws-amplify/references/core-mobile.md | 0 .../aws-amplify/references/core-web.md | 0 .../aws-amplify/references/data-backend.md | 0 .../aws-amplify/references/data-mobile.md | 0 .../aws-amplify/references/data-web.md | 0 .../aws-amplify/references/deployment.md | 0 .../aws-amplify/references/functions-and-api.md | 0 .../aws-amplify/references/scaffolding.md | 0 .../aws-amplify/references/storage-backend.md | 0 .../aws-amplify/references/storage-mobile.md | 0 .../aws-amplify/references/storage-web.md | 0 .../amazon-bedrock/SKILL.md | 0 .../references/agentcore-credentials-and-security.md | 0 .../amazon-bedrock/references/agentcore-gateway.md | 0 .../amazon-bedrock/references/agentcore-memory-observability.md | 0 .../amazon-bedrock/references/agentcore-registry-evaluations.md | 0 .../references/agentcore-runtime-container-build.md | 0 .../amazon-bedrock/references/agentcore-runtime.md | 0 .../amazon-bedrock/references/agents-and-action-groups.md | 0 .../amazon-bedrock/references/cost-tracking.md | 0 .../amazon-bedrock/references/guardrails.md | 0 .../amazon-bedrock/references/knowledge-bases-retrieval.md | 0 .../amazon-bedrock/references/knowledge-bases-setup.md | 0 .../amazon-bedrock/references/model-invocation.md | 0 .../amazon-bedrock/references/model-migration.md | 0 .../amazon-bedrock/references/model-selection-guide.md | 0 .../amazon-bedrock/references/prompt-caching.md | 0 .../amazon-bedrock/references/prompt-engineering-by-model.md | 0 .../amazon-bedrock/references/quota-health.md | 0 .../amazon-bedrock/references/sdk-converse-api-python.md | 0 .../amazon-bedrock/references/sdk-converse-api-typescript.md | 0 .../aws-cloudformation/SKILL.md | 0 .../references/author-cloudformation-best-practices.script.md | 0 .../references/check-cloudformation-template-compliance.script.md | 0 .../references/cloudformation-pre-deploy-validation.script.md | 0 .../references/lookup-resource-properties.script.md | 0 .../references/troubleshoot-deployment.script.md | 0 .../references/validate-cloudformation-template.script.md | 0 .../aws-transform/SKILL.md | 0 .../aws-transform/references/cli-reference.md | 0 .../aws-transform/references/multi-transformation.md | 0 .../aws-transform/references/remote-execution.md | 0 .../aws-transform/references/repo-analysis.md | 0 .../aws-transform/references/results-synthesis.md | 0 .../aws-transform/references/single-transformation.md | 0 .../aws-transform/references/troubleshooting.md | 0 .../SKILL.md | 0 .../configure-vpc-endpoints-for-private-aws-service-access.md | 0 .../connecting-vpcs-with-peering/SKILL.md | 0 .../references/vpc-peering-connection.md | 0 .../creating-production-vpc-multi-az/SKILL.md | 0 .../references/create-production-vpc-multi-az.md | 0 .../enabling-lambda-vpc-internet-access/SKILL.md | 0 .../references/lambda-vpc-internet-access.md | 0 .../aws-observability/SKILL.md | 0 .../aws-observability/assets/alarm-template.ts | 0 .../aws-observability/assets/otel-config.yaml | 0 .../aws-observability/references/alarms.md | 0 .../aws-observability/references/cloudtrail.md | 0 .../aws-observability/references/dashboards.md | 0 .../aws-observability/references/log-insights.md | 0 .../aws-observability/references/metrics.md | 0 .../aws-observability/references/synthetics.md | 0 .../aws-observability/references/tracing.md | 0 .../aws-observability/references/troubleshooting.md | 0 .../setting-up-cloudtrail-multi-region/SKILL.md | 0 .../references/cloudtrail-multi-region-setup.md | 0 .../setting-up-cloudwatch-alarm-notifications/SKILL.md | 0 .../references/setup-cloudwatch-alarm-notifications.md | 0 .../troubleshooting-application-failures/SKILL.md | 0 .../references/application-failure-troubleshooting.md | 0 .../aws-iam/SKILL.md | 0 .../creating-secrets-using-best-practices/SKILL.md | 0 .../references/create-secrets-using-best-practices.md | 0 .../storage => storage-skills}/securing-s3-buckets/SKILL.md | 0 .../securing-s3-buckets/references/audit-checklist.md | 0 .../securing-s3-buckets/references/encryption.md | 0 .../securing-s3-buckets/references/iam-permissions.md | 0 .../securing-s3-buckets/references/remediation.md | 0 .../securing-s3-buckets/references/workflows.md | 0 .../storing-and-querying-vectors/SKILL.md | 0 .../references/limits-and-patterns.md | 0 .../storing-and-querying-vectors/references/metadata-filtering.md | 0 .../storage => storage-skills}/troubleshooting-efs/SKILL.md | 0 .../storage => storage-skills}/troubleshooting-s3-files/SKILL.md | 0 230 files changed, 0 insertions(+), 0 deletions(-) rename skills/{services-and-workloads => analytics-skills}/aws-cleanrooms/SKILL.md (100%) rename skills/{services-and-workloads => analytics-skills}/aws-cleanrooms/references/custom-model-logging-debugging.md (100%) rename skills/{services-and-workloads => analytics-skills}/aws-cleanrooms/references/permission-debugging.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/connect-to-data-source/SKILL.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/connect-to-data-source/references/bigquery-setup.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/connect-to-data-source/references/credential-security.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/connect-to-data-source/references/discovery.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/connect-to-data-source/references/jdbc-setup.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/connect-to-data-source/references/network-setup.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/connect-to-data-source/references/snowflake-setup.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/connect-to-data-source/references/troubleshooting.md (100%) rename skills/{services-and-workloads/storage => analytics-skills}/creating-data-lake-tables/SKILL.md (100%) rename skills/{services-and-workloads/storage => analytics-skills}/creating-data-lake-tables/references/access-control.md (100%) rename skills/{services-and-workloads/storage => analytics-skills}/creating-data-lake-tables/references/athena-ddl-path.md (100%) rename skills/{services-and-workloads/storage => analytics-skills}/creating-data-lake-tables/references/best-practices.md (100%) rename skills/{services-and-workloads/storage => analytics-skills}/creating-data-lake-tables/references/table-creation-glue-etl.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/exploring-data-catalog/SKILL.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/exploring-data-catalog/references/discovery-checklist.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/find-data-lake-assets/SKILL.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/find-data-lake-assets/references/search-strategy.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/SKILL.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/athena-loading.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/bigquery-ingest.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/catalog-migration.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/ctas-patterns.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/data-quality-validation.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/dynamodb-ingest.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/error-handling.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/format-specific-loading.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/glue-etl-migration.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/glue-job-config.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/glue-job-scripts.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/iceberg-catalog-config-and-usage.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/incremental-loading.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/jdbc-ingest.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/jdbc-performance.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/jdbc-schema-discovery.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/local-upload.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/migration-troubleshooting.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/migration-validation.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/s3-files.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/schema-evolution.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/snowflake-ingest.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/testing-and-scheduling.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/type-transformations.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/ingest-into-data-lake/references/upload-options.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/query-data-lake/SKILL.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/query-data-lake/references/query-patterns.md (100%) rename skills/{services-and-workloads/analytics => analytics-skills}/query-data-lake/references/workgroup-selection.md (100%) rename skills/{services-and-workloads/messaging-and-streaming => application-integration-skills}/messaging-and-streaming/SKILL.md (100%) rename skills/{services-and-workloads => cloud-financial-management-skills}/aws-billing-and-cost-management/SKILL.md (100%) rename skills/{services-and-workloads => cloud-financial-management-skills}/aws-billing-and-cost-management/references/budgets.md (100%) rename skills/{services-and-workloads => cloud-financial-management-skills}/aws-billing-and-cost-management/references/cost-audit.md (100%) rename skills/{services-and-workloads => cloud-financial-management-skills}/aws-billing-and-cost-management/references/cost-explorer.md (100%) rename skills/{services-and-workloads => cloud-financial-management-skills}/aws-billing-and-cost-management/references/cost-optimization-hub.md (100%) rename skills/{services-and-workloads => cloud-financial-management-skills}/aws-billing-and-cost-management/references/cur-athena.md (100%) rename skills/{services-and-workloads => cloud-financial-management-skills}/aws-billing-and-cost-management/references/deterministic-calculations.md (100%) rename skills/{services-and-workloads => cloud-financial-management-skills}/aws-billing-and-cost-management/references/ebs-optimization.md (100%) rename skills/{services-and-workloads => cloud-financial-management-skills}/aws-billing-and-cost-management/references/ec2-rightsizing.md (100%) rename skills/{services-and-workloads => cloud-financial-management-skills}/aws-billing-and-cost-management/references/free-tier.md (100%) rename skills/{services-and-workloads => cloud-financial-management-skills}/aws-billing-and-cost-management/references/lambda-optimization.md (100%) rename skills/{services-and-workloads => cloud-financial-management-skills}/aws-billing-and-cost-management/references/pricing-lookup.md (100%) rename skills/{services-and-workloads => cloud-financial-management-skills}/aws-billing-and-cost-management/references/rds-optimization.md (100%) rename skills/{services-and-workloads => cloud-financial-management-skills}/aws-billing-and-cost-management/references/reserved-instances.md (100%) rename skills/{services-and-workloads => cloud-financial-management-skills}/aws-billing-and-cost-management/references/savings-plans.md (100%) rename skills/{services-and-workloads => cloud-financial-management-skills}/aws-billing-and-cost-management/references/service-optimization.md (100%) rename skills/{services-and-workloads => compute-skills}/aws-containers/SKILL.md (100%) rename skills/{services-and-workloads => compute-skills}/aws-containers/references/app-runner-guide.md (100%) rename skills/{services-and-workloads => compute-skills}/aws-containers/references/ecr-repository-management.md (100%) rename skills/{services-and-workloads => compute-skills}/aws-containers/references/ecs-exec-debugging.md (100%) rename skills/{services-and-workloads => compute-skills}/aws-containers/references/ecs-infrastructure-patterns.md (100%) rename skills/{services-and-workloads => compute-skills}/aws-containers/references/ecs-logging-and-firelens.md (100%) rename skills/{services-and-workloads => compute-skills}/aws-containers/references/ecs-troubleshooting-guide.md (100%) rename skills/{services-and-workloads => compute-skills}/aws-containers/references/fargate-service-deployment.md (100%) rename skills/{services-and-workloads => compute-skills}/aws-containers/references/fargate-spot.md (100%) rename skills/{services-and-workloads => compute-skills}/aws-containers/references/service-scaling-and-updates.md (100%) rename skills/{services-and-workloads => compute-skills}/aws-containers/references/task-definition-authoring.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/aws-serverless/SKILL.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/aws-serverless/assets/powertools-handler.py (100%) rename skills/{services-and-workloads/serverless => compute-skills}/aws-serverless/references/api-gateway.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/aws-serverless/references/architecture.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/aws-serverless/references/concurrency.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/aws-serverless/references/deployment.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/aws-serverless/references/event-sources.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/aws-serverless/references/lambda.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/aws-serverless/references/orchestration.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/aws-serverless/references/production.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/aws-serverless/references/troubleshooting.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/connecting-lambda-to-api-gateway/SKILL.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/connecting-lambda-to-api-gateway/references/lambda-gateway-api.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/connecting-lambda-to-dynamodb/SKILL.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/connecting-lambda-to-dynamodb/references/lambda-dynamodb-connection.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/creating-api-gateway-stage/SKILL.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/creating-api-gateway-stage/references/create-api-gateway-stage.md (100%) rename skills/{services-and-workloads/ec2 => compute-skills}/creating-ec2-image-builder-pipeline/SKILL.md (100%) rename skills/{services-and-workloads/ec2 => compute-skills}/creating-ec2-image-builder-pipeline/references/ec2-image-builder-pipeline.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/debugging-lambda-timeouts/SKILL.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/debugging-lambda-timeouts/references/lambda-timeout-debugging.md (100%) rename skills/{services-and-workloads/ec2 => compute-skills}/launching-ec2-instance-with-best-practices/SKILL.md (100%) rename skills/{services-and-workloads/ec2 => compute-skills}/launching-ec2-instance-with-best-practices/references/launch-ec2-instance-with-best-practices.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/routing-traffic-with-route53-and-cloudfront/SKILL.md (100%) rename skills/{services-and-workloads/serverless => compute-skills}/routing-traffic-with-route53-and-cloudfront/references/route53-cloudfront-routing.md (100%) rename skills/{services-and-workloads/ec2 => compute-skills}/setting-up-ec2-instance-profiles/SKILL.md (100%) rename skills/{services-and-workloads/ec2 => compute-skills}/setting-up-ec2-instance-profiles/references/ec2-instance-profile-setup.md (100%) rename skills/{services-and-workloads/databases => database-skills}/creating-amazon-aurora-db-cluster-with-instances/SKILL.md (100%) rename skills/{services-and-workloads/databases => database-skills}/creating-amazon-aurora-db-cluster-with-instances/references/create-amazon-aurora-db-cluster-with-instances.md (100%) rename skills/{services-and-workloads/databases => database-skills}/exporting-rds-to-s3/SKILL.md (100%) rename skills/{services-and-workloads/databases => database-skills}/exporting-rds-to-s3/references/export-rds-to-s3.md (100%) rename skills/{foundations => developer-tools-skills}/aws-cdk/SKILL.md (100%) rename skills/{foundations => developer-tools-skills}/aws-cdk/references/bootstrap-and-project-setup.md (100%) rename skills/{foundations => developer-tools-skills}/aws-cdk/references/compliance-and-drift.md (100%) rename skills/{foundations => developer-tools-skills}/aws-cdk/references/construct-patterns.md (100%) rename skills/{foundations => developer-tools-skills}/aws-cdk/references/import-and-migrate.md (100%) rename skills/{foundations => developer-tools-skills}/aws-cdk/references/refactor-and-prevent-replacement.md (100%) rename skills/{foundations => developer-tools-skills}/aws-cdk/references/troubleshooting-credentials.md (100%) rename skills/{foundations => developer-tools-skills}/aws-cdk/references/troubleshooting-deployment.md (100%) rename skills/{foundations => developer-tools-skills}/aws-cdk/references/troubleshooting-synth.md (100%) rename skills/{foundations => developer-tools-skills}/aws-cdk/references/v1-to-v2-migration.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-js-v3-usage/SKILL.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-js-v3-usage/references/clients.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-js-v3-usage/references/credentials.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-js-v3-usage/references/dynamodb.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-js-v3-usage/references/effective-practices.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-js-v3-usage/references/error-handling.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-js-v3-usage/references/lambda.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-js-v3-usage/references/performance.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-js-v3-usage/references/s3.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-js-v3-usage/references/schemas.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-js-v3-usage/references/sigv4a.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-js-v3-usage/references/typescript.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-python-usage/SKILL.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-python-usage/references/configuration.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-python-usage/references/credentials.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-python-usage/references/dynamodb.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-python-usage/references/error-handling.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-python-usage/references/pagination.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-python-usage/references/s3.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-python-usage/references/waiters.md (100%) rename skills/{foundations => developer-tools-skills}/aws-sdk-swift-usage/SKILL.md (100%) rename skills/{foundations => frontend-skills}/aws-amplify/SKILL.md (100%) rename skills/{foundations => frontend-skills}/aws-amplify/references/advanced-features.md (100%) rename skills/{foundations => frontend-skills}/aws-amplify/references/ai.md (100%) rename skills/{foundations => frontend-skills}/aws-amplify/references/auth-backend.md (100%) rename skills/{foundations => frontend-skills}/aws-amplify/references/auth-mobile.md (100%) rename skills/{foundations => frontend-skills}/aws-amplify/references/auth-web.md (100%) rename skills/{foundations => frontend-skills}/aws-amplify/references/core-mobile.md (100%) rename skills/{foundations => frontend-skills}/aws-amplify/references/core-web.md (100%) rename skills/{foundations => frontend-skills}/aws-amplify/references/data-backend.md (100%) rename skills/{foundations => frontend-skills}/aws-amplify/references/data-mobile.md (100%) rename skills/{foundations => frontend-skills}/aws-amplify/references/data-web.md (100%) rename skills/{foundations => frontend-skills}/aws-amplify/references/deployment.md (100%) rename skills/{foundations => frontend-skills}/aws-amplify/references/functions-and-api.md (100%) rename skills/{foundations => frontend-skills}/aws-amplify/references/scaffolding.md (100%) rename skills/{foundations => frontend-skills}/aws-amplify/references/storage-backend.md (100%) rename skills/{foundations => frontend-skills}/aws-amplify/references/storage-mobile.md (100%) rename skills/{foundations => frontend-skills}/aws-amplify/references/storage-web.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/SKILL.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/references/agentcore-credentials-and-security.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/references/agentcore-gateway.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/references/agentcore-memory-observability.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/references/agentcore-registry-evaluations.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/references/agentcore-runtime-container-build.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/references/agentcore-runtime.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/references/agents-and-action-groups.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/references/cost-tracking.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/references/guardrails.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/references/knowledge-bases-retrieval.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/references/knowledge-bases-setup.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/references/model-invocation.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/references/model-migration.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/references/model-selection-guide.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/references/prompt-caching.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/references/prompt-engineering-by-model.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/references/quota-health.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/references/sdk-converse-api-python.md (100%) rename skills/{services-and-workloads => generative-ai-skills}/amazon-bedrock/references/sdk-converse-api-typescript.md (100%) rename skills/{foundations => management-tools-skills}/aws-cloudformation/SKILL.md (100%) rename skills/{foundations => management-tools-skills}/aws-cloudformation/references/author-cloudformation-best-practices.script.md (100%) rename skills/{foundations => management-tools-skills}/aws-cloudformation/references/check-cloudformation-template-compliance.script.md (100%) rename skills/{foundations => management-tools-skills}/aws-cloudformation/references/cloudformation-pre-deploy-validation.script.md (100%) rename skills/{foundations => management-tools-skills}/aws-cloudformation/references/lookup-resource-properties.script.md (100%) rename skills/{foundations => management-tools-skills}/aws-cloudformation/references/troubleshoot-deployment.script.md (100%) rename skills/{foundations => management-tools-skills}/aws-cloudformation/references/validate-cloudformation-template.script.md (100%) rename skills/{services-and-workloads => migration-and-modernization-skills}/aws-transform/SKILL.md (100%) rename skills/{services-and-workloads => migration-and-modernization-skills}/aws-transform/references/cli-reference.md (100%) rename skills/{services-and-workloads => migration-and-modernization-skills}/aws-transform/references/multi-transformation.md (100%) rename skills/{services-and-workloads => migration-and-modernization-skills}/aws-transform/references/remote-execution.md (100%) rename skills/{services-and-workloads => migration-and-modernization-skills}/aws-transform/references/repo-analysis.md (100%) rename skills/{services-and-workloads => migration-and-modernization-skills}/aws-transform/references/results-synthesis.md (100%) rename skills/{services-and-workloads => migration-and-modernization-skills}/aws-transform/references/single-transformation.md (100%) rename skills/{services-and-workloads => migration-and-modernization-skills}/aws-transform/references/troubleshooting.md (100%) rename skills/{services-and-workloads/vpc => networking-and-content-delivery-skills}/configuring-vpc-endpoints-for-private-aws-service-access/SKILL.md (100%) rename skills/{services-and-workloads/vpc => networking-and-content-delivery-skills}/configuring-vpc-endpoints-for-private-aws-service-access/references/configure-vpc-endpoints-for-private-aws-service-access.md (100%) rename skills/{services-and-workloads/vpc => networking-and-content-delivery-skills}/connecting-vpcs-with-peering/SKILL.md (100%) rename skills/{services-and-workloads/vpc => networking-and-content-delivery-skills}/connecting-vpcs-with-peering/references/vpc-peering-connection.md (100%) rename skills/{services-and-workloads/vpc => networking-and-content-delivery-skills}/creating-production-vpc-multi-az/SKILL.md (100%) rename skills/{services-and-workloads/vpc => networking-and-content-delivery-skills}/creating-production-vpc-multi-az/references/create-production-vpc-multi-az.md (100%) rename skills/{services-and-workloads/serverless => networking-and-content-delivery-skills}/enabling-lambda-vpc-internet-access/SKILL.md (100%) rename skills/{services-and-workloads/serverless => networking-and-content-delivery-skills}/enabling-lambda-vpc-internet-access/references/lambda-vpc-internet-access.md (100%) rename skills/{services-and-workloads/observability => operations-skills}/aws-observability/SKILL.md (100%) rename skills/{services-and-workloads/observability => operations-skills}/aws-observability/assets/alarm-template.ts (100%) rename skills/{services-and-workloads/observability => operations-skills}/aws-observability/assets/otel-config.yaml (100%) rename skills/{services-and-workloads/observability => operations-skills}/aws-observability/references/alarms.md (100%) rename skills/{services-and-workloads/observability => operations-skills}/aws-observability/references/cloudtrail.md (100%) rename skills/{services-and-workloads/observability => operations-skills}/aws-observability/references/dashboards.md (100%) rename skills/{services-and-workloads/observability => operations-skills}/aws-observability/references/log-insights.md (100%) rename skills/{services-and-workloads/observability => operations-skills}/aws-observability/references/metrics.md (100%) rename skills/{services-and-workloads/observability => operations-skills}/aws-observability/references/synthetics.md (100%) rename skills/{services-and-workloads/observability => operations-skills}/aws-observability/references/tracing.md (100%) rename skills/{services-and-workloads/observability => operations-skills}/aws-observability/references/troubleshooting.md (100%) rename skills/{services-and-workloads/observability => operations-skills}/setting-up-cloudtrail-multi-region/SKILL.md (100%) rename skills/{services-and-workloads/observability => operations-skills}/setting-up-cloudtrail-multi-region/references/cloudtrail-multi-region-setup.md (100%) rename skills/{services-and-workloads/observability => operations-skills}/setting-up-cloudwatch-alarm-notifications/SKILL.md (100%) rename skills/{services-and-workloads/observability => operations-skills}/setting-up-cloudwatch-alarm-notifications/references/setup-cloudwatch-alarm-notifications.md (100%) rename skills/{services-and-workloads/observability => operations-skills}/troubleshooting-application-failures/SKILL.md (100%) rename skills/{services-and-workloads/observability => operations-skills}/troubleshooting-application-failures/references/application-failure-troubleshooting.md (100%) rename skills/{services-and-workloads => security-and-identity-skills}/aws-iam/SKILL.md (100%) rename skills/{foundations => security-and-identity-skills}/creating-secrets-using-best-practices/SKILL.md (100%) rename skills/{foundations => security-and-identity-skills}/creating-secrets-using-best-practices/references/create-secrets-using-best-practices.md (100%) rename skills/{services-and-workloads/storage => storage-skills}/securing-s3-buckets/SKILL.md (100%) rename skills/{services-and-workloads/storage => storage-skills}/securing-s3-buckets/references/audit-checklist.md (100%) rename skills/{services-and-workloads/storage => storage-skills}/securing-s3-buckets/references/encryption.md (100%) rename skills/{services-and-workloads/storage => storage-skills}/securing-s3-buckets/references/iam-permissions.md (100%) rename skills/{services-and-workloads/storage => storage-skills}/securing-s3-buckets/references/remediation.md (100%) rename skills/{services-and-workloads/storage => storage-skills}/securing-s3-buckets/references/workflows.md (100%) rename skills/{services-and-workloads/storage => storage-skills}/storing-and-querying-vectors/SKILL.md (100%) rename skills/{services-and-workloads/storage => storage-skills}/storing-and-querying-vectors/references/limits-and-patterns.md (100%) rename skills/{services-and-workloads/storage => storage-skills}/storing-and-querying-vectors/references/metadata-filtering.md (100%) rename skills/{services-and-workloads/storage => storage-skills}/troubleshooting-efs/SKILL.md (100%) rename skills/{services-and-workloads/storage => storage-skills}/troubleshooting-s3-files/SKILL.md (100%) diff --git a/skills/services-and-workloads/aws-cleanrooms/SKILL.md b/skills/analytics-skills/aws-cleanrooms/SKILL.md similarity index 100% rename from skills/services-and-workloads/aws-cleanrooms/SKILL.md rename to skills/analytics-skills/aws-cleanrooms/SKILL.md diff --git a/skills/services-and-workloads/aws-cleanrooms/references/custom-model-logging-debugging.md b/skills/analytics-skills/aws-cleanrooms/references/custom-model-logging-debugging.md similarity index 100% rename from skills/services-and-workloads/aws-cleanrooms/references/custom-model-logging-debugging.md rename to skills/analytics-skills/aws-cleanrooms/references/custom-model-logging-debugging.md diff --git a/skills/services-and-workloads/aws-cleanrooms/references/permission-debugging.md b/skills/analytics-skills/aws-cleanrooms/references/permission-debugging.md similarity index 100% rename from skills/services-and-workloads/aws-cleanrooms/references/permission-debugging.md rename to skills/analytics-skills/aws-cleanrooms/references/permission-debugging.md diff --git a/skills/services-and-workloads/analytics/connect-to-data-source/SKILL.md b/skills/analytics-skills/connect-to-data-source/SKILL.md similarity index 100% rename from skills/services-and-workloads/analytics/connect-to-data-source/SKILL.md rename to skills/analytics-skills/connect-to-data-source/SKILL.md diff --git a/skills/services-and-workloads/analytics/connect-to-data-source/references/bigquery-setup.md b/skills/analytics-skills/connect-to-data-source/references/bigquery-setup.md similarity index 100% rename from skills/services-and-workloads/analytics/connect-to-data-source/references/bigquery-setup.md rename to skills/analytics-skills/connect-to-data-source/references/bigquery-setup.md diff --git a/skills/services-and-workloads/analytics/connect-to-data-source/references/credential-security.md b/skills/analytics-skills/connect-to-data-source/references/credential-security.md similarity index 100% rename from skills/services-and-workloads/analytics/connect-to-data-source/references/credential-security.md rename to skills/analytics-skills/connect-to-data-source/references/credential-security.md diff --git a/skills/services-and-workloads/analytics/connect-to-data-source/references/discovery.md b/skills/analytics-skills/connect-to-data-source/references/discovery.md similarity index 100% rename from skills/services-and-workloads/analytics/connect-to-data-source/references/discovery.md rename to skills/analytics-skills/connect-to-data-source/references/discovery.md diff --git a/skills/services-and-workloads/analytics/connect-to-data-source/references/jdbc-setup.md b/skills/analytics-skills/connect-to-data-source/references/jdbc-setup.md similarity index 100% rename from skills/services-and-workloads/analytics/connect-to-data-source/references/jdbc-setup.md rename to skills/analytics-skills/connect-to-data-source/references/jdbc-setup.md diff --git a/skills/services-and-workloads/analytics/connect-to-data-source/references/network-setup.md b/skills/analytics-skills/connect-to-data-source/references/network-setup.md similarity index 100% rename from skills/services-and-workloads/analytics/connect-to-data-source/references/network-setup.md rename to skills/analytics-skills/connect-to-data-source/references/network-setup.md diff --git a/skills/services-and-workloads/analytics/connect-to-data-source/references/snowflake-setup.md b/skills/analytics-skills/connect-to-data-source/references/snowflake-setup.md similarity index 100% rename from skills/services-and-workloads/analytics/connect-to-data-source/references/snowflake-setup.md rename to skills/analytics-skills/connect-to-data-source/references/snowflake-setup.md diff --git a/skills/services-and-workloads/analytics/connect-to-data-source/references/troubleshooting.md b/skills/analytics-skills/connect-to-data-source/references/troubleshooting.md similarity index 100% rename from skills/services-and-workloads/analytics/connect-to-data-source/references/troubleshooting.md rename to skills/analytics-skills/connect-to-data-source/references/troubleshooting.md diff --git a/skills/services-and-workloads/storage/creating-data-lake-tables/SKILL.md b/skills/analytics-skills/creating-data-lake-tables/SKILL.md similarity index 100% rename from skills/services-and-workloads/storage/creating-data-lake-tables/SKILL.md rename to skills/analytics-skills/creating-data-lake-tables/SKILL.md diff --git a/skills/services-and-workloads/storage/creating-data-lake-tables/references/access-control.md b/skills/analytics-skills/creating-data-lake-tables/references/access-control.md similarity index 100% rename from skills/services-and-workloads/storage/creating-data-lake-tables/references/access-control.md rename to skills/analytics-skills/creating-data-lake-tables/references/access-control.md diff --git a/skills/services-and-workloads/storage/creating-data-lake-tables/references/athena-ddl-path.md b/skills/analytics-skills/creating-data-lake-tables/references/athena-ddl-path.md similarity index 100% rename from skills/services-and-workloads/storage/creating-data-lake-tables/references/athena-ddl-path.md rename to skills/analytics-skills/creating-data-lake-tables/references/athena-ddl-path.md diff --git a/skills/services-and-workloads/storage/creating-data-lake-tables/references/best-practices.md b/skills/analytics-skills/creating-data-lake-tables/references/best-practices.md similarity index 100% rename from skills/services-and-workloads/storage/creating-data-lake-tables/references/best-practices.md rename to skills/analytics-skills/creating-data-lake-tables/references/best-practices.md diff --git a/skills/services-and-workloads/storage/creating-data-lake-tables/references/table-creation-glue-etl.md b/skills/analytics-skills/creating-data-lake-tables/references/table-creation-glue-etl.md similarity index 100% rename from skills/services-and-workloads/storage/creating-data-lake-tables/references/table-creation-glue-etl.md rename to skills/analytics-skills/creating-data-lake-tables/references/table-creation-glue-etl.md diff --git a/skills/services-and-workloads/analytics/exploring-data-catalog/SKILL.md b/skills/analytics-skills/exploring-data-catalog/SKILL.md similarity index 100% rename from skills/services-and-workloads/analytics/exploring-data-catalog/SKILL.md rename to skills/analytics-skills/exploring-data-catalog/SKILL.md diff --git a/skills/services-and-workloads/analytics/exploring-data-catalog/references/discovery-checklist.md b/skills/analytics-skills/exploring-data-catalog/references/discovery-checklist.md similarity index 100% rename from skills/services-and-workloads/analytics/exploring-data-catalog/references/discovery-checklist.md rename to skills/analytics-skills/exploring-data-catalog/references/discovery-checklist.md diff --git a/skills/services-and-workloads/analytics/find-data-lake-assets/SKILL.md b/skills/analytics-skills/find-data-lake-assets/SKILL.md similarity index 100% rename from skills/services-and-workloads/analytics/find-data-lake-assets/SKILL.md rename to skills/analytics-skills/find-data-lake-assets/SKILL.md diff --git a/skills/services-and-workloads/analytics/find-data-lake-assets/references/search-strategy.md b/skills/analytics-skills/find-data-lake-assets/references/search-strategy.md similarity index 100% rename from skills/services-and-workloads/analytics/find-data-lake-assets/references/search-strategy.md rename to skills/analytics-skills/find-data-lake-assets/references/search-strategy.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/SKILL.md b/skills/analytics-skills/ingest-into-data-lake/SKILL.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/SKILL.md rename to skills/analytics-skills/ingest-into-data-lake/SKILL.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/athena-loading.md b/skills/analytics-skills/ingest-into-data-lake/references/athena-loading.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/athena-loading.md rename to skills/analytics-skills/ingest-into-data-lake/references/athena-loading.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/bigquery-ingest.md b/skills/analytics-skills/ingest-into-data-lake/references/bigquery-ingest.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/bigquery-ingest.md rename to skills/analytics-skills/ingest-into-data-lake/references/bigquery-ingest.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/catalog-migration.md b/skills/analytics-skills/ingest-into-data-lake/references/catalog-migration.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/catalog-migration.md rename to skills/analytics-skills/ingest-into-data-lake/references/catalog-migration.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/ctas-patterns.md b/skills/analytics-skills/ingest-into-data-lake/references/ctas-patterns.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/ctas-patterns.md rename to skills/analytics-skills/ingest-into-data-lake/references/ctas-patterns.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/data-quality-validation.md b/skills/analytics-skills/ingest-into-data-lake/references/data-quality-validation.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/data-quality-validation.md rename to skills/analytics-skills/ingest-into-data-lake/references/data-quality-validation.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/dynamodb-ingest.md b/skills/analytics-skills/ingest-into-data-lake/references/dynamodb-ingest.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/dynamodb-ingest.md rename to skills/analytics-skills/ingest-into-data-lake/references/dynamodb-ingest.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/error-handling.md b/skills/analytics-skills/ingest-into-data-lake/references/error-handling.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/error-handling.md rename to skills/analytics-skills/ingest-into-data-lake/references/error-handling.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/format-specific-loading.md b/skills/analytics-skills/ingest-into-data-lake/references/format-specific-loading.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/format-specific-loading.md rename to skills/analytics-skills/ingest-into-data-lake/references/format-specific-loading.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/glue-etl-migration.md b/skills/analytics-skills/ingest-into-data-lake/references/glue-etl-migration.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/glue-etl-migration.md rename to skills/analytics-skills/ingest-into-data-lake/references/glue-etl-migration.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/glue-job-config.md b/skills/analytics-skills/ingest-into-data-lake/references/glue-job-config.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/glue-job-config.md rename to skills/analytics-skills/ingest-into-data-lake/references/glue-job-config.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/glue-job-scripts.md b/skills/analytics-skills/ingest-into-data-lake/references/glue-job-scripts.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/glue-job-scripts.md rename to skills/analytics-skills/ingest-into-data-lake/references/glue-job-scripts.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/iceberg-catalog-config-and-usage.md b/skills/analytics-skills/ingest-into-data-lake/references/iceberg-catalog-config-and-usage.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/iceberg-catalog-config-and-usage.md rename to skills/analytics-skills/ingest-into-data-lake/references/iceberg-catalog-config-and-usage.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/incremental-loading.md b/skills/analytics-skills/ingest-into-data-lake/references/incremental-loading.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/incremental-loading.md rename to skills/analytics-skills/ingest-into-data-lake/references/incremental-loading.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/jdbc-ingest.md b/skills/analytics-skills/ingest-into-data-lake/references/jdbc-ingest.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/jdbc-ingest.md rename to skills/analytics-skills/ingest-into-data-lake/references/jdbc-ingest.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/jdbc-performance.md b/skills/analytics-skills/ingest-into-data-lake/references/jdbc-performance.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/jdbc-performance.md rename to skills/analytics-skills/ingest-into-data-lake/references/jdbc-performance.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/jdbc-schema-discovery.md b/skills/analytics-skills/ingest-into-data-lake/references/jdbc-schema-discovery.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/jdbc-schema-discovery.md rename to skills/analytics-skills/ingest-into-data-lake/references/jdbc-schema-discovery.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/local-upload.md b/skills/analytics-skills/ingest-into-data-lake/references/local-upload.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/local-upload.md rename to skills/analytics-skills/ingest-into-data-lake/references/local-upload.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/migration-troubleshooting.md b/skills/analytics-skills/ingest-into-data-lake/references/migration-troubleshooting.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/migration-troubleshooting.md rename to skills/analytics-skills/ingest-into-data-lake/references/migration-troubleshooting.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/migration-validation.md b/skills/analytics-skills/ingest-into-data-lake/references/migration-validation.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/migration-validation.md rename to skills/analytics-skills/ingest-into-data-lake/references/migration-validation.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/s3-files.md b/skills/analytics-skills/ingest-into-data-lake/references/s3-files.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/s3-files.md rename to skills/analytics-skills/ingest-into-data-lake/references/s3-files.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/schema-evolution.md b/skills/analytics-skills/ingest-into-data-lake/references/schema-evolution.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/schema-evolution.md rename to skills/analytics-skills/ingest-into-data-lake/references/schema-evolution.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/snowflake-ingest.md b/skills/analytics-skills/ingest-into-data-lake/references/snowflake-ingest.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/snowflake-ingest.md rename to skills/analytics-skills/ingest-into-data-lake/references/snowflake-ingest.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/testing-and-scheduling.md b/skills/analytics-skills/ingest-into-data-lake/references/testing-and-scheduling.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/testing-and-scheduling.md rename to skills/analytics-skills/ingest-into-data-lake/references/testing-and-scheduling.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/type-transformations.md b/skills/analytics-skills/ingest-into-data-lake/references/type-transformations.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/type-transformations.md rename to skills/analytics-skills/ingest-into-data-lake/references/type-transformations.md diff --git a/skills/services-and-workloads/analytics/ingest-into-data-lake/references/upload-options.md b/skills/analytics-skills/ingest-into-data-lake/references/upload-options.md similarity index 100% rename from skills/services-and-workloads/analytics/ingest-into-data-lake/references/upload-options.md rename to skills/analytics-skills/ingest-into-data-lake/references/upload-options.md diff --git a/skills/services-and-workloads/analytics/query-data-lake/SKILL.md b/skills/analytics-skills/query-data-lake/SKILL.md similarity index 100% rename from skills/services-and-workloads/analytics/query-data-lake/SKILL.md rename to skills/analytics-skills/query-data-lake/SKILL.md diff --git a/skills/services-and-workloads/analytics/query-data-lake/references/query-patterns.md b/skills/analytics-skills/query-data-lake/references/query-patterns.md similarity index 100% rename from skills/services-and-workloads/analytics/query-data-lake/references/query-patterns.md rename to skills/analytics-skills/query-data-lake/references/query-patterns.md diff --git a/skills/services-and-workloads/analytics/query-data-lake/references/workgroup-selection.md b/skills/analytics-skills/query-data-lake/references/workgroup-selection.md similarity index 100% rename from skills/services-and-workloads/analytics/query-data-lake/references/workgroup-selection.md rename to skills/analytics-skills/query-data-lake/references/workgroup-selection.md diff --git a/skills/services-and-workloads/messaging-and-streaming/messaging-and-streaming/SKILL.md b/skills/application-integration-skills/messaging-and-streaming/SKILL.md similarity index 100% rename from skills/services-and-workloads/messaging-and-streaming/messaging-and-streaming/SKILL.md rename to skills/application-integration-skills/messaging-and-streaming/SKILL.md diff --git a/skills/services-and-workloads/aws-billing-and-cost-management/SKILL.md b/skills/cloud-financial-management-skills/aws-billing-and-cost-management/SKILL.md similarity index 100% rename from skills/services-and-workloads/aws-billing-and-cost-management/SKILL.md rename to skills/cloud-financial-management-skills/aws-billing-and-cost-management/SKILL.md diff --git a/skills/services-and-workloads/aws-billing-and-cost-management/references/budgets.md b/skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/budgets.md similarity index 100% rename from skills/services-and-workloads/aws-billing-and-cost-management/references/budgets.md rename to skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/budgets.md diff --git a/skills/services-and-workloads/aws-billing-and-cost-management/references/cost-audit.md b/skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/cost-audit.md similarity index 100% rename from skills/services-and-workloads/aws-billing-and-cost-management/references/cost-audit.md rename to skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/cost-audit.md diff --git a/skills/services-and-workloads/aws-billing-and-cost-management/references/cost-explorer.md b/skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/cost-explorer.md similarity index 100% rename from skills/services-and-workloads/aws-billing-and-cost-management/references/cost-explorer.md rename to skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/cost-explorer.md diff --git a/skills/services-and-workloads/aws-billing-and-cost-management/references/cost-optimization-hub.md b/skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/cost-optimization-hub.md similarity index 100% rename from skills/services-and-workloads/aws-billing-and-cost-management/references/cost-optimization-hub.md rename to skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/cost-optimization-hub.md diff --git a/skills/services-and-workloads/aws-billing-and-cost-management/references/cur-athena.md b/skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/cur-athena.md similarity index 100% rename from skills/services-and-workloads/aws-billing-and-cost-management/references/cur-athena.md rename to skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/cur-athena.md diff --git a/skills/services-and-workloads/aws-billing-and-cost-management/references/deterministic-calculations.md b/skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/deterministic-calculations.md similarity index 100% rename from skills/services-and-workloads/aws-billing-and-cost-management/references/deterministic-calculations.md rename to skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/deterministic-calculations.md diff --git a/skills/services-and-workloads/aws-billing-and-cost-management/references/ebs-optimization.md b/skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/ebs-optimization.md similarity index 100% rename from skills/services-and-workloads/aws-billing-and-cost-management/references/ebs-optimization.md rename to skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/ebs-optimization.md diff --git a/skills/services-and-workloads/aws-billing-and-cost-management/references/ec2-rightsizing.md b/skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/ec2-rightsizing.md similarity index 100% rename from skills/services-and-workloads/aws-billing-and-cost-management/references/ec2-rightsizing.md rename to skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/ec2-rightsizing.md diff --git a/skills/services-and-workloads/aws-billing-and-cost-management/references/free-tier.md b/skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/free-tier.md similarity index 100% rename from skills/services-and-workloads/aws-billing-and-cost-management/references/free-tier.md rename to skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/free-tier.md diff --git a/skills/services-and-workloads/aws-billing-and-cost-management/references/lambda-optimization.md b/skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/lambda-optimization.md similarity index 100% rename from skills/services-and-workloads/aws-billing-and-cost-management/references/lambda-optimization.md rename to skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/lambda-optimization.md diff --git a/skills/services-and-workloads/aws-billing-and-cost-management/references/pricing-lookup.md b/skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/pricing-lookup.md similarity index 100% rename from skills/services-and-workloads/aws-billing-and-cost-management/references/pricing-lookup.md rename to skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/pricing-lookup.md diff --git a/skills/services-and-workloads/aws-billing-and-cost-management/references/rds-optimization.md b/skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/rds-optimization.md similarity index 100% rename from skills/services-and-workloads/aws-billing-and-cost-management/references/rds-optimization.md rename to skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/rds-optimization.md diff --git a/skills/services-and-workloads/aws-billing-and-cost-management/references/reserved-instances.md b/skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/reserved-instances.md similarity index 100% rename from skills/services-and-workloads/aws-billing-and-cost-management/references/reserved-instances.md rename to skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/reserved-instances.md diff --git a/skills/services-and-workloads/aws-billing-and-cost-management/references/savings-plans.md b/skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/savings-plans.md similarity index 100% rename from skills/services-and-workloads/aws-billing-and-cost-management/references/savings-plans.md rename to skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/savings-plans.md diff --git a/skills/services-and-workloads/aws-billing-and-cost-management/references/service-optimization.md b/skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/service-optimization.md similarity index 100% rename from skills/services-and-workloads/aws-billing-and-cost-management/references/service-optimization.md rename to skills/cloud-financial-management-skills/aws-billing-and-cost-management/references/service-optimization.md diff --git a/skills/services-and-workloads/aws-containers/SKILL.md b/skills/compute-skills/aws-containers/SKILL.md similarity index 100% rename from skills/services-and-workloads/aws-containers/SKILL.md rename to skills/compute-skills/aws-containers/SKILL.md diff --git a/skills/services-and-workloads/aws-containers/references/app-runner-guide.md b/skills/compute-skills/aws-containers/references/app-runner-guide.md similarity index 100% rename from skills/services-and-workloads/aws-containers/references/app-runner-guide.md rename to skills/compute-skills/aws-containers/references/app-runner-guide.md diff --git a/skills/services-and-workloads/aws-containers/references/ecr-repository-management.md b/skills/compute-skills/aws-containers/references/ecr-repository-management.md similarity index 100% rename from skills/services-and-workloads/aws-containers/references/ecr-repository-management.md rename to skills/compute-skills/aws-containers/references/ecr-repository-management.md diff --git a/skills/services-and-workloads/aws-containers/references/ecs-exec-debugging.md b/skills/compute-skills/aws-containers/references/ecs-exec-debugging.md similarity index 100% rename from skills/services-and-workloads/aws-containers/references/ecs-exec-debugging.md rename to skills/compute-skills/aws-containers/references/ecs-exec-debugging.md diff --git a/skills/services-and-workloads/aws-containers/references/ecs-infrastructure-patterns.md b/skills/compute-skills/aws-containers/references/ecs-infrastructure-patterns.md similarity index 100% rename from skills/services-and-workloads/aws-containers/references/ecs-infrastructure-patterns.md rename to skills/compute-skills/aws-containers/references/ecs-infrastructure-patterns.md diff --git a/skills/services-and-workloads/aws-containers/references/ecs-logging-and-firelens.md b/skills/compute-skills/aws-containers/references/ecs-logging-and-firelens.md similarity index 100% rename from skills/services-and-workloads/aws-containers/references/ecs-logging-and-firelens.md rename to skills/compute-skills/aws-containers/references/ecs-logging-and-firelens.md diff --git a/skills/services-and-workloads/aws-containers/references/ecs-troubleshooting-guide.md b/skills/compute-skills/aws-containers/references/ecs-troubleshooting-guide.md similarity index 100% rename from skills/services-and-workloads/aws-containers/references/ecs-troubleshooting-guide.md rename to skills/compute-skills/aws-containers/references/ecs-troubleshooting-guide.md diff --git a/skills/services-and-workloads/aws-containers/references/fargate-service-deployment.md b/skills/compute-skills/aws-containers/references/fargate-service-deployment.md similarity index 100% rename from skills/services-and-workloads/aws-containers/references/fargate-service-deployment.md rename to skills/compute-skills/aws-containers/references/fargate-service-deployment.md diff --git a/skills/services-and-workloads/aws-containers/references/fargate-spot.md b/skills/compute-skills/aws-containers/references/fargate-spot.md similarity index 100% rename from skills/services-and-workloads/aws-containers/references/fargate-spot.md rename to skills/compute-skills/aws-containers/references/fargate-spot.md diff --git a/skills/services-and-workloads/aws-containers/references/service-scaling-and-updates.md b/skills/compute-skills/aws-containers/references/service-scaling-and-updates.md similarity index 100% rename from skills/services-and-workloads/aws-containers/references/service-scaling-and-updates.md rename to skills/compute-skills/aws-containers/references/service-scaling-and-updates.md diff --git a/skills/services-and-workloads/aws-containers/references/task-definition-authoring.md b/skills/compute-skills/aws-containers/references/task-definition-authoring.md similarity index 100% rename from skills/services-and-workloads/aws-containers/references/task-definition-authoring.md rename to skills/compute-skills/aws-containers/references/task-definition-authoring.md diff --git a/skills/services-and-workloads/serverless/aws-serverless/SKILL.md b/skills/compute-skills/aws-serverless/SKILL.md similarity index 100% rename from skills/services-and-workloads/serverless/aws-serverless/SKILL.md rename to skills/compute-skills/aws-serverless/SKILL.md diff --git a/skills/services-and-workloads/serverless/aws-serverless/assets/powertools-handler.py b/skills/compute-skills/aws-serverless/assets/powertools-handler.py similarity index 100% rename from skills/services-and-workloads/serverless/aws-serverless/assets/powertools-handler.py rename to skills/compute-skills/aws-serverless/assets/powertools-handler.py diff --git a/skills/services-and-workloads/serverless/aws-serverless/references/api-gateway.md b/skills/compute-skills/aws-serverless/references/api-gateway.md similarity index 100% rename from skills/services-and-workloads/serverless/aws-serverless/references/api-gateway.md rename to skills/compute-skills/aws-serverless/references/api-gateway.md diff --git a/skills/services-and-workloads/serverless/aws-serverless/references/architecture.md b/skills/compute-skills/aws-serverless/references/architecture.md similarity index 100% rename from skills/services-and-workloads/serverless/aws-serverless/references/architecture.md rename to skills/compute-skills/aws-serverless/references/architecture.md diff --git a/skills/services-and-workloads/serverless/aws-serverless/references/concurrency.md b/skills/compute-skills/aws-serverless/references/concurrency.md similarity index 100% rename from skills/services-and-workloads/serverless/aws-serverless/references/concurrency.md rename to skills/compute-skills/aws-serverless/references/concurrency.md diff --git a/skills/services-and-workloads/serverless/aws-serverless/references/deployment.md b/skills/compute-skills/aws-serverless/references/deployment.md similarity index 100% rename from skills/services-and-workloads/serverless/aws-serverless/references/deployment.md rename to skills/compute-skills/aws-serverless/references/deployment.md diff --git a/skills/services-and-workloads/serverless/aws-serverless/references/event-sources.md b/skills/compute-skills/aws-serverless/references/event-sources.md similarity index 100% rename from skills/services-and-workloads/serverless/aws-serverless/references/event-sources.md rename to skills/compute-skills/aws-serverless/references/event-sources.md diff --git a/skills/services-and-workloads/serverless/aws-serverless/references/lambda.md b/skills/compute-skills/aws-serverless/references/lambda.md similarity index 100% rename from skills/services-and-workloads/serverless/aws-serverless/references/lambda.md rename to skills/compute-skills/aws-serverless/references/lambda.md diff --git a/skills/services-and-workloads/serverless/aws-serverless/references/orchestration.md b/skills/compute-skills/aws-serverless/references/orchestration.md similarity index 100% rename from skills/services-and-workloads/serverless/aws-serverless/references/orchestration.md rename to skills/compute-skills/aws-serverless/references/orchestration.md diff --git a/skills/services-and-workloads/serverless/aws-serverless/references/production.md b/skills/compute-skills/aws-serverless/references/production.md similarity index 100% rename from skills/services-and-workloads/serverless/aws-serverless/references/production.md rename to skills/compute-skills/aws-serverless/references/production.md diff --git a/skills/services-and-workloads/serverless/aws-serverless/references/troubleshooting.md b/skills/compute-skills/aws-serverless/references/troubleshooting.md similarity index 100% rename from skills/services-and-workloads/serverless/aws-serverless/references/troubleshooting.md rename to skills/compute-skills/aws-serverless/references/troubleshooting.md diff --git a/skills/services-and-workloads/serverless/connecting-lambda-to-api-gateway/SKILL.md b/skills/compute-skills/connecting-lambda-to-api-gateway/SKILL.md similarity index 100% rename from skills/services-and-workloads/serverless/connecting-lambda-to-api-gateway/SKILL.md rename to skills/compute-skills/connecting-lambda-to-api-gateway/SKILL.md diff --git a/skills/services-and-workloads/serverless/connecting-lambda-to-api-gateway/references/lambda-gateway-api.md b/skills/compute-skills/connecting-lambda-to-api-gateway/references/lambda-gateway-api.md similarity index 100% rename from skills/services-and-workloads/serverless/connecting-lambda-to-api-gateway/references/lambda-gateway-api.md rename to skills/compute-skills/connecting-lambda-to-api-gateway/references/lambda-gateway-api.md diff --git a/skills/services-and-workloads/serverless/connecting-lambda-to-dynamodb/SKILL.md b/skills/compute-skills/connecting-lambda-to-dynamodb/SKILL.md similarity index 100% rename from skills/services-and-workloads/serverless/connecting-lambda-to-dynamodb/SKILL.md rename to skills/compute-skills/connecting-lambda-to-dynamodb/SKILL.md diff --git a/skills/services-and-workloads/serverless/connecting-lambda-to-dynamodb/references/lambda-dynamodb-connection.md b/skills/compute-skills/connecting-lambda-to-dynamodb/references/lambda-dynamodb-connection.md similarity index 100% rename from skills/services-and-workloads/serverless/connecting-lambda-to-dynamodb/references/lambda-dynamodb-connection.md rename to skills/compute-skills/connecting-lambda-to-dynamodb/references/lambda-dynamodb-connection.md diff --git a/skills/services-and-workloads/serverless/creating-api-gateway-stage/SKILL.md b/skills/compute-skills/creating-api-gateway-stage/SKILL.md similarity index 100% rename from skills/services-and-workloads/serverless/creating-api-gateway-stage/SKILL.md rename to skills/compute-skills/creating-api-gateway-stage/SKILL.md diff --git a/skills/services-and-workloads/serverless/creating-api-gateway-stage/references/create-api-gateway-stage.md b/skills/compute-skills/creating-api-gateway-stage/references/create-api-gateway-stage.md similarity index 100% rename from skills/services-and-workloads/serverless/creating-api-gateway-stage/references/create-api-gateway-stage.md rename to skills/compute-skills/creating-api-gateway-stage/references/create-api-gateway-stage.md diff --git a/skills/services-and-workloads/ec2/creating-ec2-image-builder-pipeline/SKILL.md b/skills/compute-skills/creating-ec2-image-builder-pipeline/SKILL.md similarity index 100% rename from skills/services-and-workloads/ec2/creating-ec2-image-builder-pipeline/SKILL.md rename to skills/compute-skills/creating-ec2-image-builder-pipeline/SKILL.md diff --git a/skills/services-and-workloads/ec2/creating-ec2-image-builder-pipeline/references/ec2-image-builder-pipeline.md b/skills/compute-skills/creating-ec2-image-builder-pipeline/references/ec2-image-builder-pipeline.md similarity index 100% rename from skills/services-and-workloads/ec2/creating-ec2-image-builder-pipeline/references/ec2-image-builder-pipeline.md rename to skills/compute-skills/creating-ec2-image-builder-pipeline/references/ec2-image-builder-pipeline.md diff --git a/skills/services-and-workloads/serverless/debugging-lambda-timeouts/SKILL.md b/skills/compute-skills/debugging-lambda-timeouts/SKILL.md similarity index 100% rename from skills/services-and-workloads/serverless/debugging-lambda-timeouts/SKILL.md rename to skills/compute-skills/debugging-lambda-timeouts/SKILL.md diff --git a/skills/services-and-workloads/serverless/debugging-lambda-timeouts/references/lambda-timeout-debugging.md b/skills/compute-skills/debugging-lambda-timeouts/references/lambda-timeout-debugging.md similarity index 100% rename from skills/services-and-workloads/serverless/debugging-lambda-timeouts/references/lambda-timeout-debugging.md rename to skills/compute-skills/debugging-lambda-timeouts/references/lambda-timeout-debugging.md diff --git a/skills/services-and-workloads/ec2/launching-ec2-instance-with-best-practices/SKILL.md b/skills/compute-skills/launching-ec2-instance-with-best-practices/SKILL.md similarity index 100% rename from skills/services-and-workloads/ec2/launching-ec2-instance-with-best-practices/SKILL.md rename to skills/compute-skills/launching-ec2-instance-with-best-practices/SKILL.md diff --git a/skills/services-and-workloads/ec2/launching-ec2-instance-with-best-practices/references/launch-ec2-instance-with-best-practices.md b/skills/compute-skills/launching-ec2-instance-with-best-practices/references/launch-ec2-instance-with-best-practices.md similarity index 100% rename from skills/services-and-workloads/ec2/launching-ec2-instance-with-best-practices/references/launch-ec2-instance-with-best-practices.md rename to skills/compute-skills/launching-ec2-instance-with-best-practices/references/launch-ec2-instance-with-best-practices.md diff --git a/skills/services-and-workloads/serverless/routing-traffic-with-route53-and-cloudfront/SKILL.md b/skills/compute-skills/routing-traffic-with-route53-and-cloudfront/SKILL.md similarity index 100% rename from skills/services-and-workloads/serverless/routing-traffic-with-route53-and-cloudfront/SKILL.md rename to skills/compute-skills/routing-traffic-with-route53-and-cloudfront/SKILL.md diff --git a/skills/services-and-workloads/serverless/routing-traffic-with-route53-and-cloudfront/references/route53-cloudfront-routing.md b/skills/compute-skills/routing-traffic-with-route53-and-cloudfront/references/route53-cloudfront-routing.md similarity index 100% rename from skills/services-and-workloads/serverless/routing-traffic-with-route53-and-cloudfront/references/route53-cloudfront-routing.md rename to skills/compute-skills/routing-traffic-with-route53-and-cloudfront/references/route53-cloudfront-routing.md diff --git a/skills/services-and-workloads/ec2/setting-up-ec2-instance-profiles/SKILL.md b/skills/compute-skills/setting-up-ec2-instance-profiles/SKILL.md similarity index 100% rename from skills/services-and-workloads/ec2/setting-up-ec2-instance-profiles/SKILL.md rename to skills/compute-skills/setting-up-ec2-instance-profiles/SKILL.md diff --git a/skills/services-and-workloads/ec2/setting-up-ec2-instance-profiles/references/ec2-instance-profile-setup.md b/skills/compute-skills/setting-up-ec2-instance-profiles/references/ec2-instance-profile-setup.md similarity index 100% rename from skills/services-and-workloads/ec2/setting-up-ec2-instance-profiles/references/ec2-instance-profile-setup.md rename to skills/compute-skills/setting-up-ec2-instance-profiles/references/ec2-instance-profile-setup.md diff --git a/skills/services-and-workloads/databases/creating-amazon-aurora-db-cluster-with-instances/SKILL.md b/skills/database-skills/creating-amazon-aurora-db-cluster-with-instances/SKILL.md similarity index 100% rename from skills/services-and-workloads/databases/creating-amazon-aurora-db-cluster-with-instances/SKILL.md rename to skills/database-skills/creating-amazon-aurora-db-cluster-with-instances/SKILL.md diff --git a/skills/services-and-workloads/databases/creating-amazon-aurora-db-cluster-with-instances/references/create-amazon-aurora-db-cluster-with-instances.md b/skills/database-skills/creating-amazon-aurora-db-cluster-with-instances/references/create-amazon-aurora-db-cluster-with-instances.md similarity index 100% rename from skills/services-and-workloads/databases/creating-amazon-aurora-db-cluster-with-instances/references/create-amazon-aurora-db-cluster-with-instances.md rename to skills/database-skills/creating-amazon-aurora-db-cluster-with-instances/references/create-amazon-aurora-db-cluster-with-instances.md diff --git a/skills/services-and-workloads/databases/exporting-rds-to-s3/SKILL.md b/skills/database-skills/exporting-rds-to-s3/SKILL.md similarity index 100% rename from skills/services-and-workloads/databases/exporting-rds-to-s3/SKILL.md rename to skills/database-skills/exporting-rds-to-s3/SKILL.md diff --git a/skills/services-and-workloads/databases/exporting-rds-to-s3/references/export-rds-to-s3.md b/skills/database-skills/exporting-rds-to-s3/references/export-rds-to-s3.md similarity index 100% rename from skills/services-and-workloads/databases/exporting-rds-to-s3/references/export-rds-to-s3.md rename to skills/database-skills/exporting-rds-to-s3/references/export-rds-to-s3.md diff --git a/skills/foundations/aws-cdk/SKILL.md b/skills/developer-tools-skills/aws-cdk/SKILL.md similarity index 100% rename from skills/foundations/aws-cdk/SKILL.md rename to skills/developer-tools-skills/aws-cdk/SKILL.md diff --git a/skills/foundations/aws-cdk/references/bootstrap-and-project-setup.md b/skills/developer-tools-skills/aws-cdk/references/bootstrap-and-project-setup.md similarity index 100% rename from skills/foundations/aws-cdk/references/bootstrap-and-project-setup.md rename to skills/developer-tools-skills/aws-cdk/references/bootstrap-and-project-setup.md diff --git a/skills/foundations/aws-cdk/references/compliance-and-drift.md b/skills/developer-tools-skills/aws-cdk/references/compliance-and-drift.md similarity index 100% rename from skills/foundations/aws-cdk/references/compliance-and-drift.md rename to skills/developer-tools-skills/aws-cdk/references/compliance-and-drift.md diff --git a/skills/foundations/aws-cdk/references/construct-patterns.md b/skills/developer-tools-skills/aws-cdk/references/construct-patterns.md similarity index 100% rename from skills/foundations/aws-cdk/references/construct-patterns.md rename to skills/developer-tools-skills/aws-cdk/references/construct-patterns.md diff --git a/skills/foundations/aws-cdk/references/import-and-migrate.md b/skills/developer-tools-skills/aws-cdk/references/import-and-migrate.md similarity index 100% rename from skills/foundations/aws-cdk/references/import-and-migrate.md rename to skills/developer-tools-skills/aws-cdk/references/import-and-migrate.md diff --git a/skills/foundations/aws-cdk/references/refactor-and-prevent-replacement.md b/skills/developer-tools-skills/aws-cdk/references/refactor-and-prevent-replacement.md similarity index 100% rename from skills/foundations/aws-cdk/references/refactor-and-prevent-replacement.md rename to skills/developer-tools-skills/aws-cdk/references/refactor-and-prevent-replacement.md diff --git a/skills/foundations/aws-cdk/references/troubleshooting-credentials.md b/skills/developer-tools-skills/aws-cdk/references/troubleshooting-credentials.md similarity index 100% rename from skills/foundations/aws-cdk/references/troubleshooting-credentials.md rename to skills/developer-tools-skills/aws-cdk/references/troubleshooting-credentials.md diff --git a/skills/foundations/aws-cdk/references/troubleshooting-deployment.md b/skills/developer-tools-skills/aws-cdk/references/troubleshooting-deployment.md similarity index 100% rename from skills/foundations/aws-cdk/references/troubleshooting-deployment.md rename to skills/developer-tools-skills/aws-cdk/references/troubleshooting-deployment.md diff --git a/skills/foundations/aws-cdk/references/troubleshooting-synth.md b/skills/developer-tools-skills/aws-cdk/references/troubleshooting-synth.md similarity index 100% rename from skills/foundations/aws-cdk/references/troubleshooting-synth.md rename to skills/developer-tools-skills/aws-cdk/references/troubleshooting-synth.md diff --git a/skills/foundations/aws-cdk/references/v1-to-v2-migration.md b/skills/developer-tools-skills/aws-cdk/references/v1-to-v2-migration.md similarity index 100% rename from skills/foundations/aws-cdk/references/v1-to-v2-migration.md rename to skills/developer-tools-skills/aws-cdk/references/v1-to-v2-migration.md diff --git a/skills/foundations/aws-sdk-js-v3-usage/SKILL.md b/skills/developer-tools-skills/aws-sdk-js-v3-usage/SKILL.md similarity index 100% rename from skills/foundations/aws-sdk-js-v3-usage/SKILL.md rename to skills/developer-tools-skills/aws-sdk-js-v3-usage/SKILL.md diff --git a/skills/foundations/aws-sdk-js-v3-usage/references/clients.md b/skills/developer-tools-skills/aws-sdk-js-v3-usage/references/clients.md similarity index 100% rename from skills/foundations/aws-sdk-js-v3-usage/references/clients.md rename to skills/developer-tools-skills/aws-sdk-js-v3-usage/references/clients.md diff --git a/skills/foundations/aws-sdk-js-v3-usage/references/credentials.md b/skills/developer-tools-skills/aws-sdk-js-v3-usage/references/credentials.md similarity index 100% rename from skills/foundations/aws-sdk-js-v3-usage/references/credentials.md rename to skills/developer-tools-skills/aws-sdk-js-v3-usage/references/credentials.md diff --git a/skills/foundations/aws-sdk-js-v3-usage/references/dynamodb.md b/skills/developer-tools-skills/aws-sdk-js-v3-usage/references/dynamodb.md similarity index 100% rename from skills/foundations/aws-sdk-js-v3-usage/references/dynamodb.md rename to skills/developer-tools-skills/aws-sdk-js-v3-usage/references/dynamodb.md diff --git a/skills/foundations/aws-sdk-js-v3-usage/references/effective-practices.md b/skills/developer-tools-skills/aws-sdk-js-v3-usage/references/effective-practices.md similarity index 100% rename from skills/foundations/aws-sdk-js-v3-usage/references/effective-practices.md rename to skills/developer-tools-skills/aws-sdk-js-v3-usage/references/effective-practices.md diff --git a/skills/foundations/aws-sdk-js-v3-usage/references/error-handling.md b/skills/developer-tools-skills/aws-sdk-js-v3-usage/references/error-handling.md similarity index 100% rename from skills/foundations/aws-sdk-js-v3-usage/references/error-handling.md rename to skills/developer-tools-skills/aws-sdk-js-v3-usage/references/error-handling.md diff --git a/skills/foundations/aws-sdk-js-v3-usage/references/lambda.md b/skills/developer-tools-skills/aws-sdk-js-v3-usage/references/lambda.md similarity index 100% rename from skills/foundations/aws-sdk-js-v3-usage/references/lambda.md rename to skills/developer-tools-skills/aws-sdk-js-v3-usage/references/lambda.md diff --git a/skills/foundations/aws-sdk-js-v3-usage/references/performance.md b/skills/developer-tools-skills/aws-sdk-js-v3-usage/references/performance.md similarity index 100% rename from skills/foundations/aws-sdk-js-v3-usage/references/performance.md rename to skills/developer-tools-skills/aws-sdk-js-v3-usage/references/performance.md diff --git a/skills/foundations/aws-sdk-js-v3-usage/references/s3.md b/skills/developer-tools-skills/aws-sdk-js-v3-usage/references/s3.md similarity index 100% rename from skills/foundations/aws-sdk-js-v3-usage/references/s3.md rename to skills/developer-tools-skills/aws-sdk-js-v3-usage/references/s3.md diff --git a/skills/foundations/aws-sdk-js-v3-usage/references/schemas.md b/skills/developer-tools-skills/aws-sdk-js-v3-usage/references/schemas.md similarity index 100% rename from skills/foundations/aws-sdk-js-v3-usage/references/schemas.md rename to skills/developer-tools-skills/aws-sdk-js-v3-usage/references/schemas.md diff --git a/skills/foundations/aws-sdk-js-v3-usage/references/sigv4a.md b/skills/developer-tools-skills/aws-sdk-js-v3-usage/references/sigv4a.md similarity index 100% rename from skills/foundations/aws-sdk-js-v3-usage/references/sigv4a.md rename to skills/developer-tools-skills/aws-sdk-js-v3-usage/references/sigv4a.md diff --git a/skills/foundations/aws-sdk-js-v3-usage/references/typescript.md b/skills/developer-tools-skills/aws-sdk-js-v3-usage/references/typescript.md similarity index 100% rename from skills/foundations/aws-sdk-js-v3-usage/references/typescript.md rename to skills/developer-tools-skills/aws-sdk-js-v3-usage/references/typescript.md diff --git a/skills/foundations/aws-sdk-python-usage/SKILL.md b/skills/developer-tools-skills/aws-sdk-python-usage/SKILL.md similarity index 100% rename from skills/foundations/aws-sdk-python-usage/SKILL.md rename to skills/developer-tools-skills/aws-sdk-python-usage/SKILL.md diff --git a/skills/foundations/aws-sdk-python-usage/references/configuration.md b/skills/developer-tools-skills/aws-sdk-python-usage/references/configuration.md similarity index 100% rename from skills/foundations/aws-sdk-python-usage/references/configuration.md rename to skills/developer-tools-skills/aws-sdk-python-usage/references/configuration.md diff --git a/skills/foundations/aws-sdk-python-usage/references/credentials.md b/skills/developer-tools-skills/aws-sdk-python-usage/references/credentials.md similarity index 100% rename from skills/foundations/aws-sdk-python-usage/references/credentials.md rename to skills/developer-tools-skills/aws-sdk-python-usage/references/credentials.md diff --git a/skills/foundations/aws-sdk-python-usage/references/dynamodb.md b/skills/developer-tools-skills/aws-sdk-python-usage/references/dynamodb.md similarity index 100% rename from skills/foundations/aws-sdk-python-usage/references/dynamodb.md rename to skills/developer-tools-skills/aws-sdk-python-usage/references/dynamodb.md diff --git a/skills/foundations/aws-sdk-python-usage/references/error-handling.md b/skills/developer-tools-skills/aws-sdk-python-usage/references/error-handling.md similarity index 100% rename from skills/foundations/aws-sdk-python-usage/references/error-handling.md rename to skills/developer-tools-skills/aws-sdk-python-usage/references/error-handling.md diff --git a/skills/foundations/aws-sdk-python-usage/references/pagination.md b/skills/developer-tools-skills/aws-sdk-python-usage/references/pagination.md similarity index 100% rename from skills/foundations/aws-sdk-python-usage/references/pagination.md rename to skills/developer-tools-skills/aws-sdk-python-usage/references/pagination.md diff --git a/skills/foundations/aws-sdk-python-usage/references/s3.md b/skills/developer-tools-skills/aws-sdk-python-usage/references/s3.md similarity index 100% rename from skills/foundations/aws-sdk-python-usage/references/s3.md rename to skills/developer-tools-skills/aws-sdk-python-usage/references/s3.md diff --git a/skills/foundations/aws-sdk-python-usage/references/waiters.md b/skills/developer-tools-skills/aws-sdk-python-usage/references/waiters.md similarity index 100% rename from skills/foundations/aws-sdk-python-usage/references/waiters.md rename to skills/developer-tools-skills/aws-sdk-python-usage/references/waiters.md diff --git a/skills/foundations/aws-sdk-swift-usage/SKILL.md b/skills/developer-tools-skills/aws-sdk-swift-usage/SKILL.md similarity index 100% rename from skills/foundations/aws-sdk-swift-usage/SKILL.md rename to skills/developer-tools-skills/aws-sdk-swift-usage/SKILL.md diff --git a/skills/foundations/aws-amplify/SKILL.md b/skills/frontend-skills/aws-amplify/SKILL.md similarity index 100% rename from skills/foundations/aws-amplify/SKILL.md rename to skills/frontend-skills/aws-amplify/SKILL.md diff --git a/skills/foundations/aws-amplify/references/advanced-features.md b/skills/frontend-skills/aws-amplify/references/advanced-features.md similarity index 100% rename from skills/foundations/aws-amplify/references/advanced-features.md rename to skills/frontend-skills/aws-amplify/references/advanced-features.md diff --git a/skills/foundations/aws-amplify/references/ai.md b/skills/frontend-skills/aws-amplify/references/ai.md similarity index 100% rename from skills/foundations/aws-amplify/references/ai.md rename to skills/frontend-skills/aws-amplify/references/ai.md diff --git a/skills/foundations/aws-amplify/references/auth-backend.md b/skills/frontend-skills/aws-amplify/references/auth-backend.md similarity index 100% rename from skills/foundations/aws-amplify/references/auth-backend.md rename to skills/frontend-skills/aws-amplify/references/auth-backend.md diff --git a/skills/foundations/aws-amplify/references/auth-mobile.md b/skills/frontend-skills/aws-amplify/references/auth-mobile.md similarity index 100% rename from skills/foundations/aws-amplify/references/auth-mobile.md rename to skills/frontend-skills/aws-amplify/references/auth-mobile.md diff --git a/skills/foundations/aws-amplify/references/auth-web.md b/skills/frontend-skills/aws-amplify/references/auth-web.md similarity index 100% rename from skills/foundations/aws-amplify/references/auth-web.md rename to skills/frontend-skills/aws-amplify/references/auth-web.md diff --git a/skills/foundations/aws-amplify/references/core-mobile.md b/skills/frontend-skills/aws-amplify/references/core-mobile.md similarity index 100% rename from skills/foundations/aws-amplify/references/core-mobile.md rename to skills/frontend-skills/aws-amplify/references/core-mobile.md diff --git a/skills/foundations/aws-amplify/references/core-web.md b/skills/frontend-skills/aws-amplify/references/core-web.md similarity index 100% rename from skills/foundations/aws-amplify/references/core-web.md rename to skills/frontend-skills/aws-amplify/references/core-web.md diff --git a/skills/foundations/aws-amplify/references/data-backend.md b/skills/frontend-skills/aws-amplify/references/data-backend.md similarity index 100% rename from skills/foundations/aws-amplify/references/data-backend.md rename to skills/frontend-skills/aws-amplify/references/data-backend.md diff --git a/skills/foundations/aws-amplify/references/data-mobile.md b/skills/frontend-skills/aws-amplify/references/data-mobile.md similarity index 100% rename from skills/foundations/aws-amplify/references/data-mobile.md rename to skills/frontend-skills/aws-amplify/references/data-mobile.md diff --git a/skills/foundations/aws-amplify/references/data-web.md b/skills/frontend-skills/aws-amplify/references/data-web.md similarity index 100% rename from skills/foundations/aws-amplify/references/data-web.md rename to skills/frontend-skills/aws-amplify/references/data-web.md diff --git a/skills/foundations/aws-amplify/references/deployment.md b/skills/frontend-skills/aws-amplify/references/deployment.md similarity index 100% rename from skills/foundations/aws-amplify/references/deployment.md rename to skills/frontend-skills/aws-amplify/references/deployment.md diff --git a/skills/foundations/aws-amplify/references/functions-and-api.md b/skills/frontend-skills/aws-amplify/references/functions-and-api.md similarity index 100% rename from skills/foundations/aws-amplify/references/functions-and-api.md rename to skills/frontend-skills/aws-amplify/references/functions-and-api.md diff --git a/skills/foundations/aws-amplify/references/scaffolding.md b/skills/frontend-skills/aws-amplify/references/scaffolding.md similarity index 100% rename from skills/foundations/aws-amplify/references/scaffolding.md rename to skills/frontend-skills/aws-amplify/references/scaffolding.md diff --git a/skills/foundations/aws-amplify/references/storage-backend.md b/skills/frontend-skills/aws-amplify/references/storage-backend.md similarity index 100% rename from skills/foundations/aws-amplify/references/storage-backend.md rename to skills/frontend-skills/aws-amplify/references/storage-backend.md diff --git a/skills/foundations/aws-amplify/references/storage-mobile.md b/skills/frontend-skills/aws-amplify/references/storage-mobile.md similarity index 100% rename from skills/foundations/aws-amplify/references/storage-mobile.md rename to skills/frontend-skills/aws-amplify/references/storage-mobile.md diff --git a/skills/foundations/aws-amplify/references/storage-web.md b/skills/frontend-skills/aws-amplify/references/storage-web.md similarity index 100% rename from skills/foundations/aws-amplify/references/storage-web.md rename to skills/frontend-skills/aws-amplify/references/storage-web.md diff --git a/skills/services-and-workloads/amazon-bedrock/SKILL.md b/skills/generative-ai-skills/amazon-bedrock/SKILL.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/SKILL.md rename to skills/generative-ai-skills/amazon-bedrock/SKILL.md diff --git a/skills/services-and-workloads/amazon-bedrock/references/agentcore-credentials-and-security.md b/skills/generative-ai-skills/amazon-bedrock/references/agentcore-credentials-and-security.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/references/agentcore-credentials-and-security.md rename to skills/generative-ai-skills/amazon-bedrock/references/agentcore-credentials-and-security.md diff --git a/skills/services-and-workloads/amazon-bedrock/references/agentcore-gateway.md b/skills/generative-ai-skills/amazon-bedrock/references/agentcore-gateway.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/references/agentcore-gateway.md rename to skills/generative-ai-skills/amazon-bedrock/references/agentcore-gateway.md diff --git a/skills/services-and-workloads/amazon-bedrock/references/agentcore-memory-observability.md b/skills/generative-ai-skills/amazon-bedrock/references/agentcore-memory-observability.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/references/agentcore-memory-observability.md rename to skills/generative-ai-skills/amazon-bedrock/references/agentcore-memory-observability.md diff --git a/skills/services-and-workloads/amazon-bedrock/references/agentcore-registry-evaluations.md b/skills/generative-ai-skills/amazon-bedrock/references/agentcore-registry-evaluations.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/references/agentcore-registry-evaluations.md rename to skills/generative-ai-skills/amazon-bedrock/references/agentcore-registry-evaluations.md diff --git a/skills/services-and-workloads/amazon-bedrock/references/agentcore-runtime-container-build.md b/skills/generative-ai-skills/amazon-bedrock/references/agentcore-runtime-container-build.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/references/agentcore-runtime-container-build.md rename to skills/generative-ai-skills/amazon-bedrock/references/agentcore-runtime-container-build.md diff --git a/skills/services-and-workloads/amazon-bedrock/references/agentcore-runtime.md b/skills/generative-ai-skills/amazon-bedrock/references/agentcore-runtime.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/references/agentcore-runtime.md rename to skills/generative-ai-skills/amazon-bedrock/references/agentcore-runtime.md diff --git a/skills/services-and-workloads/amazon-bedrock/references/agents-and-action-groups.md b/skills/generative-ai-skills/amazon-bedrock/references/agents-and-action-groups.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/references/agents-and-action-groups.md rename to skills/generative-ai-skills/amazon-bedrock/references/agents-and-action-groups.md diff --git a/skills/services-and-workloads/amazon-bedrock/references/cost-tracking.md b/skills/generative-ai-skills/amazon-bedrock/references/cost-tracking.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/references/cost-tracking.md rename to skills/generative-ai-skills/amazon-bedrock/references/cost-tracking.md diff --git a/skills/services-and-workloads/amazon-bedrock/references/guardrails.md b/skills/generative-ai-skills/amazon-bedrock/references/guardrails.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/references/guardrails.md rename to skills/generative-ai-skills/amazon-bedrock/references/guardrails.md diff --git a/skills/services-and-workloads/amazon-bedrock/references/knowledge-bases-retrieval.md b/skills/generative-ai-skills/amazon-bedrock/references/knowledge-bases-retrieval.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/references/knowledge-bases-retrieval.md rename to skills/generative-ai-skills/amazon-bedrock/references/knowledge-bases-retrieval.md diff --git a/skills/services-and-workloads/amazon-bedrock/references/knowledge-bases-setup.md b/skills/generative-ai-skills/amazon-bedrock/references/knowledge-bases-setup.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/references/knowledge-bases-setup.md rename to skills/generative-ai-skills/amazon-bedrock/references/knowledge-bases-setup.md diff --git a/skills/services-and-workloads/amazon-bedrock/references/model-invocation.md b/skills/generative-ai-skills/amazon-bedrock/references/model-invocation.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/references/model-invocation.md rename to skills/generative-ai-skills/amazon-bedrock/references/model-invocation.md diff --git a/skills/services-and-workloads/amazon-bedrock/references/model-migration.md b/skills/generative-ai-skills/amazon-bedrock/references/model-migration.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/references/model-migration.md rename to skills/generative-ai-skills/amazon-bedrock/references/model-migration.md diff --git a/skills/services-and-workloads/amazon-bedrock/references/model-selection-guide.md b/skills/generative-ai-skills/amazon-bedrock/references/model-selection-guide.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/references/model-selection-guide.md rename to skills/generative-ai-skills/amazon-bedrock/references/model-selection-guide.md diff --git a/skills/services-and-workloads/amazon-bedrock/references/prompt-caching.md b/skills/generative-ai-skills/amazon-bedrock/references/prompt-caching.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/references/prompt-caching.md rename to skills/generative-ai-skills/amazon-bedrock/references/prompt-caching.md diff --git a/skills/services-and-workloads/amazon-bedrock/references/prompt-engineering-by-model.md b/skills/generative-ai-skills/amazon-bedrock/references/prompt-engineering-by-model.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/references/prompt-engineering-by-model.md rename to skills/generative-ai-skills/amazon-bedrock/references/prompt-engineering-by-model.md diff --git a/skills/services-and-workloads/amazon-bedrock/references/quota-health.md b/skills/generative-ai-skills/amazon-bedrock/references/quota-health.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/references/quota-health.md rename to skills/generative-ai-skills/amazon-bedrock/references/quota-health.md diff --git a/skills/services-and-workloads/amazon-bedrock/references/sdk-converse-api-python.md b/skills/generative-ai-skills/amazon-bedrock/references/sdk-converse-api-python.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/references/sdk-converse-api-python.md rename to skills/generative-ai-skills/amazon-bedrock/references/sdk-converse-api-python.md diff --git a/skills/services-and-workloads/amazon-bedrock/references/sdk-converse-api-typescript.md b/skills/generative-ai-skills/amazon-bedrock/references/sdk-converse-api-typescript.md similarity index 100% rename from skills/services-and-workloads/amazon-bedrock/references/sdk-converse-api-typescript.md rename to skills/generative-ai-skills/amazon-bedrock/references/sdk-converse-api-typescript.md diff --git a/skills/foundations/aws-cloudformation/SKILL.md b/skills/management-tools-skills/aws-cloudformation/SKILL.md similarity index 100% rename from skills/foundations/aws-cloudformation/SKILL.md rename to skills/management-tools-skills/aws-cloudformation/SKILL.md diff --git a/skills/foundations/aws-cloudformation/references/author-cloudformation-best-practices.script.md b/skills/management-tools-skills/aws-cloudformation/references/author-cloudformation-best-practices.script.md similarity index 100% rename from skills/foundations/aws-cloudformation/references/author-cloudformation-best-practices.script.md rename to skills/management-tools-skills/aws-cloudformation/references/author-cloudformation-best-practices.script.md diff --git a/skills/foundations/aws-cloudformation/references/check-cloudformation-template-compliance.script.md b/skills/management-tools-skills/aws-cloudformation/references/check-cloudformation-template-compliance.script.md similarity index 100% rename from skills/foundations/aws-cloudformation/references/check-cloudformation-template-compliance.script.md rename to skills/management-tools-skills/aws-cloudformation/references/check-cloudformation-template-compliance.script.md diff --git a/skills/foundations/aws-cloudformation/references/cloudformation-pre-deploy-validation.script.md b/skills/management-tools-skills/aws-cloudformation/references/cloudformation-pre-deploy-validation.script.md similarity index 100% rename from skills/foundations/aws-cloudformation/references/cloudformation-pre-deploy-validation.script.md rename to skills/management-tools-skills/aws-cloudformation/references/cloudformation-pre-deploy-validation.script.md diff --git a/skills/foundations/aws-cloudformation/references/lookup-resource-properties.script.md b/skills/management-tools-skills/aws-cloudformation/references/lookup-resource-properties.script.md similarity index 100% rename from skills/foundations/aws-cloudformation/references/lookup-resource-properties.script.md rename to skills/management-tools-skills/aws-cloudformation/references/lookup-resource-properties.script.md diff --git a/skills/foundations/aws-cloudformation/references/troubleshoot-deployment.script.md b/skills/management-tools-skills/aws-cloudformation/references/troubleshoot-deployment.script.md similarity index 100% rename from skills/foundations/aws-cloudformation/references/troubleshoot-deployment.script.md rename to skills/management-tools-skills/aws-cloudformation/references/troubleshoot-deployment.script.md diff --git a/skills/foundations/aws-cloudformation/references/validate-cloudformation-template.script.md b/skills/management-tools-skills/aws-cloudformation/references/validate-cloudformation-template.script.md similarity index 100% rename from skills/foundations/aws-cloudformation/references/validate-cloudformation-template.script.md rename to skills/management-tools-skills/aws-cloudformation/references/validate-cloudformation-template.script.md diff --git a/skills/services-and-workloads/aws-transform/SKILL.md b/skills/migration-and-modernization-skills/aws-transform/SKILL.md similarity index 100% rename from skills/services-and-workloads/aws-transform/SKILL.md rename to skills/migration-and-modernization-skills/aws-transform/SKILL.md diff --git a/skills/services-and-workloads/aws-transform/references/cli-reference.md b/skills/migration-and-modernization-skills/aws-transform/references/cli-reference.md similarity index 100% rename from skills/services-and-workloads/aws-transform/references/cli-reference.md rename to skills/migration-and-modernization-skills/aws-transform/references/cli-reference.md diff --git a/skills/services-and-workloads/aws-transform/references/multi-transformation.md b/skills/migration-and-modernization-skills/aws-transform/references/multi-transformation.md similarity index 100% rename from skills/services-and-workloads/aws-transform/references/multi-transformation.md rename to skills/migration-and-modernization-skills/aws-transform/references/multi-transformation.md diff --git a/skills/services-and-workloads/aws-transform/references/remote-execution.md b/skills/migration-and-modernization-skills/aws-transform/references/remote-execution.md similarity index 100% rename from skills/services-and-workloads/aws-transform/references/remote-execution.md rename to skills/migration-and-modernization-skills/aws-transform/references/remote-execution.md diff --git a/skills/services-and-workloads/aws-transform/references/repo-analysis.md b/skills/migration-and-modernization-skills/aws-transform/references/repo-analysis.md similarity index 100% rename from skills/services-and-workloads/aws-transform/references/repo-analysis.md rename to skills/migration-and-modernization-skills/aws-transform/references/repo-analysis.md diff --git a/skills/services-and-workloads/aws-transform/references/results-synthesis.md b/skills/migration-and-modernization-skills/aws-transform/references/results-synthesis.md similarity index 100% rename from skills/services-and-workloads/aws-transform/references/results-synthesis.md rename to skills/migration-and-modernization-skills/aws-transform/references/results-synthesis.md diff --git a/skills/services-and-workloads/aws-transform/references/single-transformation.md b/skills/migration-and-modernization-skills/aws-transform/references/single-transformation.md similarity index 100% rename from skills/services-and-workloads/aws-transform/references/single-transformation.md rename to skills/migration-and-modernization-skills/aws-transform/references/single-transformation.md diff --git a/skills/services-and-workloads/aws-transform/references/troubleshooting.md b/skills/migration-and-modernization-skills/aws-transform/references/troubleshooting.md similarity index 100% rename from skills/services-and-workloads/aws-transform/references/troubleshooting.md rename to skills/migration-and-modernization-skills/aws-transform/references/troubleshooting.md diff --git a/skills/services-and-workloads/vpc/configuring-vpc-endpoints-for-private-aws-service-access/SKILL.md b/skills/networking-and-content-delivery-skills/configuring-vpc-endpoints-for-private-aws-service-access/SKILL.md similarity index 100% rename from skills/services-and-workloads/vpc/configuring-vpc-endpoints-for-private-aws-service-access/SKILL.md rename to skills/networking-and-content-delivery-skills/configuring-vpc-endpoints-for-private-aws-service-access/SKILL.md diff --git a/skills/services-and-workloads/vpc/configuring-vpc-endpoints-for-private-aws-service-access/references/configure-vpc-endpoints-for-private-aws-service-access.md b/skills/networking-and-content-delivery-skills/configuring-vpc-endpoints-for-private-aws-service-access/references/configure-vpc-endpoints-for-private-aws-service-access.md similarity index 100% rename from skills/services-and-workloads/vpc/configuring-vpc-endpoints-for-private-aws-service-access/references/configure-vpc-endpoints-for-private-aws-service-access.md rename to skills/networking-and-content-delivery-skills/configuring-vpc-endpoints-for-private-aws-service-access/references/configure-vpc-endpoints-for-private-aws-service-access.md diff --git a/skills/services-and-workloads/vpc/connecting-vpcs-with-peering/SKILL.md b/skills/networking-and-content-delivery-skills/connecting-vpcs-with-peering/SKILL.md similarity index 100% rename from skills/services-and-workloads/vpc/connecting-vpcs-with-peering/SKILL.md rename to skills/networking-and-content-delivery-skills/connecting-vpcs-with-peering/SKILL.md diff --git a/skills/services-and-workloads/vpc/connecting-vpcs-with-peering/references/vpc-peering-connection.md b/skills/networking-and-content-delivery-skills/connecting-vpcs-with-peering/references/vpc-peering-connection.md similarity index 100% rename from skills/services-and-workloads/vpc/connecting-vpcs-with-peering/references/vpc-peering-connection.md rename to skills/networking-and-content-delivery-skills/connecting-vpcs-with-peering/references/vpc-peering-connection.md diff --git a/skills/services-and-workloads/vpc/creating-production-vpc-multi-az/SKILL.md b/skills/networking-and-content-delivery-skills/creating-production-vpc-multi-az/SKILL.md similarity index 100% rename from skills/services-and-workloads/vpc/creating-production-vpc-multi-az/SKILL.md rename to skills/networking-and-content-delivery-skills/creating-production-vpc-multi-az/SKILL.md diff --git a/skills/services-and-workloads/vpc/creating-production-vpc-multi-az/references/create-production-vpc-multi-az.md b/skills/networking-and-content-delivery-skills/creating-production-vpc-multi-az/references/create-production-vpc-multi-az.md similarity index 100% rename from skills/services-and-workloads/vpc/creating-production-vpc-multi-az/references/create-production-vpc-multi-az.md rename to skills/networking-and-content-delivery-skills/creating-production-vpc-multi-az/references/create-production-vpc-multi-az.md diff --git a/skills/services-and-workloads/serverless/enabling-lambda-vpc-internet-access/SKILL.md b/skills/networking-and-content-delivery-skills/enabling-lambda-vpc-internet-access/SKILL.md similarity index 100% rename from skills/services-and-workloads/serverless/enabling-lambda-vpc-internet-access/SKILL.md rename to skills/networking-and-content-delivery-skills/enabling-lambda-vpc-internet-access/SKILL.md diff --git a/skills/services-and-workloads/serverless/enabling-lambda-vpc-internet-access/references/lambda-vpc-internet-access.md b/skills/networking-and-content-delivery-skills/enabling-lambda-vpc-internet-access/references/lambda-vpc-internet-access.md similarity index 100% rename from skills/services-and-workloads/serverless/enabling-lambda-vpc-internet-access/references/lambda-vpc-internet-access.md rename to skills/networking-and-content-delivery-skills/enabling-lambda-vpc-internet-access/references/lambda-vpc-internet-access.md diff --git a/skills/services-and-workloads/observability/aws-observability/SKILL.md b/skills/operations-skills/aws-observability/SKILL.md similarity index 100% rename from skills/services-and-workloads/observability/aws-observability/SKILL.md rename to skills/operations-skills/aws-observability/SKILL.md diff --git a/skills/services-and-workloads/observability/aws-observability/assets/alarm-template.ts b/skills/operations-skills/aws-observability/assets/alarm-template.ts similarity index 100% rename from skills/services-and-workloads/observability/aws-observability/assets/alarm-template.ts rename to skills/operations-skills/aws-observability/assets/alarm-template.ts diff --git a/skills/services-and-workloads/observability/aws-observability/assets/otel-config.yaml b/skills/operations-skills/aws-observability/assets/otel-config.yaml similarity index 100% rename from skills/services-and-workloads/observability/aws-observability/assets/otel-config.yaml rename to skills/operations-skills/aws-observability/assets/otel-config.yaml diff --git a/skills/services-and-workloads/observability/aws-observability/references/alarms.md b/skills/operations-skills/aws-observability/references/alarms.md similarity index 100% rename from skills/services-and-workloads/observability/aws-observability/references/alarms.md rename to skills/operations-skills/aws-observability/references/alarms.md diff --git a/skills/services-and-workloads/observability/aws-observability/references/cloudtrail.md b/skills/operations-skills/aws-observability/references/cloudtrail.md similarity index 100% rename from skills/services-and-workloads/observability/aws-observability/references/cloudtrail.md rename to skills/operations-skills/aws-observability/references/cloudtrail.md diff --git a/skills/services-and-workloads/observability/aws-observability/references/dashboards.md b/skills/operations-skills/aws-observability/references/dashboards.md similarity index 100% rename from skills/services-and-workloads/observability/aws-observability/references/dashboards.md rename to skills/operations-skills/aws-observability/references/dashboards.md diff --git a/skills/services-and-workloads/observability/aws-observability/references/log-insights.md b/skills/operations-skills/aws-observability/references/log-insights.md similarity index 100% rename from skills/services-and-workloads/observability/aws-observability/references/log-insights.md rename to skills/operations-skills/aws-observability/references/log-insights.md diff --git a/skills/services-and-workloads/observability/aws-observability/references/metrics.md b/skills/operations-skills/aws-observability/references/metrics.md similarity index 100% rename from skills/services-and-workloads/observability/aws-observability/references/metrics.md rename to skills/operations-skills/aws-observability/references/metrics.md diff --git a/skills/services-and-workloads/observability/aws-observability/references/synthetics.md b/skills/operations-skills/aws-observability/references/synthetics.md similarity index 100% rename from skills/services-and-workloads/observability/aws-observability/references/synthetics.md rename to skills/operations-skills/aws-observability/references/synthetics.md diff --git a/skills/services-and-workloads/observability/aws-observability/references/tracing.md b/skills/operations-skills/aws-observability/references/tracing.md similarity index 100% rename from skills/services-and-workloads/observability/aws-observability/references/tracing.md rename to skills/operations-skills/aws-observability/references/tracing.md diff --git a/skills/services-and-workloads/observability/aws-observability/references/troubleshooting.md b/skills/operations-skills/aws-observability/references/troubleshooting.md similarity index 100% rename from skills/services-and-workloads/observability/aws-observability/references/troubleshooting.md rename to skills/operations-skills/aws-observability/references/troubleshooting.md diff --git a/skills/services-and-workloads/observability/setting-up-cloudtrail-multi-region/SKILL.md b/skills/operations-skills/setting-up-cloudtrail-multi-region/SKILL.md similarity index 100% rename from skills/services-and-workloads/observability/setting-up-cloudtrail-multi-region/SKILL.md rename to skills/operations-skills/setting-up-cloudtrail-multi-region/SKILL.md diff --git a/skills/services-and-workloads/observability/setting-up-cloudtrail-multi-region/references/cloudtrail-multi-region-setup.md b/skills/operations-skills/setting-up-cloudtrail-multi-region/references/cloudtrail-multi-region-setup.md similarity index 100% rename from skills/services-and-workloads/observability/setting-up-cloudtrail-multi-region/references/cloudtrail-multi-region-setup.md rename to skills/operations-skills/setting-up-cloudtrail-multi-region/references/cloudtrail-multi-region-setup.md diff --git a/skills/services-and-workloads/observability/setting-up-cloudwatch-alarm-notifications/SKILL.md b/skills/operations-skills/setting-up-cloudwatch-alarm-notifications/SKILL.md similarity index 100% rename from skills/services-and-workloads/observability/setting-up-cloudwatch-alarm-notifications/SKILL.md rename to skills/operations-skills/setting-up-cloudwatch-alarm-notifications/SKILL.md diff --git a/skills/services-and-workloads/observability/setting-up-cloudwatch-alarm-notifications/references/setup-cloudwatch-alarm-notifications.md b/skills/operations-skills/setting-up-cloudwatch-alarm-notifications/references/setup-cloudwatch-alarm-notifications.md similarity index 100% rename from skills/services-and-workloads/observability/setting-up-cloudwatch-alarm-notifications/references/setup-cloudwatch-alarm-notifications.md rename to skills/operations-skills/setting-up-cloudwatch-alarm-notifications/references/setup-cloudwatch-alarm-notifications.md diff --git a/skills/services-and-workloads/observability/troubleshooting-application-failures/SKILL.md b/skills/operations-skills/troubleshooting-application-failures/SKILL.md similarity index 100% rename from skills/services-and-workloads/observability/troubleshooting-application-failures/SKILL.md rename to skills/operations-skills/troubleshooting-application-failures/SKILL.md diff --git a/skills/services-and-workloads/observability/troubleshooting-application-failures/references/application-failure-troubleshooting.md b/skills/operations-skills/troubleshooting-application-failures/references/application-failure-troubleshooting.md similarity index 100% rename from skills/services-and-workloads/observability/troubleshooting-application-failures/references/application-failure-troubleshooting.md rename to skills/operations-skills/troubleshooting-application-failures/references/application-failure-troubleshooting.md diff --git a/skills/services-and-workloads/aws-iam/SKILL.md b/skills/security-and-identity-skills/aws-iam/SKILL.md similarity index 100% rename from skills/services-and-workloads/aws-iam/SKILL.md rename to skills/security-and-identity-skills/aws-iam/SKILL.md diff --git a/skills/foundations/creating-secrets-using-best-practices/SKILL.md b/skills/security-and-identity-skills/creating-secrets-using-best-practices/SKILL.md similarity index 100% rename from skills/foundations/creating-secrets-using-best-practices/SKILL.md rename to skills/security-and-identity-skills/creating-secrets-using-best-practices/SKILL.md diff --git a/skills/foundations/creating-secrets-using-best-practices/references/create-secrets-using-best-practices.md b/skills/security-and-identity-skills/creating-secrets-using-best-practices/references/create-secrets-using-best-practices.md similarity index 100% rename from skills/foundations/creating-secrets-using-best-practices/references/create-secrets-using-best-practices.md rename to skills/security-and-identity-skills/creating-secrets-using-best-practices/references/create-secrets-using-best-practices.md diff --git a/skills/services-and-workloads/storage/securing-s3-buckets/SKILL.md b/skills/storage-skills/securing-s3-buckets/SKILL.md similarity index 100% rename from skills/services-and-workloads/storage/securing-s3-buckets/SKILL.md rename to skills/storage-skills/securing-s3-buckets/SKILL.md diff --git a/skills/services-and-workloads/storage/securing-s3-buckets/references/audit-checklist.md b/skills/storage-skills/securing-s3-buckets/references/audit-checklist.md similarity index 100% rename from skills/services-and-workloads/storage/securing-s3-buckets/references/audit-checklist.md rename to skills/storage-skills/securing-s3-buckets/references/audit-checklist.md diff --git a/skills/services-and-workloads/storage/securing-s3-buckets/references/encryption.md b/skills/storage-skills/securing-s3-buckets/references/encryption.md similarity index 100% rename from skills/services-and-workloads/storage/securing-s3-buckets/references/encryption.md rename to skills/storage-skills/securing-s3-buckets/references/encryption.md diff --git a/skills/services-and-workloads/storage/securing-s3-buckets/references/iam-permissions.md b/skills/storage-skills/securing-s3-buckets/references/iam-permissions.md similarity index 100% rename from skills/services-and-workloads/storage/securing-s3-buckets/references/iam-permissions.md rename to skills/storage-skills/securing-s3-buckets/references/iam-permissions.md diff --git a/skills/services-and-workloads/storage/securing-s3-buckets/references/remediation.md b/skills/storage-skills/securing-s3-buckets/references/remediation.md similarity index 100% rename from skills/services-and-workloads/storage/securing-s3-buckets/references/remediation.md rename to skills/storage-skills/securing-s3-buckets/references/remediation.md diff --git a/skills/services-and-workloads/storage/securing-s3-buckets/references/workflows.md b/skills/storage-skills/securing-s3-buckets/references/workflows.md similarity index 100% rename from skills/services-and-workloads/storage/securing-s3-buckets/references/workflows.md rename to skills/storage-skills/securing-s3-buckets/references/workflows.md diff --git a/skills/services-and-workloads/storage/storing-and-querying-vectors/SKILL.md b/skills/storage-skills/storing-and-querying-vectors/SKILL.md similarity index 100% rename from skills/services-and-workloads/storage/storing-and-querying-vectors/SKILL.md rename to skills/storage-skills/storing-and-querying-vectors/SKILL.md diff --git a/skills/services-and-workloads/storage/storing-and-querying-vectors/references/limits-and-patterns.md b/skills/storage-skills/storing-and-querying-vectors/references/limits-and-patterns.md similarity index 100% rename from skills/services-and-workloads/storage/storing-and-querying-vectors/references/limits-and-patterns.md rename to skills/storage-skills/storing-and-querying-vectors/references/limits-and-patterns.md diff --git a/skills/services-and-workloads/storage/storing-and-querying-vectors/references/metadata-filtering.md b/skills/storage-skills/storing-and-querying-vectors/references/metadata-filtering.md similarity index 100% rename from skills/services-and-workloads/storage/storing-and-querying-vectors/references/metadata-filtering.md rename to skills/storage-skills/storing-and-querying-vectors/references/metadata-filtering.md diff --git a/skills/services-and-workloads/storage/troubleshooting-efs/SKILL.md b/skills/storage-skills/troubleshooting-efs/SKILL.md similarity index 100% rename from skills/services-and-workloads/storage/troubleshooting-efs/SKILL.md rename to skills/storage-skills/troubleshooting-efs/SKILL.md diff --git a/skills/services-and-workloads/storage/troubleshooting-s3-files/SKILL.md b/skills/storage-skills/troubleshooting-s3-files/SKILL.md similarity index 100% rename from skills/services-and-workloads/storage/troubleshooting-s3-files/SKILL.md rename to skills/storage-skills/troubleshooting-s3-files/SKILL.md From c134a2576311c34b7cd2ac6ff9a210afe4f19cd6 Mon Sep 17 00:00:00 2001 From: Arne Wouters Date: Wed, 6 May 2026 08:45:36 +0200 Subject: [PATCH 2/5] chore: rename analytics skills with gerund form and update references --- .../SKILL.md | 12 ++++----- .../references/bigquery-setup.md | 0 .../references/credential-security.md | 0 .../references/discovery.md | 0 .../references/jdbc-setup.md | 0 .../references/network-setup.md | 0 .../references/snowflake-setup.md | 0 .../references/troubleshooting.md | 0 .../SKILL.md | 18 ++++++------- .../references/access-control.md | 0 .../references/athena-ddl-path.md | 0 .../references/best-practices.md | 0 .../references/table-creation-glue-etl.md | 0 .../skills/exploring-data-catalog/SKILL.md | 6 ++--- .../SKILL.md | 4 +-- .../references/search-strategy.md | 0 .../SKILL.md | 26 +++++++++---------- .../references/athena-loading.md | 0 .../references/bigquery-ingest.md | 2 +- .../references/catalog-migration.md | 6 ++--- .../references/ctas-patterns.md | 0 .../references/data-quality-validation.md | 0 .../references/dynamodb-ingest.md | 0 .../references/error-handling.md | 2 +- .../references/format-specific-loading.md | 0 .../references/glue-etl-migration.md | 0 .../references/glue-job-config.md | 0 .../references/glue-job-scripts.md | 0 .../iceberg-catalog-config-and-usage.md | 2 +- .../references/incremental-loading.md | 0 .../references/jdbc-ingest.md | 16 ++++++------ .../references/jdbc-performance.md | 0 .../references/jdbc-schema-discovery.md | 0 .../references/local-upload.md | 0 .../references/migration-troubleshooting.md | 0 .../references/migration-validation.md | 0 .../references/s3-files.md | 6 ++--- .../references/schema-evolution.md | 0 .../references/snowflake-ingest.md | 2 +- .../references/testing-and-scheduling.md | 0 .../references/type-transformations.md | 0 .../references/upload-options.md | 0 .../SKILL.md | 12 ++++----- .../references/query-patterns.md | 0 .../references/workgroup-selection.md | 0 .../SKILL.md | 4 +-- .../references/limits-and-patterns.md | 0 .../references/metadata-filtering.md | 0 48 files changed, 59 insertions(+), 59 deletions(-) rename plugins/aws-data-analytics/skills/{connect-to-data-source => connecting-to-data-source}/SKILL.md (93%) rename plugins/aws-data-analytics/skills/{connect-to-data-source => connecting-to-data-source}/references/bigquery-setup.md (100%) rename plugins/aws-data-analytics/skills/{connect-to-data-source => connecting-to-data-source}/references/credential-security.md (100%) rename plugins/aws-data-analytics/skills/{connect-to-data-source => connecting-to-data-source}/references/discovery.md (100%) rename plugins/aws-data-analytics/skills/{connect-to-data-source => connecting-to-data-source}/references/jdbc-setup.md (100%) rename plugins/aws-data-analytics/skills/{connect-to-data-source => connecting-to-data-source}/references/network-setup.md (100%) rename plugins/aws-data-analytics/skills/{connect-to-data-source => connecting-to-data-source}/references/snowflake-setup.md (100%) rename plugins/aws-data-analytics/skills/{connect-to-data-source => connecting-to-data-source}/references/troubleshooting.md (100%) rename plugins/aws-data-analytics/skills/{create-data-lake-table => creating-data-lake-table}/SKILL.md (93%) rename plugins/aws-data-analytics/skills/{create-data-lake-table => creating-data-lake-table}/references/access-control.md (100%) rename plugins/aws-data-analytics/skills/{create-data-lake-table => creating-data-lake-table}/references/athena-ddl-path.md (100%) rename plugins/aws-data-analytics/skills/{create-data-lake-table => creating-data-lake-table}/references/best-practices.md (100%) rename plugins/aws-data-analytics/skills/{create-data-lake-table => creating-data-lake-table}/references/table-creation-glue-etl.md (100%) rename plugins/aws-data-analytics/skills/{find-data-lake-assets => finding-data-lake-assets}/SKILL.md (98%) rename plugins/aws-data-analytics/skills/{find-data-lake-assets => finding-data-lake-assets}/references/search-strategy.md (100%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/SKILL.md (91%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/athena-loading.md (100%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/bigquery-ingest.md (97%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/catalog-migration.md (94%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/ctas-patterns.md (100%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/data-quality-validation.md (100%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/dynamodb-ingest.md (100%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/error-handling.md (98%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/format-specific-loading.md (100%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/glue-etl-migration.md (100%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/glue-job-config.md (100%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/glue-job-scripts.md (100%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/iceberg-catalog-config-and-usage.md (98%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/incremental-loading.md (100%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/jdbc-ingest.md (85%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/jdbc-performance.md (100%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/jdbc-schema-discovery.md (100%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/local-upload.md (100%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/migration-troubleshooting.md (100%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/migration-validation.md (100%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/s3-files.md (90%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/schema-evolution.md (100%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/snowflake-ingest.md (97%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/testing-and-scheduling.md (100%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/type-transformations.md (100%) rename plugins/aws-data-analytics/skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/upload-options.md (100%) rename plugins/aws-data-analytics/skills/{query-data-lake => querying-data-lake}/SKILL.md (92%) rename plugins/aws-data-analytics/skills/{query-data-lake => querying-data-lake}/references/query-patterns.md (100%) rename plugins/aws-data-analytics/skills/{query-data-lake => querying-data-lake}/references/workgroup-selection.md (100%) rename plugins/aws-data-analytics/skills/{store-and-query-vectors => storing-and-querying-vectors}/SKILL.md (98%) rename plugins/aws-data-analytics/skills/{store-and-query-vectors => storing-and-querying-vectors}/references/limits-and-patterns.md (100%) rename plugins/aws-data-analytics/skills/{store-and-query-vectors => storing-and-querying-vectors}/references/metadata-filtering.md (100%) diff --git a/plugins/aws-data-analytics/skills/connect-to-data-source/SKILL.md b/plugins/aws-data-analytics/skills/connecting-to-data-source/SKILL.md similarity index 93% rename from plugins/aws-data-analytics/skills/connect-to-data-source/SKILL.md rename to plugins/aws-data-analytics/skills/connecting-to-data-source/SKILL.md index 420d5af..767e8c8 100644 --- a/plugins/aws-data-analytics/skills/connect-to-data-source/SKILL.md +++ b/plugins/aws-data-analytics/skills/connecting-to-data-source/SKILL.md @@ -1,13 +1,13 @@ --- -name: connect-to-data-source +name: connecting-to-data-source description: 'Create and troubleshoot AWS Glue connections to JDBC databases (Oracle, SQL Server, PostgreSQL, MySQL, RDS), Redshift, Snowflake, and BigQuery. Gathers connection hints from user, discovers existing connections and RDS/Redshift candidates, registers credentials in Secrets Manager or IAM DB auth, configures VPC, and tests. Triggers on: connect to database, set up Glue connection, register data source, connect to Snowflake/BigQuery/RDS, connection timeout, test connection, troubleshoot - connection. Do NOT use for moving data (use ingest-into-data-lake), creating tables - (use create-data-lake-table), queries (use query-data-lake), catalog exploration + connection. Do NOT use for moving data (use ingesting-into-data-lake), creating tables + (use creating-data-lake-table), queries (use querying-data-lake), catalog exploration (use exploring-data-catalog), or SaaS (Salesforce, ServiceNow, SAP, MongoDB, Kafka).' version: 1 metadata: @@ -20,7 +20,7 @@ argument-hint: '[source-type|connection-name|hostname]' # Connect to Data Source -Register an external data source with AWS Glue so downstream skills (ingest-into-data-lake) can move data from it. A Glue connection stores the network config, driver, and credential reference for one source. Create once per source, reuse across jobs. +Register an external data source with AWS Glue so downstream skills (ingesting-into-data-lake) can move data from it. A Glue connection stores the network config, driver, and credential reference for one source. Create once per source, reuse across jobs. ## Philosophy @@ -48,7 +48,7 @@ Ask the user which source type they want to connect to, or infer from hints: | "Snowflake" | Snowflake | `SNOWFLAKE` | [snowflake-setup.md](references/snowflake-setup.md) | | "BigQuery", "Google analytics warehouse" | BigQuery | `BIGQUERY` | [bigquery-setup.md](references/bigquery-setup.md) | -If the user names DynamoDB or a local file, stop and tell them: DynamoDB is read directly by Glue without a connection, and local files belong in the ingest-into-data-lake skill's local-upload workflow. +If the user names DynamoDB or a local file, stop and tell them: DynamoDB is read directly by Glue without a connection, and local files belong in the ingesting-into-data-lake skill's local-upload workflow. ### 3. Gather Connection Hints from the User @@ -126,7 +126,7 @@ After TestConnection passes, verify the connection works with the user's intende Phase B catches issues that TestConnection misses: driver compatibility at job runtime, catalog configuration, Spark-level serialization, and engine-specific auth flows (e.g., Snowflake SNOWFLAKE type works in ETL but not via JDBC crawlers). -On success in both phases, tell user the connection name is ready for `ingest-into-data-lake`. On failure in either phase, Step 8. +On success in both phases, tell user the connection name is ready for `ingesting-into-data-lake`. On failure in either phase, Step 8. ### 8. Troubleshoot (only if test failed) diff --git a/plugins/aws-data-analytics/skills/connect-to-data-source/references/bigquery-setup.md b/plugins/aws-data-analytics/skills/connecting-to-data-source/references/bigquery-setup.md similarity index 100% rename from plugins/aws-data-analytics/skills/connect-to-data-source/references/bigquery-setup.md rename to plugins/aws-data-analytics/skills/connecting-to-data-source/references/bigquery-setup.md diff --git a/plugins/aws-data-analytics/skills/connect-to-data-source/references/credential-security.md b/plugins/aws-data-analytics/skills/connecting-to-data-source/references/credential-security.md similarity index 100% rename from plugins/aws-data-analytics/skills/connect-to-data-source/references/credential-security.md rename to plugins/aws-data-analytics/skills/connecting-to-data-source/references/credential-security.md diff --git a/plugins/aws-data-analytics/skills/connect-to-data-source/references/discovery.md b/plugins/aws-data-analytics/skills/connecting-to-data-source/references/discovery.md similarity index 100% rename from plugins/aws-data-analytics/skills/connect-to-data-source/references/discovery.md rename to plugins/aws-data-analytics/skills/connecting-to-data-source/references/discovery.md diff --git a/plugins/aws-data-analytics/skills/connect-to-data-source/references/jdbc-setup.md b/plugins/aws-data-analytics/skills/connecting-to-data-source/references/jdbc-setup.md similarity index 100% rename from plugins/aws-data-analytics/skills/connect-to-data-source/references/jdbc-setup.md rename to plugins/aws-data-analytics/skills/connecting-to-data-source/references/jdbc-setup.md diff --git a/plugins/aws-data-analytics/skills/connect-to-data-source/references/network-setup.md b/plugins/aws-data-analytics/skills/connecting-to-data-source/references/network-setup.md similarity index 100% rename from plugins/aws-data-analytics/skills/connect-to-data-source/references/network-setup.md rename to plugins/aws-data-analytics/skills/connecting-to-data-source/references/network-setup.md diff --git a/plugins/aws-data-analytics/skills/connect-to-data-source/references/snowflake-setup.md b/plugins/aws-data-analytics/skills/connecting-to-data-source/references/snowflake-setup.md similarity index 100% rename from plugins/aws-data-analytics/skills/connect-to-data-source/references/snowflake-setup.md rename to plugins/aws-data-analytics/skills/connecting-to-data-source/references/snowflake-setup.md diff --git a/plugins/aws-data-analytics/skills/connect-to-data-source/references/troubleshooting.md b/plugins/aws-data-analytics/skills/connecting-to-data-source/references/troubleshooting.md similarity index 100% rename from plugins/aws-data-analytics/skills/connect-to-data-source/references/troubleshooting.md rename to plugins/aws-data-analytics/skills/connecting-to-data-source/references/troubleshooting.md diff --git a/plugins/aws-data-analytics/skills/create-data-lake-table/SKILL.md b/plugins/aws-data-analytics/skills/creating-data-lake-table/SKILL.md similarity index 93% rename from plugins/aws-data-analytics/skills/create-data-lake-table/SKILL.md rename to plugins/aws-data-analytics/skills/creating-data-lake-table/SKILL.md index d4f5bb9..0614550 100644 --- a/plugins/aws-data-analytics/skills/create-data-lake-table/SKILL.md +++ b/plugins/aws-data-analytics/skills/creating-data-lake-table/SKILL.md @@ -1,13 +1,13 @@ --- -name: create-data-lake-table +name: creating-data-lake-table description: 'Create managed Iceberg tables using Amazon S3 Tables (s3tables API namespace) with automatic compaction and snapshot management. Sets up table bucket, namespace, table, schema, Glue catalog registration, partitioning, IAM access control. Triggers on: create table, data lake table, analytics table, structured data storage, S3 Tables, Iceberg, Athena table, partitioning strategy, access permissions. Do NOT - use for: importing files (use ingest-into-data-lake), vector storage (use store-and-query-vectors), - querying existing tables (use query-data-lake), or locating existing table (use - find-data-lake-assets).' + use for: importing files (use ingesting-into-data-lake), vector storage (use storing-and-querying-vectors), + querying existing tables (use querying-data-lake), or locating existing table (use + finding-data-lake-assets).' version: 1 metadata: service: [s3tables, glue, athena] @@ -35,15 +35,15 @@ You MUST run `aws glue get-tables --database-name ` when user mentions a d | What you find | Action | |---------------|--------| -| Fuzzy database name ("our analytics db") | You MUST STOP. Delegate to `find-data-lake-assets` to resolve. | -| Non-S3-Tables table with matching name | You MUST STOP. Delegate to `find-data-lake-assets`. You MUST NOT create until user confirms. | +| Fuzzy database name ("our analytics db") | You MUST STOP. Delegate to `finding-data-lake-assets` to resolve. | +| Non-S3-Tables table with matching name | You MUST STOP. Delegate to `finding-data-lake-assets`. You MUST NOT create until user confirms. | | Existing S3 Tables table with matching name | You MUST check schema match. Reuse if compatible, recreate only if user confirms. | | No matching tables | Proceed with creation (Steps 1-8). | | User explicitly requests new S3 Tables table | Skip checks, proceed with creation. | **Creation paths:** -- **Existing data in S3**: Create empty table (Steps 1-8), then use `ingest-into-data-lake` skill. +- **Existing data in S3**: Create empty table (Steps 1-8), then use `ingesting-into-data-lake` skill. - **Glue ETL pipeline**: Read `references/table-creation-glue-etl.md` first, then Steps 1-6. - **Lake Formation access control**: Search AWS docs for `"S3 Tables integration with Lake Formation"`. @@ -58,7 +58,7 @@ You MUST run `aws glue get-tables --database-name ` when user mentions a d - **Explicit schema**: Validate Iceberg types. - **Loose description**: Ask columns, types, grain. Propose and confirm. -- **Existing S3 data**: Infer schema from file headers only. Create empty table first, then use `ingest-into-data-lake` skill. +- **Existing S3 data**: Infer schema from file headers only. Create empty table first, then use `ingesting-into-data-lake` skill. **Constraints:** @@ -194,4 +194,4 @@ You MUST verify with `aws s3tables get-table` and confirm queryability with `DES - [best-practices.md](references/best-practices.md) -- Iceberg types, partitions, naming, common errors - [athena-ddl-path.md](references/athena-ddl-path.md) -- Athena DDL, schema evolution - [table-creation-glue-etl.md](references/table-creation-glue-etl.md) -- Spark DDL via Glue ETL -- Loading data: `ingest-into-data-lake` skill +- Loading data: `ingesting-into-data-lake` skill diff --git a/plugins/aws-data-analytics/skills/create-data-lake-table/references/access-control.md b/plugins/aws-data-analytics/skills/creating-data-lake-table/references/access-control.md similarity index 100% rename from plugins/aws-data-analytics/skills/create-data-lake-table/references/access-control.md rename to plugins/aws-data-analytics/skills/creating-data-lake-table/references/access-control.md diff --git a/plugins/aws-data-analytics/skills/create-data-lake-table/references/athena-ddl-path.md b/plugins/aws-data-analytics/skills/creating-data-lake-table/references/athena-ddl-path.md similarity index 100% rename from plugins/aws-data-analytics/skills/create-data-lake-table/references/athena-ddl-path.md rename to plugins/aws-data-analytics/skills/creating-data-lake-table/references/athena-ddl-path.md diff --git a/plugins/aws-data-analytics/skills/create-data-lake-table/references/best-practices.md b/plugins/aws-data-analytics/skills/creating-data-lake-table/references/best-practices.md similarity index 100% rename from plugins/aws-data-analytics/skills/create-data-lake-table/references/best-practices.md rename to plugins/aws-data-analytics/skills/creating-data-lake-table/references/best-practices.md diff --git a/plugins/aws-data-analytics/skills/create-data-lake-table/references/table-creation-glue-etl.md b/plugins/aws-data-analytics/skills/creating-data-lake-table/references/table-creation-glue-etl.md similarity index 100% rename from plugins/aws-data-analytics/skills/create-data-lake-table/references/table-creation-glue-etl.md rename to plugins/aws-data-analytics/skills/creating-data-lake-table/references/table-creation-glue-etl.md diff --git a/plugins/aws-data-analytics/skills/exploring-data-catalog/SKILL.md b/plugins/aws-data-analytics/skills/exploring-data-catalog/SKILL.md index a62e702..34601cb 100644 --- a/plugins/aws-data-analytics/skills/exploring-data-catalog/SKILL.md +++ b/plugins/aws-data-analytics/skills/exploring-data-catalog/SKILL.md @@ -3,8 +3,8 @@ name: exploring-data-catalog description: 'Full inventory and audit of AWS Glue Data Catalog assets across S3 Tables, Redshift-federated, and remote Iceberg catalogs. Triggers on: inventory the catalog, audit databases, list all tables, catalog overview, data landscape, enumerate catalogs, - data inventory, search the catalog. Do NOT use for finding specific data (use find-data-lake-assets), - running queries (use query-data-lake), or creating tables (use create-data-lake-table).' + data inventory, search the catalog. Do NOT use for finding specific data (use finding-data-lake-assets), + running queries (use querying-data-lake), or creating tables (use creating-data-lake-table).' version: 1 metadata: service: [glue, s3, s3tables] @@ -115,7 +115,7 @@ Resolve the argument in this order; stop at the first match: - Flag stale tables and missing descriptions - Suggest partitioning for large unpartitioned tables - Summary first, details on request -- You MUST NOT execute Athena queries (`start-query-execution`) during discovery; query execution belongs to `query-data-lake` +- You MUST NOT execute Athena queries (`start-query-execution`) during discovery; query execution belongs to `querying-data-lake` ## Troubleshooting diff --git a/plugins/aws-data-analytics/skills/find-data-lake-assets/SKILL.md b/plugins/aws-data-analytics/skills/finding-data-lake-assets/SKILL.md similarity index 98% rename from plugins/aws-data-analytics/skills/find-data-lake-assets/SKILL.md rename to plugins/aws-data-analytics/skills/finding-data-lake-assets/SKILL.md index 2774feb..062d2a7 100644 --- a/plugins/aws-data-analytics/skills/find-data-lake-assets/SKILL.md +++ b/plugins/aws-data-analytics/skills/finding-data-lake-assets/SKILL.md @@ -1,11 +1,11 @@ --- -name: find-data-lake-assets +name: finding-data-lake-assets description: 'Resolve data lake and lakehouse asset references across Glue Data Catalog, S3, S3 Tables, and Redshift. Triggers on: find the table, where is our data, which table has, locate dataset, find data for, search catalog, what tables match, Redshift table, lakehouse table, data lake table, warehouse table, reverse lookup S3 path. Do NOT use for: full catalog audits (use exploring-data-catalog), running queries - (use query-data-lake), creating tables (use create-data-lake-table).' + (use querying-data-lake), creating tables (use creating-data-lake-table).' version: 1 metadata: service: [glue, s3, s3tables, redshift] diff --git a/plugins/aws-data-analytics/skills/find-data-lake-assets/references/search-strategy.md b/plugins/aws-data-analytics/skills/finding-data-lake-assets/references/search-strategy.md similarity index 100% rename from plugins/aws-data-analytics/skills/find-data-lake-assets/references/search-strategy.md rename to plugins/aws-data-analytics/skills/finding-data-lake-assets/references/search-strategy.md diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/SKILL.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/SKILL.md similarity index 91% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/SKILL.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/SKILL.md index 5815e74..de16d30 100644 --- a/plugins/aws-data-analytics/skills/ingest-into-data-lake/SKILL.md +++ b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/SKILL.md @@ -1,5 +1,5 @@ --- -name: ingest-into-data-lake +name: ingesting-into-data-lake description: 'Import data into the AWS data lake from S3 files, local uploads, JDBC databases (Oracle, SQL Server, PostgreSQL, MySQL, RDS, Aurora), Amazon Redshift, Snowflake, BigQuery, DynamoDB, or existing Glue catalog tables (migration). Default @@ -8,8 +8,8 @@ description: 'Import data into the AWS data lake from S3 files, local uploads, J Triggers on: import data, load data, ingest, sync database, migrate table, move data to AWS, set up pipeline, ETL, pull from Snowflake, query BigQuery into S3, export DynamoDB, CTAS, convert to Iceberg. Do NOT use for setting up or troubleshooting - Glue connections (use connect-to-data-source), creating empty tables (use create-data-lake-table), - running queries (use query-data-lake), finding tables by fuzzy name (use find-data-lake-assets), + Glue connections (use connecting-to-data-source), creating empty tables (use creating-data-lake-table), + running queries (use querying-data-lake), finding tables by fuzzy name (use finding-data-lake-assets), catalog audit (use exploring-data-catalog), or SaaS platforms like Salesforce, ServiceNow, SAP, MongoDB, Kafka.' version: 1 @@ -23,7 +23,7 @@ argument-hint: '[source-path|connection-name|table-name] [--target s3-tables|ice # Ingest into Data Lake -Move data from a source into a queryable table in the data lake. This skill assumes the source connection (if one is needed) already exists. For Glue connection setup or troubleshooting, delegate to `connect-to-data-source`. +Move data from a source into a queryable table in the data lake. This skill assumes the source connection (if one is needed) already exists. For Glue connection setup or troubleshooting, delegate to `connecting-to-data-source`. ## Philosophy @@ -39,7 +39,7 @@ You MUST execute commands using AWS MCP server tools when connected -- they prov - You MUST check whether AWS MCP tools or AWS CLI are available and inform the user if missing - You MUST confirm target AWS region and verify credentials with `aws sts get-caller-identity` -- For SageMaker Unified Studio project roles, note that target tables and connections may be scoped to the project. See the caller ARN detection pattern in `query-data-lake`. +- For SageMaker Unified Studio project roles, note that target tables and connections may be scoped to the project. See the caller ARN detection pattern in `querying-data-lake`. ### 2. Classify the Source @@ -55,7 +55,7 @@ You MUST execute commands using AWS MCP server tools when connected -- they prov If the user names Salesforce, ServiceNow, SAP, MongoDB, Kafka, or another SaaS/streaming source, decline -- these are not supported in this release. -If the source table is referenced by a fuzzy or business name ("migrate our orders table", "pull from the sales warehouse"), delegate to `find-data-lake-assets` to resolve before proceeding. +If the source table is referenced by a fuzzy or business name ("migrate our orders table", "pull from the sales warehouse"), delegate to `finding-data-lake-assets` to resolve before proceeding. ### 3. Confirm Connection Exists (if applicable) @@ -65,7 +65,7 @@ For JDBC, Snowflake, and BigQuery sources, a Glue connection is required. Check: aws glue get-connection --name --region ``` -If the connection does not exist, stop and delegate to `connect-to-data-source` to create and test it. Do not proceed with ingest until the connection is verified. +If the connection does not exist, stop and delegate to `connecting-to-data-source` to create and test it. Do not proceed with ingest until the connection is verified. Local files, S3 files, DynamoDB, and catalog migration do not need a Glue connection. @@ -74,7 +74,7 @@ Local files, S3 files, DynamoDB, and catalog migration do not need a Glue connec You MUST ask the user (or suggest based on catalog inventory) before creating or writing to any table: - **Database/namespace**: Does a specific target database exist? Or should one be created? -- **Table**: Existing table (append/merge) or new table (delegate to `create-data-lake-table`)? +- **Table**: Existing table (append/merge) or new table (delegate to `creating-data-lake-table`)? - **Format**: S3 Tables (default), standard Iceberg, or raw Parquet? **Inventory-aware defaults:** @@ -89,8 +89,8 @@ Do not force S3 Tables on customers who haven't adopted it. See [iceberg-catalog **Delegations from this step:** -- Target table doesn't exist -> `create-data-lake-table` -- Target database named by fuzzy term -> `find-data-lake-assets` +- Target table doesn't exist -> `creating-data-lake-table` +- Target database named by fuzzy term -> `finding-data-lake-assets` - User doesn't know what exists -> `exploring-data-catalog` ### 5. Execute Source Workflow @@ -132,7 +132,7 @@ For recurring pipelines, create a Glue Trigger with a cron schedule. See [testin - `overwritePartitions()` only replaces partitions present in the DataFrame -- for full refresh with deletes, use `createOrReplace()` - Standard Iceberg targets MUST include a LOCATION clause; S3 Tables MUST NOT - DynamoDB does not need a Glue connection -- do not attempt to create one -- Connection failures during ingest delegate back to `connect-to-data-source`; do not debug network/credentials in this skill +- Connection failures during ingest delegate back to `connecting-to-data-source`; do not debug network/credentials in this skill - For target tables in SageMaker Unified Studio projects, ensure the project role has write access to the target namespace before the Glue job runs ## Troubleshooting @@ -142,7 +142,7 @@ For recurring pipelines, create a Glue Trigger with a cron schedule. See [testin | Access Denied on S3 | Missing IAM permissions | Check Glue role has s3:GetObject, s3:PutObject | | Access Denied on S3 Tables | Missing s3tables:* permissions | Add S3 Tables inline policy to Glue role | | CTAS timeout | Dataset too large for Athena | Switch to Glue ETL or batch with WHERE filters | -| JDBC connection timeout/auth failure | Connection-level issue | Delegate to `connect-to-data-source` | +| JDBC connection timeout/auth failure | Connection-level issue | Delegate to `connecting-to-data-source` | | Throughput exceeded (DynamoDB) | Read percent too high | Lower `read.percent` or use native export | See [error-handling.md](references/error-handling.md) for the full catalog. @@ -171,7 +171,7 @@ See [error-handling.md](references/error-handling.md) for the full catalog. - [type-transformations.md](references/type-transformations.md) -- Type conflict resolution - [format-specific-loading.md](references/format-specific-loading.md) -- CSV/JSON/Parquet/Avro/ORC specifics - [athena-loading.md](references/athena-loading.md) -- Athena INSERT INTO as simple-load fallback -- [error-handling.md](references/error-handling.md) -- Ingest errors (connection errors delegate to connect-to-data-source) +- [error-handling.md](references/error-handling.md) -- Ingest errors (connection errors delegate to connecting-to-data-source) - [upload-options.md](references/upload-options.md) -- aws s3 cp vs sync, multipart ### Migration-specific diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/athena-loading.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/athena-loading.md similarity index 100% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/athena-loading.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/athena-loading.md diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/bigquery-ingest.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/bigquery-ingest.md similarity index 97% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/bigquery-ingest.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/bigquery-ingest.md index 093ddb7..b257016 100644 --- a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/bigquery-ingest.md +++ b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/bigquery-ingest.md @@ -1,6 +1,6 @@ # BigQuery Ingest -Move data from Google BigQuery into the data lake. Assumes a Glue `BIGQUERY` connection exists. If not, delegate to `connect-to-data-source`. +Move data from Google BigQuery into the data lake. Assumes a Glue `BIGQUERY` connection exists. If not, delegate to `connecting-to-data-source`. ## Contents diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/catalog-migration.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/catalog-migration.md similarity index 94% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/catalog-migration.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/catalog-migration.md index 83a11a3..be5c0a7 100644 --- a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/catalog-migration.md +++ b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/catalog-migration.md @@ -19,7 +19,7 @@ Note: The target for catalog migration is always S3 Tables -- that is the purpos ### Phase 1: Understand the Source -1. **Identify the source table**: Get the fully qualified name (`database.table` or `catalog.database.table`). If the user gives a fuzzy or business name ("our orders table", "the sales data"), delegate to the `find-data-lake-assets` skill to resolve it before continuing -- the rest of this workflow assumes a concrete reference. +1. **Identify the source table**: Get the fully qualified name (`database.table` or `catalog.database.table`). If the user gives a fuzzy or business name ("our orders table", "the sales data"), delegate to the `finding-data-lake-assets` skill to resolve it before continuing -- the rest of this workflow assumes a concrete reference. 2. **Inspect the source**: - **With MCP**: Use `aws-mcp` to get table metadata (format, location, schema, partitions) - **Without MCP**: `aws glue get-table --database-name --name ` @@ -34,8 +34,8 @@ Note: The target for catalog migration is always S3 Tables -- that is the purpos ### Phase 2: Prepare the Target -1. **Ensure table bucket exists**: Check with `aws s3tables list-table-buckets`. If none, delegate to [create-data-lake-table](../../create-data-lake-table/SKILL.md) Phase 2. -2. **Ensure analytics integration is enabled**: Verify `s3tablescatalog` exists. Delegate to [create-data-lake-table](../../create-data-lake-table/SKILL.md) Phase 2, step 4 if not set up. +1. **Ensure table bucket exists**: Check with `aws s3tables list-table-buckets`. If none, delegate to [creating-data-lake-table](../../creating-data-lake-table/SKILL.md) Phase 2. +2. **Ensure analytics integration is enabled**: Verify `s3tablescatalog` exists. Delegate to [creating-data-lake-table](../../creating-data-lake-table/SKILL.md) Phase 2, step 4 if not set up. 3. **Create or select namespace**: Use existing or create new via `aws s3tables create-namespace`. 4. **Plan partition strategy**: Iceberg supports hidden partition transforms (`day()`, `month()`, `year()`, `hour()`, `bucket()`). Recommend converting Hive-style explicit partition columns to Iceberg transforms where possible. diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/ctas-patterns.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/ctas-patterns.md similarity index 100% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/ctas-patterns.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/ctas-patterns.md diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/data-quality-validation.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/data-quality-validation.md similarity index 100% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/data-quality-validation.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/data-quality-validation.md diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/dynamodb-ingest.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/dynamodb-ingest.md similarity index 100% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/dynamodb-ingest.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/dynamodb-ingest.md diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/error-handling.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/error-handling.md similarity index 98% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/error-handling.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/error-handling.md index fe4524d..9b4785c 100644 --- a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/error-handling.md +++ b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/error-handling.md @@ -6,7 +6,7 @@ Complete guide for handling common errors and issues during data import into S3 This reference covers errors encountered during the data import workflow. Errors are organized by workflow phase and severity. -**Connection errors are out of scope for this skill.** JDBC/Snowflake/BigQuery connection failures (timeouts, auth failures, driver not found, SSL errors) belong to `connect-to-data-source`. When a Glue job fails with a connection-level error, delegate to that skill's troubleshooting rather than debugging here. +**Connection errors are out of scope for this skill.** JDBC/Snowflake/BigQuery connection failures (timeouts, auth failures, driver not found, SSL errors) belong to `connecting-to-data-source`. When a Glue job fails with a connection-level error, delegate to that skill's troubleshooting rather than debugging here. ## Common Issues by Category diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/format-specific-loading.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/format-specific-loading.md similarity index 100% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/format-specific-loading.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/format-specific-loading.md diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/glue-etl-migration.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/glue-etl-migration.md similarity index 100% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/glue-etl-migration.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/glue-etl-migration.md diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/glue-job-config.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/glue-job-config.md similarity index 100% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/glue-job-config.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/glue-job-config.md diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/glue-job-scripts.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/glue-job-scripts.md similarity index 100% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/glue-job-scripts.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/glue-job-scripts.md diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/iceberg-catalog-config-and-usage.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/iceberg-catalog-config-and-usage.md similarity index 98% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/iceberg-catalog-config-and-usage.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/iceberg-catalog-config-and-usage.md index 0bdc192..a9474f2 100644 --- a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/iceberg-catalog-config-and-usage.md +++ b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/iceberg-catalog-config-and-usage.md @@ -11,7 +11,7 @@ Managed Iceberg tables with automatic compaction, snapshot management, and multi - Table and column names must be lowercase - Requires Glue 5.1 or higher and `--datalake-formats iceberg` job argument - All `spark.sql.catalog.*` config goes in `--conf` job arguments, never in `spark.conf.set()` (Glue 5.x static config restriction) -- Delegate table creation to [create-data-lake-table](../../create-data-lake-table/SKILL.md) +- Delegate table creation to [creating-data-lake-table](../../creating-data-lake-table/SKILL.md) Two access methods exist. Use Analytics Integration when the table needs to be visible to Athena, Redshift, or EMR. Use REST Endpoint when only Glue Spark jobs access the table. diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/incremental-loading.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/incremental-loading.md similarity index 100% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/incremental-loading.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/incremental-loading.md diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/jdbc-ingest.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/jdbc-ingest.md similarity index 85% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/jdbc-ingest.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/jdbc-ingest.md index 3652602..751a093 100644 --- a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/jdbc-ingest.md +++ b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/jdbc-ingest.md @@ -1,6 +1,6 @@ # JDBC Database Ingest -Move data from a JDBC source (Oracle, SQL Server, PostgreSQL, MySQL, RDS, Aurora, Redshift) into the data lake. Assumes a Glue connection exists. If it doesn't, delegate to the `connect-to-data-source` skill first. +Move data from a JDBC source (Oracle, SQL Server, PostgreSQL, MySQL, RDS, Aurora, Redshift) into the data lake. Assumes a Glue connection exists. If it doesn't, delegate to the `connecting-to-data-source` skill first. ## Contents @@ -12,9 +12,9 @@ Move data from a JDBC source (Oracle, SQL Server, PostgreSQL, MySQL, RDS, Aurora ## Prerequisites -- A tested Glue connection (created via `connect-to-data-source` skill) +- A tested Glue connection (created via `connecting-to-data-source` skill) - Source table name, schema, and optional filter SQL -- Target table (existing or to be created via `create-data-lake-table` skill) +- Target table (existing or to be created via `creating-data-lake-table` skill) - Target format decided (default S3 Tables; see [iceberg-catalog-config-and-usage.md](iceberg-catalog-config-and-usage.md)) ## Workflow @@ -25,7 +25,7 @@ Move data from a JDBC source (Oracle, SQL Server, PostgreSQL, MySQL, RDS, Aurora aws glue get-connection --name --region ``` -If the connection does not exist, stop and delegate to `connect-to-data-source`. +If the connection does not exist, stop and delegate to `connecting-to-data-source`. ### 2. Identify source scope @@ -42,7 +42,7 @@ Ask the user which tables, views, or custom SQL query. See [jdbc-schema-discover ### 4. Create target table if needed -If the target table doesn't exist, delegate to `create-data-lake-table`. Never create it inline. +If the target table doesn't exist, delegate to `creating-data-lake-table`. Never create it inline. ### 5. Build the Glue 5.1 or higher job @@ -99,7 +99,7 @@ Best practices: - Ensure `lowerBound`/`upperBound` cover actual data range - Source database must handle concurrent connections -Retrieve credentials from the connection at runtime rather than hardcoding. See [connect-to-data-source credential-security.md](../../connect-to-data-source/references/credential-security.md) for IAM DB auth and Secrets Manager patterns. +Retrieve credentials from the connection at runtime rather than hardcoding. See [connecting-to-data-source credential-security.md](../../connecting-to-data-source/references/credential-security.md) for IAM DB auth and Secrets Manager patterns. ## Type Mapping @@ -169,6 +169,6 @@ Same as PostgreSQL mappings. Redshift-specific additions: ## Connection Errors -If the Glue job fails with a connection-related error (timeout, auth failure, driver not found, SSL handshake), delegate to `connect-to-data-source` for troubleshooting. Do not attempt network or credential fixes in this skill. +If the Glue job fails with a connection-related error (timeout, auth failure, driver not found, SSL handshake), delegate to `connecting-to-data-source` for troubleshooting. Do not attempt network or credential fixes in this skill. -See [connect-to-data-source troubleshooting.md](../../connect-to-data-source/references/troubleshooting.md). +See [connecting-to-data-source troubleshooting.md](../../connecting-to-data-source/references/troubleshooting.md). diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/jdbc-performance.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/jdbc-performance.md similarity index 100% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/jdbc-performance.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/jdbc-performance.md diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/jdbc-schema-discovery.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/jdbc-schema-discovery.md similarity index 100% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/jdbc-schema-discovery.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/jdbc-schema-discovery.md diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/local-upload.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/local-upload.md similarity index 100% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/local-upload.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/local-upload.md diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/migration-troubleshooting.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/migration-troubleshooting.md similarity index 100% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/migration-troubleshooting.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/migration-troubleshooting.md diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/migration-validation.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/migration-validation.md similarity index 100% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/migration-validation.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/migration-validation.md diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/s3-files.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/s3-files.md similarity index 90% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/s3-files.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/s3-files.md index 0d6be3a..274c176 100644 --- a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/s3-files.md +++ b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/s3-files.md @@ -36,7 +36,7 @@ Schema evolution and nested data: See [schema-evolution.md](schema-evolution.md) ### Phase 3: Set Up or Verify Target Table 1. **Check if table exists** using MCP or CLI -2. **Create table if needed**: Delegate to [create-data-lake-table](../../create-data-lake-table/SKILL.md) for all target types. Pass the target format (S3 Tables, standard Iceberg, or raw files) and schema. See [iceberg-catalog-config-and-usage.md](iceberg-catalog-config-and-usage.md) for target-specific catalog configuration used in the subsequent Glue job. +2. **Create table if needed**: Delegate to [creating-data-lake-table](../../creating-data-lake-table/SKILL.md) for all target types. Pass the target format (S3 Tables, standard Iceberg, or raw files) and schema. See [iceberg-catalog-config-and-usage.md](iceberg-catalog-config-and-usage.md) for target-specific catalog configuration used in the subsequent Glue job. 3. **Evolve schema if needed**: Compare schemas, generate ALTER TABLE ADD COLUMNS, execute via Athena ### Phase 3.5: Verify or Create IAM Role for Glue @@ -45,7 +45,7 @@ Schema evolution and nested data: See [schema-evolution.md](schema-evolution.md) 2. **Verify permissions**: AWSGlueServiceRole managed policy, S3 access, S3 Tables inline policy (if S3 Tables target) 3. **Create role if needed**: Trust policy for `glue.amazonaws.com`, attach policies, capture role ARN -Complete IAM setup: Handled by [create-data-lake-table](../../create-data-lake-table/SKILL.md). +Complete IAM setup: Handled by [creating-data-lake-table](../../creating-data-lake-table/SKILL.md). ### Phase 4: Execute Data Load @@ -103,7 +103,7 @@ Present summary: what was loaded, how to query, any issues, next steps. - S3 Tables requires Glue 5.1 or higher. Standard Iceberg also requires Glue 5.1 or higher for proper Iceberg compatibility. - S3 Tables CREATE TABLE must NOT include a LOCATION clause. Standard Iceberg MUST include one. -- When creating tables for S3 Tables import, use the Spark DDL path (Path B) in create-data-lake-table to ensure the Glue catalog is configured. +- When creating tables for S3 Tables import, use the Spark DDL path (Path B) in creating-data-lake-table to ensure the Glue catalog is configured. - Target-specific catalog configuration and Glue version requirements are defined in [iceberg-catalog-config-and-usage.md](iceberg-catalog-config-and-usage.md). ## References diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/schema-evolution.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/schema-evolution.md similarity index 100% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/schema-evolution.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/schema-evolution.md diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/snowflake-ingest.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/snowflake-ingest.md similarity index 97% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/snowflake-ingest.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/snowflake-ingest.md index e558ced..dcaa589 100644 --- a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/snowflake-ingest.md +++ b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/snowflake-ingest.md @@ -1,6 +1,6 @@ # Snowflake Ingest -Move data from Snowflake into the data lake. Assumes a Glue `SNOWFLAKE` connection exists. If not, delegate to `connect-to-data-source`. +Move data from Snowflake into the data lake. Assumes a Glue `SNOWFLAKE` connection exists. If not, delegate to `connecting-to-data-source`. ## Contents diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/testing-and-scheduling.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/testing-and-scheduling.md similarity index 100% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/testing-and-scheduling.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/testing-and-scheduling.md diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/type-transformations.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/type-transformations.md similarity index 100% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/type-transformations.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/type-transformations.md diff --git a/plugins/aws-data-analytics/skills/ingest-into-data-lake/references/upload-options.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/upload-options.md similarity index 100% rename from plugins/aws-data-analytics/skills/ingest-into-data-lake/references/upload-options.md rename to plugins/aws-data-analytics/skills/ingesting-into-data-lake/references/upload-options.md diff --git a/plugins/aws-data-analytics/skills/query-data-lake/SKILL.md b/plugins/aws-data-analytics/skills/querying-data-lake/SKILL.md similarity index 92% rename from plugins/aws-data-analytics/skills/query-data-lake/SKILL.md rename to plugins/aws-data-analytics/skills/querying-data-lake/SKILL.md index 0711fd6..f3fef31 100644 --- a/plugins/aws-data-analytics/skills/query-data-lake/SKILL.md +++ b/plugins/aws-data-analytics/skills/querying-data-lake/SKILL.md @@ -1,10 +1,10 @@ --- -name: query-data-lake +name: querying-data-lake description: 'Execute and manage Athena SQL queries across default and federated catalogs (Glue, S3 Tables, Redshift). Triggers on phrases like: query data, run SQL, athena query, analyze table, SQL query, workgroup status, profile table, query Redshift - catalog, query S3 Tables. Do NOT use for finding specific data assets (use find-data-lake-assets), - full catalog audits (use exploring-data-catalog), importing data (use ingest-into-data-lake).' + catalog, query S3 Tables. Do NOT use for finding specific data assets (use finding-data-lake-assets), + full catalog audits (use exploring-data-catalog), importing data (use ingesting-into-data-lake).' version: 1 metadata: service: [athena, glue, s3tables, redshift] @@ -20,7 +20,7 @@ Execute SQL queries on Amazon Athena across default and federated catalogs (Glue ## Overview -Executes and manages Athena SQL queries across default and federated catalogs. Selects a workgroup, resolves target assets (delegating fuzzy references to `find-data-lake-assets`), classifies statements for safety, and reports cost and data scanned. Use the AWS MCP server for sandboxed execution and audit logging; the same AWS CLI commands work directly when the MCP server is not available. +Executes and manages Athena SQL queries across default and federated catalogs. Selects a workgroup, resolves target assets (delegating fuzzy references to `finding-data-lake-assets`), classifies statements for safety, and reports cost and data scanned. Use the AWS MCP server for sandboxed execution and audit logging; the same AWS CLI commands work directly when the MCP server is not available. **Constraints for parameter acquisition:** @@ -54,14 +54,14 @@ Check caller identity, list workgroups, auto-select the best one (see [workgroup ### 3. Resolve the Target Asset -If the user refers to a table by name, by business concept ("our quarterly report", "the sales data"), by S3 path, or by catalog without specifying the table, delegate to `find-data-lake-assets` to return the concrete `database.table` (and catalog if non-default). +If the user refers to a table by name, by business concept ("our quarterly report", "the sales data"), by S3 path, or by catalog without specifying the table, delegate to `finding-data-lake-assets` to return the concrete `database.table` (and catalog if non-default). **Constraints:** - You MUST NOT attempt to resolve fuzzy asset references with `athena list-data-catalogs` or by iterating `get-tables` — those miss federated catalogs and waste tokens - You SHOULD skip this step only when the user provides a fully-qualified reference (exact `database.table`) or raw SQL they want executed as-is - You MUST state the resolved asset explicitly before building the query: "Found [table] in [catalog]. Using this for the query." -- You SHOULD default to the default Glue catalog unless the user mentions "federated", "Redshift", "S3 Tables", or `find-data-lake-assets` returns a different catalog +- You SHOULD default to the default Glue catalog unless the user mentions "federated", "Redshift", "S3 Tables", or `finding-data-lake-assets` returns a different catalog ### 4. Discover Schema diff --git a/plugins/aws-data-analytics/skills/query-data-lake/references/query-patterns.md b/plugins/aws-data-analytics/skills/querying-data-lake/references/query-patterns.md similarity index 100% rename from plugins/aws-data-analytics/skills/query-data-lake/references/query-patterns.md rename to plugins/aws-data-analytics/skills/querying-data-lake/references/query-patterns.md diff --git a/plugins/aws-data-analytics/skills/query-data-lake/references/workgroup-selection.md b/plugins/aws-data-analytics/skills/querying-data-lake/references/workgroup-selection.md similarity index 100% rename from plugins/aws-data-analytics/skills/query-data-lake/references/workgroup-selection.md rename to plugins/aws-data-analytics/skills/querying-data-lake/references/workgroup-selection.md diff --git a/plugins/aws-data-analytics/skills/store-and-query-vectors/SKILL.md b/plugins/aws-data-analytics/skills/storing-and-querying-vectors/SKILL.md similarity index 98% rename from plugins/aws-data-analytics/skills/store-and-query-vectors/SKILL.md rename to plugins/aws-data-analytics/skills/storing-and-querying-vectors/SKILL.md index c08c572..1908aa2 100644 --- a/plugins/aws-data-analytics/skills/store-and-query-vectors/SKILL.md +++ b/plugins/aws-data-analytics/skills/storing-and-querying-vectors/SKILL.md @@ -1,10 +1,10 @@ --- -name: store-and-query-vectors +name: storing-and-querying-vectors description: 'Store and query vector embeddings using Amazon S3 Vectors, a cost-effective long-term vector storage service with its own API namespace (s3vectors). Triggers on: create S3 vector bucket, vector index, store embeddings, semantic search, RAG vector storage, similarity search, vector database, migrate from other vector databases. - Do NOT use for: querying tabular data (use query-data-lake), S3 object storage, + Do NOT use for: querying tabular data (use querying-data-lake), S3 object storage, or hundreds/thousands of sustained QPS (use OpenSearch).' version: 1 metadata: diff --git a/plugins/aws-data-analytics/skills/store-and-query-vectors/references/limits-and-patterns.md b/plugins/aws-data-analytics/skills/storing-and-querying-vectors/references/limits-and-patterns.md similarity index 100% rename from plugins/aws-data-analytics/skills/store-and-query-vectors/references/limits-and-patterns.md rename to plugins/aws-data-analytics/skills/storing-and-querying-vectors/references/limits-and-patterns.md diff --git a/plugins/aws-data-analytics/skills/store-and-query-vectors/references/metadata-filtering.md b/plugins/aws-data-analytics/skills/storing-and-querying-vectors/references/metadata-filtering.md similarity index 100% rename from plugins/aws-data-analytics/skills/store-and-query-vectors/references/metadata-filtering.md rename to plugins/aws-data-analytics/skills/storing-and-querying-vectors/references/metadata-filtering.md From 70287a5d3aeb8ca4c3f4dd19470c490786e9ca49 Mon Sep 17 00:00:00 2001 From: Arne Wouters Date: Wed, 6 May 2026 08:52:57 +0200 Subject: [PATCH 3/5] chore: copy changes to analytics skills to overall skills folder --- .../SKILL.md | 12 +++---- .../references/bigquery-setup.md | 0 .../references/credential-security.md | 0 .../references/discovery.md | 0 .../references/jdbc-setup.md | 0 .../references/network-setup.md | 0 .../references/snowflake-setup.md | 0 .../references/troubleshooting.md | 0 .../SKILL.md | 31 +++++++++---------- .../references/access-control.md | 0 .../references/athena-ddl-path.md | 0 .../references/best-practices.md | 0 .../references/table-creation-glue-etl.md | 0 .../exploring-data-catalog/SKILL.md | 6 ++-- .../SKILL.md | 4 +-- .../references/search-strategy.md | 0 .../SKILL.md | 26 ++++++++-------- .../references/athena-loading.md | 0 .../references/bigquery-ingest.md | 2 +- .../references/catalog-migration.md | 6 ++-- .../references/ctas-patterns.md | 0 .../references/data-quality-validation.md | 0 .../references/dynamodb-ingest.md | 0 .../references/error-handling.md | 2 +- .../references/format-specific-loading.md | 0 .../references/glue-etl-migration.md | 0 .../references/glue-job-config.md | 0 .../references/glue-job-scripts.md | 0 .../iceberg-catalog-config-and-usage.md | 2 +- .../references/incremental-loading.md | 0 .../references/jdbc-ingest.md | 16 +++++----- .../references/jdbc-performance.md | 0 .../references/jdbc-schema-discovery.md | 0 .../references/local-upload.md | 0 .../references/migration-troubleshooting.md | 0 .../references/migration-validation.md | 0 .../references/s3-files.md | 6 ++-- .../references/schema-evolution.md | 0 .../references/snowflake-ingest.md | 2 +- .../references/testing-and-scheduling.md | 0 .../references/type-transformations.md | 0 .../references/upload-options.md | 0 .../SKILL.md | 12 +++---- .../references/query-patterns.md | 0 .../references/workgroup-selection.md | 0 .../storing-and-querying-vectors/SKILL.md | 14 ++++----- 46 files changed, 69 insertions(+), 72 deletions(-) rename skills/analytics-skills/{connect-to-data-source => connecting-to-data-source}/SKILL.md (93%) rename skills/analytics-skills/{connect-to-data-source => connecting-to-data-source}/references/bigquery-setup.md (100%) rename skills/analytics-skills/{connect-to-data-source => connecting-to-data-source}/references/credential-security.md (100%) rename skills/analytics-skills/{connect-to-data-source => connecting-to-data-source}/references/discovery.md (100%) rename skills/analytics-skills/{connect-to-data-source => connecting-to-data-source}/references/jdbc-setup.md (100%) rename skills/analytics-skills/{connect-to-data-source => connecting-to-data-source}/references/network-setup.md (100%) rename skills/analytics-skills/{connect-to-data-source => connecting-to-data-source}/references/snowflake-setup.md (100%) rename skills/analytics-skills/{connect-to-data-source => connecting-to-data-source}/references/troubleshooting.md (100%) rename skills/analytics-skills/{creating-data-lake-tables => creating-data-lake-table}/SKILL.md (88%) rename skills/analytics-skills/{creating-data-lake-tables => creating-data-lake-table}/references/access-control.md (100%) rename skills/analytics-skills/{creating-data-lake-tables => creating-data-lake-table}/references/athena-ddl-path.md (100%) rename skills/analytics-skills/{creating-data-lake-tables => creating-data-lake-table}/references/best-practices.md (100%) rename skills/analytics-skills/{creating-data-lake-tables => creating-data-lake-table}/references/table-creation-glue-etl.md (100%) rename skills/analytics-skills/{find-data-lake-assets => finding-data-lake-assets}/SKILL.md (98%) rename skills/analytics-skills/{find-data-lake-assets => finding-data-lake-assets}/references/search-strategy.md (100%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/SKILL.md (91%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/athena-loading.md (100%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/bigquery-ingest.md (97%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/catalog-migration.md (94%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/ctas-patterns.md (100%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/data-quality-validation.md (100%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/dynamodb-ingest.md (100%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/error-handling.md (98%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/format-specific-loading.md (100%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/glue-etl-migration.md (100%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/glue-job-config.md (100%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/glue-job-scripts.md (100%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/iceberg-catalog-config-and-usage.md (98%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/incremental-loading.md (100%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/jdbc-ingest.md (85%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/jdbc-performance.md (100%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/jdbc-schema-discovery.md (100%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/local-upload.md (100%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/migration-troubleshooting.md (100%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/migration-validation.md (100%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/s3-files.md (90%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/schema-evolution.md (100%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/snowflake-ingest.md (97%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/testing-and-scheduling.md (100%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/type-transformations.md (100%) rename skills/analytics-skills/{ingest-into-data-lake => ingesting-into-data-lake}/references/upload-options.md (100%) rename skills/analytics-skills/{query-data-lake => querying-data-lake}/SKILL.md (92%) rename skills/analytics-skills/{query-data-lake => querying-data-lake}/references/query-patterns.md (100%) rename skills/analytics-skills/{query-data-lake => querying-data-lake}/references/workgroup-selection.md (100%) diff --git a/skills/analytics-skills/connect-to-data-source/SKILL.md b/skills/analytics-skills/connecting-to-data-source/SKILL.md similarity index 93% rename from skills/analytics-skills/connect-to-data-source/SKILL.md rename to skills/analytics-skills/connecting-to-data-source/SKILL.md index 420d5af..767e8c8 100644 --- a/skills/analytics-skills/connect-to-data-source/SKILL.md +++ b/skills/analytics-skills/connecting-to-data-source/SKILL.md @@ -1,13 +1,13 @@ --- -name: connect-to-data-source +name: connecting-to-data-source description: 'Create and troubleshoot AWS Glue connections to JDBC databases (Oracle, SQL Server, PostgreSQL, MySQL, RDS), Redshift, Snowflake, and BigQuery. Gathers connection hints from user, discovers existing connections and RDS/Redshift candidates, registers credentials in Secrets Manager or IAM DB auth, configures VPC, and tests. Triggers on: connect to database, set up Glue connection, register data source, connect to Snowflake/BigQuery/RDS, connection timeout, test connection, troubleshoot - connection. Do NOT use for moving data (use ingest-into-data-lake), creating tables - (use create-data-lake-table), queries (use query-data-lake), catalog exploration + connection. Do NOT use for moving data (use ingesting-into-data-lake), creating tables + (use creating-data-lake-table), queries (use querying-data-lake), catalog exploration (use exploring-data-catalog), or SaaS (Salesforce, ServiceNow, SAP, MongoDB, Kafka).' version: 1 metadata: @@ -20,7 +20,7 @@ argument-hint: '[source-type|connection-name|hostname]' # Connect to Data Source -Register an external data source with AWS Glue so downstream skills (ingest-into-data-lake) can move data from it. A Glue connection stores the network config, driver, and credential reference for one source. Create once per source, reuse across jobs. +Register an external data source with AWS Glue so downstream skills (ingesting-into-data-lake) can move data from it. A Glue connection stores the network config, driver, and credential reference for one source. Create once per source, reuse across jobs. ## Philosophy @@ -48,7 +48,7 @@ Ask the user which source type they want to connect to, or infer from hints: | "Snowflake" | Snowflake | `SNOWFLAKE` | [snowflake-setup.md](references/snowflake-setup.md) | | "BigQuery", "Google analytics warehouse" | BigQuery | `BIGQUERY` | [bigquery-setup.md](references/bigquery-setup.md) | -If the user names DynamoDB or a local file, stop and tell them: DynamoDB is read directly by Glue without a connection, and local files belong in the ingest-into-data-lake skill's local-upload workflow. +If the user names DynamoDB or a local file, stop and tell them: DynamoDB is read directly by Glue without a connection, and local files belong in the ingesting-into-data-lake skill's local-upload workflow. ### 3. Gather Connection Hints from the User @@ -126,7 +126,7 @@ After TestConnection passes, verify the connection works with the user's intende Phase B catches issues that TestConnection misses: driver compatibility at job runtime, catalog configuration, Spark-level serialization, and engine-specific auth flows (e.g., Snowflake SNOWFLAKE type works in ETL but not via JDBC crawlers). -On success in both phases, tell user the connection name is ready for `ingest-into-data-lake`. On failure in either phase, Step 8. +On success in both phases, tell user the connection name is ready for `ingesting-into-data-lake`. On failure in either phase, Step 8. ### 8. Troubleshoot (only if test failed) diff --git a/skills/analytics-skills/connect-to-data-source/references/bigquery-setup.md b/skills/analytics-skills/connecting-to-data-source/references/bigquery-setup.md similarity index 100% rename from skills/analytics-skills/connect-to-data-source/references/bigquery-setup.md rename to skills/analytics-skills/connecting-to-data-source/references/bigquery-setup.md diff --git a/skills/analytics-skills/connect-to-data-source/references/credential-security.md b/skills/analytics-skills/connecting-to-data-source/references/credential-security.md similarity index 100% rename from skills/analytics-skills/connect-to-data-source/references/credential-security.md rename to skills/analytics-skills/connecting-to-data-source/references/credential-security.md diff --git a/skills/analytics-skills/connect-to-data-source/references/discovery.md b/skills/analytics-skills/connecting-to-data-source/references/discovery.md similarity index 100% rename from skills/analytics-skills/connect-to-data-source/references/discovery.md rename to skills/analytics-skills/connecting-to-data-source/references/discovery.md diff --git a/skills/analytics-skills/connect-to-data-source/references/jdbc-setup.md b/skills/analytics-skills/connecting-to-data-source/references/jdbc-setup.md similarity index 100% rename from skills/analytics-skills/connect-to-data-source/references/jdbc-setup.md rename to skills/analytics-skills/connecting-to-data-source/references/jdbc-setup.md diff --git a/skills/analytics-skills/connect-to-data-source/references/network-setup.md b/skills/analytics-skills/connecting-to-data-source/references/network-setup.md similarity index 100% rename from skills/analytics-skills/connect-to-data-source/references/network-setup.md rename to skills/analytics-skills/connecting-to-data-source/references/network-setup.md diff --git a/skills/analytics-skills/connect-to-data-source/references/snowflake-setup.md b/skills/analytics-skills/connecting-to-data-source/references/snowflake-setup.md similarity index 100% rename from skills/analytics-skills/connect-to-data-source/references/snowflake-setup.md rename to skills/analytics-skills/connecting-to-data-source/references/snowflake-setup.md diff --git a/skills/analytics-skills/connect-to-data-source/references/troubleshooting.md b/skills/analytics-skills/connecting-to-data-source/references/troubleshooting.md similarity index 100% rename from skills/analytics-skills/connect-to-data-source/references/troubleshooting.md rename to skills/analytics-skills/connecting-to-data-source/references/troubleshooting.md diff --git a/skills/analytics-skills/creating-data-lake-tables/SKILL.md b/skills/analytics-skills/creating-data-lake-table/SKILL.md similarity index 88% rename from skills/analytics-skills/creating-data-lake-tables/SKILL.md rename to skills/analytics-skills/creating-data-lake-table/SKILL.md index b6bee11..0614550 100644 --- a/skills/analytics-skills/creating-data-lake-tables/SKILL.md +++ b/skills/analytics-skills/creating-data-lake-table/SKILL.md @@ -1,21 +1,20 @@ --- -name: creating-data-lake-tables -description: > - Create managed Iceberg tables using Amazon S3 Tables (s3tables API namespace) - with automatic compaction and snapshot management. Sets up table bucket, - namespace, table, schema, Glue catalog registration, partitioning, IAM access control. - Triggers on: create table, data lake table, analytics table, structured data storage, - S3 Tables, Iceberg, Athena table, partitioning strategy, access permissions. Do NOT use - for: importing files (use ingest-into-data-lake), vector storage (use store-and-query-vectors), - querying existing tables (use query-data-lake), or locating existing table - (use find-data-lake-assets). -argument-hint: "[table-description|schema-spec]" +name: creating-data-lake-table +description: 'Create managed Iceberg tables using Amazon S3 Tables (s3tables API namespace) + with automatic compaction and snapshot management. Sets up table bucket, namespace, + table, schema, Glue catalog registration, partitioning, IAM access control. Triggers + on: create table, data lake table, analytics table, structured data storage, S3 + Tables, Iceberg, Athena table, partitioning strategy, access permissions. Do NOT + use for: importing files (use ingesting-into-data-lake), vector storage (use storing-and-querying-vectors), + querying existing tables (use querying-data-lake), or locating existing table (use + finding-data-lake-assets).' version: 1 metadata: service: [s3tables, glue, athena] task: [deploy, debug] persona: [developer, data-engineer] workload: [data-analytics] +argument-hint: '[table-description|schema-spec]' --- # Create Data Lake Tables with Amazon S3 Tables @@ -36,15 +35,15 @@ You MUST run `aws glue get-tables --database-name ` when user mentions a d | What you find | Action | |---------------|--------| -| Fuzzy database name ("our analytics db") | You MUST STOP. Delegate to `find-data-lake-assets` to resolve. | -| Non-S3-Tables table with matching name | You MUST STOP. Delegate to `find-data-lake-assets`. You MUST NOT create until user confirms. | +| Fuzzy database name ("our analytics db") | You MUST STOP. Delegate to `finding-data-lake-assets` to resolve. | +| Non-S3-Tables table with matching name | You MUST STOP. Delegate to `finding-data-lake-assets`. You MUST NOT create until user confirms. | | Existing S3 Tables table with matching name | You MUST check schema match. Reuse if compatible, recreate only if user confirms. | | No matching tables | Proceed with creation (Steps 1-8). | | User explicitly requests new S3 Tables table | Skip checks, proceed with creation. | **Creation paths:** -- **Existing data in S3**: Create empty table (Steps 1-8), then use `ingest-into-data-lake` skill. +- **Existing data in S3**: Create empty table (Steps 1-8), then use `ingesting-into-data-lake` skill. - **Glue ETL pipeline**: Read `references/table-creation-glue-etl.md` first, then Steps 1-6. - **Lake Formation access control**: Search AWS docs for `"S3 Tables integration with Lake Formation"`. @@ -59,7 +58,7 @@ You MUST run `aws glue get-tables --database-name ` when user mentions a d - **Explicit schema**: Validate Iceberg types. - **Loose description**: Ask columns, types, grain. Propose and confirm. -- **Existing S3 data**: Infer schema from file headers only. Create empty table first, then use `ingest-into-data-lake` skill. +- **Existing S3 data**: Infer schema from file headers only. Create empty table first, then use `ingesting-into-data-lake` skill. **Constraints:** @@ -195,4 +194,4 @@ You MUST verify with `aws s3tables get-table` and confirm queryability with `DES - [best-practices.md](references/best-practices.md) -- Iceberg types, partitions, naming, common errors - [athena-ddl-path.md](references/athena-ddl-path.md) -- Athena DDL, schema evolution - [table-creation-glue-etl.md](references/table-creation-glue-etl.md) -- Spark DDL via Glue ETL -- Loading data: `ingest-into-data-lake` skill +- Loading data: `ingesting-into-data-lake` skill diff --git a/skills/analytics-skills/creating-data-lake-tables/references/access-control.md b/skills/analytics-skills/creating-data-lake-table/references/access-control.md similarity index 100% rename from skills/analytics-skills/creating-data-lake-tables/references/access-control.md rename to skills/analytics-skills/creating-data-lake-table/references/access-control.md diff --git a/skills/analytics-skills/creating-data-lake-tables/references/athena-ddl-path.md b/skills/analytics-skills/creating-data-lake-table/references/athena-ddl-path.md similarity index 100% rename from skills/analytics-skills/creating-data-lake-tables/references/athena-ddl-path.md rename to skills/analytics-skills/creating-data-lake-table/references/athena-ddl-path.md diff --git a/skills/analytics-skills/creating-data-lake-tables/references/best-practices.md b/skills/analytics-skills/creating-data-lake-table/references/best-practices.md similarity index 100% rename from skills/analytics-skills/creating-data-lake-tables/references/best-practices.md rename to skills/analytics-skills/creating-data-lake-table/references/best-practices.md diff --git a/skills/analytics-skills/creating-data-lake-tables/references/table-creation-glue-etl.md b/skills/analytics-skills/creating-data-lake-table/references/table-creation-glue-etl.md similarity index 100% rename from skills/analytics-skills/creating-data-lake-tables/references/table-creation-glue-etl.md rename to skills/analytics-skills/creating-data-lake-table/references/table-creation-glue-etl.md diff --git a/skills/analytics-skills/exploring-data-catalog/SKILL.md b/skills/analytics-skills/exploring-data-catalog/SKILL.md index a62e702..34601cb 100644 --- a/skills/analytics-skills/exploring-data-catalog/SKILL.md +++ b/skills/analytics-skills/exploring-data-catalog/SKILL.md @@ -3,8 +3,8 @@ name: exploring-data-catalog description: 'Full inventory and audit of AWS Glue Data Catalog assets across S3 Tables, Redshift-federated, and remote Iceberg catalogs. Triggers on: inventory the catalog, audit databases, list all tables, catalog overview, data landscape, enumerate catalogs, - data inventory, search the catalog. Do NOT use for finding specific data (use find-data-lake-assets), - running queries (use query-data-lake), or creating tables (use create-data-lake-table).' + data inventory, search the catalog. Do NOT use for finding specific data (use finding-data-lake-assets), + running queries (use querying-data-lake), or creating tables (use creating-data-lake-table).' version: 1 metadata: service: [glue, s3, s3tables] @@ -115,7 +115,7 @@ Resolve the argument in this order; stop at the first match: - Flag stale tables and missing descriptions - Suggest partitioning for large unpartitioned tables - Summary first, details on request -- You MUST NOT execute Athena queries (`start-query-execution`) during discovery; query execution belongs to `query-data-lake` +- You MUST NOT execute Athena queries (`start-query-execution`) during discovery; query execution belongs to `querying-data-lake` ## Troubleshooting diff --git a/skills/analytics-skills/find-data-lake-assets/SKILL.md b/skills/analytics-skills/finding-data-lake-assets/SKILL.md similarity index 98% rename from skills/analytics-skills/find-data-lake-assets/SKILL.md rename to skills/analytics-skills/finding-data-lake-assets/SKILL.md index 2774feb..062d2a7 100644 --- a/skills/analytics-skills/find-data-lake-assets/SKILL.md +++ b/skills/analytics-skills/finding-data-lake-assets/SKILL.md @@ -1,11 +1,11 @@ --- -name: find-data-lake-assets +name: finding-data-lake-assets description: 'Resolve data lake and lakehouse asset references across Glue Data Catalog, S3, S3 Tables, and Redshift. Triggers on: find the table, where is our data, which table has, locate dataset, find data for, search catalog, what tables match, Redshift table, lakehouse table, data lake table, warehouse table, reverse lookup S3 path. Do NOT use for: full catalog audits (use exploring-data-catalog), running queries - (use query-data-lake), creating tables (use create-data-lake-table).' + (use querying-data-lake), creating tables (use creating-data-lake-table).' version: 1 metadata: service: [glue, s3, s3tables, redshift] diff --git a/skills/analytics-skills/find-data-lake-assets/references/search-strategy.md b/skills/analytics-skills/finding-data-lake-assets/references/search-strategy.md similarity index 100% rename from skills/analytics-skills/find-data-lake-assets/references/search-strategy.md rename to skills/analytics-skills/finding-data-lake-assets/references/search-strategy.md diff --git a/skills/analytics-skills/ingest-into-data-lake/SKILL.md b/skills/analytics-skills/ingesting-into-data-lake/SKILL.md similarity index 91% rename from skills/analytics-skills/ingest-into-data-lake/SKILL.md rename to skills/analytics-skills/ingesting-into-data-lake/SKILL.md index 5815e74..de16d30 100644 --- a/skills/analytics-skills/ingest-into-data-lake/SKILL.md +++ b/skills/analytics-skills/ingesting-into-data-lake/SKILL.md @@ -1,5 +1,5 @@ --- -name: ingest-into-data-lake +name: ingesting-into-data-lake description: 'Import data into the AWS data lake from S3 files, local uploads, JDBC databases (Oracle, SQL Server, PostgreSQL, MySQL, RDS, Aurora), Amazon Redshift, Snowflake, BigQuery, DynamoDB, or existing Glue catalog tables (migration). Default @@ -8,8 +8,8 @@ description: 'Import data into the AWS data lake from S3 files, local uploads, J Triggers on: import data, load data, ingest, sync database, migrate table, move data to AWS, set up pipeline, ETL, pull from Snowflake, query BigQuery into S3, export DynamoDB, CTAS, convert to Iceberg. Do NOT use for setting up or troubleshooting - Glue connections (use connect-to-data-source), creating empty tables (use create-data-lake-table), - running queries (use query-data-lake), finding tables by fuzzy name (use find-data-lake-assets), + Glue connections (use connecting-to-data-source), creating empty tables (use creating-data-lake-table), + running queries (use querying-data-lake), finding tables by fuzzy name (use finding-data-lake-assets), catalog audit (use exploring-data-catalog), or SaaS platforms like Salesforce, ServiceNow, SAP, MongoDB, Kafka.' version: 1 @@ -23,7 +23,7 @@ argument-hint: '[source-path|connection-name|table-name] [--target s3-tables|ice # Ingest into Data Lake -Move data from a source into a queryable table in the data lake. This skill assumes the source connection (if one is needed) already exists. For Glue connection setup or troubleshooting, delegate to `connect-to-data-source`. +Move data from a source into a queryable table in the data lake. This skill assumes the source connection (if one is needed) already exists. For Glue connection setup or troubleshooting, delegate to `connecting-to-data-source`. ## Philosophy @@ -39,7 +39,7 @@ You MUST execute commands using AWS MCP server tools when connected -- they prov - You MUST check whether AWS MCP tools or AWS CLI are available and inform the user if missing - You MUST confirm target AWS region and verify credentials with `aws sts get-caller-identity` -- For SageMaker Unified Studio project roles, note that target tables and connections may be scoped to the project. See the caller ARN detection pattern in `query-data-lake`. +- For SageMaker Unified Studio project roles, note that target tables and connections may be scoped to the project. See the caller ARN detection pattern in `querying-data-lake`. ### 2. Classify the Source @@ -55,7 +55,7 @@ You MUST execute commands using AWS MCP server tools when connected -- they prov If the user names Salesforce, ServiceNow, SAP, MongoDB, Kafka, or another SaaS/streaming source, decline -- these are not supported in this release. -If the source table is referenced by a fuzzy or business name ("migrate our orders table", "pull from the sales warehouse"), delegate to `find-data-lake-assets` to resolve before proceeding. +If the source table is referenced by a fuzzy or business name ("migrate our orders table", "pull from the sales warehouse"), delegate to `finding-data-lake-assets` to resolve before proceeding. ### 3. Confirm Connection Exists (if applicable) @@ -65,7 +65,7 @@ For JDBC, Snowflake, and BigQuery sources, a Glue connection is required. Check: aws glue get-connection --name --region ``` -If the connection does not exist, stop and delegate to `connect-to-data-source` to create and test it. Do not proceed with ingest until the connection is verified. +If the connection does not exist, stop and delegate to `connecting-to-data-source` to create and test it. Do not proceed with ingest until the connection is verified. Local files, S3 files, DynamoDB, and catalog migration do not need a Glue connection. @@ -74,7 +74,7 @@ Local files, S3 files, DynamoDB, and catalog migration do not need a Glue connec You MUST ask the user (or suggest based on catalog inventory) before creating or writing to any table: - **Database/namespace**: Does a specific target database exist? Or should one be created? -- **Table**: Existing table (append/merge) or new table (delegate to `create-data-lake-table`)? +- **Table**: Existing table (append/merge) or new table (delegate to `creating-data-lake-table`)? - **Format**: S3 Tables (default), standard Iceberg, or raw Parquet? **Inventory-aware defaults:** @@ -89,8 +89,8 @@ Do not force S3 Tables on customers who haven't adopted it. See [iceberg-catalog **Delegations from this step:** -- Target table doesn't exist -> `create-data-lake-table` -- Target database named by fuzzy term -> `find-data-lake-assets` +- Target table doesn't exist -> `creating-data-lake-table` +- Target database named by fuzzy term -> `finding-data-lake-assets` - User doesn't know what exists -> `exploring-data-catalog` ### 5. Execute Source Workflow @@ -132,7 +132,7 @@ For recurring pipelines, create a Glue Trigger with a cron schedule. See [testin - `overwritePartitions()` only replaces partitions present in the DataFrame -- for full refresh with deletes, use `createOrReplace()` - Standard Iceberg targets MUST include a LOCATION clause; S3 Tables MUST NOT - DynamoDB does not need a Glue connection -- do not attempt to create one -- Connection failures during ingest delegate back to `connect-to-data-source`; do not debug network/credentials in this skill +- Connection failures during ingest delegate back to `connecting-to-data-source`; do not debug network/credentials in this skill - For target tables in SageMaker Unified Studio projects, ensure the project role has write access to the target namespace before the Glue job runs ## Troubleshooting @@ -142,7 +142,7 @@ For recurring pipelines, create a Glue Trigger with a cron schedule. See [testin | Access Denied on S3 | Missing IAM permissions | Check Glue role has s3:GetObject, s3:PutObject | | Access Denied on S3 Tables | Missing s3tables:* permissions | Add S3 Tables inline policy to Glue role | | CTAS timeout | Dataset too large for Athena | Switch to Glue ETL or batch with WHERE filters | -| JDBC connection timeout/auth failure | Connection-level issue | Delegate to `connect-to-data-source` | +| JDBC connection timeout/auth failure | Connection-level issue | Delegate to `connecting-to-data-source` | | Throughput exceeded (DynamoDB) | Read percent too high | Lower `read.percent` or use native export | See [error-handling.md](references/error-handling.md) for the full catalog. @@ -171,7 +171,7 @@ See [error-handling.md](references/error-handling.md) for the full catalog. - [type-transformations.md](references/type-transformations.md) -- Type conflict resolution - [format-specific-loading.md](references/format-specific-loading.md) -- CSV/JSON/Parquet/Avro/ORC specifics - [athena-loading.md](references/athena-loading.md) -- Athena INSERT INTO as simple-load fallback -- [error-handling.md](references/error-handling.md) -- Ingest errors (connection errors delegate to connect-to-data-source) +- [error-handling.md](references/error-handling.md) -- Ingest errors (connection errors delegate to connecting-to-data-source) - [upload-options.md](references/upload-options.md) -- aws s3 cp vs sync, multipart ### Migration-specific diff --git a/skills/analytics-skills/ingest-into-data-lake/references/athena-loading.md b/skills/analytics-skills/ingesting-into-data-lake/references/athena-loading.md similarity index 100% rename from skills/analytics-skills/ingest-into-data-lake/references/athena-loading.md rename to skills/analytics-skills/ingesting-into-data-lake/references/athena-loading.md diff --git a/skills/analytics-skills/ingest-into-data-lake/references/bigquery-ingest.md b/skills/analytics-skills/ingesting-into-data-lake/references/bigquery-ingest.md similarity index 97% rename from skills/analytics-skills/ingest-into-data-lake/references/bigquery-ingest.md rename to skills/analytics-skills/ingesting-into-data-lake/references/bigquery-ingest.md index 093ddb7..b257016 100644 --- a/skills/analytics-skills/ingest-into-data-lake/references/bigquery-ingest.md +++ b/skills/analytics-skills/ingesting-into-data-lake/references/bigquery-ingest.md @@ -1,6 +1,6 @@ # BigQuery Ingest -Move data from Google BigQuery into the data lake. Assumes a Glue `BIGQUERY` connection exists. If not, delegate to `connect-to-data-source`. +Move data from Google BigQuery into the data lake. Assumes a Glue `BIGQUERY` connection exists. If not, delegate to `connecting-to-data-source`. ## Contents diff --git a/skills/analytics-skills/ingest-into-data-lake/references/catalog-migration.md b/skills/analytics-skills/ingesting-into-data-lake/references/catalog-migration.md similarity index 94% rename from skills/analytics-skills/ingest-into-data-lake/references/catalog-migration.md rename to skills/analytics-skills/ingesting-into-data-lake/references/catalog-migration.md index 83a11a3..be5c0a7 100644 --- a/skills/analytics-skills/ingest-into-data-lake/references/catalog-migration.md +++ b/skills/analytics-skills/ingesting-into-data-lake/references/catalog-migration.md @@ -19,7 +19,7 @@ Note: The target for catalog migration is always S3 Tables -- that is the purpos ### Phase 1: Understand the Source -1. **Identify the source table**: Get the fully qualified name (`database.table` or `catalog.database.table`). If the user gives a fuzzy or business name ("our orders table", "the sales data"), delegate to the `find-data-lake-assets` skill to resolve it before continuing -- the rest of this workflow assumes a concrete reference. +1. **Identify the source table**: Get the fully qualified name (`database.table` or `catalog.database.table`). If the user gives a fuzzy or business name ("our orders table", "the sales data"), delegate to the `finding-data-lake-assets` skill to resolve it before continuing -- the rest of this workflow assumes a concrete reference. 2. **Inspect the source**: - **With MCP**: Use `aws-mcp` to get table metadata (format, location, schema, partitions) - **Without MCP**: `aws glue get-table --database-name --name
` @@ -34,8 +34,8 @@ Note: The target for catalog migration is always S3 Tables -- that is the purpos ### Phase 2: Prepare the Target -1. **Ensure table bucket exists**: Check with `aws s3tables list-table-buckets`. If none, delegate to [create-data-lake-table](../../create-data-lake-table/SKILL.md) Phase 2. -2. **Ensure analytics integration is enabled**: Verify `s3tablescatalog` exists. Delegate to [create-data-lake-table](../../create-data-lake-table/SKILL.md) Phase 2, step 4 if not set up. +1. **Ensure table bucket exists**: Check with `aws s3tables list-table-buckets`. If none, delegate to [creating-data-lake-table](../../creating-data-lake-table/SKILL.md) Phase 2. +2. **Ensure analytics integration is enabled**: Verify `s3tablescatalog` exists. Delegate to [creating-data-lake-table](../../creating-data-lake-table/SKILL.md) Phase 2, step 4 if not set up. 3. **Create or select namespace**: Use existing or create new via `aws s3tables create-namespace`. 4. **Plan partition strategy**: Iceberg supports hidden partition transforms (`day()`, `month()`, `year()`, `hour()`, `bucket()`). Recommend converting Hive-style explicit partition columns to Iceberg transforms where possible. diff --git a/skills/analytics-skills/ingest-into-data-lake/references/ctas-patterns.md b/skills/analytics-skills/ingesting-into-data-lake/references/ctas-patterns.md similarity index 100% rename from skills/analytics-skills/ingest-into-data-lake/references/ctas-patterns.md rename to skills/analytics-skills/ingesting-into-data-lake/references/ctas-patterns.md diff --git a/skills/analytics-skills/ingest-into-data-lake/references/data-quality-validation.md b/skills/analytics-skills/ingesting-into-data-lake/references/data-quality-validation.md similarity index 100% rename from skills/analytics-skills/ingest-into-data-lake/references/data-quality-validation.md rename to skills/analytics-skills/ingesting-into-data-lake/references/data-quality-validation.md diff --git a/skills/analytics-skills/ingest-into-data-lake/references/dynamodb-ingest.md b/skills/analytics-skills/ingesting-into-data-lake/references/dynamodb-ingest.md similarity index 100% rename from skills/analytics-skills/ingest-into-data-lake/references/dynamodb-ingest.md rename to skills/analytics-skills/ingesting-into-data-lake/references/dynamodb-ingest.md diff --git a/skills/analytics-skills/ingest-into-data-lake/references/error-handling.md b/skills/analytics-skills/ingesting-into-data-lake/references/error-handling.md similarity index 98% rename from skills/analytics-skills/ingest-into-data-lake/references/error-handling.md rename to skills/analytics-skills/ingesting-into-data-lake/references/error-handling.md index fe4524d..9b4785c 100644 --- a/skills/analytics-skills/ingest-into-data-lake/references/error-handling.md +++ b/skills/analytics-skills/ingesting-into-data-lake/references/error-handling.md @@ -6,7 +6,7 @@ Complete guide for handling common errors and issues during data import into S3 This reference covers errors encountered during the data import workflow. Errors are organized by workflow phase and severity. -**Connection errors are out of scope for this skill.** JDBC/Snowflake/BigQuery connection failures (timeouts, auth failures, driver not found, SSL errors) belong to `connect-to-data-source`. When a Glue job fails with a connection-level error, delegate to that skill's troubleshooting rather than debugging here. +**Connection errors are out of scope for this skill.** JDBC/Snowflake/BigQuery connection failures (timeouts, auth failures, driver not found, SSL errors) belong to `connecting-to-data-source`. When a Glue job fails with a connection-level error, delegate to that skill's troubleshooting rather than debugging here. ## Common Issues by Category diff --git a/skills/analytics-skills/ingest-into-data-lake/references/format-specific-loading.md b/skills/analytics-skills/ingesting-into-data-lake/references/format-specific-loading.md similarity index 100% rename from skills/analytics-skills/ingest-into-data-lake/references/format-specific-loading.md rename to skills/analytics-skills/ingesting-into-data-lake/references/format-specific-loading.md diff --git a/skills/analytics-skills/ingest-into-data-lake/references/glue-etl-migration.md b/skills/analytics-skills/ingesting-into-data-lake/references/glue-etl-migration.md similarity index 100% rename from skills/analytics-skills/ingest-into-data-lake/references/glue-etl-migration.md rename to skills/analytics-skills/ingesting-into-data-lake/references/glue-etl-migration.md diff --git a/skills/analytics-skills/ingest-into-data-lake/references/glue-job-config.md b/skills/analytics-skills/ingesting-into-data-lake/references/glue-job-config.md similarity index 100% rename from skills/analytics-skills/ingest-into-data-lake/references/glue-job-config.md rename to skills/analytics-skills/ingesting-into-data-lake/references/glue-job-config.md diff --git a/skills/analytics-skills/ingest-into-data-lake/references/glue-job-scripts.md b/skills/analytics-skills/ingesting-into-data-lake/references/glue-job-scripts.md similarity index 100% rename from skills/analytics-skills/ingest-into-data-lake/references/glue-job-scripts.md rename to skills/analytics-skills/ingesting-into-data-lake/references/glue-job-scripts.md diff --git a/skills/analytics-skills/ingest-into-data-lake/references/iceberg-catalog-config-and-usage.md b/skills/analytics-skills/ingesting-into-data-lake/references/iceberg-catalog-config-and-usage.md similarity index 98% rename from skills/analytics-skills/ingest-into-data-lake/references/iceberg-catalog-config-and-usage.md rename to skills/analytics-skills/ingesting-into-data-lake/references/iceberg-catalog-config-and-usage.md index 0bdc192..a9474f2 100644 --- a/skills/analytics-skills/ingest-into-data-lake/references/iceberg-catalog-config-and-usage.md +++ b/skills/analytics-skills/ingesting-into-data-lake/references/iceberg-catalog-config-and-usage.md @@ -11,7 +11,7 @@ Managed Iceberg tables with automatic compaction, snapshot management, and multi - Table and column names must be lowercase - Requires Glue 5.1 or higher and `--datalake-formats iceberg` job argument - All `spark.sql.catalog.*` config goes in `--conf` job arguments, never in `spark.conf.set()` (Glue 5.x static config restriction) -- Delegate table creation to [create-data-lake-table](../../create-data-lake-table/SKILL.md) +- Delegate table creation to [creating-data-lake-table](../../creating-data-lake-table/SKILL.md) Two access methods exist. Use Analytics Integration when the table needs to be visible to Athena, Redshift, or EMR. Use REST Endpoint when only Glue Spark jobs access the table. diff --git a/skills/analytics-skills/ingest-into-data-lake/references/incremental-loading.md b/skills/analytics-skills/ingesting-into-data-lake/references/incremental-loading.md similarity index 100% rename from skills/analytics-skills/ingest-into-data-lake/references/incremental-loading.md rename to skills/analytics-skills/ingesting-into-data-lake/references/incremental-loading.md diff --git a/skills/analytics-skills/ingest-into-data-lake/references/jdbc-ingest.md b/skills/analytics-skills/ingesting-into-data-lake/references/jdbc-ingest.md similarity index 85% rename from skills/analytics-skills/ingest-into-data-lake/references/jdbc-ingest.md rename to skills/analytics-skills/ingesting-into-data-lake/references/jdbc-ingest.md index 3652602..751a093 100644 --- a/skills/analytics-skills/ingest-into-data-lake/references/jdbc-ingest.md +++ b/skills/analytics-skills/ingesting-into-data-lake/references/jdbc-ingest.md @@ -1,6 +1,6 @@ # JDBC Database Ingest -Move data from a JDBC source (Oracle, SQL Server, PostgreSQL, MySQL, RDS, Aurora, Redshift) into the data lake. Assumes a Glue connection exists. If it doesn't, delegate to the `connect-to-data-source` skill first. +Move data from a JDBC source (Oracle, SQL Server, PostgreSQL, MySQL, RDS, Aurora, Redshift) into the data lake. Assumes a Glue connection exists. If it doesn't, delegate to the `connecting-to-data-source` skill first. ## Contents @@ -12,9 +12,9 @@ Move data from a JDBC source (Oracle, SQL Server, PostgreSQL, MySQL, RDS, Aurora ## Prerequisites -- A tested Glue connection (created via `connect-to-data-source` skill) +- A tested Glue connection (created via `connecting-to-data-source` skill) - Source table name, schema, and optional filter SQL -- Target table (existing or to be created via `create-data-lake-table` skill) +- Target table (existing or to be created via `creating-data-lake-table` skill) - Target format decided (default S3 Tables; see [iceberg-catalog-config-and-usage.md](iceberg-catalog-config-and-usage.md)) ## Workflow @@ -25,7 +25,7 @@ Move data from a JDBC source (Oracle, SQL Server, PostgreSQL, MySQL, RDS, Aurora aws glue get-connection --name --region ``` -If the connection does not exist, stop and delegate to `connect-to-data-source`. +If the connection does not exist, stop and delegate to `connecting-to-data-source`. ### 2. Identify source scope @@ -42,7 +42,7 @@ Ask the user which tables, views, or custom SQL query. See [jdbc-schema-discover ### 4. Create target table if needed -If the target table doesn't exist, delegate to `create-data-lake-table`. Never create it inline. +If the target table doesn't exist, delegate to `creating-data-lake-table`. Never create it inline. ### 5. Build the Glue 5.1 or higher job @@ -99,7 +99,7 @@ Best practices: - Ensure `lowerBound`/`upperBound` cover actual data range - Source database must handle concurrent connections -Retrieve credentials from the connection at runtime rather than hardcoding. See [connect-to-data-source credential-security.md](../../connect-to-data-source/references/credential-security.md) for IAM DB auth and Secrets Manager patterns. +Retrieve credentials from the connection at runtime rather than hardcoding. See [connecting-to-data-source credential-security.md](../../connecting-to-data-source/references/credential-security.md) for IAM DB auth and Secrets Manager patterns. ## Type Mapping @@ -169,6 +169,6 @@ Same as PostgreSQL mappings. Redshift-specific additions: ## Connection Errors -If the Glue job fails with a connection-related error (timeout, auth failure, driver not found, SSL handshake), delegate to `connect-to-data-source` for troubleshooting. Do not attempt network or credential fixes in this skill. +If the Glue job fails with a connection-related error (timeout, auth failure, driver not found, SSL handshake), delegate to `connecting-to-data-source` for troubleshooting. Do not attempt network or credential fixes in this skill. -See [connect-to-data-source troubleshooting.md](../../connect-to-data-source/references/troubleshooting.md). +See [connecting-to-data-source troubleshooting.md](../../connecting-to-data-source/references/troubleshooting.md). diff --git a/skills/analytics-skills/ingest-into-data-lake/references/jdbc-performance.md b/skills/analytics-skills/ingesting-into-data-lake/references/jdbc-performance.md similarity index 100% rename from skills/analytics-skills/ingest-into-data-lake/references/jdbc-performance.md rename to skills/analytics-skills/ingesting-into-data-lake/references/jdbc-performance.md diff --git a/skills/analytics-skills/ingest-into-data-lake/references/jdbc-schema-discovery.md b/skills/analytics-skills/ingesting-into-data-lake/references/jdbc-schema-discovery.md similarity index 100% rename from skills/analytics-skills/ingest-into-data-lake/references/jdbc-schema-discovery.md rename to skills/analytics-skills/ingesting-into-data-lake/references/jdbc-schema-discovery.md diff --git a/skills/analytics-skills/ingest-into-data-lake/references/local-upload.md b/skills/analytics-skills/ingesting-into-data-lake/references/local-upload.md similarity index 100% rename from skills/analytics-skills/ingest-into-data-lake/references/local-upload.md rename to skills/analytics-skills/ingesting-into-data-lake/references/local-upload.md diff --git a/skills/analytics-skills/ingest-into-data-lake/references/migration-troubleshooting.md b/skills/analytics-skills/ingesting-into-data-lake/references/migration-troubleshooting.md similarity index 100% rename from skills/analytics-skills/ingest-into-data-lake/references/migration-troubleshooting.md rename to skills/analytics-skills/ingesting-into-data-lake/references/migration-troubleshooting.md diff --git a/skills/analytics-skills/ingest-into-data-lake/references/migration-validation.md b/skills/analytics-skills/ingesting-into-data-lake/references/migration-validation.md similarity index 100% rename from skills/analytics-skills/ingest-into-data-lake/references/migration-validation.md rename to skills/analytics-skills/ingesting-into-data-lake/references/migration-validation.md diff --git a/skills/analytics-skills/ingest-into-data-lake/references/s3-files.md b/skills/analytics-skills/ingesting-into-data-lake/references/s3-files.md similarity index 90% rename from skills/analytics-skills/ingest-into-data-lake/references/s3-files.md rename to skills/analytics-skills/ingesting-into-data-lake/references/s3-files.md index 0d6be3a..274c176 100644 --- a/skills/analytics-skills/ingest-into-data-lake/references/s3-files.md +++ b/skills/analytics-skills/ingesting-into-data-lake/references/s3-files.md @@ -36,7 +36,7 @@ Schema evolution and nested data: See [schema-evolution.md](schema-evolution.md) ### Phase 3: Set Up or Verify Target Table 1. **Check if table exists** using MCP or CLI -2. **Create table if needed**: Delegate to [create-data-lake-table](../../create-data-lake-table/SKILL.md) for all target types. Pass the target format (S3 Tables, standard Iceberg, or raw files) and schema. See [iceberg-catalog-config-and-usage.md](iceberg-catalog-config-and-usage.md) for target-specific catalog configuration used in the subsequent Glue job. +2. **Create table if needed**: Delegate to [creating-data-lake-table](../../creating-data-lake-table/SKILL.md) for all target types. Pass the target format (S3 Tables, standard Iceberg, or raw files) and schema. See [iceberg-catalog-config-and-usage.md](iceberg-catalog-config-and-usage.md) for target-specific catalog configuration used in the subsequent Glue job. 3. **Evolve schema if needed**: Compare schemas, generate ALTER TABLE ADD COLUMNS, execute via Athena ### Phase 3.5: Verify or Create IAM Role for Glue @@ -45,7 +45,7 @@ Schema evolution and nested data: See [schema-evolution.md](schema-evolution.md) 2. **Verify permissions**: AWSGlueServiceRole managed policy, S3 access, S3 Tables inline policy (if S3 Tables target) 3. **Create role if needed**: Trust policy for `glue.amazonaws.com`, attach policies, capture role ARN -Complete IAM setup: Handled by [create-data-lake-table](../../create-data-lake-table/SKILL.md). +Complete IAM setup: Handled by [creating-data-lake-table](../../creating-data-lake-table/SKILL.md). ### Phase 4: Execute Data Load @@ -103,7 +103,7 @@ Present summary: what was loaded, how to query, any issues, next steps. - S3 Tables requires Glue 5.1 or higher. Standard Iceberg also requires Glue 5.1 or higher for proper Iceberg compatibility. - S3 Tables CREATE TABLE must NOT include a LOCATION clause. Standard Iceberg MUST include one. -- When creating tables for S3 Tables import, use the Spark DDL path (Path B) in create-data-lake-table to ensure the Glue catalog is configured. +- When creating tables for S3 Tables import, use the Spark DDL path (Path B) in creating-data-lake-table to ensure the Glue catalog is configured. - Target-specific catalog configuration and Glue version requirements are defined in [iceberg-catalog-config-and-usage.md](iceberg-catalog-config-and-usage.md). ## References diff --git a/skills/analytics-skills/ingest-into-data-lake/references/schema-evolution.md b/skills/analytics-skills/ingesting-into-data-lake/references/schema-evolution.md similarity index 100% rename from skills/analytics-skills/ingest-into-data-lake/references/schema-evolution.md rename to skills/analytics-skills/ingesting-into-data-lake/references/schema-evolution.md diff --git a/skills/analytics-skills/ingest-into-data-lake/references/snowflake-ingest.md b/skills/analytics-skills/ingesting-into-data-lake/references/snowflake-ingest.md similarity index 97% rename from skills/analytics-skills/ingest-into-data-lake/references/snowflake-ingest.md rename to skills/analytics-skills/ingesting-into-data-lake/references/snowflake-ingest.md index e558ced..dcaa589 100644 --- a/skills/analytics-skills/ingest-into-data-lake/references/snowflake-ingest.md +++ b/skills/analytics-skills/ingesting-into-data-lake/references/snowflake-ingest.md @@ -1,6 +1,6 @@ # Snowflake Ingest -Move data from Snowflake into the data lake. Assumes a Glue `SNOWFLAKE` connection exists. If not, delegate to `connect-to-data-source`. +Move data from Snowflake into the data lake. Assumes a Glue `SNOWFLAKE` connection exists. If not, delegate to `connecting-to-data-source`. ## Contents diff --git a/skills/analytics-skills/ingest-into-data-lake/references/testing-and-scheduling.md b/skills/analytics-skills/ingesting-into-data-lake/references/testing-and-scheduling.md similarity index 100% rename from skills/analytics-skills/ingest-into-data-lake/references/testing-and-scheduling.md rename to skills/analytics-skills/ingesting-into-data-lake/references/testing-and-scheduling.md diff --git a/skills/analytics-skills/ingest-into-data-lake/references/type-transformations.md b/skills/analytics-skills/ingesting-into-data-lake/references/type-transformations.md similarity index 100% rename from skills/analytics-skills/ingest-into-data-lake/references/type-transformations.md rename to skills/analytics-skills/ingesting-into-data-lake/references/type-transformations.md diff --git a/skills/analytics-skills/ingest-into-data-lake/references/upload-options.md b/skills/analytics-skills/ingesting-into-data-lake/references/upload-options.md similarity index 100% rename from skills/analytics-skills/ingest-into-data-lake/references/upload-options.md rename to skills/analytics-skills/ingesting-into-data-lake/references/upload-options.md diff --git a/skills/analytics-skills/query-data-lake/SKILL.md b/skills/analytics-skills/querying-data-lake/SKILL.md similarity index 92% rename from skills/analytics-skills/query-data-lake/SKILL.md rename to skills/analytics-skills/querying-data-lake/SKILL.md index 0711fd6..f3fef31 100644 --- a/skills/analytics-skills/query-data-lake/SKILL.md +++ b/skills/analytics-skills/querying-data-lake/SKILL.md @@ -1,10 +1,10 @@ --- -name: query-data-lake +name: querying-data-lake description: 'Execute and manage Athena SQL queries across default and federated catalogs (Glue, S3 Tables, Redshift). Triggers on phrases like: query data, run SQL, athena query, analyze table, SQL query, workgroup status, profile table, query Redshift - catalog, query S3 Tables. Do NOT use for finding specific data assets (use find-data-lake-assets), - full catalog audits (use exploring-data-catalog), importing data (use ingest-into-data-lake).' + catalog, query S3 Tables. Do NOT use for finding specific data assets (use finding-data-lake-assets), + full catalog audits (use exploring-data-catalog), importing data (use ingesting-into-data-lake).' version: 1 metadata: service: [athena, glue, s3tables, redshift] @@ -20,7 +20,7 @@ Execute SQL queries on Amazon Athena across default and federated catalogs (Glue ## Overview -Executes and manages Athena SQL queries across default and federated catalogs. Selects a workgroup, resolves target assets (delegating fuzzy references to `find-data-lake-assets`), classifies statements for safety, and reports cost and data scanned. Use the AWS MCP server for sandboxed execution and audit logging; the same AWS CLI commands work directly when the MCP server is not available. +Executes and manages Athena SQL queries across default and federated catalogs. Selects a workgroup, resolves target assets (delegating fuzzy references to `finding-data-lake-assets`), classifies statements for safety, and reports cost and data scanned. Use the AWS MCP server for sandboxed execution and audit logging; the same AWS CLI commands work directly when the MCP server is not available. **Constraints for parameter acquisition:** @@ -54,14 +54,14 @@ Check caller identity, list workgroups, auto-select the best one (see [workgroup ### 3. Resolve the Target Asset -If the user refers to a table by name, by business concept ("our quarterly report", "the sales data"), by S3 path, or by catalog without specifying the table, delegate to `find-data-lake-assets` to return the concrete `database.table` (and catalog if non-default). +If the user refers to a table by name, by business concept ("our quarterly report", "the sales data"), by S3 path, or by catalog without specifying the table, delegate to `finding-data-lake-assets` to return the concrete `database.table` (and catalog if non-default). **Constraints:** - You MUST NOT attempt to resolve fuzzy asset references with `athena list-data-catalogs` or by iterating `get-tables` — those miss federated catalogs and waste tokens - You SHOULD skip this step only when the user provides a fully-qualified reference (exact `database.table`) or raw SQL they want executed as-is - You MUST state the resolved asset explicitly before building the query: "Found [table] in [catalog]. Using this for the query." -- You SHOULD default to the default Glue catalog unless the user mentions "federated", "Redshift", "S3 Tables", or `find-data-lake-assets` returns a different catalog +- You SHOULD default to the default Glue catalog unless the user mentions "federated", "Redshift", "S3 Tables", or `finding-data-lake-assets` returns a different catalog ### 4. Discover Schema diff --git a/skills/analytics-skills/query-data-lake/references/query-patterns.md b/skills/analytics-skills/querying-data-lake/references/query-patterns.md similarity index 100% rename from skills/analytics-skills/query-data-lake/references/query-patterns.md rename to skills/analytics-skills/querying-data-lake/references/query-patterns.md diff --git a/skills/analytics-skills/query-data-lake/references/workgroup-selection.md b/skills/analytics-skills/querying-data-lake/references/workgroup-selection.md similarity index 100% rename from skills/analytics-skills/query-data-lake/references/workgroup-selection.md rename to skills/analytics-skills/querying-data-lake/references/workgroup-selection.md diff --git a/skills/storage-skills/storing-and-querying-vectors/SKILL.md b/skills/storage-skills/storing-and-querying-vectors/SKILL.md index 4153528..1908aa2 100644 --- a/skills/storage-skills/storing-and-querying-vectors/SKILL.md +++ b/skills/storage-skills/storing-and-querying-vectors/SKILL.md @@ -1,13 +1,11 @@ --- name: storing-and-querying-vectors -description: > - Store and query vector embeddings using Amazon S3 Vectors, - a cost-effective long-term vector storage service with its own - API namespace (s3vectors). Triggers on: create S3 vector bucket, vector index, - store embeddings, semantic search, RAG vector storage, similarity search, - vector database, migrate from other vector databases. Do NOT use for: querying - tabular data (use query-data-lake), S3 object storage, or - hundreds/thousands of sustained QPS (use OpenSearch). +description: 'Store and query vector embeddings using Amazon S3 Vectors, a cost-effective + long-term vector storage service with its own API namespace (s3vectors). Triggers + on: create S3 vector bucket, vector index, store embeddings, semantic search, RAG + vector storage, similarity search, vector database, migrate from other vector databases. + Do NOT use for: querying tabular data (use querying-data-lake), S3 object storage, + or hundreds/thousands of sustained QPS (use OpenSearch).' version: 1 metadata: service: [s3vectors, bedrock] From 624c4fcedb51e16b9e857282a4e87fba912c33a9 Mon Sep 17 00:00:00 2001 From: Arne Wouters Date: Wed, 6 May 2026 09:03:01 +0200 Subject: [PATCH 4/5] fix: update skill descriptions with multiline string instead of quoted string --- .../skills/connecting-to-data-source/SKILL.md | 19 ++++++++++--------- .../skills/creating-data-lake-table/SKILL.md | 15 ++++++++------- .../skills/exploring-data-catalog/SKILL.md | 11 ++++++----- .../skills/finding-data-lake-assets/SKILL.md | 9 +++++---- .../skills/ingesting-into-data-lake/SKILL.md | 13 +++++++------ .../skills/querying-data-lake/SKILL.md | 11 ++++++----- .../storing-and-querying-vectors/SKILL.md | 13 +++++++------ .../connecting-to-data-source/SKILL.md | 19 ++++++++++--------- .../creating-data-lake-table/SKILL.md | 15 ++++++++------- .../exploring-data-catalog/SKILL.md | 11 ++++++----- .../finding-data-lake-assets/SKILL.md | 9 +++++---- .../ingesting-into-data-lake/SKILL.md | 13 +++++++------ .../querying-data-lake/SKILL.md | 11 ++++++----- .../storing-and-querying-vectors/SKILL.md | 13 +++++++------ 14 files changed, 98 insertions(+), 84 deletions(-) diff --git a/plugins/aws-data-analytics/skills/connecting-to-data-source/SKILL.md b/plugins/aws-data-analytics/skills/connecting-to-data-source/SKILL.md index 767e8c8..2959909 100644 --- a/plugins/aws-data-analytics/skills/connecting-to-data-source/SKILL.md +++ b/plugins/aws-data-analytics/skills/connecting-to-data-source/SKILL.md @@ -1,14 +1,15 @@ --- name: connecting-to-data-source -description: 'Create and troubleshoot AWS Glue connections to JDBC databases (Oracle, - SQL Server, PostgreSQL, MySQL, RDS), Redshift, Snowflake, and BigQuery. Gathers - connection hints from user, discovers existing connections and RDS/Redshift candidates, - registers credentials in Secrets Manager or IAM DB auth, configures VPC, and tests. - Triggers on: connect to database, set up Glue connection, register data source, - connect to Snowflake/BigQuery/RDS, connection timeout, test connection, troubleshoot - connection. Do NOT use for moving data (use ingesting-into-data-lake), creating tables - (use creating-data-lake-table), queries (use querying-data-lake), catalog exploration - (use exploring-data-catalog), or SaaS (Salesforce, ServiceNow, SAP, MongoDB, Kafka).' +description: >- + Create and troubleshoot AWS Glue connections to JDBC databases (Oracle, SQL Server, + PostgreSQL, MySQL, RDS), Redshift, Snowflake, and BigQuery. Gathers connection hints + from user, discovers existing connections and RDS/Redshift candidates, registers + credentials in Secrets Manager or IAM DB auth, configures VPC, and tests. Triggers + on: connect to database, set up Glue connection, register data source, connect to + Snowflake/BigQuery/RDS, connection timeout, test connection, troubleshoot connection. + Do NOT use for moving data (use ingesting-into-data-lake), creating tables (use + creating-data-lake-table), queries (use querying-data-lake), catalog exploration + (use exploring-data-catalog), or SaaS (Salesforce, ServiceNow, SAP, MongoDB, Kafka). version: 1 metadata: service: [glue, secretsmanager, rds, redshift] diff --git a/plugins/aws-data-analytics/skills/creating-data-lake-table/SKILL.md b/plugins/aws-data-analytics/skills/creating-data-lake-table/SKILL.md index 0614550..456ba3e 100644 --- a/plugins/aws-data-analytics/skills/creating-data-lake-table/SKILL.md +++ b/plugins/aws-data-analytics/skills/creating-data-lake-table/SKILL.md @@ -1,13 +1,14 @@ --- name: creating-data-lake-table -description: 'Create managed Iceberg tables using Amazon S3 Tables (s3tables API namespace) - with automatic compaction and snapshot management. Sets up table bucket, namespace, - table, schema, Glue catalog registration, partitioning, IAM access control. Triggers - on: create table, data lake table, analytics table, structured data storage, S3 - Tables, Iceberg, Athena table, partitioning strategy, access permissions. Do NOT - use for: importing files (use ingesting-into-data-lake), vector storage (use storing-and-querying-vectors), +description: >- + Create managed Iceberg tables using Amazon S3 Tables (s3tables API namespace) with + automatic compaction and snapshot management. Sets up table bucket, namespace, table, + schema, Glue catalog registration, partitioning, IAM access control. Triggers on: + create table, data lake table, analytics table, structured data storage, S3 Tables, + Iceberg, Athena table, partitioning strategy, access permissions. Do NOT use for: + importing files (use ingesting-into-data-lake), vector storage (use storing-and-querying-vectors), querying existing tables (use querying-data-lake), or locating existing table (use - finding-data-lake-assets).' + finding-data-lake-assets). version: 1 metadata: service: [s3tables, glue, athena] diff --git a/plugins/aws-data-analytics/skills/exploring-data-catalog/SKILL.md b/plugins/aws-data-analytics/skills/exploring-data-catalog/SKILL.md index 34601cb..b6bc15d 100644 --- a/plugins/aws-data-analytics/skills/exploring-data-catalog/SKILL.md +++ b/plugins/aws-data-analytics/skills/exploring-data-catalog/SKILL.md @@ -1,10 +1,11 @@ --- name: exploring-data-catalog -description: 'Full inventory and audit of AWS Glue Data Catalog assets across S3 Tables, - Redshift-federated, and remote Iceberg catalogs. Triggers on: inventory the catalog, - audit databases, list all tables, catalog overview, data landscape, enumerate catalogs, - data inventory, search the catalog. Do NOT use for finding specific data (use finding-data-lake-assets), - running queries (use querying-data-lake), or creating tables (use creating-data-lake-table).' +description: >- + Full inventory and audit of AWS Glue Data Catalog assets across S3 Tables, Redshift-federated, + and remote Iceberg catalogs. Triggers on: inventory the catalog, audit databases, + list all tables, catalog overview, data landscape, enumerate catalogs, data inventory, + search the catalog. Do NOT use for finding specific data (use finding-data-lake-assets), + running queries (use querying-data-lake), or creating tables (use creating-data-lake-table). version: 1 metadata: service: [glue, s3, s3tables] diff --git a/plugins/aws-data-analytics/skills/finding-data-lake-assets/SKILL.md b/plugins/aws-data-analytics/skills/finding-data-lake-assets/SKILL.md index 062d2a7..b712040 100644 --- a/plugins/aws-data-analytics/skills/finding-data-lake-assets/SKILL.md +++ b/plugins/aws-data-analytics/skills/finding-data-lake-assets/SKILL.md @@ -1,11 +1,12 @@ --- name: finding-data-lake-assets -description: 'Resolve data lake and lakehouse asset references across Glue Data Catalog, - S3, S3 Tables, and Redshift. Triggers on: find the table, where is our data, which - table has, locate dataset, find data for, search catalog, what tables match, Redshift +description: >- + Resolve data lake and lakehouse asset references across Glue Data Catalog, S3, S3 + Tables, and Redshift. Triggers on: find the table, where is our data, which table + has, locate dataset, find data for, search catalog, what tables match, Redshift table, lakehouse table, data lake table, warehouse table, reverse lookup S3 path. Do NOT use for: full catalog audits (use exploring-data-catalog), running queries - (use querying-data-lake), creating tables (use creating-data-lake-table).' + (use querying-data-lake), creating tables (use creating-data-lake-table). version: 1 metadata: service: [glue, s3, s3tables, redshift] diff --git a/plugins/aws-data-analytics/skills/ingesting-into-data-lake/SKILL.md b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/SKILL.md index de16d30..ff6feea 100644 --- a/plugins/aws-data-analytics/skills/ingesting-into-data-lake/SKILL.md +++ b/plugins/aws-data-analytics/skills/ingesting-into-data-lake/SKILL.md @@ -1,17 +1,18 @@ --- name: ingesting-into-data-lake -description: 'Import data into the AWS data lake from S3 files, local uploads, JDBC - databases (Oracle, SQL Server, PostgreSQL, MySQL, RDS, Aurora), Amazon Redshift, - Snowflake, BigQuery, DynamoDB, or existing Glue catalog tables (migration). Default - target is S3 Tables; standard Iceberg on a general purpose bucket is supported where - S3 Tables is not adopted. Handles one-time loads, recurring pipelines, migrations. +description: >- + Import data into the AWS data lake from S3 files, local uploads, JDBC databases + (Oracle, SQL Server, PostgreSQL, MySQL, RDS, Aurora), Amazon Redshift, Snowflake, + BigQuery, DynamoDB, or existing Glue catalog tables (migration). Default target + is S3 Tables; standard Iceberg on a general purpose bucket is supported where S3 + Tables is not adopted. Handles one-time loads, recurring pipelines, migrations. Triggers on: import data, load data, ingest, sync database, migrate table, move data to AWS, set up pipeline, ETL, pull from Snowflake, query BigQuery into S3, export DynamoDB, CTAS, convert to Iceberg. Do NOT use for setting up or troubleshooting Glue connections (use connecting-to-data-source), creating empty tables (use creating-data-lake-table), running queries (use querying-data-lake), finding tables by fuzzy name (use finding-data-lake-assets), catalog audit (use exploring-data-catalog), or SaaS platforms like Salesforce, ServiceNow, - SAP, MongoDB, Kafka.' + SAP, MongoDB, Kafka. version: 1 metadata: service: [glue, s3, s3tables, athena, dynamodb] diff --git a/plugins/aws-data-analytics/skills/querying-data-lake/SKILL.md b/plugins/aws-data-analytics/skills/querying-data-lake/SKILL.md index f3fef31..dae8701 100644 --- a/plugins/aws-data-analytics/skills/querying-data-lake/SKILL.md +++ b/plugins/aws-data-analytics/skills/querying-data-lake/SKILL.md @@ -1,10 +1,11 @@ --- name: querying-data-lake -description: 'Execute and manage Athena SQL queries across default and federated catalogs - (Glue, S3 Tables, Redshift). Triggers on phrases like: query data, run SQL, athena - query, analyze table, SQL query, workgroup status, profile table, query Redshift - catalog, query S3 Tables. Do NOT use for finding specific data assets (use finding-data-lake-assets), - full catalog audits (use exploring-data-catalog), importing data (use ingesting-into-data-lake).' +description: >- + Execute and manage Athena SQL queries across default and federated catalogs (Glue, + S3 Tables, Redshift). Triggers on phrases like: query data, run SQL, athena query, + analyze table, SQL query, workgroup status, profile table, query Redshift catalog, + query S3 Tables. Do NOT use for finding specific data assets (use finding-data-lake-assets), + full catalog audits (use exploring-data-catalog), importing data (use ingesting-into-data-lake). version: 1 metadata: service: [athena, glue, s3tables, redshift] diff --git a/plugins/aws-data-analytics/skills/storing-and-querying-vectors/SKILL.md b/plugins/aws-data-analytics/skills/storing-and-querying-vectors/SKILL.md index 1908aa2..048f2f7 100644 --- a/plugins/aws-data-analytics/skills/storing-and-querying-vectors/SKILL.md +++ b/plugins/aws-data-analytics/skills/storing-and-querying-vectors/SKILL.md @@ -1,11 +1,12 @@ --- name: storing-and-querying-vectors -description: 'Store and query vector embeddings using Amazon S3 Vectors, a cost-effective - long-term vector storage service with its own API namespace (s3vectors). Triggers - on: create S3 vector bucket, vector index, store embeddings, semantic search, RAG - vector storage, similarity search, vector database, migrate from other vector databases. - Do NOT use for: querying tabular data (use querying-data-lake), S3 object storage, - or hundreds/thousands of sustained QPS (use OpenSearch).' +description: >- + Store and query vector embeddings using Amazon S3 Vectors, a cost-effective long-term + vector storage service with its own API namespace (s3vectors). Triggers on: create + S3 vector bucket, vector index, store embeddings, semantic search, RAG vector storage, + similarity search, vector database, migrate from other vector databases. Do NOT + use for: querying tabular data (use querying-data-lake), S3 object storage, or hundreds/thousands + of sustained QPS (use OpenSearch). version: 1 metadata: service: [s3vectors, bedrock] diff --git a/skills/analytics-skills/connecting-to-data-source/SKILL.md b/skills/analytics-skills/connecting-to-data-source/SKILL.md index 767e8c8..2959909 100644 --- a/skills/analytics-skills/connecting-to-data-source/SKILL.md +++ b/skills/analytics-skills/connecting-to-data-source/SKILL.md @@ -1,14 +1,15 @@ --- name: connecting-to-data-source -description: 'Create and troubleshoot AWS Glue connections to JDBC databases (Oracle, - SQL Server, PostgreSQL, MySQL, RDS), Redshift, Snowflake, and BigQuery. Gathers - connection hints from user, discovers existing connections and RDS/Redshift candidates, - registers credentials in Secrets Manager or IAM DB auth, configures VPC, and tests. - Triggers on: connect to database, set up Glue connection, register data source, - connect to Snowflake/BigQuery/RDS, connection timeout, test connection, troubleshoot - connection. Do NOT use for moving data (use ingesting-into-data-lake), creating tables - (use creating-data-lake-table), queries (use querying-data-lake), catalog exploration - (use exploring-data-catalog), or SaaS (Salesforce, ServiceNow, SAP, MongoDB, Kafka).' +description: >- + Create and troubleshoot AWS Glue connections to JDBC databases (Oracle, SQL Server, + PostgreSQL, MySQL, RDS), Redshift, Snowflake, and BigQuery. Gathers connection hints + from user, discovers existing connections and RDS/Redshift candidates, registers + credentials in Secrets Manager or IAM DB auth, configures VPC, and tests. Triggers + on: connect to database, set up Glue connection, register data source, connect to + Snowflake/BigQuery/RDS, connection timeout, test connection, troubleshoot connection. + Do NOT use for moving data (use ingesting-into-data-lake), creating tables (use + creating-data-lake-table), queries (use querying-data-lake), catalog exploration + (use exploring-data-catalog), or SaaS (Salesforce, ServiceNow, SAP, MongoDB, Kafka). version: 1 metadata: service: [glue, secretsmanager, rds, redshift] diff --git a/skills/analytics-skills/creating-data-lake-table/SKILL.md b/skills/analytics-skills/creating-data-lake-table/SKILL.md index 0614550..456ba3e 100644 --- a/skills/analytics-skills/creating-data-lake-table/SKILL.md +++ b/skills/analytics-skills/creating-data-lake-table/SKILL.md @@ -1,13 +1,14 @@ --- name: creating-data-lake-table -description: 'Create managed Iceberg tables using Amazon S3 Tables (s3tables API namespace) - with automatic compaction and snapshot management. Sets up table bucket, namespace, - table, schema, Glue catalog registration, partitioning, IAM access control. Triggers - on: create table, data lake table, analytics table, structured data storage, S3 - Tables, Iceberg, Athena table, partitioning strategy, access permissions. Do NOT - use for: importing files (use ingesting-into-data-lake), vector storage (use storing-and-querying-vectors), +description: >- + Create managed Iceberg tables using Amazon S3 Tables (s3tables API namespace) with + automatic compaction and snapshot management. Sets up table bucket, namespace, table, + schema, Glue catalog registration, partitioning, IAM access control. Triggers on: + create table, data lake table, analytics table, structured data storage, S3 Tables, + Iceberg, Athena table, partitioning strategy, access permissions. Do NOT use for: + importing files (use ingesting-into-data-lake), vector storage (use storing-and-querying-vectors), querying existing tables (use querying-data-lake), or locating existing table (use - finding-data-lake-assets).' + finding-data-lake-assets). version: 1 metadata: service: [s3tables, glue, athena] diff --git a/skills/analytics-skills/exploring-data-catalog/SKILL.md b/skills/analytics-skills/exploring-data-catalog/SKILL.md index 34601cb..b6bc15d 100644 --- a/skills/analytics-skills/exploring-data-catalog/SKILL.md +++ b/skills/analytics-skills/exploring-data-catalog/SKILL.md @@ -1,10 +1,11 @@ --- name: exploring-data-catalog -description: 'Full inventory and audit of AWS Glue Data Catalog assets across S3 Tables, - Redshift-federated, and remote Iceberg catalogs. Triggers on: inventory the catalog, - audit databases, list all tables, catalog overview, data landscape, enumerate catalogs, - data inventory, search the catalog. Do NOT use for finding specific data (use finding-data-lake-assets), - running queries (use querying-data-lake), or creating tables (use creating-data-lake-table).' +description: >- + Full inventory and audit of AWS Glue Data Catalog assets across S3 Tables, Redshift-federated, + and remote Iceberg catalogs. Triggers on: inventory the catalog, audit databases, + list all tables, catalog overview, data landscape, enumerate catalogs, data inventory, + search the catalog. Do NOT use for finding specific data (use finding-data-lake-assets), + running queries (use querying-data-lake), or creating tables (use creating-data-lake-table). version: 1 metadata: service: [glue, s3, s3tables] diff --git a/skills/analytics-skills/finding-data-lake-assets/SKILL.md b/skills/analytics-skills/finding-data-lake-assets/SKILL.md index 062d2a7..b712040 100644 --- a/skills/analytics-skills/finding-data-lake-assets/SKILL.md +++ b/skills/analytics-skills/finding-data-lake-assets/SKILL.md @@ -1,11 +1,12 @@ --- name: finding-data-lake-assets -description: 'Resolve data lake and lakehouse asset references across Glue Data Catalog, - S3, S3 Tables, and Redshift. Triggers on: find the table, where is our data, which - table has, locate dataset, find data for, search catalog, what tables match, Redshift +description: >- + Resolve data lake and lakehouse asset references across Glue Data Catalog, S3, S3 + Tables, and Redshift. Triggers on: find the table, where is our data, which table + has, locate dataset, find data for, search catalog, what tables match, Redshift table, lakehouse table, data lake table, warehouse table, reverse lookup S3 path. Do NOT use for: full catalog audits (use exploring-data-catalog), running queries - (use querying-data-lake), creating tables (use creating-data-lake-table).' + (use querying-data-lake), creating tables (use creating-data-lake-table). version: 1 metadata: service: [glue, s3, s3tables, redshift] diff --git a/skills/analytics-skills/ingesting-into-data-lake/SKILL.md b/skills/analytics-skills/ingesting-into-data-lake/SKILL.md index de16d30..ff6feea 100644 --- a/skills/analytics-skills/ingesting-into-data-lake/SKILL.md +++ b/skills/analytics-skills/ingesting-into-data-lake/SKILL.md @@ -1,17 +1,18 @@ --- name: ingesting-into-data-lake -description: 'Import data into the AWS data lake from S3 files, local uploads, JDBC - databases (Oracle, SQL Server, PostgreSQL, MySQL, RDS, Aurora), Amazon Redshift, - Snowflake, BigQuery, DynamoDB, or existing Glue catalog tables (migration). Default - target is S3 Tables; standard Iceberg on a general purpose bucket is supported where - S3 Tables is not adopted. Handles one-time loads, recurring pipelines, migrations. +description: >- + Import data into the AWS data lake from S3 files, local uploads, JDBC databases + (Oracle, SQL Server, PostgreSQL, MySQL, RDS, Aurora), Amazon Redshift, Snowflake, + BigQuery, DynamoDB, or existing Glue catalog tables (migration). Default target + is S3 Tables; standard Iceberg on a general purpose bucket is supported where S3 + Tables is not adopted. Handles one-time loads, recurring pipelines, migrations. Triggers on: import data, load data, ingest, sync database, migrate table, move data to AWS, set up pipeline, ETL, pull from Snowflake, query BigQuery into S3, export DynamoDB, CTAS, convert to Iceberg. Do NOT use for setting up or troubleshooting Glue connections (use connecting-to-data-source), creating empty tables (use creating-data-lake-table), running queries (use querying-data-lake), finding tables by fuzzy name (use finding-data-lake-assets), catalog audit (use exploring-data-catalog), or SaaS platforms like Salesforce, ServiceNow, - SAP, MongoDB, Kafka.' + SAP, MongoDB, Kafka. version: 1 metadata: service: [glue, s3, s3tables, athena, dynamodb] diff --git a/skills/analytics-skills/querying-data-lake/SKILL.md b/skills/analytics-skills/querying-data-lake/SKILL.md index f3fef31..dae8701 100644 --- a/skills/analytics-skills/querying-data-lake/SKILL.md +++ b/skills/analytics-skills/querying-data-lake/SKILL.md @@ -1,10 +1,11 @@ --- name: querying-data-lake -description: 'Execute and manage Athena SQL queries across default and federated catalogs - (Glue, S3 Tables, Redshift). Triggers on phrases like: query data, run SQL, athena - query, analyze table, SQL query, workgroup status, profile table, query Redshift - catalog, query S3 Tables. Do NOT use for finding specific data assets (use finding-data-lake-assets), - full catalog audits (use exploring-data-catalog), importing data (use ingesting-into-data-lake).' +description: >- + Execute and manage Athena SQL queries across default and federated catalogs (Glue, + S3 Tables, Redshift). Triggers on phrases like: query data, run SQL, athena query, + analyze table, SQL query, workgroup status, profile table, query Redshift catalog, + query S3 Tables. Do NOT use for finding specific data assets (use finding-data-lake-assets), + full catalog audits (use exploring-data-catalog), importing data (use ingesting-into-data-lake). version: 1 metadata: service: [athena, glue, s3tables, redshift] diff --git a/skills/storage-skills/storing-and-querying-vectors/SKILL.md b/skills/storage-skills/storing-and-querying-vectors/SKILL.md index 1908aa2..048f2f7 100644 --- a/skills/storage-skills/storing-and-querying-vectors/SKILL.md +++ b/skills/storage-skills/storing-and-querying-vectors/SKILL.md @@ -1,11 +1,12 @@ --- name: storing-and-querying-vectors -description: 'Store and query vector embeddings using Amazon S3 Vectors, a cost-effective - long-term vector storage service with its own API namespace (s3vectors). Triggers - on: create S3 vector bucket, vector index, store embeddings, semantic search, RAG - vector storage, similarity search, vector database, migrate from other vector databases. - Do NOT use for: querying tabular data (use querying-data-lake), S3 object storage, - or hundreds/thousands of sustained QPS (use OpenSearch).' +description: >- + Store and query vector embeddings using Amazon S3 Vectors, a cost-effective long-term + vector storage service with its own API namespace (s3vectors). Triggers on: create + S3 vector bucket, vector index, store embeddings, semantic search, RAG vector storage, + similarity search, vector database, migrate from other vector databases. Do NOT + use for: querying tabular data (use querying-data-lake), S3 object storage, or hundreds/thousands + of sustained QPS (use OpenSearch). version: 1 metadata: service: [s3vectors, bedrock] From 5e7c2eab2ddefb202ccee022aa54daafa0a0f9ee Mon Sep 17 00:00:00 2001 From: Arne Wouters Date: Wed, 6 May 2026 09:07:34 +0200 Subject: [PATCH 5/5] chore: rename messaging skill --- .../SKILL.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) rename skills/application-integration-skills/{messaging-and-streaming => aws-messaging-and-streaming}/SKILL.md (99%) diff --git a/skills/application-integration-skills/messaging-and-streaming/SKILL.md b/skills/application-integration-skills/aws-messaging-and-streaming/SKILL.md similarity index 99% rename from skills/application-integration-skills/messaging-and-streaming/SKILL.md rename to skills/application-integration-skills/aws-messaging-and-streaming/SKILL.md index d53ee77..c9c3169 100644 --- a/skills/application-integration-skills/messaging-and-streaming/SKILL.md +++ b/skills/application-integration-skills/aws-messaging-and-streaming/SKILL.md @@ -1,5 +1,5 @@ --- -name: messaging-and-streaming +name: aws-messaging-and-streaming description: > Guides use of AWS messaging and streaming services. Covers Amazon SQS, Amazon SNS, Amazon EventBridge, Amazon MQ, Amazon Kinesis Data Streams,