Ok, tested with a simple Fargate-based ECS service around a container that produces random json logs and it worked ok with both scalyr/fluentd:0.8.18 and scalyr/fluentd:0.9.0

Here's the complete task definition for the scalyr/fluentd:0.9.0 test:

{
    "taskDefinitionArn": "<task>",
    "containerDefinitions": [
        {
            "name": "scalyr-fluentd",
            "image": "scalyr/fluentd:0.9.0",
            "cpu": 0,
            "portMappings": [
                {
                    "name": "scalyr-fluentd-80-tcp",
                    "containerPort": 80,
                    "hostPort": 80,
                    "protocol": "tcp",
                    "appProtocol": "http"
                }
            ],
            "essential": true,
            "environment": [],
            "mountPoints": [],
            "volumesFrom": [],
            "user": "0",
            "logConfiguration": {
                "logDriver": "awslogs",
                "options": {
                    "awslogs-group": "/ecs/jmakar-scalyr-fluentd-0_9_0",
                    "mode": "non-blocking",
                    "awslogs-create-group": "true",
                    "max-buffer-size": "25m",
                    "awslogs-region": "<region>",
                    "awslogs-stream-prefix": "ecs"
                }
            },
            "systemControls": [],
            "firelensConfiguration": {
                "type": "fluentd",
                "options": {
                    "enable-ecs-log-metadata": "true"
                }
            }
        },
        {
            "name": "random-json-logger",
            "image": "sikwan/random-json-logger:latest",
            "cpu": 0,
            "portMappings": [],
            "essential": true,
            "environment": [],
            "mountPoints": [],
            "volumesFrom": [],
            "logConfiguration": {
                "logDriver": "awsfirelens",
                "options": {
                    "@type": "scalyr",
                    "api_write_token": "<api-write-token>",
                    "message_field": "log"
                }
            },
            "systemControls": []
        }
    ],
    "family": "jmakar-scalyr-fluentd-0_9_0",
    "executionRoleArn": "<role>",
    "networkMode": "awsvpc",
    "revision": 2,
    "volumes": [],
    "status": "ACTIVE",
    "requiresAttributes": [
        {
            "name": "com.amazonaws.ecs.capability.logging-driver.awslogs"
        },
        {
            "name": "ecs.capability.execution-role-awslogs"
        },
        {
            "name": "com.amazonaws.ecs.capability.docker-remote-api.1.19"
        },
        {
            "name": "com.amazonaws.ecs.capability.docker-remote-api.1.28"
        },
        {
            "name": "com.amazonaws.ecs.capability.logging-driver.awsfirelens"
        },
        {
            "name": "ecs.capability.firelens.fluentd"
        },
        {
            "name": "com.amazonaws.ecs.capability.docker-remote-api.1.18"
        },
        {
            "name": "ecs.capability.task-eni"
        },
        {
            "name": "com.amazonaws.ecs.capability.docker-remote-api.1.29"
        }
    ],
    "placementConstraints": [],
    "compatibilities": [
        "EC2",
        "FARGATE"
    ],
    "requiresCompatibilities": [
        "FARGATE"
    ],
    "cpu": "1024",
    "memory": "3072",
    "runtimePlatform": {
        "cpuArchitecture": "X86_64",
        "operatingSystemFamily": "LINUX"
    },
    "registeredAt": "2025-06-03T21:13:57.859Z",
    "registeredBy": "<user>",
    "enableFaultInjection": false,
    "tags": []
}

Note that most of this is set by default (I didn't bother removing the unneeded portMappings section for example), the only sections I had to add were the firelensConfiguration section of the scalyr-fluentd container and the logConfiguration section of the random-json-logger container.

Does this help? I don't mind reviewing your task definition, which you can send via email if preferable (available in my Github profile)

High CPU usage with 0.8.18 #47

Description

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions