I need to simulate 43 million session calls per minute

[summersjc]

Describe the feature you'd like
Need a more scalable solution to enable much higher throughput when Simulating our Identity management system and requests going to our session servers. Is there a way to create this kind of load with this current system? The traffic sent also needs to be able to verify sub millisecond response time accuracy since we are dealing with Elasticache responses.

Additional context
Are there plans to revamp the current architecture? Or create an alternative similar solution?

[gockle]

The solution currently has the following options to scale,

1. Task Count can be set upto the limit allowed in the aws account which is by default 2000. The task count is per region so the solution can be used to use multiple regions to simulate user interactions.
2. Concurrency value is recommended to be set to 200 virtual users, refer the implementation guide for more details. To increase virtual users or concurrency you can choose to update the task definition with higher vCPU and memory (but this should be done after cost considerations).
3. The value of concurrency is selected based on benchmarks for the 2vCPU and 4GB memory (which is the default when the solution is created in the task definition).
4. If a simple test is created by selecting the option Simple HTTP Endpoint. The test sceanrio is used to be run on blazemeter which uses jmeter to run the test.
5. The solution currently runs the test until the hold for time period expires, i.e each virtual user (concurrency value) makes multiple requests to the api endpoint, the number of api endpoint calls in a time period depends on the response from the api call.
6. Recommend to review the jmeter documentation for authoring a test sceanrio which can run tests in concurrent thread groups.

I would recommend to try to run a few tests and monitor the number of api calls or total count of api calls are being made. Currently there are no plans to expand/modify the current architecture, please review the documentation for load test tools alternatives here.