aws-backend: add support for running instances on multiple subnets

[timbrown5]

Update the AWS backend (and instance config) to add the ability to run instance on a set of subnets (and
so availability zone).

The main use-case for this is to allow instance to come up in multiple availability zones. A user would create one (or more) subnets in an availability zone and the list the subnets in the subnet_configs section. This has two main advantages:

• There is some crude load balancing (subnets are picked at random from the list)
• If an instance fails to start we can retry in another subnet. This will help in cases where an AZ has been starved of all the instance and instance not longer start.

To support this (without breaking existing configs) I added a new subnet_configs section to the instance config. This is mutually exclusive to the existing subnet_id section.
If subnet_configs is set, then the backend will choose one of the subnets at random and try to bring up the instance there. If this fails. then another subnet will be tried, until one works. If none of the subnets work, an the exception will be re-raised.

[timbrown5]

Note: I use aws SSO profiles for auth, so needed to add a check for the AWS_PROFILE env var to be able to run the tests.

[codecov]

Codecov Report

Attention: Patch coverage is 19.14894% with 38 lines in your changes missing coverage. Please review.

Project coverage is 84.80%. Comparing base (8969d71) to head (3f60dbf).

Files with missing lines	Patch %	Lines
runner_manager/backend/aws.py	11.62%	38 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #700      +/-   ##
==========================================
- Coverage   86.68%   84.80%   -1.88%     
==========================================
  Files          35       35              
  Lines        1510     1547      +37     
==========================================
+ Hits         1309     1312       +3     
- Misses        201      235      +34     

Flag	Coverage Δ
api	62.76% <19.14%> (-1.15%)	⬇️
unit	66.96% <19.14%> (-1.45%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[tcarmet]

Hey @timbrown5 ! Thank you for the contribution!

Haven't got the time to review it properly yet, but will do soon, in the meantime, don't worry about codecov complaining, we don't execute those tests in the CI, but do check the linting issues reported (should be easily fixed with a trunk fmt if you have trunk installed).

Cheers!

[tcarmet]

just a small change request, and let's merge it.

Thanks again

[tcarmet]

Use log

Suggested change

	print(f"Order: {order}")
	log.debug(f"Order: {order}")