feat: Add custom S3 endpoint support via URL query parameters

[corylanou]

Summary

This PR adds support for custom S3-compatible storage endpoints directly from the command line using URL query parameters. This allows users to replicate to services like MinIO, Tigris, Wasabi, and other S3-compatible storage providers without needing a configuration file.

Fixes #219

Changes

• Added ParseReplicaURLWithQuery() function to parse query parameters from S3 URLs
• Modified NewS3ReplicaClientFromConfig() to handle query parameters:
  • endpoint - Custom S3-compatible endpoint
  • region - AWS region
  • forcePathStyle - Path-style vs virtual-hosted-style addressing
  • skipVerify - TLS certificate verification
• Auto-prepend http:// to endpoints without a scheme
• Added AWS S3 regex pattern for proper bucket name parsing
• Added MinIO integration test to CI workflow

Query Parameters

Parameter	Description	Default
endpoint	Custom S3-compatible endpoint URL	-
region	AWS region	us-east-1 for custom endpoints
forcePathStyle	Use path-style addressing	true for custom endpoints
skipVerify	Skip TLS certificate verification	false

Examples

# MinIO
litestream replicate /path/to/db.sqlite \
  "s3://mybucket/db?endpoint=localhost:9000&forcePathStyle=true"

# Tigris (Fly.io)
litestream replicate /path/to/db.sqlite \
  "s3://my-tigris-bucket/db?endpoint=fly.storage.tigris.dev&region=auto"

# Restore from MinIO
litestream restore -o restored.db \
  "s3://mybucket/db?endpoint=localhost:9000"

# Standard AWS S3 (unchanged)
litestream replicate /path/to/db.sqlite s3://mybucket/db

Testing

• ✅ Unit tests added for URL parsing with query parameters
• ✅ Unit tests added for S3 client configuration
• ✅ Integration tested locally with real MinIO instance
• ✅ MinIO integration test added to CI workflow
• ✅ All existing tests pass (backward compatibility maintained)

Test plan

• Run unit tests: go test ./cmd/litestream ./s3
• Test with local MinIO container
• Verify restore functionality works
• Ensure backward compatibility with existing S3 URLs
• Test with actual Tigris deployment (requires account)
• Test with other S3-compatible providers

🤖 Generated with Claude Code

[github-actions]

✅ Manual integration tests have been run by @corylanou

View test results