Skip to content

Latest commit

 

History

History
328 lines (307 loc) · 16.9 KB

performance-aws-instances.md

File metadata and controls

328 lines (307 loc) · 16.9 KB
layout title description postgres-only-1000 postgres-only-1000-arm postgres-only-x3-stress postgres-only-x10-stress postgres-only-6000 postgres-kafka-5000 postgres-kafka-5000-long-running postgres-kafka-x3-stress postgres-kafka-x3-stress-back-to-x1 cassandra-25k-10k-30k cassandra-25k-10k-30k-disk cassandra-25k-10k-30k-jmx cassandra-100k-5k-15k cassandra-100k-10k-30k cassandra-100k-10k-30k-24h thingsboard-100k-devices-connected postgres-kafka-disk-usage cassandra-disk-usage
docwithnav
ThingsBoard Performance on different AWS instances
ThingsBoard Performance on different AWS instances results
0 1 2 3 4 5 6
image title
/images/reference/performance-aws-instances/method/t3-medium/postgres/queue-stats.png
Thingsboard queue stats
image title
/images/reference/performance-aws-instances/method/t3-medium/postgres/api-usage.png
Thingsboard API usage
image title
/images/reference/performance-aws-instances/method/t3-medium/postgres/htop.png
htop
image title
/images/reference/performance-aws-instances/method/t3-medium/postgres/jmx-visualvm-monitoring.png
JMX VisualVM monitoring
image title
/images/reference/performance-aws-instances/method/t3-medium/postgres/postgresql-pgadmin-dashboard.png
Postgresql PgAdmin dashboard
image title
/images/reference/performance-aws-instances/method/t3-medium/postgres/aws-instance-monitoring.png
AWS instance monitoring
image title
/images/reference/performance-aws-instances/method/t3-medium/postgres/aws-storage-monitoring.png
AWS storage monitoring
0 1 2 3 4 5 6
image title
/images/reference/performance-aws-instances/method/arm/t4g-medium/postgres/queue-stats.png
Thingsboard queue stats on ARM architecture
image title
/images/reference/performance-aws-instances/method/arm/t4g-medium/postgres/api-usage.png
Thingsboard API usage on ARM architecture
image title
/images/reference/performance-aws-instances/method/arm/t4g-medium/postgres/htop.png
htop on ARM architecture
image title
/images/reference/performance-aws-instances/method/arm/t4g-medium/postgres/jmx-visualvm-monitoring.png
JMX VisualVM monitoring on ARM architecture
image title
/images/reference/performance-aws-instances/method/arm/t4g-medium/postgres/postgresql-pgadmin-dashboard.png
Postgresql PgAdmin dashboard on ARM architecture
image title
/images/reference/performance-aws-instances/method/arm/t4g-medium/postgres/aws-instance-monitoring.png
AWS instance monitoring on ARM architecture
image title
/images/reference/performance-aws-instances/method/arm/t4g-medium/postgres/aws-storage-monitoring.png
AWS storage monitoring on ARM architecture
0 1 2 3 4 5 6
image title
/images/reference/performance-aws-instances/method/t3-medium/burst-x3/burst-x3-queue-stats.png
Thingsboard queue stats
image title
/images/reference/performance-aws-instances/method/t3-medium/burst-x3/burst-x3-api-usage.png
Thingsboard API usage
image title
/images/reference/performance-aws-instances/method/t3-medium/burst-x3/burst-x3-htop.png
htop
image title
/images/reference/performance-aws-instances/method/t3-medium/burst-x3/burst-x3-jmx-visualvm-monitoring.png
JMX VisualVM monitoring
image title
/images/reference/performance-aws-instances/method/t3-medium/burst-x3/burst-x3-postgresql-pgadmin-dashboard.png
Postgresql PgAdmin dashboard
image title
/images/reference/performance-aws-instances/method/t3-medium/burst-x3/burst-x3-aws-instance-monitoring.png
AWS instance monitoring
image title
/images/reference/performance-aws-instances/method/t3-medium/burst-x3/burst-x3-aws-storage-monitoring.png
AWS storage monitoring
0 1 2 3 4 5 6 7
image title
/images/reference/performance-aws-instances/method/t3-medium/flood-x10/beginning-htop.png
100% CPU load at the beginning x10 stress test
image title
/images/reference/performance-aws-instances/method/t3-medium/flood-x10/beginning-queue-stats.png
Queue stats - performance degrade
image title
/images/reference/performance-aws-instances/method/t3-medium/flood-x10/beginning-jmx-visualvm-monitoring.png
Heap memory used is constantly growing on the JMX monitor
image title
/images/reference/performance-aws-instances/method/t3-medium/flood-x10/queue-stats.png
Queue stats drop to zero and do not respond anymore
image title
/images/reference/performance-aws-instances/method/t3-medium/flood-x10/htop.png
CPU is still 100% load, but mainly spending on the garbage collector
image title
/images/reference/performance-aws-instances/method/t3-medium/flood-x10/jmx-visualvm-monitoring.png
JMX VusialVM monitoring on system dying due to out of memory
image title
/images/reference/performance-aws-instances/method/t3-medium/flood-x10/out-of-memory.png
Out of memory log message
image title
/images/reference/performance-aws-instances/method/t3-medium/flood-x10/aws-instance-monitoring.png
AWS instance monitoring during the x10 stress test
0 1 2 3 4 5 6 7
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres/thingsboard-aws-m6a-large-queue-stats-dashboard.png
Queue stats dashboard
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres/thingsboard-aws-m6a-large-api-usage-dashboard.png
Thingsboard API usage dashboard
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres/thingsboard-aws-m6a-large-htop-cpu-memory-io-monitoring.png
htop: CPU, memory, IO read/write
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres/thingsboard-aws-m6a-large-jmx-visualvm-monitoring.png
Java CPU and heap monitoring with JMX VisualVM
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres/thingsboard-aws-m6a-large-postgresql-pgadmin-dashboard.png
Postgres PgAdmin dashboard
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres/thingsboard-aws-m6a-large-cpu-network-monitoring.png
AWS CPU and network monitoring
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres/thingsboard-aws-m6a-large-disk-monitoring.png
AWS storage monitoring
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres/thingsboard-aws-m6a-large-disk-type.png
Storage type GP3, 3000 IOPS, 125 MB/s
0 1 2 3 4 5 6
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/queue-stats.png
Thingsboard queue stats
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/api-usage.png
Thingsboard API usage
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/htop.png
htop
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/jmx-visualvm-monitoring.png
JMX VisualVM monitoring
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/postgresql-pgadmin-dashboard.png
Postgresql PgAdmin dashboard
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/aws-instance-monitoring.png
AWS instance monitoring
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/aws-storage-monitoring.png
AWS storage monitoring
0 1 2
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/long-running/queue-stats-long-running.png
Thingsboard queue stats
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/long-running/api-usage-long-running.png
Thingsboard API usage
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/long-running/jmx-visualvm-monitoring-long-running.png
JMX VisualVM monitoring
0 1 2 3 4
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/stress-x3/htop-stress-x3.png
100% CPU utilization. The system is overloaded
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/stress-x3/queue-stats-stress-x3.png
Thingsboard queue stats under x3 stress test
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/stress-x3/jmx-visualvm-monitoring-long-running-stress-x3.png
Java machine feels good. Heap memory has enough space to operate
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/stress-x3/kafka-producer-jmx-mbean-stress-x3.png
Kafka producer state with JMX MBean
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/stress-x3/kafka-lag-stress-x3.png
Kafka Lag is building up
0 1 2
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/stress-x3/queue-stats--x1--stress-x3--x1.png
Rule engine stats for x1, x3, and back to x1 loads
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/stress-x3/api-usage--x1--stress-x3--x1.png
Here are the API usage stats that shows the transport rate (incoming messages and data points) and the rule engine performance
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/stress-x3/kafka-lag-stress-x3-after.png
Kafka lag is going down
0 1 2 3 4 5
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/25k-10k-30k/queue-stats.png
Queue stats dashboard
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/25k-10k-30k/api-usage.png
Thingsboard API usage dashboard
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/25k-10k-30k/htop.png
htop: CPU, memory, IO read/write
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/25k-10k-30k/postgresql-pgadmin-dashboard.png
Postgres PgAdmin dashboard
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/25k-10k-30k/aws-instance-monitoring.png
AWS CPU and network monitoring
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/25k-10k-30k/aws-storage-monitoring.png
AWS storage monitoring
0 1
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/25k-10k-30k/cassandra-disk-size.png
Cassandra disk size usage
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/25k-10k-30k/telemetry-persisted-chart.png
Telemetry persisted chart
0 1 2 3 4
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/25k-10k-30k/visualvm-forwarded-applications.png
VisualVM Java application list
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/25k-10k-30k/jmx-thingsboard.png
JMX monitoring for the Thingsboard. The system is stable
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/25k-10k-30k/jmx-kafka.png
JMX monitoring for the Kafka. The system is stable
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/25k-10k-30k/jmx-zookeeper.png
JMX monitoring for the Zookeeper. The system is stable
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/25k-10k-30k/jmx-cassandra.png
JMX monitoring for the Cassandra. The system is stable
0 1 2 3 4 5 6 7
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-5k-15k/queue-stats.png
Queue stats dashboard
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-5k-15k/api-usage.png
Thingsboard API usage dashboard
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-5k-15k/htop.png
htop: CPU, memory, IO read/write
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-5k-15k/jmx-visualvm-monitoring.png
JMX VisualVM monitoring
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-5k-15k/postgresql-pgadmin-dashboard.png
Postgres PgAdmin dashboard
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-5k-15k/aws-instance-monitoring.png
AWS CPU and network monitoring
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-5k-15k/aws-storage-monitoring.png
AWS storage monitoring
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-5k-15k/disk-usage-cassandra.png
Cassandra disk usage
0 1 2 3 4 5 6
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-10k-30k/queue-stats.png
Queue stats dashboard
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-10k-30k/api-usage.png
Thingsboard API usage dashboard
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-10k-30k/htop.png
htop: CPU, memory, IO read/write
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-10k-30k/jmx-visualvm-monitoring.png
JMX VisualVM monitoring
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-10k-30k/postgresql-pgadmin-dashboard.png
Postgres PgAdmin dashboard
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-10k-30k/aws-instance-monitoring.png
AWS CPU and network monitoring
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-10k-30k/aws-storage-monitoring.png
AWS storage monitoring
0 1 2 3
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-10k-30k/24h-run/queue-stats.png
Queue stats dashboard
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-10k-30k/24h-run/api-usage.png
Thingsboard API usage dashboard
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-10k-30k/24h-run/aws-instance-monitoring.png
AWS CPU and network monitoring
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-10k-30k/24h-run/aws-storage-monitoring.png
AWS storage monitoring
0 1
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-is-connected/devices-list-100k-thingsboard.png
Device List with 100k+ lines
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-is-connected/jmx-mbeans-java-lang-operating-system-open-file-descriptor-count.png
Jmx MBeans java.lang.operating_system open_file_descriptor_count
0 1 2 3
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/stress-x3/postgresql-disk-usage-total.png
Postgres disk usage total
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/stress-x3/postgresql-disk-usage-by-table.png
Postgres disk usage by table
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/stress-x3/kafka-disk-usage-total.png
Kafka disk usage total
image title
/images/reference/performance-aws-instances/method/m6a-large/postgres-kafka/stress-x3/kafka-disk-usage-by-topic.png
Kafka disk usage by topic
0
image title
/images/reference/performance-aws-instances/method/m6a-2xlarge/100k-5k-15k/disk-usage-cassandra.png
Cassandra disk usage is about 20 GiB per 1.3B data points

{% include get-hosts-name.html %} {% include /docs/reference/performance-aws-instances.md %}