fix(eventstream): Use an arroyo producer for eventstream

[evanh]

Migrate to the arroyo producer (to capture accurate metrics) and also increase the buffer size of
the producer.

[codecov]

Codecov Report

❌ Patch coverage is 80.00000% with 3 lines in your changes missing coverage. Please review.
✅ All tests successful. No failed tests found.

Files with missing lines	Patch %	Lines
src/sentry/eventstream/kafka/backend.py	80.00%	3 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##           master   #104763      +/-   ##
===========================================
- Coverage   80.61%    80.54%   -0.07%     
===========================================
  Files        9419      9385      -34     
  Lines      403881    403624     -257     
  Branches    25637     25781     +144     
===========================================
- Hits       325572    325099     -473     
- Misses      77840     78090     +250     
+ Partials      469       435      -34     

[shashjar]

Wrt the if not asynchronous handling, I don't see a flush() method on the KafkaProducer. I think we want to do produce_future.result() to block until delivery completes instead.

[shashjar]

Same as Sentry bot - should we handle when value is None?

And I think we can update the error type to BaseException.

[getsantry]

This pull request has gone three weeks without activity. In another week, I will close it.

But! If you comment or otherwise update it, I will reset the clock, and if you add the label WIP, I will leave it alone unless WIP is removed ... forever!

---

"A weed is but an unloved flower." ― Ella Wheeler Wilcox 🥀