Skip to content

[DOCS-10730] Add Obs Pipelines 2.6 components #29866

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 21 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
127 changes: 91 additions & 36 deletions config/_default/menus/main.en.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -5161,26 +5161,31 @@ menu:
parent: observability_pipelines_log_volume_control
identifier: observability_pipelines_log_volume_control_logstash
weight: 1019
- name: Socket (TCP or UDP)
url: observability_pipelines/set_up_pipelines/log_volume_control/socket/
parent: observability_pipelines_log_volume_control
identifier: observability_pipelines_log_volume_control_socket
weight: 1020
- name: Splunk HTTP Event Collector
url: observability_pipelines/set_up_pipelines/log_volume_control/splunk_hec/
parent: observability_pipelines_log_volume_control
identifier: observability_pipelines_log_volume_control_splunk_hec
weight: 1020
weight: 1021
- name: Splunk Forwarders (TCP)
url: observability_pipelines/set_up_pipelines/log_volume_control/splunk_tcp/
parent: observability_pipelines_log_volume_control
identifier: observability_pipelines_log_volume_control_splunk_tcp
weight: 1021
weight: 1022
- name: Sumo Logic Hosted Collector
url: observability_pipelines/set_up_pipelines/log_volume_control/sumo_logic_hosted_collector/
parent: observability_pipelines_log_volume_control
identifier: observability_pipelines_log_volume_control_sumo_logic_hosted_collector
weight: 1022
weight: 1023
- name: Syslog
url: observability_pipelines/set_up_pipelines/log_volume_control/syslog/
parent: observability_pipelines_log_volume_control
identifier: observability_pipelines_log_volume_control_syslog
weight: 1023
weight: 1024
- name: Dual Ship Logs
url: observability_pipelines/set_up_pipelines/dual_ship_logs/
parent: observability_pipelines_set_up_pipelines
Expand Down Expand Up @@ -5231,26 +5236,31 @@ menu:
parent: observability_pipelines_dual_ship_logs
identifier: observability_pipelines_dual_ship_logs_logstash
weight: 2019
- name: Socket (TCP or UDP)
url: observability_pipelines/set_up_pipelines/dual_ship_logs/socket/
parent: observability_pipelines_dual_ship_logs
identifier: observability_pipelines_dual_ship_logs_socket
weight: 2020
- name: Splunk HTTP Event Collector
url: observability_pipelines/set_up_pipelines/dual_ship_logs/splunk_hec/
parent: observability_pipelines_dual_ship_logs
identifier: observability_pipelines_dual_ship_logs_splunk_hec
weight: 2020
weight: 2021
- name: Splunk Forwarders (TCP)
url: observability_pipelines/set_up_pipelines/dual_ship_logs/splunk_tcp/
parent: observability_pipelines_dual_ship_logs
identifier: observability_pipelines_dual_ship_logs_splunk_tcp
weight: 2021
weight: 2022
- name: Sumo Logic Hosted Collector
url: observability_pipelines/set_up_pipelines/dual_ship_logs/sumo_logic_hosted_collector/
parent: observability_pipelines_dual_ship_logs
identifier: observability_pipelines_dual_ship_logs_sumo_logic_hosted_collector
weight: 2022
weight: 2023
- name: Syslog
url: observability_pipelines/set_up_pipelines/dual_ship_logs/syslog/
parent: observability_pipelines_dual_ship_logs
identifier: observability_pipelines_dual_ship_logs_syslog
weight: 2021
weight: 2024
- name: Archive Logs
url: observability_pipelines/set_up_pipelines/archive_logs/
parent: observability_pipelines_set_up_pipelines
Expand Down Expand Up @@ -5301,26 +5311,31 @@ menu:
parent: observability_pipelines_archive_logs
identifier: observability_pipelines_archive_logs_logstash
weight: 3019
- name: Socket (TCP or UDP)
url: observability_pipelines/set_up_pipelines/archive_logs/socket/
parent: observability_pipelines_archive_logs
identifier: observability_pipelines_archive_logs_socket
weight: 3020
- name: Splunk HTTP Event Collector
url: observability_pipelines/set_up_pipelines/archive_logs/splunk_hec/
parent: observability_pipelines_archive_logs
identifier: observability_pipelines_archive_logs_splunk_hec
weight: 3020
weight: 3021
- name: Splunk Forwarders (TCP)
url: observability_pipelines/set_up_pipelines/archive_logs/splunk_tcp/
parent: observability_pipelines_archive_logs
identifier: observability_pipelines_archive_logs_splunk_tcp
weight: 3021
weight: 3022
- name: Sumo Logic Hosted Collector
url: observability_pipelines/set_up_pipelines/archive_logs/sumo_logic_hosted_collector/
parent: observability_pipelines_archive_logs
identifier: observability_pipelines_archive_logs_sumo_logic_hosted_collector
weight: 3022
weight: 3023
- name: Syslog
url: observability_pipelines/set_up_pipelines/archive_logs/syslog/
parent: observability_pipelines_archive_logs
identifier: observability_pipelines_archive_logs_syslog
weight: 3023
weight: 3024
- name: Split Logs
url: observability_pipelines/set_up_pipelines/split_logs/
parent: observability_pipelines_set_up_pipelines
Expand Down Expand Up @@ -5371,26 +5386,31 @@ menu:
parent: observability_pipelines_split_logs
identifier: observability_pipelines_split_logs_logstash
weight: 4019
- name: Socket (TCP or UDP)
url: observability_pipelines/set_up_pipelines/split_logs/socket/
parent: observability_pipelines_split_logs
identifier: observability_pipelines_split_logs_socket
weight: 4020
- name: Splunk HTTP Event Collector
url: observability_pipelines/set_up_pipelines/split_logs/splunk_hec/
parent: observability_pipelines_split_logs
identifier: observability_pipelines_split_logs_splunk_hec
weight: 4020
weight: 4021
- name: Splunk Forwarders (TCP)
url: observability_pipelines/set_up_pipelines/split_logs/splunk_tcp/
parent: observability_pipelines_split_logs
identifier: observability_pipelines_split_logs_splunk_tcp
weight: 4021
weight: 4022
- name: Sumo Logic Hosted Collector
url: observability_pipelines/set_up_pipelines/split_logs/sumo_logic_hosted_collector/
parent: observability_pipelines_split_logs
identifier: observability_pipelines_split_logs_sumo_logic_hosted_collector
weight: 4022
weight: 4023
- name: Syslog
url: observability_pipelines/set_up_pipelines/split_logs/syslog/
parent: observability_pipelines_split_logs
identifier: observability_pipelines_split_logs_syslog
weight: 4023
weight: 4024
- name: Sensitive Data Redaction
url: observability_pipelines/set_up_pipelines/sensitive_data_redaction/
parent: observability_pipelines_set_up_pipelines
Expand Down Expand Up @@ -5441,26 +5461,31 @@ menu:
parent: observability_pipelines_sensitive_data_redaction
identifier: observability_pipelines_sensitive_data_redaction_logstash
weight: 5019
- name: Socket (TCP or UDP)
url: observability_pipelines/set_up_pipelines/sensitive_data_redaction/socket/
parent: observability_pipelines_sensitive_data_redaction
identifier: observability_pipelines_sensitive_data_redaction_socket
weight: 5020
- name: Splunk HTTP Event Collector
url: observability_pipelines/set_up_pipelines/sensitive_data_redaction/splunk_hec/
parent: observability_pipelines_sensitive_data_redaction
identifier: observability_pipelines_sensitive_data_redaction_splunk_hec
weight: 5020
weight: 5021
- name: Splunk Forwarders (TCP)
url: observability_pipelines/set_up_pipelines/sensitive_data_redaction/splunk_tcp/
parent: observability_pipelines_sensitive_data_redaction
identifier: observability_pipelines_sensitive_data_redaction_splunk_tcp
weight: 5021
weight: 5022
- name: Sumo Logic Hosted Collector
url: observability_pipelines/set_up_pipelines/sensitive_data_redaction/sumo_logic_hosted_collector/
parent: observability_pipelines_sensitive_data_redaction
identifier: observability_pipelines_sensitive_data_redaction_sumo_logic_hosted_collector
weight: 5022
weight: 5023
- name: Syslog
url: observability_pipelines/set_up_pipelines/sensitive_data_redaction/syslog/
parent: observability_pipelines_sensitive_data_redaction
identifier: observability_pipelines_sensitive_data_redaction_syslog
weight: 5023
weight: 5024
- name: Log Enrichment
url: observability_pipelines/set_up_pipelines/log_enrichment/
parent: observability_pipelines_set_up_pipelines
Expand Down Expand Up @@ -5511,26 +5536,31 @@ menu:
parent: observability_pipelines_log_enrichment
identifier: observability_pipelines_log_enrichment_logstash
weight: 6019
- name: Socket (TCP or UDP)
url: observability_pipelines/set_up_pipelines/log_enrichment/socket/
parent: observability_pipelines_log_enrichment
identifier: observability_pipelines_log_enrichment_socket
weight: 6020
- name: Splunk HTTP Event Collector
url: observability_pipelines/set_up_pipelines/log_enrichment/splunk_hec/
parent: observability_pipelines_log_enrichment
identifier: observability_pipelines_log_enrichment_splunk_hec
weight: 6020
weight: 6021
- name: Splunk Forwarders (TCP)
url: observability_pipelines/set_up_pipelines/log_enrichment/splunk_tcp/
parent: observability_pipelines_log_enrichment
identifier: observability_pipelines_log_enrichment_splunk_tcp
weight: 6021
weight: 6022
- name: Sumo Logic Hosted Collector
url: observability_pipelines/set_up_pipelines/log_enrichment/sumo_logic_hosted_collector/
parent: observability_pipelines_log_enrichment
identifier: observability_pipelines_log_enrichment_sumo_logic_hosted_collector
weight: 6022
weight: 6023
- name: Syslog
url: observability_pipelines/set_up_pipelines/log_enrichment/syslog/
parent: observability_pipelines_log_enrichment
identifier: observability_pipelines_log_enrichment_syslog
weight: 6023
weight: 6024
- name: Generate Metrics
identifier: observability_pipelines_generate_metrics
url: /observability_pipelines/set_up_pipelines/generate_metrics/
Expand Down Expand Up @@ -5581,26 +5611,31 @@ menu:
parent: observability_pipelines_generate_metrics
identifier: observability_pipelines_generate_metrics_logstash
weight: 7019
- name: Socket (TCP or UDP)
url: observability_pipelines/set_up_pipelines/generate_metrics/socket/
parent: observability_pipelines_generate_metrics
identifier: observability_pipelines_generate_metrics_socket
weight: 7020
- name: Splunk HTTP Event Collector
url: observability_pipelines/set_up_pipelines/generate_metrics/splunk_hec/
parent: observability_pipelines_generate_metrics
identifier: observability_pipelines_generate_metrics_splunk_hec
weight: 7020
weight: 7021
- name: Splunk Forwarders (TCP)
url: observability_pipelines/set_up_pipelines/generate_metrics/splunk_tcp/
parent: observability_pipelines_generate_metrics
identifier: observability_pipelines_generate_metrics_splunk_tcp
weight: 7021
weight: 7022
- name: Sumo Logic Hosted Collector
url: observability_pipelines/set_up_pipelines/generate_metrics/sumo_logic_hosted_collector/
parent: observability_pipelines_generate_metrics
identifier: observability_pipelines_generate_metrics_sumo_logic_hosted_collector
weight: 7022
weight: 7023
- name: Syslog
url: observability_pipelines/set_up_pipelines/generate_metrics/syslog/
parent: observability_pipelines_generate_metrics
identifier: observability_pipelines_generate_metrics_syslog
weight: 7023
weight: 7024
- name: Run Multiple Pipelines on a Host
identifier: observability_run_multiple_pipelines_on_a_host
url: /observability_pipelines/set_up_pipelines/run_multiple_pipelines_on_a_host/
Expand Down Expand Up @@ -5706,26 +5741,31 @@ menu:
parent: observability_pipelines_sources
identifier: observability_pipelines_sources_logstash
weight: 810
- name: Socket
url: observability_pipelines/sources/socket/
parent: observability_pipelines_sources
identifier: observability_pipelines_sources_socket
weight: 811
- name: Splunk HEC
url: observability_pipelines/sources/splunk_hec/
parent: observability_pipelines_sources
identifier: observability_pipelines_sources_splunk_hec
weight: 811
weight: 812
- name: Splunk TCP
url: observability_pipelines/sources/splunk_tcp/
parent: observability_pipelines_sources
identifier: observability_pipelines_sources_splunk_tcp
weight: 812
weight: 813
- name: Sumo Logic Hosted Collector
url: observability_pipelines/sources/sumo_logic/
parent: observability_pipelines_sources
identifier: observability_pipelines_sources_sumo_logic
weight: 813
weight: 814
- name: Syslog
url: observability_pipelines/sources/syslog/
parent: observability_pipelines_sources
identifier: observability_pipelines_sources_syslog
weight: 814
weight: 815
- name: Processors
url: observability_pipelines/processors/
parent: observability_pipelines
Expand Down Expand Up @@ -5816,11 +5856,16 @@ menu:
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_split_array
weight: 917
- name: Tags Processor
url: observability_pipelines/processors/tags_processor
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_tags_processor
weight: 918
- name: Throttle
url: observability_pipelines/processors/throttle
parent: observability_pipelines_processors
identifier: observability_pipelines_processors_throttle
weight: 918
weight: 919
- name: Destinations
url: observability_pipelines/destinations/
parent: observability_pipelines
Expand Down Expand Up @@ -5886,21 +5931,31 @@ menu:
parent: observability_pipelines_destinations
identifier: observability_pipelines_sentinelone
weight: 1012
- name: Socket
url: observability_pipelines/destinations/socket
parent: observability_pipelines_destinations
identifier: observability_pipelines_socket
weight: 1013
- name: Splunk HEC
url: observability_pipelines/destinations/splunk_hec
parent: observability_pipelines_destinations
identifier: observability_pipelines_splunk_hec
weight: 1013
weight: 1014
- name: Sumo Logic Hosted Collector
url: observability_pipelines/destinations/sumo_logic_hosted_collector
parent: observability_pipelines_destinations
identifier: observability_pipelines_sumo_logic_hosted_collector
weight: 1014
weight: 1015
- name: Syslog
url: observability_pipelines/destinations/syslog
parent: observability_pipelines_destinations
identifier: observability_pipelines_syslog
weight: 1015
weight: 1016
- name: Syslog
url: observability_pipelines/destinations/syslog
parent: observability_pipelines_destinations
identifier: observability_pipelines_syslog
weight: 1017
- name: Environment Variables
url: observability_pipelines/environment_variables/
parent: observability_pipelines
Expand Down
27 changes: 27 additions & 0 deletions content/en/observability_pipelines/destinations/socket.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
---
title: Socket Destination
disable_toc: false
---

Use Observability Pipelines' Socket destination to send logs to a socket endpoint.

## Setup

Set up the Socket destination and its environment variables when you [set up a pipeline][1]. The information below is configured in the pipelines UI.

### Set up the destination

{{% observability_pipelines/destination_settings/socket %}}

### Set the environment variables

{{% observability_pipelines/configure_existing_pipelines/destination_env_vars/socket %}}

### How the destination works

#### Event batching

The Socket destination does not batch events.

[1]: https://app.datadoghq.com/observability-pipelines
[2]: /observability_pipelines/destinations/#event-batching
7 changes: 7 additions & 0 deletions content/en/observability_pipelines/environment_variables.md
Original file line number Diff line number Diff line change
Expand Up @@ -43,6 +43,10 @@ Some Observability Pipelines components require setting up environment variables
### Logstash
{{% observability_pipelines/configure_existing_pipelines/source_env_vars/logstash %}}

### Socket

{{% observability_pipelines/configure_existing_pipelines/source_env_vars/socket %}}

### Splunk HEC
{{% observability_pipelines/configure_existing_pipelines/source_env_vars/splunk_hec %}}

Expand Down Expand Up @@ -100,6 +104,9 @@ Some Observability Pipelines components require setting up environment variables
### SentinelOne
{{% observability_pipelines/configure_existing_pipelines/destination_env_vars/sentinelone %}}

### Socket
{{% observability_pipelines/configure_existing_pipelines/destination_env_vars/socket %}}

### Splunk HEC
{{% observability_pipelines/configure_existing_pipelines/destination_env_vars/splunk_hec %}}

Expand Down
Loading
Loading