Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Malcolm v25.01.0 #618

Merged
merged 57 commits into from
Jan 17, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
57 commits
Select commit Hold shift + click to select a range
6e157fb
Bump development for v25.01.0, also update copyright year
mmguero Dec 19, 2024
59ba40b
Merge branch 'development' of https://github.com/mmguero-dev/Malcolm …
mmguero Dec 19, 2024
433aa57
bump netbox to v4.1.10, osd_transform to v2.18.0, and fluent-bit to v…
mmguero Jan 6, 2025
02cf852
for cisagov/Malcolm#354, work in progress for Malcolm directly accept…
mmguero Jan 6, 2025
76606c9
for cisagov/Malcolm#354, work in progress for Malcolm directly accept…
mmguero Jan 6, 2025
a5eb005
cisagov/Malcolm#543, add naviation pane to non-network dashboards
mmguero Jan 7, 2025
9256719
bump jinja to 3.1.5
mmguero Jan 7, 2025
d021eaa
Documentation for cisagov/Malcolm#354, syslog
mmguero Jan 7, 2025
f8217e0
replace old filebeat input for syslog with tcp/udp input and syslog p…
mmguero Jan 7, 2025
6461221
Documentation for cisagov/Malcolm#354, syslog
mmguero Jan 7, 2025
83d7485
install.py tweak for cisagov/Malcolm#354
mmguero Jan 7, 2025
0f69adb
minor fix for for cisagov/Malcolm#354, set host.name correctly
mmguero Jan 7, 2025
329de6f
bump netbox to v4.11.1 and elasticsearch-dsl to v8.17.1
mmguero Jan 8, 2025
fa6807b
start of cisagov/Malcolm#356, normalize winlogbeats
mmguero Jan 8, 2025
413eca5
WIP of cisagov/Malcolm#356, normalize winlogbeats
mmguero Jan 8, 2025
9ce0289
WIP of cisagov/Malcolm#356, normalize winlogbeats
mmguero Jan 8, 2025
e0e8af5
WIP of cisagov/Malcolm#356, fix for a dashboard
mmguero Jan 8, 2025
8cb4348
WIP of cisagov/Malcolm#356, normalize winlogbeats
mmguero Jan 8, 2025
de41177
Work in progress for cisagov/Malcolm#541, making sure conn.log and kn…
mmguero Jan 9, 2025
98d7d17
Work in progress for cisagov/Malcolm#541
mmguero Jan 9, 2025
3866959
standardize ICS protocols in network.protocol field, so they all get …
mmguero Jan 9, 2025
0844647
fix cisagov/Malcolm#533, allow keystores to be created on startup eve…
mmguero Jan 9, 2025
eae26a7
forgot to add file for cisagov/Malcolm#356
mmguero Jan 9, 2025
dea3ce7
For cisagov/Malcolm#524, handle filenames with spaces in extracted_fi…
mmguero Jan 9, 2025
35da64f
work for cisagov/Malcolm#542, preserve custom field formatting for in…
mmguero Jan 13, 2025
a884675
work for cisagov/Malcolm#542, preserve custom field formatting for in…
mmguero Jan 13, 2025
d2827a3
bump yq to v4.45.1
mmguero Jan 13, 2025
3c94d7f
for cisagov/Malcolm#551, URL pivot links from dashboards to arkime
mmguero Jan 13, 2025
ae3c7f0
for cisagov/Malcolm#551, URL pivot links from dashboards to arkime
mmguero Jan 13, 2025
4bd8362
fix pivot from arkime to dashboards and vice-versa when using a traef…
mmguero Jan 14, 2025
4dd9ef9
for cisagov/Malcolm#551, URL pivot links from dashboards to netbox
mmguero Jan 14, 2025
db8bde4
for cisagov/Malcolm#551, URL pivot links from dashboards to netbox
mmguero Jan 14, 2025
bdac4f4
for cisagov/Malcolm#551, URL pivot links from netbox to arkime/dashbo…
mmguero Jan 14, 2025
c005ec2
start of cisagov/Malcolm#553, update zeek to v7.1.0
mmguero Jan 14, 2025
f3231e9
cisagov/Malcolm#553, handle conn.log for zeek v7.1.0 and documentatio…
mmguero Jan 14, 2025
d6c48f1
cisagov/Malcolm#553, handle postgresql.log
mmguero Jan 14, 2025
c400649
cisagov/Malcolm#553, handle postgresql.log
mmguero Jan 14, 2025
f29ff50
cisagov/Malcolm#553, added PostgreSQL dashboard
mmguero Jan 14, 2025
77d6996
for cisagov/Malcolm#551, URL pivot links in dashboards (ignore date/t…
mmguero Jan 14, 2025
33c05c7
start of omron fins integration, cisagov/Malcolm#554
mmguero Jan 15, 2025
260a7f0
wip omron fins integration, , cisagov/Malcolm#554
mmguero Jan 15, 2025
4949221
arkime to v5.6.0
mmguero Jan 15, 2025
e4408f6
bump logstash and filebeat to v8.17.0
mmguero Jan 15, 2025
2c1571b
Fix nginx filebeat
mmguero Jan 15, 2025
d0fe1e0
WIP omron fins integration, cisagov/Malcolm#554
mmguero Jan 15, 2025
0ca98c0
WIP omron fins integration, cisagov/Malcolm#554
mmguero Jan 15, 2025
2f5a022
WIP omron fins integration, cisagov/Malcolm#554
mmguero Jan 15, 2025
9503a4d
WIP omron fins integration, cisagov/Malcolm#554
mmguero Jan 15, 2025
5d8fed7
WIP omron fins integration, cisagov/Malcolm#554
mmguero Jan 15, 2025
401da78
dashboards tweaks
mmguero Jan 16, 2025
61eab8b
fix links for hh redirect download
mmguero Jan 16, 2025
a950f6c
fix issue with nginx proxy
mmguero Jan 16, 2025
b244418
Merge branch 'development' of https://github.com/mmguero-dev/Malcolm …
mmguero Jan 16, 2025
8115771
html formatting
mmguero Jan 16, 2025
c67ecab
Merge branch 'development' of https://github.com/mmguero-dev/Malcolm …
mmguero Jan 16, 2025
b92528b
documentation for workaround for UFW software firewall for Malcolm IS…
mmguero Jan 17, 2025
70c3c85
Merge branch 'development' of https://github.com/mmguero-dev/Malcolm …
mmguero Jan 17, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 1 addition & 1 deletion Dockerfiles/api.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ RUN python3 -m pip wheel --no-cache-dir --no-deps --wheel-dir /usr/src/app/wheel

FROM python:3-slim-bookworm

# Copyright (c) 2024 Battelle Energy Alliance, LLC. All rights reserved.
# Copyright (c) 2025 Battelle Energy Alliance, LLC. All rights reserved.
LABEL maintainer="[email protected]"
LABEL org.opencontainers.image.authors='[email protected]'
LABEL org.opencontainers.image.url='https://github.com/idaholab/Malcolm'
Expand Down
4 changes: 2 additions & 2 deletions Dockerfiles/arkime.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Copyright (c) 2024 Battelle Energy Alliance, LLC. All rights reserved.
# Copyright (c) 2025 Battelle Energy Alliance, LLC. All rights reserved.

FROM debian:12-slim

Expand Down Expand Up @@ -33,7 +33,7 @@ ENV PYTHONDONTWRITEBYTECODE 1
ENV PYTHONUNBUFFERED 1

ENV ARKIME_DIR "/opt/arkime"
ENV ARKIME_VERSION "5.5.1"
ENV ARKIME_VERSION "5.6.0"
ENV ARKIME_DEB_URL "https://github.com/arkime/arkime/releases/download/v${ARKIME_VERSION}/arkime_${ARKIME_VERSION}-1.debian12_XXX.deb"
ENV ARKIME_JA4_SO_URL "https://github.com/arkime/arkime/releases/download/v${ARKIME_VERSION}/ja4plus.XXX.so"
ENV ARKIME_LOCALELASTICSEARCH no
Expand Down
2 changes: 1 addition & 1 deletion Dockerfiles/dashboards-helper.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
FROM debian:12-slim

# Copyright (c) 2020 Battelle Energy Alliance, LLC. All rights reserved.
# Copyright (c) 2025 Battelle Energy Alliance, LLC. All rights reserved.
LABEL maintainer="[email protected]"
LABEL org.opencontainers.image.authors='[email protected]'
LABEL org.opencontainers.image.url='https://github.com/idaholab/Malcolm'
Expand Down
10 changes: 5 additions & 5 deletions Dockerfiles/dashboards.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ ENV TERM xterm
ENV TINI_VERSION v0.19.0
ENV TINI_URL https://github.com/krallin/tini/releases/download/${TINI_VERSION}/tini

ENV OSD_TRANSFORM_VIS_VERSION 2.17.1
ENV OSD_TRANSFORM_VIS_VERSION 2.18.0

ARG NODE_OPTIONS="--max_old_space_size=4096"
ENV NODE_OPTIONS $NODE_OPTIONS
Expand All @@ -42,10 +42,10 @@ RUN export BINARCH=$(uname -m | sed 's/x86_64/amd64/' | sed 's/aarch64/arm64/')
# Malcolm manages authentication and encryption via NGINX reverse proxy
/usr/share/opensearch-dashboards/bin/opensearch-dashboards-plugin remove securityDashboards --allow-root && \
cd /tmp && \
unzip transformVis.zip opensearch-dashboards/transformVis/opensearch_dashboards.json opensearch-dashboards/transformVis/package.json && \
sed -i "s/2\.17\.1/2\.18\.0/g" opensearch-dashboards/transformVis/opensearch_dashboards.json && \
sed -i "s/2\.17\.1/2\.18\.0/g" opensearch-dashboards/transformVis/package.json && \
zip transformVis.zip opensearch-dashboards/transformVis/opensearch_dashboards.json opensearch-dashboards/transformVis/package.json && \
# unzip transformVis.zip opensearch-dashboards/transformVis/opensearch_dashboards.json opensearch-dashboards/transformVis/package.json && \
# sed -i "s/2\.17\.1/2\.18\.0/g" opensearch-dashboards/transformVis/opensearch_dashboards.json && \
# sed -i "s/2\.17\.1/2\.18\.0/g" opensearch-dashboards/transformVis/package.json && \
# zip transformVis.zip opensearch-dashboards/transformVis/opensearch_dashboards.json opensearch-dashboards/transformVis/package.json && \
cd /usr/share/opensearch-dashboards/plugins && \
/usr/share/opensearch-dashboards/bin/opensearch-dashboards-plugin install file:///tmp/transformVis.zip --allow-root && \
rm -rf /tmp/transformVis /tmp/opensearch-dashboards && \
Expand Down
2 changes: 1 addition & 1 deletion Dockerfiles/dirinit.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
FROM alpine:3.20

# Copyright (c) 2024 Battelle Energy Alliance, LLC. All rights reserved.
# Copyright (c) 2025 Battelle Energy Alliance, LLC. All rights reserved.
LABEL maintainer="[email protected]"
LABEL org.opencontainers.image.authors='[email protected]'
LABEL org.opencontainers.image.url='https://github.com/idaholab/Malcolm'
Expand Down
2 changes: 1 addition & 1 deletion Dockerfiles/file-monitor.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
FROM debian:12-slim

# Copyright (c) 2024 Battelle Energy Alliance, LLC. All rights reserved.
# Copyright (c) 2025 Battelle Energy Alliance, LLC. All rights reserved.
LABEL maintainer="[email protected]"
LABEL org.opencontainers.image.authors='[email protected]'
LABEL org.opencontainers.image.url='https://github.com/idaholab/Malcolm'
Expand Down
2 changes: 1 addition & 1 deletion Dockerfiles/file-upload.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
FROM debian:12-slim AS npmget

# Copyright (c) 2024 Battelle Energy Alliance, LLC. All rights reserved.
# Copyright (c) 2025 Battelle Energy Alliance, LLC. All rights reserved.

ENV DEBIAN_FRONTEND noninteractive

Expand Down
14 changes: 10 additions & 4 deletions Dockerfiles/filebeat.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
FROM docker.elastic.co/beats/filebeat-oss:8.16.0
FROM docker.elastic.co/beats/filebeat-oss:8.17.0

# Copyright (c) 2024 Battelle Energy Alliance, LLC. All rights reserved.
# Copyright (c) 2025 Battelle Energy Alliance, LLC. All rights reserved.
LABEL maintainer="[email protected]"
LABEL org.opencontainers.image.authors='[email protected]'
LABEL org.opencontainers.image.url='https://github.com/idaholab/Malcolm'
Expand Down Expand Up @@ -65,13 +65,15 @@ ARG FILEBEAT_TCP_PARSE_SOURCE_FIELD="message"
ARG FILEBEAT_TCP_PARSE_TARGET_FIELD=""
ARG FILEBEAT_TCP_PARSE_DROP_FIELD=""
ARG FILEBEAT_TCP_TAG="_malcolm_beats"
ARG FILEBEAT_SYSLOG_TCP_LISTEN=false
ARG FILEBEAT_SYSLOG_UDP_LISTEN=false
ARG PCAP_NODE_NAME=malcolm

ENV SUPERCRONIC_VERSION "0.2.33"
ENV SUPERCRONIC_URL "https://github.com/aptible/supercronic/releases/download/v$SUPERCRONIC_VERSION/supercronic-linux-"
ENV SUPERCRONIC_CRONTAB "/etc/crontab"

ENV YQ_VERSION "4.44.6"
ENV YQ_VERSION "4.45.1"
ENV YQ_URL "https://github.com/mikefarah/yq/releases/download/v${YQ_VERSION}/yq_linux_"

ENV EVTX_VERSION "0.8.4"
Expand Down Expand Up @@ -125,12 +127,14 @@ COPY --from=ghcr.io/mmguero-dev/gostatic --chmod=755 /goStatic /usr/bin/goStatic
ADD filebeat/filebeat-logs.yml /usr/share/filebeat-logs/filebeat-logs.yml
ADD filebeat/filebeat-nginx.yml /usr/share/filebeat-nginx/filebeat-nginx.yml
ADD filebeat/filebeat-tcp.yml /usr/share/filebeat-tcp/filebeat-tcp.yml
ADD filebeat/filebeat-syslog-udp.yml /usr/share/filebeat-syslog-udp/filebeat-syslog-udp.yml
ADD filebeat/filebeat-syslog-tcp.yml /usr/share/filebeat-syslog-tcp/filebeat-syslog-tcp.yml
ADD filebeat/scripts /usr/local/bin/
ADD scripts/malcolm_utils.py /usr/local/bin/
ADD shared/bin/watch_common.py /usr/local/bin/
ADD shared/bin/opensearch_status.sh /usr/local/bin/
ADD filebeat/supervisord.conf /etc/supervisord.conf
RUN for INPUT in logs nginx tcp; do \
RUN for INPUT in logs nginx tcp syslog-tcp syslog-udp; do \
mkdir -p /usr/share/filebeat-$INPUT/data; \
chown -R root:${PGROUP} /usr/share/filebeat-$INPUT; \
cp -a /usr/share/filebeat/module /usr/share/filebeat-$INPUT/module; \
Expand Down Expand Up @@ -172,6 +176,8 @@ ENV FILEBEAT_TCP_PARSE_SOURCE_FIELD $FILEBEAT_TCP_PARSE_SOURCE_FIELD
ENV FILEBEAT_TCP_PARSE_TARGET_FIELD $FILEBEAT_TCP_PARSE_TARGET_FIELD
ENV FILEBEAT_TCP_PARSE_DROP_FIELD $FILEBEAT_TCP_PARSE_DROP_FIELD
ENV FILEBEAT_TCP_TAG $FILEBEAT_TCP_TAG
ENV FILEBEAT_SYSLOG_TCP_LISTEN $FILEBEAT_SYSLOG_TCP_LISTEN
ENV FILEBEAT_SYSLOG_UDP_LISTEN $FILEBEAT_SYSLOG_UDP_LISTEN
ENV FILEBEAT_REGISTRY_FILE "/usr/share/filebeat-logs/data/registry/filebeat/log.json"
ENV FILEBEAT_ZEEK_DIR "/zeek/"
ENV PCAP_NODE_NAME $PCAP_NODE_NAME
Expand Down
2 changes: 1 addition & 1 deletion Dockerfiles/freq.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
FROM debian:12-slim

# Copyright (c) 2024 Battelle Energy Alliance, LLC. All rights reserved.
# Copyright (c) 2025 Battelle Energy Alliance, LLC. All rights reserved.
LABEL maintainer="[email protected]"
LABEL org.opencontainers.image.authors='[email protected]'
LABEL org.opencontainers.image.url='https://github.com/idaholab/Malcolm'
Expand Down
2 changes: 1 addition & 1 deletion Dockerfiles/htadmin.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
FROM debian:11-slim

# Copyright (c) 2024 Battelle Energy Alliance, LLC. All rights reserved.
# Copyright (c) 2025 Battelle Energy Alliance, LLC. All rights reserved.
LABEL maintainer="[email protected]"
LABEL org.opencontainers.image.authors='[email protected]'
LABEL org.opencontainers.image.url='https://github.com/idaholab/Malcolm'
Expand Down
2 changes: 1 addition & 1 deletion Dockerfiles/logstash.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
FROM docker.elastic.co/logstash/logstash-oss:8.16.0
FROM docker.elastic.co/logstash/logstash-oss:8.17.0

LABEL maintainer="[email protected]"
LABEL org.opencontainers.image.authors='[email protected]'
Expand Down
6 changes: 3 additions & 3 deletions Dockerfiles/netbox.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
FROM netboxcommunity/netbox:v4.1.8
FROM netboxcommunity/netbox:v4.1.11

# Copyright (c) 2024 Battelle Energy Alliance, LLC. All rights reserved.
# Copyright (c) 2025 Battelle Energy Alliance, LLC. All rights reserved.
LABEL maintainer="[email protected]"
LABEL org.opencontainers.image.authors='[email protected]'
LABEL org.opencontainers.image.url='https://github.com/idaholab/Malcolm'
Expand Down Expand Up @@ -33,7 +33,7 @@ ENV NETBOX_INITIALIZERS_VERSION "v4.1.0"
ENV NETBOX_TOPOLOGY_VERSION "4.1.0"
ENV NETBOX_HEALTHCHECK_VERSION "0.2.0"

ENV YQ_VERSION "4.44.6"
ENV YQ_VERSION "4.45.1"
ENV YQ_URL "https://github.com/mikefarah/yq/releases/download/v${YQ_VERSION}/yq_linux_"

ENV NETBOX_DEVICETYPE_LIBRARY_IMPORT_URL "https://codeload.github.com/mmguero-dev/Device-Type-Library-Import/tar.gz/develop"
Expand Down
2 changes: 1 addition & 1 deletion Dockerfiles/nginx.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Copyright (c) 2024 Battelle Energy Alliance, LLC. All rights reserved.
# Copyright (c) 2025 Battelle Energy Alliance, LLC. All rights reserved.

####################################################################################
# thanks to: nginx - https://github.com/nginxinc/docker-nginx/blob/master/mainline/alpine/Dockerfile
Expand Down
2 changes: 1 addition & 1 deletion Dockerfiles/opensearch.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
FROM opensearchproject/opensearch:2.18.0

# Copyright (c) 2024 Battelle Energy Alliance, LLC. All rights reserved.
# Copyright (c) 2025 Battelle Energy Alliance, LLC. All rights reserved.
LABEL maintainer="[email protected]"
LABEL org.opencontainers.image.authors='[email protected]'
LABEL org.opencontainers.image.url='https://github.com/idaholab/Malcolm'
Expand Down
2 changes: 1 addition & 1 deletion Dockerfiles/pcap-capture.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
FROM debian:12-slim

# Copyright (c) 2024 Battelle Energy Alliance, LLC. All rights reserved.
# Copyright (c) 2025 Battelle Energy Alliance, LLC. All rights reserved.
LABEL maintainer="[email protected]"
LABEL org.opencontainers.image.authors='[email protected]'
LABEL org.opencontainers.image.url='https://github.com/idaholab/Malcolm'
Expand Down
2 changes: 1 addition & 1 deletion Dockerfiles/pcap-monitor.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
FROM debian:12-slim

# Copyright (c) 2024 Battelle Energy Alliance, LLC. All rights reserved.
# Copyright (c) 2025 Battelle Energy Alliance, LLC. All rights reserved.
LABEL maintainer="[email protected]"
LABEL org.opencontainers.image.authors='[email protected]'
LABEL org.opencontainers.image.url='https://github.com/idaholab/Malcolm'
Expand Down
2 changes: 1 addition & 1 deletion Dockerfiles/postgresql.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
FROM postgres:16-alpine

# Copyright (c) 2024 Battelle Energy Alliance, LLC. All rights reserved.
# Copyright (c) 2025 Battelle Energy Alliance, LLC. All rights reserved.
LABEL maintainer="[email protected]"
LABEL org.opencontainers.image.authors='[email protected]'
LABEL org.opencontainers.image.url='https://github.com/idaholab/Malcolm'
Expand Down
2 changes: 1 addition & 1 deletion Dockerfiles/redis.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
FROM redis:7-alpine

# Copyright (c) 2024 Battelle Energy Alliance, LLC. All rights reserved.
# Copyright (c) 2025 Battelle Energy Alliance, LLC. All rights reserved.
LABEL maintainer="[email protected]"
LABEL org.opencontainers.image.authors='[email protected]'
LABEL org.opencontainers.image.url='https://github.com/idaholab/Malcolm'
Expand Down
4 changes: 2 additions & 2 deletions Dockerfiles/suricata.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
FROM debian:12-slim

# Copyright (c) 2024 Battelle Energy Alliance, LLC. All rights reserved.
# Copyright (c) 2025 Battelle Energy Alliance, LLC. All rights reserved.
LABEL maintainer="[email protected]"
LABEL org.opencontainers.image.authors='[email protected]'
LABEL org.opencontainers.image.url='https://github.com/idaholab/Malcolm'
Expand Down Expand Up @@ -37,7 +37,7 @@ ENV SUPERCRONIC_VERSION "0.2.33"
ENV SUPERCRONIC_URL "https://github.com/aptible/supercronic/releases/download/v$SUPERCRONIC_VERSION/supercronic-linux-"
ENV SUPERCRONIC_CRONTAB "/etc/crontab"

ENV YQ_VERSION "4.44.6"
ENV YQ_VERSION "4.45.1"
ENV YQ_URL "https://github.com/mikefarah/yq/releases/download/v${YQ_VERSION}/yq_linux_"

ENV SURICATA_VERSION_PATTERN "1:7.0.*"
Expand Down
12 changes: 7 additions & 5 deletions Dockerfiles/zeek.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
FROM debian:12-slim

# Copyright (c) 2024 Battelle Energy Alliance, LLC. All rights reserved.
# Copyright (c) 2025 Battelle Energy Alliance, LLC. All rights reserved.
LABEL maintainer="[email protected]"
LABEL org.opencontainers.image.authors='[email protected]'
LABEL org.opencontainers.image.url='https://github.com/idaholab/Malcolm'
Expand Down Expand Up @@ -33,7 +33,7 @@ USER root
# see PUSER_CHOWN at the bottom of the file (after the other environment variables it references)

# for download and install
ARG ZEEK_VERSION=7.0.5-0
ARG ZEEK_VERSION=7.1.0-0
ENV ZEEK_VERSION $ZEEK_VERSION
ARG ZEEK_DEB_ALTERNATE_DOWNLOAD_URL=""

Expand Down Expand Up @@ -182,17 +182,17 @@ RUN groupadd --gid ${DEFAULT_GID} ${PUSER} && \

# sanity checks to make sure the plugins installed and copied over correctly
# these ENVs should match the third party scripts/plugins installed by zeek_install_plugins.sh
ENV ZEEK_THIRD_PARTY_PLUGINS_GREP "(Zeek::Spicy|ANALYZER_SPICY_OSPF|ANALYZER_SPICY_OPENVPN_UDP\b|ANALYZER_SPICY_IPSEC_UDP\b|ANALYZER_SPICY_TFTP|ANALYZER_SPICY_WIREGUARD|ANALYZER_SPICY_HART_IP_UDP|ANALYZER_SPICY_HART_IP_TCP|ANALYZER_SYNCHROPHASOR_TCP|ANALYZER_GENISYS_TCP|ANALYZER_SPICY_GE_SRTP|ANALYZER_SPICY_PROFINET_IO_CM|ANALYZER_S7COMM_TCP|Corelight::PE_XOR|ICSNPP::BACnet|ICSNPP::BSAP|ICSNPP::ENIP|ICSNPP::ETHERCAT|ICSNPP::OPCUA_Binary|Salesforce::GQUIC|Zeek::PROFINET|Zeek::TDS|Seiso::Kafka)"
ENV ZEEK_THIRD_PARTY_PLUGINS_GREP "(Zeek::Spicy|ANALYZER_SPICY_OSPF|ANALYZER_SPICY_OPENVPN_UDP\b|ANALYZER_SPICY_IPSEC_UDP\b|ANALYZER_SPICY_TFTP|ANALYZER_SPICY_WIREGUARD|ANALYZER_SPICY_HART_IP_UDP|ANALYZER_SPICY_HART_IP_TCP|ANALYZER_OMRON_FINS_TCP|ANALYZER_OMRON_FINS_UDP|ANALYZER_SYNCHROPHASOR_TCP|ANALYZER_GENISYS_TCP|ANALYZER_SPICY_GE_SRTP|ANALYZER_SPICY_PROFINET_IO_CM|ANALYZER_S7COMM_TCP|Corelight::PE_XOR|ICSNPP::BACnet|ICSNPP::BSAP|ICSNPP::ENIP|ICSNPP::ETHERCAT|ICSNPP::OPCUA_Binary|Salesforce::GQUIC|Zeek::PROFINET|Zeek::TDS|Seiso::Kafka)"
ENV ZEEK_THIRD_PARTY_SCRIPTS_GREP "(bro-is-darknet/main|bro-simple-scan/scan|bzar/main|callstranger-detector/callstranger|cve-2020-0601/cve-2020-0601|cve-2020-13777/cve-2020-13777|CVE-2020-16898/CVE-2020-16898|CVE-2021-1675/main|CVE-2021-31166/detect|CVE-2021-38647/omigod|CVE-2021-41773/CVE_2021_41773|CVE-2021-42292/main|cve-2021-44228/CVE_2021_44228|cve-2022-21907/main|cve-2022-22954/main|CVE-2022-23270-PPTP/main|CVE-2022-24491/main|CVE-2022-24497/main|cve-2022-26809/main|CVE-2022-26937/main|CVE-2022-30216/main|CVE-2022-3602/__load__|hassh/hassh|http-more-files-names/main|ja4/main|pingback/detect|ripple20/ripple20|SIGRed/CVE-2020-1350|zeek-agenttesla-detector/main|zeek-asyncrat-detector/main|zeek-EternalSafety/main|zeek-httpattacks/main|zeek-netsupport-detector/main|zeek-quasarrat-detector/main|zeek-sniffpass/__load__|zeek-strrat-detector/main|zerologon/main)\.(zeek|bro)"

RUN mkdir -p /tmp/logs && \
cd /tmp/logs && \
export ZEEK_THIRD_PARTY_PLUGINS_COUNT=$(echo "$ZEEK_THIRD_PARTY_PLUGINS_GREP" | grep -P -o "\([^)]+\)" | head -n 1 | sed "s/^(//" | sed "s/)$//" | tr '|' '\n' | wc -l) && \
export ZEEK_THIRD_PARTY_SCRIPTS_COUNT=$(echo "$ZEEK_THIRD_PARTY_SCRIPTS_GREP" | grep -P -o "\([^)]+\)" | head -n 1 | sed "s/^(//" | sed "s/)$//" | tr '|' '\n' | wc -l) && \
"$ZEEK_DIR"/bin/zeek-offline -NN local >zeeknn.log 2>/dev/null && \
bash -c "(( $(grep -cP "$ZEEK_THIRD_PARTY_PLUGINS_GREP" zeeknn.log) >= $ZEEK_THIRD_PARTY_PLUGINS_COUNT)) && echo $ZEEK_THIRD_PARTY_PLUGINS_COUNT' Zeek plugins loaded correctly' || (echo 'One or more Zeek plugins did not load correctly' && cat zeeknn.log && exit 1)" && \
bash -c "(( $(grep -cP "$ZEEK_THIRD_PARTY_PLUGINS_GREP" zeeknn.log) >= $ZEEK_THIRD_PARTY_PLUGINS_COUNT )) && echo $ZEEK_THIRD_PARTY_PLUGINS_COUNT' Zeek plugins loaded correctly' || (echo 'One or more Zeek plugins did not load correctly' && cat zeeknn.log && exit 1)" && \
"$ZEEK_DIR"/bin/zeek-offline -C -r /tmp/pcaps/udp.pcap local policy/misc/loaded-scripts >loaded_scripts.log 2>/dev/null && \
bash -c "(( $(grep -cP "$ZEEK_THIRD_PARTY_SCRIPTS_GREP" loaded_scripts.log) == $ZEEK_THIRD_PARTY_SCRIPTS_COUNT)) && echo $ZEEK_THIRD_PARTY_SCRIPTS_COUNT' Zeek scripts loaded correctly' || (echo 'One or more Zeek scripts did not load correctly' && cat loaded_scripts.log && exit 1)" && \
bash -c "(( $(grep -cP "$ZEEK_THIRD_PARTY_SCRIPTS_GREP" loaded_scripts.log) == $ZEEK_THIRD_PARTY_SCRIPTS_COUNT )) && echo $ZEEK_THIRD_PARTY_SCRIPTS_COUNT' Zeek scripts loaded correctly' || (echo 'One or more Zeek scripts did not load correctly' && cat loaded_scripts.log && exit 1)" && \
cd /tmp && \
rm -rf /tmp/logs /tmp/pcaps

Expand Down Expand Up @@ -267,6 +267,7 @@ ARG ZEEK_DISABLE_SPICY_TAILSCALE=
ARG ZEEK_DISABLE_SPICY_TFTP=
ARG ZEEK_DISABLE_SPICY_WIREGUARD=
ARG ZEEK_SYNCHROPHASOR_DETAILED=
ARG ZEEK_OMRON_FINS_DETAILED=true
ARG ZEEK_KAFKA_ENABLED=
ARG ZEEK_KAFKA_BROKERS=kafka.local:9091
ARG ZEEK_KAFKA_TOPIC=zeek
Expand All @@ -288,6 +289,7 @@ ENV ZEEK_DISABLE_SPICY_TAILSCALE $ZEEK_DISABLE_SPICY_TAILSCALE
ENV ZEEK_DISABLE_SPICY_TFTP $ZEEK_DISABLE_SPICY_TFTP
ENV ZEEK_DISABLE_SPICY_WIREGUARD $ZEEK_DISABLE_SPICY_WIREGUARD
ENV ZEEK_SYNCHROPHASOR_DETAILED $ZEEK_SYNCHROPHASOR_DETAILED
ENV ZEEK_OMRON_FINS_DETAILED $ZEEK_OMRON_FINS_DETAILED
ENV ZEEK_KAFKA_ENABLED $ZEEK_KAFKA_ENABLED
ENV ZEEK_KAFKA_BROKERS $ZEEK_KAFKA_BROKERS
ENV ZEEK_KAFKA_TOPIC $ZEEK_KAFKA_TOPIC
Expand Down
2 changes: 1 addition & 1 deletion LICENSE.txt
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
Copyright 2024 Battelle Energy Alliance, LLC
Copyright 2025 Battelle Energy Alliance, LLC

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion NOTICE.txt
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ https://github.com/idaholab/Malcolm

See LICENSE.txt for license terms.

Malcolm is Copyright (c) 2024 Battelle Energy Alliance, LLC, and is developed
Malcolm is Copyright (c) 2025 Battelle Energy Alliance, LLC, and is developed
and released through the cooperation of the Cybersecurity and Infrastructure
Security Agency of the U.S. Department of Homeland Security. All rights reserved.

Expand Down
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ You can help steer Malcolm's development by sharing your ideas and feedback. Ple

## <a name="Footer"></a>Copyright and License

Malcolm is Copyright 2024 Battelle Energy Alliance, LLC, and is developed and released through the cooperation of the [Cybersecurity and Infrastructure Security Agency](https://www.cisa.gov/) of the [U.S. Department of Homeland Security](https://www.dhs.gov/).
Malcolm is Copyright 2025 Battelle Energy Alliance, LLC, and is developed and released through the cooperation of the [Cybersecurity and Infrastructure Security Agency](https://www.cisa.gov/) of the [U.S. Department of Homeland Security](https://www.dhs.gov/).

Malcolm is licensed under the Apache License, version 2.0. See `LICENSE.txt` for the terms of its release.

Expand Down
2 changes: 1 addition & 1 deletion _config.yml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
repository: idaholab/Malcolm
title: Malcolm
malcolm:
version: 24.12.0
version: 25.01.0
description: A powerful, easily deployable network traffic analysis tool suite for network security monitoring
logo: docs/images/logo/Malcolm_outline_banner_dark.png
remote_theme: pages-themes/[email protected]
Expand Down
2 changes: 1 addition & 1 deletion api/requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -6,5 +6,5 @@ requests==2.32.0
regex==2022.3.2
dateparser==1.1.1
elasticsearch==8.17.0
elasticsearch-dsl==8.17.0
elasticsearch-dsl==8.17.1
psutil==5.9.8
Loading