diff --git a/docs/source/cast-big-data/beats.rst b/docs/source/cast-big-data/beats.rst index f79de7b19..746fd6236 100644 --- a/docs/source/cast-big-data/beats.rst +++ b/docs/source/cast-big-data/beats.rst @@ -24,6 +24,8 @@ for a more generalized installation guide please consult the official `Filebeats 1. Install the filebeats rpm on the node: +This node is usually the CSM master where transaction logs are located. + .. code-block:: bash rpm -ivh filebeat-*.rpm diff --git a/docs/source/cast-big-data/common-problems.rst b/docs/source/cast-big-data/common-problems.rst index 4c3d47a8b..2014c32bf 100644 --- a/docs/source/cast-big-data/common-problems.rst +++ b/docs/source/cast-big-data/common-problems.rst @@ -20,7 +20,7 @@ There was a typo in a previous version of CAST. The field "close_removed" is a b Logstash Not Starting --------------------- -In ELK 6.8.1, Logstash may not start and run on Power, due to an arch issue. +In ELK 7.5.1, Logstash may not start and run on Power, due to an arch issue. .. code-block:: none @@ -35,7 +35,7 @@ GitHub Issue: https://github.com/elastic/logstash/issues/10755 IBM and the CAST team have made a script to fix this packaging issue. -The patch can be found in the CAST repo at: https://github.com/IBM/CAST/blob/master/csm_big_data/logstash/patches/csm_logstash_6-8-1_patch.sh and in the install dir at: ``/opt/ibm/csm/bigdata/logstash/patches/csm_logstash_6-8-1_patch.sh``. +The patch can be found in the CAST repo at: https://github.com/IBM/CAST/blob/master/csm_big_data/logstash/csm_logstash_patch_jruby_9.2.8.sh and in the install dir at: ``/opt/ibm/csm/bigdata/logstash/csm_logstash_patch_jruby_9.2.8.sh``. Run this patch before starting Logstash. diff --git a/docs/source/cast-big-data/elasticsearch.rst b/docs/source/cast-big-data/elasticsearch.rst index 8f4b71ece..38234419a 100644 --- a/docs/source/cast-big-data/elasticsearch.rst +++ b/docs/source/cast-big-data/elasticsearch.rst @@ -14,8 +14,10 @@ storage or large numbers of drives are prefered. Configuration ------------- -.. note:: This guide has been tested using Elasticsearch 6.8.1, the latest RPM may be downloaded from - `the Elastic Site `_. +.. note:: This guide has been tested using Elasticsearch 7.5.1, which is built for IBM System P. + At this writing, + `the Elastic Site `_ no longer provided rpms + for the ppc64le architecture. The following is a brief introduction to the installation and configuration of the elasticsearch service. It is generally assumed that elasticsearch is to be installed on multiple Big Data Nodes to take @@ -26,11 +28,45 @@ CAST provides a set of sample configuration files in the repository at `csm_big_ If the |csm-bds| rpm as been installed the sample configurations may be found in `/opt/ibm/csm/bigdata/elasticsearch/`. -1. Install the elasticsearch rpm and java 1.8.1+ (command run from directory with elasticsearch rpm): +Preparing for installation +^^^^^^^^^^^^^^^^^^^^^^^^^^ + +Create user ID for `Elasticsearch`, `Kibana`, and `Logstash` on all the BDS nodes. Each user ID should have unique ID number. For example: + +Verify the groups and users were submitted into the `/etc/passwd` and `/etc/group` files. + +.. code-block:: bash + + grep 'logstash\|elasticsearch\|kibana' /etc/passwd /etc/group + /etc/passwd:elasticsearch:x:1900:1900::/home/elasticsearch:/bin/bash + /etc/passwd:kibana:x:1901:1901::/home/kibana:/bin/bash + /etc/passwd:logstash:x:1902:1902::/home/logstash:/bin/bash + /etc/group:elasticsearch:x:1900: + /etc/group:kibana:x:1901: + /etc/group:logstash:x:1902: + +1. Install the elasticsearch rpm and java-11 (command run from directory with elasticsearch rpm): + +.. code-block:: bash + + yum install -y elasticsearch-*.rpm java* + +.. note:: After installing `Java`, set up the `JAVA` environment variables in root's `.bashrc` file. Assuming `Java` is installed in `/usr/lib/jvm/java-11`. + +.. code-block:: bash + + export JAVA_HOME=/usr/lib/jvm/java-11 + export PATH=/usr/lib/jvm/java-11/bin:$PATH + +The above dir. could also be a symbolic link. There could be multiple versions of `Java` installed by other software. Find out where java is: .. code-block:: bash - yum install -y elasticsearch-*.rpm java-1.8.*-openjdk + # which java + /usr/lib/jvm/java-11/bin/java + + # ls -ld /usr/lib/jvm/java-11 + lrwxrwxrwx 1 root root 29 Jul 12 15:59 /usr/lib/jvm/java-11 -> /etc/alternatives/java_sdk_11 2. Copy the Elasticsearch configuration files to the `/etc/elasticsearch` directory. @@ -62,8 +98,8 @@ in `/opt/ibm/csm/bigdata/elasticsearch/`. .. note:: This is technically optional, however, data will have limited use. This script configures Elasticsearch to properly parse timestamps. -Elasticsearch should now be operational. If Logstash was properly configured there should already -be data being written to your index. +Elasticsearch should now be operational. Next logical step is to + `install and configure Logstash `_. Tuning Elasticsearch -------------------- diff --git a/docs/source/cast-big-data/kibana.rst b/docs/source/cast-big-data/kibana.rst index 2bbed28b7..365a480e7 100644 --- a/docs/source/cast-big-data/kibana.rst +++ b/docs/source/cast-big-data/kibana.rst @@ -10,18 +10,77 @@ CAST provides a utility plugin for multistep searches of CSM jobs in Kibana dash Configuration ------------- -.. note:: This guide has been tested using Kibana 6.8.1, the latest RPM may be downloaded from - `the Elastic Site `_. +.. note:: This guide has been tested using Kibana 7.5.1, which is built for IBM System P. + At this writing, + `the Elastic Site `_ no longer provided rpms + for the ppc64le architecture. The following is a brief introduction to the installation and configuration of the Kibana service. At the current time CAST does not provide a configuration file in its RPM. +.. note:: `Kibana` installation has dependency on `node.js`. Make sure the RH BASEOS media or repository is available. + 1. Install the Kibana rpm: .. code-block:: bash - yum install -y kibana-*.rpm + yum install -y kibana-*.rpm + +.. code-block:: bash + + # yum install kibana-7.5.1-1_ol001.el8.ppc64le.rpm + Updating Subscription Management repositories. + Unable to read consumer identity + + This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. + + Last metadata expiration check: 0:24:48 ago on Mon 12 Jul 2021 03:49:51 PM EDT. + Dependencies resolved. + ============================================================================================================================================================= + Package Arch Version Repository Size + ============================================================================================================================================================= + Installing: + kibana ppc64le 7.5.1-1_ol001.el8 @commandline 202 M + Installing dependencies: + nodejs ppc64le 1:10.24.0-1.module+el8.3.0+10166+b07ac28e local-rhels8.4-ppc64le--install-REPO-os-rhels-8.4-rhels8.4-ga-repo-ppc64le 9.2 M + npm ppc64le 1:6.14.11-1.10.24.0.1.module+el8.3.0+10166+b07ac28e local-rhels8.4-ppc64le--install-REPO-os-rhels-8.4-rhels8.4-ga-repo-ppc64le 3.7 M + Enabling module streams: + nodejs 10 + + Transaction Summary + ============================================================================================================================================================= + Install 3 Packages + + Total size: 214 M + Total download size: 13 M + Installed size: 661 M + Is this ok [y/N]: y + +.. note:: `Kibana` requires the dir `/var/run/kibana` to store its pid. Create the directory if not there. + +.. code-block:: bash + + mkdir /var/run/kibana; chown -R kibana:kibana /var/run/kibana + # ls -l /var/run/ | grep kibana + drwxr-xr-x 2 kibana kibana 60 Sep 15 16:18 kibana + +After successful `Kibana` installation, check following directory. + +.. code-block:: bash + + # ls -ld /usr/share/kibana + drwxr-xr-x 11 root root 4096 Jul 12 16:15 /usr/share/kibana + # ls -ld /var/run/kibana + drwxr-xr-x 2 kibana kibana 60 Sep 15 16:18 /var/run/kibana + +Each installation also put configuration files and templates into /etc. For example: + +.. code-block:: bash + + # ls -l /etc/kibana + -rw-r--r-- 1 kibana kibana 344 Jul 12 16:26 kibana.yml + -rw-r--r-- 1 kibana kibana 5149 Jul 12 16:26 kibana.yml.inst 2. Configure the Kibana YAML file (`/etc/kibana/kibana.yml`) @@ -48,6 +107,8 @@ CAST recommends the following four values be set before starting Kibana: rpm -ivh ibm-csm-bds-kibana-*.noarch.rpm +See `Cast Search `_ for more information. + 4. Start Kibana: .. code-block:: bash @@ -63,7 +124,7 @@ CAST Search CAST Search is a React plugin designed for interfacing with elastic search an building filters for Kibana Dashboards. To maxmize the value of the plugin the `cast-allocation` index pattern should be -specified. +specified. See detailed instructions for `Cast Search installation and configuration `_. .. TODO describe funciton and feature in greater depth. diff --git a/docs/source/cast-big-data/logstash.rst b/docs/source/cast-big-data/logstash.rst index 23b54be83..9182a703d 100644 --- a/docs/source/cast-big-data/logstash.rst +++ b/docs/source/cast-big-data/logstash.rst @@ -23,8 +23,10 @@ Installation and Configuration Installation ^^^^^^^^^^^^ -.. note:: This guide has been tested using Logstash 6.8.1, the latest RPM may be downloaded from - `the Elastic Site `_. +.. note:: This guide has been tested using Logstash 7.5.1, which is built for IBM System P. + At this writing, + `the Elastic Site `_ no longer provided rpms + for the ppc64le architecture. For the official install guide of Logstash in the ELK stack go to: `Installing Logstash`_ @@ -33,11 +35,66 @@ CAST provides a set of sample configuration files in the repository at `csm_big_ If the |csm-bds| rpm has been installed the sample configurations may be found in `/opt/ibm/csm/bigdata/logstash/`. -1. Install the logstash rpm and java 1.8.1+ (command run from directory with logstash rpm): +Preparing for installation + +The Elastic software stack components are installed and run on multiple nodes with associated +user name such as `elasticsearch`, `kibana`, and `logstash`. They are required to have +the same user ID and group ID across nodes. Following are examples of creating and verifying +these user IDs. + +.. code-block:: bash + + # groupadd -g 1900 elasticsearch; groupadd -g 1901 kibana; groupadd -g 1902 logstash + # useradd -g 1900 -u 1900 elasticsearch; useradd -g 1901 -u 1901 kibana; useradd -g 1902 -u 1902 logstash + +.. code-block:: bash + + grep 'logstash\|elasticsearch\|kibana' /etc/passwd /etc/group + /etc/passwd:elasticsearch:x:1900:1900::/home/elasticsearch:/bin/bash + /etc/passwd:kibana:x:1901:1901::/home/kibana:/bin/bash + /etc/passwd:logstash:x:1902:1902::/home/logstash:/bin/bash + /etc/group:elasticsearch:x:1900: + /etc/group:kibana:x:1901: + /etc/group:logstash:x:1902: + +1. Install the logstash rpm and java-11 (command run from directory with logstash rpm): + +.. code-block:: bash + + yum install -y logstash-*.rpm java-11* + +.. note:: Java-11 is a prerequite and can be installed before logstash. In that case, you just + install logstash. + +.. code-block:: bash + + yum install -y logstash-*.rpm + +After the JAVA-11 installation + +.. note:: After installing `Java`, set up the `JAVA` environment variables in root's `.bashrc` file. Assuming `Java` is installed in `/usr/lib/jvm/java-11`. + +Additionally, bundler and jruby could be installed outside of logstash, so these could also be include in the `/root/.bashrc` file as well. +There could be incompatibility issues because logstash installs its own bundler and jruby. They have to be added in-front of the PATH so they are found first. +The admin can try to run the two different versions by specifying absolute paths. + +.. code-block:: bash + + export JAVA_HOME=/usr/lib/jvm/java-11 + export PATH=/usr/lib/jvm/java-11/bin:$PATH + export BUNDLE_DIR=/usr/share/logstash/vendor/bundle/jruby/2.5.0/bin + export JRUBY_DIR=/usr/share/logstash/vendor/jruby/bin + export PATH=$BUNDLE_DIR:$JRUBY_DIR:$PATH + +The above dir. could also be a symbolic link. There could be multiple versions of `Java` installed by other software. Find out where java is: .. code-block:: bash - yum install -y logstash-*.rpm java-1.8.*-openjdk + # which java + /usr/lib/jvm/java-11/bin/java + + # ls -ld /usr/lib/jvm/java-11 + lrwxrwxrwx 1 root root 29 Jul 12 15:59 /usr/lib/jvm/java-11 -> /etc/alternatives/java_sdk_11 2. Copy the Logstash pipeline configuration files to the appropriate directories. @@ -94,6 +151,9 @@ Configuration pipeline.batch.size: 2000 # This is the MAXIMUM, to prevent exceedingly long waits a delay is supplied. pipeline.batch.delay: 50 # Maximum time to wait to execute an underfilled queue in milliseconds. queue.type: persisted + log.level: info + path.queue: /var/log/logstash/logstash-queue/ + queue.max_bytes: 300gb ... Tuning logstash is highly dependant on your use case and environment. What follows is a set of @@ -207,7 +267,7 @@ Now that every thing has been installed and configured. You can start Logstash. Logstash should now be operational. At this point data aggregators should be configured to point to your Logstash node as appropriate. -.. note:: In ELK 6.8.1, Logstash may not start and run on Power, due to an arch issue. Please see: :ref:`Logstash_Not_Starting` +.. note:: In ELK 7.5.1, Logstash may not start and run on Power, due to an arch issue. Please see: :ref:`Logstash_Not_Starting` CSM Event Correlator --------------------- diff --git a/docs/source/conf.py b/docs/source/conf.py index 15d8be99e..85a537c51 100644 --- a/docs/source/conf.py +++ b/docs/source/conf.py @@ -51,7 +51,7 @@ # General information about the project. project = u'CAST' -copyright = u'2020, IBM Corporation' +copyright = u'2021, IBM Corporation' author = u'IBM Corporation' # The version info for the project you're documenting, acts as replacement for @@ -59,9 +59,9 @@ # built documents. # # The short X.Y version. -version = u'1.8.2' +version = u'1.8.3' # The full version, including alpha/beta/rc tags. -release = u'1.8.2' +release = u'1.8.3' # The language for content autogenerated by Sphinx. Refer to documentation # for a list of supported languages. diff --git a/docs/source/csm/csm-installation-and-configuration/appendices.rst b/docs/source/csm/csm-installation-and-configuration/appendices.rst index 08cb0344f..b48888dab 100644 --- a/docs/source/csm/csm-installation-and-configuration/appendices.rst +++ b/docs/source/csm/csm-installation-and-configuration/appendices.rst @@ -10,7 +10,7 @@ Please ensure the following steps have been completed on the xCAT Management nod 1. xCAT has been installed and the basic configuration has been completed. 2. Section 2.2 has been completed and the cast-boost rpms are currently accessible at ``${HOME}/rpmbuild/RPMS/ppc64le``. -3. The ``ibm-flightlog-1.8.2-*.ppc64le`` is present on the xCAT Management node. +3. The ``ibm-flightlog-1.8.3-*.ppc64le`` is present on the xCAT Management node. 4. Install ``createrepo`` for building the other packages directory. After verifying the above steps have been completed do the following: @@ -19,7 +19,7 @@ After verifying the above steps have been completed do the following: .. code-block:: bash - $ copycds RHEL-7.5-Server-ppc64le-dvd1.iso + $ copycds RHEL-8.4-Server-ppc64le-dvd1.iso $ lsdef –t osimage @@ -27,50 +27,50 @@ After verifying the above steps have been completed do the following: .. code-block:: bash - $ image_input="rhels7.5-ppc64le-netboot-compute" - $ image_output="rhels7.5-ppc64le-diskless-compute" + $ image_input="rhels8.4-ppc64le-netboot-compute" + $ image_output="rhels8.4-ppc64le-diskless-compute" $ lsdef -t osimage -z $image_input | sed -e "s/$image_input/$image_output/g" | mkdef -z 3. Move the cast-boost rpms to the otherpkgdir directory for the generation of the diskless image: .. code-block:: bash - $ lsdef -t osimage rhels7.5-ppc64le-diskless-compute - $ cp cast-boost* /install/post/otherpkgs/rhels7.5/ppc64le/cast-boost - $ createrepo /install/post/otherpkgs/rhels7.5/ppc64le/cast-boost + $ lsdef -t osimage rhels8.4-ppc64le-diskless-compute + $ cp cast-boost* /install/post/otherpkgs/rhels8.4/ppc64le/cast-boost + $ createrepo /install/post/otherpkgs/rhels8.4/ppc64le/cast-boost 4. Move the CSM rpms to the otherpkgdir directory: .. code-block:: bash - $ cp csm_rpms/* /install/post/otherpkgs/rhels7.5/ppc64le/csm - $ createrepo /install/post/otherpkgs/rhels7.5/ppc64le/csm + $ cp csm_rpms/* /install/post/otherpkgs/rhels8.4/ppc64le/csm + $ createrepo /install/post/otherpkgs/rhels8.4/ppc64le/csm 5. Run creatrepo one last time: .. code-block:: bash - $ createrepo /install/post/otherpkgs/rhels7.5/ppc64le + $ createrepo /install/post/otherpkgs/rhels8.4/ppc64le 6. Add the following to a package list in the otherpkgdir, then add the package list to the osimage: .. code-block:: bash - $ vi /install/post/otherpkgs/rhels7.5/ppc64le/csm.pkglist + $ vi /install/post/otherpkgs/rhels8.4/ppc64le/csm.pkglist cast-boost/cast-boost-* - csm/ibm-flightlog-1.8.2-*.ppc64le - csm/ibm-csm-core-1.8.2-*.ppc64le - csm/ibm-csm-api-1.8.2-*.ppc64le + csm/ibm-flightlog-1.8.3-*.ppc64le + csm/ibm-csm-core-1.8.3-*.ppc64le + csm/ibm-csm-api-1.8.3-*.ppc64le - $ chdef -t osimage rhels7.5-ppc64le-diskless-compute otherpkglist=/install/post/otherpkgs/rhels7.5/ppc64le/csm.pkglist + $ chdef -t osimage rhels8.4-ppc64le-diskless-compute otherpkglist=/install/post/otherpkgs/rhels8.4/ppc64le/csm.pkglist 7. Generate and package the diskless image: .. code-block:: bash - $ genimage rhels7.5-ppc64le-diskless-compute - $ packimage rhels7.5-ppc64le-diskless-compute + $ genimage rhels8.4-ppc64le-diskless-compute + $ packimage rhels8.4-ppc64le-diskless-compute diff --git a/docs/source/csm/csm-installation-and-configuration/configuration.rst b/docs/source/csm/csm-installation-and-configuration/configuration.rst index 219b72805..e2151ccee 100644 --- a/docs/source/csm/csm-installation-and-configuration/configuration.rst +++ b/docs/source/csm/csm-installation-and-configuration/configuration.rst @@ -244,7 +244,7 @@ Run CSM infrastructure health check on the login / launch node to verify the inf Connected. Checking infrastructure... (this may take a moment. Please be patient...) ###### RESPONSE FROM THE LOCAL DAEMON ####### - MASTER: c650f99p06 (bounced=0; version=1.8.2) + MASTER: c650f99p06 (bounced=0; version=1.8.3) DB_free_conn_size: 10 DB_locked_conn_pool_size: 0 Timer_test: success @@ -255,7 +255,7 @@ Run CSM infrastructure health check on the login / launch node to verify the inf UniqueID_test: success Aggregators:2 - AGGREGATOR: c650f99p06 (bounced=1; version=1.8.2) + AGGREGATOR: c650f99p06 (bounced=1; version=1.8.3) Active_primary: 2 Unresponsive_primary: 0 Active_secondary: 2 @@ -263,17 +263,17 @@ Run CSM infrastructure health check on the login / launch node to verify the inf Primary Nodes: Active: 2 - COMPUTE: c650f99p18 (bounced=1; version=1.8.2; link=PRIMARY) - COMPUTE: c650f99p26 (bounced=1; version=1.8.2; link=SECONDARY) + COMPUTE: c650f99p18 (bounced=1; version=1.8.3; link=PRIMARY) + COMPUTE: c650f99p26 (bounced=1; version=1.8.3; link=SECONDARY) Unresponsive: 0 Secondary Nodes: Active: 2 - COMPUTE: c650f99p36 (bounced=1; version=1.8.2; link=SECONDARY) - COMPUTE: c650f99p28 (bounced=1; version=1.8.2; link=SECONDARY) + COMPUTE: c650f99p36 (bounced=1; version=1.8.3; link=SECONDARY) + COMPUTE: c650f99p28 (bounced=1; version=1.8.3; link=SECONDARY) Unresponsive: 0 - AGGREGATOR: c650f99p30 (bounced=1; version=1.8.2) + AGGREGATOR: c650f99p30 (bounced=1; version=1.8.3) Active_primary: 2 Unresponsive_primary: 0 Active_secondary: 2 @@ -281,25 +281,25 @@ Run CSM infrastructure health check on the login / launch node to verify the inf Primary Nodes: Active: 2 - COMPUTE: c650f99p36 (bounced=1; version=1.8.2; link=PRIMARY) - COMPUTE: c650f99p28 (bounced=1; version=1.8.2; link=PRIMARY) + COMPUTE: c650f99p36 (bounced=1; version=1.8.3; link=PRIMARY) + COMPUTE: c650f99p28 (bounced=1; version=1.8.3; link=PRIMARY) Unresponsive: 0 Secondary Nodes: Active: 2 - COMPUTE: c650f99p18 (bounced=1; version=1.8.2; link=SECONDARY) - COMPUTE: c650f99p26 (bounced=1; version=1.8.2; link=PRIMARY) + COMPUTE: c650f99p18 (bounced=1; version=1.8.3; link=SECONDARY) + COMPUTE: c650f99p26 (bounced=1; version=1.8.3; link=PRIMARY) Unresponsive: 0 Unresponsive Aggregators: 0 Utility Nodes:1 - UTILITY: c650f99p16 (bounced=1; version=1.8.2) + UTILITY: c650f99p16 (bounced=1; version=1.8.3) Unresponsive Utility Nodes: 0 - Local_daemon: MASTER: c650f99p06 (bounced=0; version=1.8.2) + Local_daemon: MASTER: c650f99p06 (bounced=0; version=1.8.3) Status: ############################################# @@ -331,7 +331,7 @@ Install the ibm-csm-restd rpm if it is not already installed: .. code-block:: bash - $ rpm -ivh ibm-csm-restd-1.8.2-*.ppc64le.rpm + $ rpm -ivh ibm-csm-restd-1.8.3-*.ppc64le.rpm Copy the default configuration file from /opt/ibm/csm/share/etc to /etc/ibm/csm: diff --git a/docs/source/csm/csm-installation-and-configuration/installation.rst b/docs/source/csm/csm-installation-and-configuration/installation.rst index c83a14ab9..9fa6bac8d 100644 --- a/docs/source/csm/csm-installation-and-configuration/installation.rst +++ b/docs/source/csm/csm-installation-and-configuration/installation.rst @@ -8,7 +8,7 @@ List of CSM RPMs The following RPMs are all of the required RPMs for :ref:`CSM`. These RPMs can be found on Box in the same folder as this document. Please verify that you have all required RPMs. -For CSM, all CSM rpms have a version of ibm-csm-component-1.8.2-commit_sequence.ppc64le.rpm, for example, ibm-csm-core-1.8.2-3566.ppc64le.rpm. The commit_sequence portion is an increasing value that changes every time a new commit is added to the repository. Because the commit_sequence changes so frequently, this document makes use of a wildcard for this portion of the rpm name. +For CSM, all CSM rpms have a version of ibm-csm-component-1.8.3-commit_sequence.ppc64le.rpm, for example, ibm-csm-core-1.8.3-3605.ppc64le.rpm. The commit_sequence portion is an increasing value that changes every time a new commit is added to the repository. Because the commit_sequence changes so frequently, this document makes use of a wildcard for this portion of the rpm name. **ibm-csm-core** holds CSM infrastructure daemon and configuration file examples. @@ -137,13 +137,13 @@ Install the flightlog RPM and the following CSM RPMs, which can be found on Box. .. code-block:: bash - $ rpm -ivh ibm-flightlog-1.8.2-*.ppc64le.rpm \ - ibm-csm-core-1.8.2-*.ppc64le.rpm \ - ibm-csm-api-1.8.2-*.ppc64le.rpm \ - ibm-csm-db-1.8.2-*.noarch.rpm \ - ibm-csm-bds-1.8.2-*.noarch.rpm \ - ibm-csm-hcdiag-1.8.2-*.noarch.rpm \ - ibm-csm-restd-1.8.2-*.ppc64le.rpm + $ rpm -ivh ibm-flightlog-1.8.3-*.ppc64le.rpm \ + ibm-csm-core-1.8.3-*.ppc64le.rpm \ + ibm-csm-api-1.8.3-*.ppc64le.rpm \ + ibm-csm-db-1.8.3-*.noarch.rpm \ + ibm-csm-bds-1.8.3-*.noarch.rpm \ + ibm-csm-hcdiag-1.8.3-*.noarch.rpm \ + ibm-csm-restd-1.8.3-*.ppc64le.rpm Installing CSM onto the Service Nodes ------------------------------------- @@ -158,13 +158,13 @@ Clone existing images, add the following packages to the “otherpkgs” directo .. code-block:: bash cast-boost-* - ibm-flightlog-1.8.2-*.ppc64le - ibm-csm-core-1.8.2-*.ppc64le - ibm-csm-api-1.8.2-*.ppc64le - ibm-csm-bds-1.8.2-*.noarch - ibm-csm-bds-logstash-1.8.2-*.noarch - ibm-csm-hcdiag-1.8.2-*.noarch - ibm-csm-restd-1.8.2-*.ppc64le + ibm-flightlog-1.8.3-*.ppc64le + ibm-csm-core-1.8.3-*.ppc64le + ibm-csm-api-1.8.3-*.ppc64le + ibm-csm-bds-1.8.3-*.noarch + ibm-csm-bds-logstash-1.8.3-*.noarch + ibm-csm-hcdiag-1.8.3-*.noarch + ibm-csm-restd-1.8.3-*.ppc64le Full Disk ^^^^^^^^^ @@ -187,13 +187,13 @@ Install the flightlog RPM and the following CSM RPMs, which can be found on Box. .. code-block:: bash - $ rpm -ivh ibm-flightlog-1.8.2-*.ppc64le.rpm \ - ibm-csm-core-1.8.2-*.ppc64le.rpm \ - ibm-csm-api-1.8.2-*.ppc64le.rpm \ - ibm-csm-bds-1.8.2-*.noarch.rpm \ - ibm-csm-bds-logstash-1.8.2-*.noarch.rpm \ - ibm-csm-hcdiag-1.8.2-*.noarch.rpm \ - ibm-csm-restd-1.8.2-*.ppc64le.rpm + $ rpm -ivh ibm-flightlog-1.8.3-*.ppc64le.rpm \ + ibm-csm-core-1.8.3-*.ppc64le.rpm \ + ibm-csm-api-1.8.3-*.ppc64le.rpm \ + ibm-csm-bds-1.8.3-*.noarch.rpm \ + ibm-csm-bds-logstash-1.8.3-*.noarch.rpm \ + ibm-csm-hcdiag-1.8.3-*.noarch.rpm \ + ibm-csm-restd-1.8.3-*.ppc64le.rpm Installing CSM onto the Login, Launch, and Workload manager Nodes ----------------------------------------------------------------- @@ -208,10 +208,10 @@ Clone existing images, add the following packages to the “otherpkgs” directo .. code-block:: bash cast-boost-* - ibm-flightlog-1.8.2-*.ppc64le - ibm-csm-core-1.8.2-*.ppc64le - ibm-csm-api-1.8.2-*.ppc64le - ibm-csm-hcdiag-1.8.2-*.noarch + ibm-flightlog-1.8.3-*.ppc64le + ibm-csm-core-1.8.3-*.ppc64le + ibm-csm-api-1.8.3-*.ppc64le + ibm-csm-hcdiag-1.8.3-*.noarch Full Disk ^^^^^^^^^ @@ -229,10 +229,10 @@ Install the cast-boost RPMs, which can be found on Box .. code-block:: bash - $ rpm -ivh ibm-flightlog-1.8.2-*.ppc64le.rpm \ - ibm-csm-core-1.8.2-*.ppc64le.rpm \ - ibm-csm-api-1.8.2-*.ppc64le.rpm \ - ibm-csm-hcdiag-1.8.2-*.noarch.rpm + $ rpm -ivh ibm-flightlog-1.8.3-*.ppc64le.rpm \ + ibm-csm-core-1.8.3-*.ppc64le.rpm \ + ibm-csm-api-1.8.3-*.ppc64le.rpm \ + ibm-csm-hcdiag-1.8.3-*.noarch.rpm Installing CSM onto the Compute Nodes ------------------------------------- @@ -247,10 +247,10 @@ Clone existing images, add the following packages to the “otherpkgs” directo .. code-block:: bash cast-boost-* - ibm-flightlog-1.8.2-*.ppc64le - ibm-csm-core-1.8.2-*.ppc64le - ibm-csm-api-1.8.2-*.ppc64le - ibm-csm-hcdiag-1.8.2-*.noarch + ibm-flightlog-1.8.3-*.ppc64le + ibm-csm-core-1.8.3-*.ppc64le + ibm-csm-api-1.8.3-*.ppc64le + ibm-csm-hcdiag-1.8.3-*.noarch Full disk ^^^^^^^^^ @@ -276,10 +276,10 @@ Note: replace ``/path/to/rpms`` with the appropriate location for your system. $ xdsh compute "cd /path/to/rpms; \ - rpm -ivh ibm-flightlog-1.8.2-*.ppc64le.rpm \ - ibm-csm-core-1.8.2-*.ppc64le.rpm \ - ibm-csm-api-1.8.2-*.ppc64le.rpm \ - ibm-csm-hcdiag-1.8.2-*.noarch" + rpm -ivh ibm-flightlog-1.8.3-*.ppc64le.rpm \ + ibm-csm-core-1.8.3-*.ppc64le.rpm \ + ibm-csm-api-1.8.3-*.ppc64le.rpm \ + ibm-csm-hcdiag-1.8.3-*.noarch" diff --git a/docs/source/csm/csm-installation-and-configuration/pre_requisites.rst b/docs/source/csm/csm-installation-and-configuration/pre_requisites.rst index 8559c345c..42b9ea47f 100644 --- a/docs/source/csm/csm-installation-and-configuration/pre_requisites.rst +++ b/docs/source/csm/csm-installation-and-configuration/pre_requisites.rst @@ -23,13 +23,13 @@ Without these dependencies CSM cannot run. - Version - Comments * - xCAT - - 2.16.1 + - 2.16.2 - * - Postgres SQL - - 10.6 + - 10.15 - `xCAT document for migration `_ * - openssl-libs - - 1.1.1c-15 + - 1.1.1g-15.el8_3 - * - perl-YAML - 1.24-3 @@ -38,11 +38,12 @@ Without these dependencies CSM cannot run. - 2.97.001-2 - Required by the Diagnostic's tests that get information from the UFM. * - cast-boost - - 1.66.0-7 + - 1.66.0-10 - Found on Box Already bumped up on rhels 8 CSM uses the version of boost RPMS included with the OS instead of the custom built cast-boost RPMS used of rhels 7 * - P9 Witherspoon firmware level - - * **BMC:** ibm-v2.3-476-g2d622cb-r33-coral-cfm-0-gb2c03c9 - * **Host:** IBM-witherspoon-OP9_v2.0.14_1.2 + - * A minimum Server Firmware level of OP940.20 for models 8335-GTX and 8335-GTH. + * A minimum Server Firmware level of OP910.50 for 8335-GTG. + * A minimum Server Firmware level of OP910.50C for models 8335-GTC and 8335-GTW. - Found on Box @@ -92,7 +93,7 @@ These dependencies are highly suggested. * net-tools package (ifconfig command) * mesa-libGLU-devel and mesa-libGLU packages * - Spectrum MPI - - 10.4.0.2 + - 10.4.0.4 - Needed by the Diagnostic tests: * dgemm @@ -105,10 +106,10 @@ These dependencies are highly suggested. * IBM ESSL (IBM Engineering and Scientific Subroutine Libray) * IBM XL Fortran * - sudo - - sudo-1.8.29-5.el8.ppc64le + - sudo-1.8.29-7.el8.ppc64le - Required by the Diagnostic’s tests that needs to run as root * - lm-sensors - - 3.4.0 + - 3.4.0-22 - Required by the Diagnostic’s temperature tests. @@ -123,7 +124,7 @@ Software with dependencies on CSM - Version - Comments * - Spectrum LSF - - 10.1 (With SP 4.0 Update) + - 10.1 (fix pack 12) - * - Burst Buffer - 1.8.2 diff --git a/docs/source/csm/csm-installation-and-configuration/uninstallation.rst b/docs/source/csm/csm-installation-and-configuration/uninstallation.rst index d68dd3480..7d9f05ef0 100644 --- a/docs/source/csm/csm-installation-and-configuration/uninstallation.rst +++ b/docs/source/csm/csm-installation-and-configuration/uninstallation.rst @@ -24,9 +24,9 @@ Remove rpms .. code-block:: bash - $ xdsh compute,utility "rpm -e ibm-csm-core-1.8.2-*.ppc64le ibm-csm-api-1.8.2-*.ppc64le ibm-flightlog-1.8.2-*.ppc64le ibm-csm-hcdiag-1.8.2-*.noarch" + $ xdsh compute,utility "rpm -e ibm-csm-core-1.8.3-*.ppc64le ibm-csm-api-1.8.3-*.ppc64le ibm-flightlog-1.8.3-*.ppc64le ibm-csm-hcdiag-1.8.3-*.noarch" - $ rpm -e ibm-csm-core-1.8.2-*.ppc64le ibm-csm-hcdiag-1.8.2-*.noarch ibm-csm-db-1.8.2-*.noarch ibm-csm-api-1.8.2-*.ppc64le ibm-csm-restd-1.8.2-*.ppc64le ibm-flightlog-1.8.2-*.ppc64le + $ rpm -e ibm-csm-core-1.8.3-*.ppc64le ibm-csm-hcdiag-1.8.3-*.noarch ibm-csm-db-1.8.3-*.noarch ibm-csm-api-1.8.3-*.ppc64le ibm-csm-restd-1.8.3-*.ppc64le ibm-flightlog-1.8.3-*.ppc64le Clean up log and configuration files diff --git a/docs/source/csm/csm-user-guide/csm_rest_daemon.rst b/docs/source/csm/csm-user-guide/csm_rest_daemon.rst index dd78c1172..1562adeb6 100644 --- a/docs/source/csm/csm-user-guide/csm_rest_daemon.rst +++ b/docs/source/csm/csm-user-guide/csm_rest_daemon.rst @@ -12,7 +12,7 @@ The CSM REST daemon (csmrestd) is optional and is not required for normal cluste Packaging and Installation -------------------------- -All required binaries, configuration files, and example scripts are packaged in ``ibm-csm-restd-1.8.2-*.ppc64le.rpm``. +All required binaries, configuration files, and example scripts are packaged in ``ibm-csm-restd-1.8.3-*.ppc64le.rpm``. To install and configure csmrestd, please refer to :ref:`CSM_INSTALLATION_AND_CONFIGURATION`. Creating a CSM RAS event via the REST API