Tableau RMT not working

Server Details

Tableau server version: 2023.3.8

RMT versions tried: 2023.3.1 / 2024.2.2 (facing same issue on both)

RMT Ubuntu: 22.04

I am able to install RMT on the target server and register envs

1. curl -O https://downloads.tableau.com/esdalt/2023.3.1/tableau_powertools/Tabrmt-Master-amd64-2023-3-1.deb
2. sudo gdebi -n Tabrmt-Master-amd64-2023-3-1.deb
3. sudo /opt/tableau/tabrmt/master/install-scripts/initialize-rmt-master --accepteula
4. sudo su - tabrmt-master
5. /opt/tableau/tabrmt/master/rmtadmin master-setup --password-min-special=0 --admin-username=tableau --admin-password=pass --require-https=true --http-port=80 --confirm
6. /opt/tableau/tabrmt/master/rmtadmin create-env --name=DEV --gateway-url=https://tableau-dev.exmaple.com --version=2023.3.8 --api-username=portal --api-password=pass --repository-server=tableau-dev.us-east-1.rds.amazonaws.com --repository-database=workgroup --repository-port=5432 --repository-username=rails --repository-password=pass --repository-ssl-mode=Disable
7. rmtadmin bootstrap-file --env=DEV --filename=dev-bootstrap.json
8. Able to open server at url and login

Then I register agent

1. curl -O https://downloads.tableau.com/esdalt/2023.3.1/tableau_powertools/Tabrmt-Agent-amd64-2023-3-1.deb
2. sudo gdebi -n Tabrmt-Agent-amd64-2023-3-1.deb
3. sudo /opt/tableau/tabrmt/agent/install-scripts/initialize-rmt-agent --accepteula
4. sudo su --login tabrmt-agent
5. rmtadmin register dev-bootstrap.json --username=tableau --password=pass
6. Agent registered, I am able to see on RMT console agent is registered but see no metrics

Agent is registered but I am unable to metrics/graphs on RMT server.

If I restart the server at this point, it is bricked and becomes unrecoverable.

Command used to restart: /opt/tableau/tabrmt/master/rmtadmin restart

I think rabbitmq might be culprit. But cannot be sure, also I think the problem with RMT starts at the point I register the first agent

RabbitMQ log

2025-04-10 14:34:27.369630+00:00 [info] <0.1622.0> connection <0.1622.0> (172.17.104.169:41172 -> 172.17.201.148:5671 - tabrmt-agent-background (73369)): user 'userc9332d9f063044b4b016c3b5f3a1867c' authenticated and granted access to vhost 'tabrmt'

2025-04-10 14:34:32.739236+00:00 [notice] <0.1684.0> TLS server: In state certify at ssl_handshake.erl:2111 generated SERVER ALERT: Fatal - Unknown CA

2025-04-10 14:34:32.739236+00:00 [notice] <0.1684.0> 

2025-04-10 14:34:56.661772+00:00 [notice] <0.1690.0> TLS server: In state certify at ssl_handshake.erl:2111 generated SERVER ALERT: Fatal - Unknown CA

2025-04-10 14:34:56.661772+00:00 [notice] <0.1690.0> 

2025-04-10 14:35:03.761974+00:00 [notice] <0.1696.0> TLS server: In state certify at ssl_handshake.erl:2111 generated SERVER ALERT: Fatal - Unknown CA

Background log

{

  "Timestamp": "2025-04-10T14:34:34.0057548+00:00",

  "Level": "Error",

  "MessageTemplate": "An error occurred consuming message(s) for queue {queue}.",

  "RenderedMessage": "An error occurred consuming message(s) for queue \"VizQLGatewayRequest\".",

  "Exception": "System.TimeoutException: The operation has timed out.\n  at RabbitMQ.Client.Impl.SimpleBlockingRpcContinuation.GetReply(TimeSpan timeout)\n  at RabbitMQ.Client.Im.......",

  "Properties": {

    "queue": "VizQLGatewayRequest",

    "EventId": {

      "Id": 315,

      "Name": "Error consuming message queue message"

    },

    "SourceContext": "Tableau.PowerTools.Server.Master.Background.Processing.ServerMonitoring.VizQL.VizQLGatewayRequestConsumer",

    "ProcessId": 15765,

    "ThreadId": 79,

    "PTMessageProcessor": "VizQLGatewayRequestProcessor",

    "PTAgent": {

      "Environment": {

        "Id": 1,

        "Slug": "DEV"

      },

      "Server": {

        "Id": 1,

        "HostName": "tb101"

      },

      "Key": "7952313c-260a-4595-85c3-b248d59cecf0",

      "Id": 1

    },

    "PTCorrelationId": "a02f0000-807e-120b-27fb-08dd783a5d25"

  }

}

{

  "Timestamp": "2025-04-10T14:34:17.0573063+00:00",

  "Level": "Error",

  "MessageTemplate": "S-FAULT {DestinationAddress} {MessageId} {MessageType}",

  "Exception": "System.TimeoutException: The operation has timed out.\n  at RabbitMQ.Client.Impl.SimpleBlockingRpcContinuation.GetReply(TimeSpan timeout)\n  at RabbitMQ.Client.Impl.ModelBase.ModelRpc(MethodBase method, ContentHeaderBase header, Byte[] body)\n  at RabbitMQ.Client....",

  "Properties": {

    "DestinationAddress": "rabbitmqs://localhost/tabrmt/Tableau.PowerTools.Server.Master.Background.Processing.ServerMonitoring.VizQL:QueryBegin",

    "MessageId": "953d0000-807e-120b-c430-08dd783cba00",

    "MessageType": "Tableau.PowerTools.Server.Master.Background.Processing.ServerMonitoring.VizQL.QueryBegin",

    "SourceContext": "MassTransit",

    "ProcessId": 15765,

    "ThreadId": 57,

    "PTMessageProcessor": "VizQLGatewayRequestProcessor",

    "PTAgent": {

      "Key": "7952313c-260a-4595-85c3-b248d59cecf0"

    },

    "PTCorrelationId": "a02f0000-807e-120b-27fb-08dd783a5d25"

  }

}