I just deployed a cluster with 6 additional nodes, and after configuration and a restart, one of the node is not responding. It is showing as status not available for all processes on that node. All window servers.
The program is that The Tableau Server Administration Agent in Window Services is not starting in that node, and I can't manually start it either. In the configuration page it is showing as (?) and server is degraded, but working.
It is taking very long for any tsm commands as the server is waiting for this node to respond, which it won't, and even stopping and starting the server ends in error, only when it timeouts, usually 35-40 mins..
Any idea why the agent won't start ? I'm thinking I will have to remove the node and add a new one back but I can't even remove it from configuration as it was saying "Node '' is not in a valid state to remove filestore from topology.".
I also tried tsm topology filestore decommission on that node but it was stuck at 0% for a while, I think the cluster just can't find or talk to the node anymore.
Any ideas and experience with this ?
Thanks in advance!
@Bobo Oo
Hi, I would start by restarting the machine of the failed node. This may get the node online.
Is that node where you have the tsm controller, and related administration services?. If not, then you may follow https://help.tableau.com/current/server-linux/en-us/distrib_node_fail.htm
Also related to the decomission of the filestore (let's say the node id is node 3
tsm stop --ignore-node-status node3
tsm topology filestore decommission -n node3 --delete-filestore
tsm pending-changes apply --ignore-warnings --ignore-node-status <nodeID>
tsm topology remove-nodes --node-names node3
tsm pending-changes apply --ignore-warnings --ignore-node-status <nodeID>
Be careful with node removal!!. Take a full read of the help document, specially, if the node was running process only on that node and not present in other nodes. Also, if the node was running the coordination service, you will have to deploy a new coordination service ensemble.
If this post resolves the question, would you be so kind to "Select as Best"?. This will help other users find the same answer/resolution and help community keep track of answered questions. Thank you.
Regards,
Diego Martinez
Tableau Visionary and Forums Ambassador
