Bug 1087809 - crm shell / hawk, can now create iSCSITarget, backend command not called.
crm shell / hawk, can now create iSCSITarget, backend command not called.
Status: RESOLVED INVALID
Classification: openSUSE
Product: openSUSE Tumbleweed
Classification: openSUSE
Component: High Availability
Current
Other Other
: P5 - None : Normal (vote)
: ---
Assigned To: SUSE Linux Enterprise High Availability Team
E-mail List
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2018-04-03 04:50 UTC by Lingshan Zhu
Modified: 2020-09-19 09:18 UTC (History)
4 users (show)

See Also:
Found By: ---
Services Priority:
Business Priority:
Blocker: ---
Marketing QA Status: ---
IT Deployment: ---
kgronlund: needinfo? (lszhu)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Lingshan Zhu 2018-04-03 04:50:10 UTC
after initialized a fresh 2 nodes cluster with ha-cluster-init / join, can not create an iSCSITarget with hawk, the backend command is not called. Hawk message: 2018-04-03 11:25: Operation start failed for resource target_test on node node1: call-id=12, rc-code=generic error (1), exit-reason=none

When try to add a target manually with crm shell, I see an error message: "ERROR: configure.configure: No closing quotation".

The cluster is alive in crm_mon
Comment 1 Lingshan Zhu 2018-04-03 06:14:41 UTC
journalctl messages:

node1:/home/lszhu # journalctl -xe -u hawk
Apr 03 14:10:48 node1 hawk-apiserver[2197]: Listening to https://0.0.0.0:7630
Apr 03 14:10:48 node1 hawk-apiserver[2197]: level=warning msg="Failed to connect to Pacemaker: -107: ENOTCONN Transport endpoint is not connected"
Apr 03 14:10:53 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:0"
Apr 03 14:11:11 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:2"
Apr 03 14:11:11 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:4"
Apr 03 14:11:11 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:4"
Apr 03 14:11:11 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:4"
Apr 03 14:11:12 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:5"
Apr 03 14:11:13 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:6"
Apr 03 14:11:13 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:7"
Apr 03 14:11:13 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:8"
Apr 03 14:11:13 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:9"
Apr 03 14:11:13 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:10"
Apr 03 14:11:13 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:11"
Apr 03 14:11:13 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:12"
Apr 03 14:11:13 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:13"
Apr 03 14:11:13 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:14"
Apr 03 14:11:13 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:15"
Apr 03 14:11:13 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:16"
Apr 03 14:11:14 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:17"
Apr 03 14:11:15 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:18"
Apr 03 14:11:15 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:20"
Apr 03 14:11:15 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:20"
Apr 03 14:11:15 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:21"
Apr 03 14:11:15 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:22"
Apr 03 14:11:16 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:23"
Apr 03 14:11:17 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:24"
Apr 03 14:11:17 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:26"
Apr 03 14:11:17 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:26"
Apr 03 14:11:17 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:27"
Apr 03 14:11:18 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:9:28"
Apr 03 14:12:28 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:10:0"
Apr 03 14:12:29 node1 hawk-apiserver[2197]: 2018/04/03 14:12:29 http -> https://192.168.100.9:7630/cib/live/primitives/target_test/edit
Apr 03 14:12:29 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:10:1"
Apr 03 14:12:29 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:10:1"
Apr 03 14:12:29 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:10:4"
Apr 03 14:12:29 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:10:4"
Apr 03 14:12:29 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:10:4"
Apr 03 14:12:29 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:10:6"
Apr 03 14:12:29 node1 hawk-apiserver[2197]: level=info msg="[CIB]: 0:10:6"
lines 252-291/291 (END)
Comment 2 Kristoffer Gronlund 2018-04-03 07:19:03 UTC
Hi Lingshan,

Please attach a crm report, as well as the output from

journalctl -u hawk-backend

Also, could you add the command you run from the command line?

Thank you :)
Comment 3 Lingshan Zhu 2018-04-10 03:25:29 UTC
This is the command line I used manually:

primitive iscsi_target_lszhu ocf:heartbeat:iSCSITarget params iqn="iqn.2018-04.suse.com.lszhu" implementation="lio-t" op monitor interval="10s
Comment 4 Lingshan Zhu 2018-04-10 03:31:42 UTC
There is a problem in hb_report, see https://bugzilla.suse.com/show_bug.cgi?id=1088784, I will try to collect logs once this issue fixed.
Comment 5 Lingshan Zhu 2018-04-10 04:38:26 UTC
here is hawk back-end journal:

-- Reboot --
Apr 10 11:20:24 node1 systemd[1]: Started HA Web Konsole Backend.
Apr 10 11:20:25 node1 puma.ruby2.5[2231]: [2231] Puma starting in cluster mode...
Apr 10 11:20:25 node1 puma.ruby2.5[2231]: [2231] * Version 3.11.2 (ruby 2.5.0-p0), codename: Love Song
Apr 10 11:20:25 node1 puma.ruby2.5[2231]: [2231] * Min threads: 0, max threads: 1
Apr 10 11:20:25 node1 puma.ruby2.5[2231]: [2231] * Environment: production
Apr 10 11:20:25 node1 puma.ruby2.5[2231]: [2231] * Process workers: 1
Apr 10 11:20:25 node1 puma.ruby2.5[2231]: [2231] * Preloading application
Apr 10 11:20:32 node1 puma.ruby2.5[2231]: WARNING: Nokogiri was built against LibXML version 2.9.7, but has dynamically loaded 2.9.8
Apr 10 11:20:37 node1 puma.ruby2.5[2231]: [2231] * Listening on unix:///usr/share/hawk/tmp/hawk.sock
Apr 10 11:20:37 node1 puma.ruby2.5[2231]: [2231] Use Ctrl-C to stop
Apr 10 11:20:37 node1 puma.ruby2.5[2231]: [2231] - Worker 0 (pid: 2533) booted, phase: 0
Comment 6 Kristoffer Gronlund 2018-04-16 08:02:05 UTC
(In reply to Lingshan Zhu from comment #3)
> This is the command line I used manually:
> 
> primitive iscsi_target_lszhu ocf:heartbeat:iSCSITarget params
> iqn="iqn.2018-04.suse.com.lszhu" implementation="lio-t" op monitor
> interval="10s

The problem with the manual command is that the final interval="10s lacks the closing quotation mark. Either write interval=10s or interval="10s"
Comment 7 Kristoffer Gronlund 2018-04-16 08:04:32 UTC
The other issue reported with message:

2018-04-03 11:25: Operation start failed for resource target_test on node node1: call-id=12, rc-code=generic error (1), exit-reason=none

in Hawk, indicates a problem encountered by the agent itself. That is, Hawk successfully configured the resource "target_test", but the start operation on node1 failed to complete with a generic error code. Exactly why this happens is difficult to say without knowing more about the system and the agent. Perhaps some parameter is incorrect, or perhaps some software is not installed, etc.
Comment 8 Dario Maiocchi 2020-09-19 09:18:25 UTC
as commented by Krig back in the time, this is invalid. closing