Add a Selection Definition subnode () to the Physics Symbol node to compute the position of icon will be computed from the selection provided by this node, if you choose Centroid of selected entities for the Line to point and Joint decorations.

Here you specify a selection of the connector position. See the documentation for the Selection section in the settings for Physics Symbol above.