Hopefully I have understood your problem correctly.
When you are processing a drop event, you can fetch 3 values: dragValue, dropValue and dragType. You can set the dragType to sourcePanelName to know the source of drag.
Hope this helps.
yes you have understood it properly. I solved it with the help of your advise.