Comment on POA - Power of Attorney for your Demat account
Nothing wrong with sharing your demat account number with your Broker. The PoA too is a limited PoA and can only be used to debit shares from your account when you sell shares, else the PoA gives no additional powers to the broker.