Can anyone use my lost PAN card?

No, no one else can use your PAN. However, it is advisable to lodge a complaint against your lost PAN card at the nearest police station and take a copy of the complaint. This will keep you in a safe position in case someone tries to use it or for any contingency situation.