Just found a solution, hope this will help you and everyone else who came here from google.
Run Regedit, look for HKEY_CLASSES_ROOT\Folder\shell\pintostartscreen
Make a backup to .reg file (use context menu) and delete the whole branch. Effective immediately :)
This will remove Pin to Start...