In the PowerShell:

Get-AppxPackage Microsoft.MSPaint | Remove-AppxPackage

Remove context menu entries from explorer by file ending, e.g.:

HKEY_LOCAL_MACHINE\SOFTWARE\Classes\SystemFileAssociations\.jpeg\Shell