1. Open the command prompt as an Administator
  2. Mount the EFI partition where the boot loaders are stored by running mountvol z: /s (you can use any letter if z is taken)
  3. Move to this partition by running z:
  4. Move to the folder with the boot loaders by running cd EFI
  5. Remove the ubuntu boot loader by running rmdir /S ubuntu