https://www.digitalcitizen.life/when-each-sound-windows-sound-scheme-played/

Actual path in the above article is wrong, see where to go below.

Windows by default plays annoying sounds when something fails in a program, e.g. when the search in Firefox or other programs finds zero occurrences, or in any editor, just trying to move the cursor past the end of the file.

To turn off these sounds:

  1. go to Control Panel->Hardware and Sounds->Alter System Sounds
  2. change the sound file to (None) for the following events:

Windows/Asterisk Windows/Default Beep Windows/Exclamation

Those were the events that were bothering me the most, you may want to disable other ones.