Windows uses what they call "alt codes," where you hold down the alt key and type a numerical code on your numeric keypad. You can find them with a search: here's one site:

https://sites.psu.edu/symbolcodes/windows/codealt/

Note that you can't just do an accent and apply it to any character (like compose). You have to put in the code for the accented character.