Why is it important to call the green die 'olive'? Both 'olive' and 'green' have 5 characters... I suppose it's because you can spell out MR. BOY with the dice in winning order if you use olive :)
If you watch the video further, James explains that there is in fact a second 'chain' of victory, which is memorised using the colours in alphabetical order.