Yes that is irritating, however easy to put right.
Tools > Internet Options > General Tab > Home page, change that to what you want, I use 'about:blank' which obviously is a blank page as the Home page.
Or use whatever Website address suits you e.g. 'https://www.google.co.uk/' if you want the Google search engine for UK as the Home page, no single quotes.
In the same General Tab down a bit under Start-up select 'Start with Home page'.
Yes that is irritating, however easy to put right...
Every browser either sets its own preferred home page by default or defaults to the home page set in Windows' Internet Options.
There's no way that the browser's installer, or the Windows installer in the case of IE, can read your mind and set the page you think you want for a home page. You should always expect to have to set your preference manually after install.