Having problems with my hdmi connection on my computer

I recently just bought a new computer and there must be something wrong with my graphics drivers or my ports. It took the longest time for the computer to connect the first time, and if it wiggles a little bit I lose my display. Sometimes it's just the sound. When i first turn on my computer sometimes I don't have sound from the get go and I have to scroll through the displays on my monitor like physically press the button to switch through vga hdmi display port etc and then all the way back to hdmi to regain my sound. I have tried three different monitors and several hdmi cords and have pinpointed the computer to having the problem. I have fully updated everything.