Yes, that means you probably have [Japanese input system] + [English keyboard layout]
On my system, when I press shift + 2, I get ["], meaning that I have
[Japanese input system] + [Japanese keyboard layout].
By the way, can you change to a Japanese keyboard layout on your system if you wanted...