Microsoft shows off its vision for gesture-controlled PCs

Microsoft is looking for new ways for people to interact with computers that build upon the actions that mouse and keyboard make possible.

The software giant's search for new human-machine interfaces has led it to investigate gesture-recognition, where a computer user controls their machine using hand movements.

On Wednesday Microsoft showed off a system that captures gestures made above the surface of the PC keyboard and translates them into commands for Windows.

At the base of this new control system is the Kinect, Microsoft's sensor bar that not only captures 2D video but the depth of the scene it's filming — allowing it to place objects in 3D space.

Kinect was originally developed as a controller for the Xbox 360 games console, but the device is also available with a software development kit for Windows PCs and has been used to develop a number of non-gaming applications
.

Read more at: Microsoft shows off its vision for gesture-controlled PCs | ZDNet
 
The last thing I want to be doing at work is waving my hands around to make things happen. I wish the clown at MS who thought Minority Report was "cool and neat" gets canned soon.
 

My Computer

System One

  • OS
    Windows 8.1 Pro 64 bit
    Computer type
    PC/Desktop
    CPU
    Intel i5 3570K
    Motherboard
    ASRock Z77 Extreme4
    Memory
    8 Gb
    Graphics Card(s)
    Intel HD 4000
    Sound Card
    On board
Keyboard shortcuts are already simple to do and fast enough, what is the point in them even making this, just another money sink imo.
 

My Computer

System One

  • OS
    Windows 7 Home Premium x64
    Computer type
    PC/Desktop
    System Manufacturer/Model
    Hewlett Packard P7-1017c
    CPU
    Intel Core i3-2100 @ 3.1Ghz
    Motherboard
    Pegatron HP
    Memory
    Crucial 2x4GB DDR3 1333 MHz
    Graphics Card(s)
    Sapphire Radeon HD 7850 2GB GDDR5
    Sound Card
    Realtek HD Onboard
    Monitor(s) Displays
    HP 2211x
    Screen Resolution
    1920x1080
    Hard Drives
    Hitachi 1TB 7200 RPM
    PSU
    Corsair CX600 80+ Bronze
    Case
    Coolermaster HAF 912
    Cooling
    Stock Intel Fan
    Keyboard
    HP Keyboard
    Mouse
    HP Mouse
    Internet Speed
    30+ Mbps Download; 2Mbps Upload
    Browser
    Google Chrome
    Antivirus
    Norton 360
    Other Info
    New build with custom parts later in the year
Still, no contenders to the good ol' mouse.
 

My Computer

System One

  • OS
    Windows 8.1 Pro
    Computer type
    PC/Desktop
    System Manufacturer/Model
    Self built
    CPU
    Intel Core i7-4790
    Motherboard
    GA-Z87X-D3H
    Memory
    G.SKILL 8GB (2 x 4GB) DDR3 F3-10666CL9D-8GBNT
    Graphics Card(s)
    Sapphire ATI Radeon R7 250
    Sound Card
    Realtek ALC892
    Monitor(s) Displays
    Samsung UN32EH5000, Dell 1703FPT
    Screen Resolution
    1920 x 1080
    Hard Drives
    WD5003AZEX
    WD10EZEX
    Samsung HD103SJ
    Samsung 128 GB 840 PRO
    PSU
    SeaSonic M12II SS-500GM
    Case
    Fractal Design Define R4
    Cooling
    Zalman CNPS9900ALED
    Keyboard
    Logitech K800
    Mouse
    Logitech M705
    Internet Speed
    16 Mbps
    Browser
    Firefox
    Antivirus
    Avast
    Other Info
    Bose Companion 2 Multimedia Speakers
Instead of trying to improve on the mouse and keyboard via the use of exaggerated hand movements, I'd prefer they perfect voice response so it would be truly useful.
 

My Computer

System One

  • OS
    W10 Pro (desktop), W10 (laptop), W10 Pro (tablet)
    Computer type
    PC/Desktop
    System Manufacturer/Model
    Home built i7-8700K, Hp Envy x360 EVO Laptop, MS Surface Pro 7
    CPU
    3.7Ghz Core i7-8700K, 11th Gen Core i7-1165G7 4.7Ghz, 10th Gen Core™ i5-1035G4 1.1Ghz
    Motherboard
    ASUS TUF Z370-Pro Gaming, HP, MS
    Memory
    16G, 8G, 8G
    Graphics Card(s)
    AMD Radeon RX580, Intel Iris X Graphics, Intel Iris Plus Graphics G4
    Sound Card
    ATI High Definition Audio (Built-in to mobo)
    Monitor(s) Displays
    Dual Samsung U32J59 32 inch monitors, 13.3" display, 12.3" display
    Screen Resolution
    3840x2160 (Desktop), 1920x1080 (laptop), 2736x1824 Pro 7
    Hard Drives
    500GB ssd boot drive with 2 & 10TB Data (Desktop), 512GB ssd (laptop), 128GB SSD (tablet)
    PSU
    Corsair CX 750M
    Case
    Antec 100
    Cooling
    Coolermaster CM 212+
    Keyboard
    IBM Model M - used continuously since 1986
    Mouse
    Microsoft IntelliMouse
    Internet Speed
    665Mbps/15Mbps down/up
    Browser
    FireFox, MS Edge
    Antivirus
    Defender on all
    Other Info
    Retired in 2015 after working in the tech industry for 41 years. First 10 years as a Technician, the rest as a programmer/software engineer. After 1 year of retirement, I was bored so went back to work as a Robotic Process Automation Consultant. Retired for 3rd (and final) time in 2019.
The last thing I want to be doing at work is waving my hands around to make things happen. I wish the clown at MS who thought Minority Report was "cool and neat" gets canned soon.

Why is it that whenever people see these demos they immediately assume Microsoft is going to throw away the keyboard and mouse and replace it with something like this. The point is completely flying over your head.

This is research. It's about developing new alternative input, to complement traditional input. No, you don't want to wave your hands around all the time when using a computer, but you might when you're using a Home Theater PC from across a room. Or, more importantly, this is just a step on the journey to a more advanced form of interaction.

Think about Tony Stark interacting with 3D holographic CAD/CAM. You need this technology to get to that technology eventually, as it's just one piece of it.

You mentioned Minority Report.. but you seem to have forgotten.. they had keyboards and mice too, when they wanted to use them.
 

My Computer

System One

  • OS
    Windows 8.1 Pro
    CPU
    Intel i7 3770K
    Motherboard
    Gigabyte Z77X-UD4 TH
    Memory
    16GB DDR3 1600
    Graphics Card(s)
    nVidia GTX 650
    Sound Card
    Onboard Audio
    Monitor(s) Displays
    Auria 27" IPS + 2x Samsung 23"
    Screen Resolution
    2560x1440 + 2x 2048x1152
    Hard Drives
    Corsair m4 256GB, 2 WD 2TB drives
    Case
    Antec SOLO II
    Keyboard
    Microsoft Natural Ergonomic Keyboard 4000
    Mouse
    Logitech MX
Guess I didn't see it this way but rather how it pertains to me personally. Voice commands would go hand-in-hand with this.

The last thing I want to be doing at work is waving my hands around to make things happen. I wish the clown at MS who thought Minority Report was "cool and neat" gets canned soon.

Why is it that whenever people see these demos they immediately assume Microsoft is going to throw away the keyboard and mouse and replace it with something like this. The point is completely flying over your head.

This is research. It's about developing new alternative input, to complement traditional input. No, you don't want to wave your hands around all the time when using a computer, but you might when you're using a Home Theater PC from across a room. Or, more importantly, this is just a step on the journey to a more advanced form of interaction.

Think about Tony Stark interacting with 3D holographic CAD/CAM. You need this technology to get to that technology eventually, as it's just one piece of it.

You mentioned Minority Report.. but you seem to have forgotten.. they had keyboards and mice too, when they wanted to use them.
 

My Computer

System One

  • OS
    Windows 7 Home Premium x64
    Computer type
    PC/Desktop
    System Manufacturer/Model
    Hewlett Packard P7-1017c
    CPU
    Intel Core i3-2100 @ 3.1Ghz
    Motherboard
    Pegatron HP
    Memory
    Crucial 2x4GB DDR3 1333 MHz
    Graphics Card(s)
    Sapphire Radeon HD 7850 2GB GDDR5
    Sound Card
    Realtek HD Onboard
    Monitor(s) Displays
    HP 2211x
    Screen Resolution
    1920x1080
    Hard Drives
    Hitachi 1TB 7200 RPM
    PSU
    Corsair CX600 80+ Bronze
    Case
    Coolermaster HAF 912
    Cooling
    Stock Intel Fan
    Keyboard
    HP Keyboard
    Mouse
    HP Mouse
    Internet Speed
    30+ Mbps Download; 2Mbps Upload
    Browser
    Google Chrome
    Antivirus
    Norton 360
    Other Info
    New build with custom parts later in the year
Guess I didn't see it this way but rather how it pertains to me personally. Voice commands would go hand-in-hand with this.

Voice input technology has large plateaued. The problem is that people just don't speak clearly or reliably. Humans can't even understand other humans much of the time. How do you expect computers to?

There are too many problems that have to be solved for voice commands to continue moving forward. Noise cancelation issues, speech impediment issues, command confidence..

The most annoying thing about voice commands is that you either have to live with mistakes, some of which may be able to be corrected while others may not.. or live with constant confirmations... "Confirm you meant to delete your foot". Gestures have a much higher confidence level and have fewer issues relating to them. Another area being researched is body language. The computer may literally be able to know what you're thinking by watching you without any overt movement on your part. These problems are much simpler than the problems around voice.
 

My Computer

System One

  • OS
    Windows 8.1 Pro
    CPU
    Intel i7 3770K
    Motherboard
    Gigabyte Z77X-UD4 TH
    Memory
    16GB DDR3 1600
    Graphics Card(s)
    nVidia GTX 650
    Sound Card
    Onboard Audio
    Monitor(s) Displays
    Auria 27" IPS + 2x Samsung 23"
    Screen Resolution
    2560x1440 + 2x 2048x1152
    Hard Drives
    Corsair m4 256GB, 2 WD 2TB drives
    Case
    Antec SOLO II
    Keyboard
    Microsoft Natural Ergonomic Keyboard 4000
    Mouse
    Logitech MX
Good point.
 

My Computer

System One

  • OS
    Windows 7 Home Premium x64
    Computer type
    PC/Desktop
    System Manufacturer/Model
    Hewlett Packard P7-1017c
    CPU
    Intel Core i3-2100 @ 3.1Ghz
    Motherboard
    Pegatron HP
    Memory
    Crucial 2x4GB DDR3 1333 MHz
    Graphics Card(s)
    Sapphire Radeon HD 7850 2GB GDDR5
    Sound Card
    Realtek HD Onboard
    Monitor(s) Displays
    HP 2211x
    Screen Resolution
    1920x1080
    Hard Drives
    Hitachi 1TB 7200 RPM
    PSU
    Corsair CX600 80+ Bronze
    Case
    Coolermaster HAF 912
    Cooling
    Stock Intel Fan
    Keyboard
    HP Keyboard
    Mouse
    HP Mouse
    Internet Speed
    30+ Mbps Download; 2Mbps Upload
    Browser
    Google Chrome
    Antivirus
    Norton 360
    Other Info
    New build with custom parts later in the year
Plus, the gesture stuff has huge applications in Video Games, Simulations (military and otherwise), Healthcare (disabled people can make gestures, but they may not be able to type or speak).

Regardless of whether or not you think this particular application is useful, Microsoft seems to think it will pay off in some way or another.. There is seldom a thing as useless research, as even research that is not commercially viable often leads to other research that may lead to other research that eventually is.
 

My Computer

System One

  • OS
    Windows 8.1 Pro
    CPU
    Intel i7 3770K
    Motherboard
    Gigabyte Z77X-UD4 TH
    Memory
    16GB DDR3 1600
    Graphics Card(s)
    nVidia GTX 650
    Sound Card
    Onboard Audio
    Monitor(s) Displays
    Auria 27" IPS + 2x Samsung 23"
    Screen Resolution
    2560x1440 + 2x 2048x1152
    Hard Drives
    Corsair m4 256GB, 2 WD 2TB drives
    Case
    Antec SOLO II
    Keyboard
    Microsoft Natural Ergonomic Keyboard 4000
    Mouse
    Logitech MX
Another way to look at this is when working with the hearing impaired.
 

My Computer

System One

  • OS
    Win 8, (VM win7, XP, Vista)
    Computer type
    PC/Desktop
    System Manufacturer/Model
    HP Pavilion p1423w
    CPU
    Intel Core i5 3330 Ivy Bridge
    Motherboard
    Foxconn - 2ADA Ivy Brige
    Memory
    16 GB 1066MHz DDR3
    Graphics Card(s)
    ATI Radeon HD 5450
    Sound Card
    HD Realteck (Onboard)
    Monitor(s) Displays
    Mitsubishi LED TV/Montior HD, Dell 23 HD, Hanspree 25" HD
    Screen Resolution
    Mit. 1980-1080, Dell 2048-115, Hanspree 1920-10802
    Hard Drives
    1 SanDisk 240Gig SSD, 2 Samsung 512Gig SSDs
    Case
    Tower
    Cooling
    Original (Fans)
    Keyboard
    Microsoft Keyboard 2000
    Mouse
    Microsoft Optical Mouse 5000
    Internet Speed
    1.3 (350 to 1024 if lucky)
    Browser
    Firefox 19.1
    Antivirus
    MSE-Defender
MS seemed to think RT would pay off also. How did that work out for them? Just because MS see's something in it doesn't mean anyone else will.
 

My Computer

System One

  • OS
    W7
Hi there
Sometimes people need to get a bit of reality about them - can you imagine this type of nonsense working on a PLANE !! also imagine an office -- I've got a decent space but the more offices I visit people seem to be crammed in more and more having less space than ever before - who ever invented that dreadful conception of "Open Plan" offices -- deadly combination of "Mobile Phone" in cramped office -- people are inconsiderate enough when using mobiles today in any case , having to bear them in in cramped offices is just pure PURGATORY - loud pings every 19 secs when texts arrive, answering phone or making incessant calls with a voice that would put an army DRILL SGT to shame etc - gesture motions in these places would just be REDICULOUS too - people would get oblivious to their neighbours - your coffee / computer / monitor etc would probably just get knocked to the ground by some bozo gesturing around while at the same time yelling away on a mobile phone.

For people with mobility impairments this could be a good idea - but unleash on general public -- NO THANKS !!.

Cheers
jimbo
 

My Computer

System One

  • OS
    Linux Centos 7, W8.1, W7, W2K3 Server W10
    Computer type
    PC/Desktop
    Monitor(s) Displays
    1 X LG 40 inch TV
    Hard Drives
    SSD's * 3 (Samsung 840 series) 250 GB
    2 X 3 TB sata
    5 X 1 TB sata
    Internet Speed
    0.12 GB/s (120Mb/s)
Why is it that whenever people see these demos they immediately assume Microsoft is going to throw away the keyboard and mouse and replace it with something like this.


Uh.... windows 8...??? :roflmao:
 

My Computer

System One

  • OS
    Win8.1 Pro, Desktop Mode
    Computer type
    PC/Desktop
    System Manufacturer/Model
    Me
    CPU
    AMD FX-8150
    Motherboard
    Gigabyte GA-890GPA-UD3H
    Memory
    8.00 GB Dual-Channel DDR3 (9-9-9-28)
    Graphics Card(s)
    AMD Radeon HD 6570
    Sound Card
    Creative X-Fi Titanium
    Monitor(s) Displays
    PX2710MW
    Screen Resolution
    1920x1080@60Hz
    Hard Drives
    1x1TB Western Digital WDC WD1001FALS-00J7B1 ATA Device Caviar Black -

    4 x 2TB Seagate ST32000542A -
    1 x 4TB Seagate External
    Case
    Antec
    Cooling
    Noctua NH-D14
    Keyboard
    Logitech Illuminated Keyboard K740
    Internet Speed
    60meg cable
    Browser
    Cyberfox
    Antivirus
    AVG Security Suite
That's weird, I was just shaking my can of compressed air to clean my keyboard and all these porn sites opened up in IE, all by them selves. What's up with that?
 

My Computer

System One

  • OS
    Windows 10 Education 64 Bit
    Computer type
    PC/Desktop
    System Manufacturer/Model
    Asus
    CPU
    AMD Phenom II X4 980 Black Edition Deneb 3.7GHz
    Motherboard
    ASUS M4N68T-M V2 µATX Motherboard
    Memory
    8GB 4GBx2 Kingston PC10600 DDR3 1333 Memory
    Graphics Card(s)
    NVIDIA Geforce GT640 2 Gig DDR3 PCIe
    Sound Card
    VIA VT1708s High Definition Audio 8-channel Onboard
    Monitor(s) Displays
    22" LG E2242 1080p and 2 19" I-INC AG191D
    Screen Resolution
    1280x1024 - 1920x1080 - 1280x1024
    Hard Drives
    Crucial MX100 256 GB SSD and 500 GB WD Blue SATA
    PSU
    Thermaltake TR 620
    Case
    Power Up Black ATX Mid-Tower Case
    Cooling
    Stock heatsink fan
    Keyboard
    Logitech Wireless K350 Wave
    Mouse
    Logitech M570 Trackball and T650 TouchPad
    Internet Speed
    80 Mbps Down 30 Mbps Up
    Browser
    Internet Explorer 11
    Antivirus
    Windows Defender
    Other Info
    HP DVD1040e Lightscribe - External USB2
The dangers of Internet Explorer!
That's weird, I was just shaking my can of compressed air to clean my keyboard and all these porn sites opened up in IE, all by them selves. What's up with that?
 

My Computer

System One

  • OS
    Windows 7 Home Premium x64
    Computer type
    PC/Desktop
    System Manufacturer/Model
    Hewlett Packard P7-1017c
    CPU
    Intel Core i3-2100 @ 3.1Ghz
    Motherboard
    Pegatron HP
    Memory
    Crucial 2x4GB DDR3 1333 MHz
    Graphics Card(s)
    Sapphire Radeon HD 7850 2GB GDDR5
    Sound Card
    Realtek HD Onboard
    Monitor(s) Displays
    HP 2211x
    Screen Resolution
    1920x1080
    Hard Drives
    Hitachi 1TB 7200 RPM
    PSU
    Corsair CX600 80+ Bronze
    Case
    Coolermaster HAF 912
    Cooling
    Stock Intel Fan
    Keyboard
    HP Keyboard
    Mouse
    HP Mouse
    Internet Speed
    30+ Mbps Download; 2Mbps Upload
    Browser
    Google Chrome
    Antivirus
    Norton 360
    Other Info
    New build with custom parts later in the year
since people refuse to buy the Metro touch-based OS for their PCs, they now ram voice and motion control into out thorats?

I already can envision an office with professionals (engineers, accountants, graphics designers etc.) with everyoen talking adn waiving aroudn trying to enter numbers. Every voice-device isn't able to recognize my voice and gives me jibberish s far. I'm sure the IRS will appareciate the accuracy of my taxes when I enter them with my voice.

Touch is fine for small mobile devices. but you imagine peole on the bus or in public gesturing and talking to their device?
 

My Computer

System One

  • OS
    Windows 7 Pro 64
    CPU
    Core i3 3.3 GHz
    Memory
    16 GB 1600 MHz
    Hard Drives
    SSD Samsung 830 128 GB
I have no interest whatsoever in touch-screens on PCs, and will not own one.

And I have even less interest in this 'gesture' rubbish!

I wouldn't even consider purchasing.


Wenda.
 
Last edited:

My Computer

System One

  • OS
    Windows 8.1 'Ultimate' RTM 64 bit (Pro/WMC).
    Computer type
    Laptop
    System Manufacturer/Model
    Acer AS8951G 'Desktop Replacement'.
    CPU
    i7-2670QM@2.2/3.1Ghz.
    Motherboard
    Acer
    Memory
    8GB@1366Mhz.
    Graphics Card(s)
    GeForce GT555M 2GB DDR3
    Sound Card
    Realtek HD w/Dolby 5.1 surround.
    Monitor(s) Displays
    Built-in. Non-touch.
    Screen Resolution
    18/4" 1920x1080 full-HD.
    Hard Drives
    Toshiba 750GBx2 internal. 1x2TB, 2x640GB, 1x500GB external.
    PSU
    Stock.
    Case
    Laptop.
    Cooling
    Stock.
    Keyboard
    Full 101-key
    Mouse
    USB cordless.
    Browser
    IE11, Firefox, Tor.
    Antivirus
    Windows Defender, MalwareBytes Pro.
    Other Info
    BD-ROM drive.
MS seemed to think RT would pay off also. How did that work out for them? Just because MS see's something in it doesn't mean anyone else will.

As I said. Microsoft released Windows NT in 1993. It did not become commercially successful until Windows 2000 for the server and XP on the desktop. That was 7-8 years. Microsoft is no stranger to introducing a technology and allowing it to evolve to the point where it becomes successful.

RT will pay off, both in the mobile market as well as the server market. There are new ARM based server blade clusters from both HP and Dell that draw 15W or less per blade (which is a huge datacenter cost savings) and the plan is to have a server version of RT as their OS, though I wouldn't expect this until Windows 9 timeframe.
 

My Computer

System One

  • OS
    Windows 8.1 Pro
    CPU
    Intel i7 3770K
    Motherboard
    Gigabyte Z77X-UD4 TH
    Memory
    16GB DDR3 1600
    Graphics Card(s)
    nVidia GTX 650
    Sound Card
    Onboard Audio
    Monitor(s) Displays
    Auria 27" IPS + 2x Samsung 23"
    Screen Resolution
    2560x1440 + 2x 2048x1152
    Hard Drives
    Corsair m4 256GB, 2 WD 2TB drives
    Case
    Antec SOLO II
    Keyboard
    Microsoft Natural Ergonomic Keyboard 4000
    Mouse
    Logitech MX
Back
Top