Microsoft demos amazing 3D multitouch tech

James Bannan10 November 2008, 1:15 PM

Microsoft Surface was just the beginning, it seems. Microsoft has demoed an amazing, 3D multitouch technology which allows interaction to happen "beyond the screen".


At the recent Microsoft Professional Developers Conference in Los Angeles, one of the keynotes was delivered by Rick Rashid, Senior VP of Microsoft Research, who spoke about the division’s role within the company, and demoed some of the latest projects to emerge from their labs.

SecondLight is the result of the efforts of Microsoft Research team members, and at PDC 2008 they demonstrated the direction where Surface is evolving. The prototype system is called SecondLight, and is a rear-projection display which uses an advanced surface technology to enable image projection beyond the physical surface of the screen, creating an interaction zone above the unit, in addition to the surface zone.

SecondLight uses a liquid crystal material which is very similar to “privacy glass”, which can be switched between transparent and opaque. The SecondLight display is rapidly switched between the two states so that it appears transparent all the time to the user, and so that two images can be shown simultaneously – a digital image on the opaque setting and a projected image on the transparent setting – without the images interfering with each other in any way.

Because of the different properties of the surface in each state, camera within the unit can detect normal touch input and can also interact with a suitable diffuse surface held above the display, like paper or certain types of plastic. With some clever programming, the two surfaces can then display different data about the same content, for example the surface display could be of a car, with the second surface showing technical schematics.

The tracking capabilities of the SecondLight camera allows for some very cool effects. It can track a mobile diffuse surface and dynamically distort the projected image so that it appears in correct proportions on the mobile surface regardless of where it is held in relation to the flat surface. This was demonstrated by a small mobile surface “capturing” a video clip and displaying it correctly when the surface was held above the SecondLight unit, even to a near-vertical position. When a mobile surface is in use, the camera can actively track it to enable multi-touch input on it as well as on the original surface.

The overall feel of SecondLight was almost exactly that shown by the tactile computing surface in Minority Report – gestures, multi-touch and active object tracking.

In real life, what it will be used for remains to be seen -- no doubt the military will jump on the applications for warfare command systems, and there are obvious applications for museums and information centres, but beyond that, it'll be interesting to see what it is used in.


James Bannan attended PDC 2008 Los Angeles as a guest of Microsoft.


Post your comment



Comments

RSS feed Email alert

Raindog (Senior Forumologist):

All very exciting, but 3D? C'mon what a bunch of marketing hype. How can you have 3D touch via a 2D surface?

The sooner all these marketing types that attach this rubbish to products are sent off, for a long flight on the "B" ship, the better it will be for the rest of us.

10 November 2008, 3:27 PM (1 year ago)report abuse Send to a friend reply

TV Bis (User):

Quoting Raindog:
The sooner all these marketing types that attach this rubbish to products are sent off, for a long flight on the "B" ship, the better it will be for the rest of us.

Don't be so negative RD! I could just imagine you and your quotes in a newspaper prior to the Internet being produced when Ed Roberts produced the Altair 8800 and coined the term "PC".
Personal Computer? A party trick! Who would ever want and use a computer at work let alone at home????

So I am sure that if this technology is practical enough for normal everyday usage it will find its way. An example would be for a better heads up display in aircraft etc.



11 November 2008, 10:51 AM (1 year ago)report abuse Send to a friend reply

Raindog (Senior Forumologist):

Quoting TV Bis:
Don't be so negative RD!

The correct term is realistic. I choose to be realistic.


Quoting TV Bis:
I could just imagine you and

leave me out of your imaginations thank you, the thought is just way creepy.


Quoting TV Bis:
Who would ever want and use a computer at work let alone at home????

Well at that period in history I was working with computers, what were you doing?


Quoting TV Bis:
So I am sure that if this technology is practical enough for normal everyday usage

There are people who are sure they have seen UFOs too.


Quoting TV Bis:
An example would be for a better heads up display in aircraft etc.

A pilot display that required floating media to be manoeuvred above a display panel run from some version of Windows. The pilot would want to have the other hand on the ejector seat lever at all times.


11 November 2008, 11:06 AM (1 year ago)report abuse Send to a friend reply

TV Bis (User):

Quoting Raindog:
Quoting TV Bis:
Don't be so negative RD!

The correct term is realistic. I choose to be realistic.

Well stop being realistic in a negative way!

Quoting Raindog:
Well at that period in history I was working with computers, what were you doing?

Oh, at that time I was BEING BORN!

Quoting Raindog:
There are people who are sure they have seen UFOs too.

Can you prove that they haven't?

Quoting Raindog:
A pilot display that required floating media to be manoeuvred above a display panel run from some version of Windows. The pilot would want to have the other hand on the ejector seat lever at all times.

I see that you are anti MS or should I say anti everything?
So end of debate and I'll see you in my dreams RD..................



11 November 2008, 2:51 PM (1 year ago)report abuse Send to a friend reply

Raindog (Senior Forumologist):

Quoting TV Bis:
Well stop being realistic in a negative way!

I will be how I choose, If you have an issue with that then it is your issue.


Quoting TV Bis:
Can you prove that they haven't?

I'd rather not trouble myself with the affairs of nut-jobs and dreamers.


Quoting TV Bis:
I see that you are anti MS or should I say anti everything?

Then you see wrong, you misreading, not my problem.


Quoting TV Bis:
So end of debate

There was no debate, just you sulking at an opinion that differed from your own.


Quoting TV Bis:
and I'll see you in my dreams RD.....

Another who has me in their dreams, this is disturbing to say the least.


Quoting TV Bis:
Oh, at that time I was BEING BORN!

Still you've had plenty of time to learn that opinions other than your own can be entirely valid. There is no reason for any failure on your part to absorb such a basic concept.

11 November 2008, 5:03 PM (1 year ago)report abuse Send to a friend reply
10 November 2008, 4:00 PM (1 year ago)report abuse Send to a friend reply

Me In Oz (Cornerstone member):

As with everything else tech and med ? The military will jump on it first and then the civ population will follow !
Personally I think it is great tech for true 3D design, and gaming is set to be turned on it's head (literally) !
Anyone see Ironman ? ...... heh heh heh

10 November 2008, 6:23 PM (1 year ago)report abuse Send to a friend reply

Raindog (Senior Forumologist):

Quoting Me In Oz:
The military will jump on it first and then the civ population will follow !

One too many games of Soldier of fortune there MIO, I don't think the military, even our underfunded Australian military sit around waiting for new Windows releases.


Quoting Me In Oz:
Personally I think it is great tech for true 3D design

Even if its not really 3D? How do you touch a 2D surface in 3D exactly? Are you supposed to wear blue/red glasses while screen touching?

All you need is a traymobile, near total darkness, a couple of high output projectors, copious quantities of greaseproof paper and a healthy sense of the absurd. What a load of bunkum.

Previous attempts by MS to make users look like total tools by talking to half baked voice command systems will be well outclassed with this latest effort in applied pointlessness.

10 November 2008, 6:34 PM (1 year ago)report abuse Send to a friend reply

Me In Oz (Cornerstone member):

Quoting Raindog:
What a load of bunkum.

You do love to pooh pooh on everything !
I'm glad that there are innovators and people who are willing to try new things in industry (not just MS) Raindog !
With people like you at the helm of R&D we'd all still be in the dark ages.




10 November 2008, 10:36 PM (1 year ago)report abuse Send to a friend reply

Raindog (Senior Forumologist):

Quoting Me In Oz:
I'm glad that there are innovators and people who are willing to try new things

I'm equally glad there are wise heads that can pick party tricks from innovation without raising a sweat.


Quoting Me In Oz:
With people like you at the helm of R&D we'd all still be in the dark ages.

Better get yourself a flashlight! No hang on make that a burning stick! because I'm not changing my career path anytime soon. :>

Hold up strips of greaseproof to read to read the Easter eggs in your MS operating system, I'm sure some marketing guru could dream of a productivity advantage from that, but sensible folks will just shake their heads. :>


10 November 2008, 10:55 PM (1 year ago)report abuse Send to a friend reply

SLi (Cornerstone member):

Quoting Raindog:
Hold up strips of greaseproof to read to read the Easter eggs in your MS operating system, I'm sure some marketing guru could dream of a productivity advantage from that, but sensible folks will just shake their heads. :>

When, Raindog, was the last time you used your innovative mind to create a product of use to others in the world? You may not see the usefulness of this new technology, and may not have the brain capacity to fully comprehend the idea of using a 2D interface as a 3D interface, but that's simply no reason to try and force your highly judgemental opinion on other people in the forum. If you got nothing nice to say about the new technology, keep it to yourself in future if you could. Others may see the usefulness and innovation in this product, so instead of pulling the new tech to bits, lets discuss the possibilities and opportunity this product has in todays market, shall we?
This new tech's usefulness is still being discussed worldwide by business owners and the like, this is just a 'Demo', so don't judge it too quickly if you please.


10 November 2008, 11:32 PM (1 year ago)report abuse Send to a friend reply

Raindog (Senior Forumologist):

Quoting SLi:
When, Raindog, was the last time you used your innovative mind to create a product of use to others in the world?

It's how I make my living. Next question.


Quoting SLi:
You may not see the usefulness of this new technology

I don't!


Quoting SLi:
and may not have the brain capacity to fully comprehend

Whereas you do not have the capacity to pen a simple reply without resorting to personal attack. Neither the ability to interpret your environment, or the experience to determine what is or isn't practical.


Quoting SLi:
the idea of using a 2D interface as a 3D interface

It's not 3D!!!! It's a party trick, name one practical application for this tom-foolery! And no enhancing the user experience in a game of Maim and Bludgeon IV is neither useful nor innovative.


Quoting SLi:
but that's simply no reason to try and force your highly judgemental opinion on other people in the forum.

Force my opinion? I stated my opinion. You don't like that opinion so you've chosen to throw a tantrum.


Quoting SLi:
If you got nothing nice to say about the new technology

This party trick would hardly rate as technology. I will comment on technologies, new and old, as I see fit, without fear or favour.


Quoting SLi:
keep it to yourself in future if you could.

We no actually I could not. Have you a clue how a forum works? If we were to restrict opinions to only those that coincided with your bizarre twist on the world, it would would hardly be good, or more importantly, useful reading.
What arrogance for you to attempt to suppress any comment that does not align with your own narrow understanding.


Quoting SLi:
Others may see the usefulness and innovation in this product,

They may well do, but as yet we have not seen that other than from people who would see Win7 supporting, a USB Turban with reusable brain probe, as the next killer inclusion for the release.


Quoting SLi:
so instead of pulling the new tech to bits

It's called critical evaluation, if ever you been involved in design or innovation you'd maybe have a clue of the value of such a concept.


Quoting SLi:
lets discuss the possibilities and opportunity this product has in todays market

OK I'm game for a laugh,
- How do you propose this is readily adapted to currently available and thus reasonably affordable screen technology?

- You mentioned usefulness, name a practical application where this claimed technology would enhance productivity or the ergonomics of completing a given task?


Quoting SLi:
This new tech's usefulness is still being discussed worldwide by business owners and the like

By business owners eh, well there you go it must be worthwhile. There are business owners worldwide discussing the risk of UFO strike too.


Quoting SLi:
this is just a 'Demo

I see party trick is as a far more apt description.


Quoting SLi:
so don't judge it too quickly if you please

I'll judge at any rate I damn well choose thank you very much. It's not your place to decide the content of mine or anyone else's comment. So take you dork-a-hoot excitement and roll it up into what ever brand of gee-whizz enthusiasm you choose, and stay the hell out of my opinion while you do so.


11 November 2008, 9:02 AM (1 year ago)report abuse Send to a friend reply

SLi (Cornerstone member):

Quoting Raindog:
OK I'm game for a laugh,
- How do you propose this is readily adapted to currently available and thus reasonably affordable screen technology?

- You mentioned usefulness, name a practical application where this claimed technology would enhance productivity or the ergonomics of completing a given task?

As I said, the usefulness of this new TECHNOLOGY, which somehow your incapable mind refuses to comprehend, is still being discussed, and Microsoft is 'Demoing' this technology, not so that it can be used immediately, but that people can see the technology available today. I admit, not every technology invented is totally useful, and these new touch screen capabilities, although you fail to understand COULD be useful in the course of time. You fail to understand the concept that this is a DEMO of the new technology.

Quoting Raindog:
I see party trick is as a far more apt description.

Proves my point about judging too quickly, and misunderstanding the concept of technology being in 'DEMO' stage.



Quoting Raindog:
It's how I make my living

I find this extremely hard to believe... someone of your low intelligence level making money off innovation?


Quoting Raindog:
I'll judge at any rate I damn well choose thank you very much. It's not your place to decide the content of mine or anyone else's comment. So take you dork-a-hoot excitement and roll it up into what ever brand of gee-whizz enthusiasm you choose, and stay the hell out of my opinion while you do so.

See, now you're the one making the mistake. I voiced my judgmental opinion about your opinion, and now your voicing your judgmental opinion about my opinion, in fact doing the exact same as I just did. I dont know what you do with your 'excitement' but rolling it up in gee-whizz enthusiasm just doesn't tickle my fancy.



11 November 2008, 10:13 AM (1 year ago)report abuse Send to a friend reply

Raindog (Senior Forumologist):

Quoting SLi:
As I said, the usefulness of this new TECHNOLOGY

No amount of capitalisation on your part will turn a party trick into a technology.


Quoting SLi:
which somehow your incapable mind refuses to comprehend


So again devoid of any actual reasoning you resort to taunts and personal attacks. You don't have much of a case there do you?


Quoting SLi:
is still being discussed

And being discussed here, I've asked you to point out possible practical uses, none of which have been forthcoming.


Quoting SLi:
and Microsoft is 'Demoing' this technology, not so that it can be used immediately, but that people can see the technology available today

But this party trick/technology is not available today, neither is it anywhere near being in a form that could be mass produced let alone utilised for some practical purpose.


Quoting SLi:
I admit

There's a first


Quoting SLi:
not every technology invented is totally useful


Yes this one one is destined for the closet where the motorcycle ashtrays and battery operated battery chargers ended up.


Quoting SLi:
although you fail to understand COULD be useful in the course of time.

There is no failure to understand on my behalf, that is a failed assumption on your behalf. Suggest a possible application if you feel so strongly about it. Or is this another party trick/technology that will also need its application to be created.


Quoting SLi:
You fail to understand the concept that this is a DEMO of the new technology.

Again there is no failure to understand on my behalf, in actuality it is a failure to comprehend on your behalf.


Quoting SLi:
Proves my point about judging too quickly, and misunderstanding the concept of technology being in 'DEMO' stage.

Repeating yourself and adding meaningless capitalisation do nothing to prove a point you have failed to substantiate.


Quoting SLi:
I find this extremely hard to believe...

What you do or do not believe is of no consequence, and in now way changes a simply stated fact.


Quoting SLi:
someone of your low intelligence level making money off innovation?

And there you go again devoid of sensible argument you resort to unfounded insult and personal attack as away out of your predicament.


Quoting SLi:
See, now you're the one making the mistake.

No I think you will find your the one mistaken.



Quoting SLi:
I voiced my judgmental opinion about your opinion


If you scroll back just a little you see that you clearly suggested I should not voice any opinion that did not coincide with your own.



Quoting SLi:
and now your voicing your judgmental opinion about my opinion


No I'm simply addressing your wish to stifle any opinion that does not coincide with your own as folly.


Quoting SLi:
in fact doing the exact same as I just did

And what did rushing about in ever-decreasing circles ever get someone, other than a fit of the vapours.


Quoting SLi:
I don't know what you do

Exactly!

11 November 2008, 10:25 AM (1 year ago)report abuse Send to a friend reply

agami (User):

I like it. I think it's very clever.

The designation of its dimensional operation parameters are not important.
Also, just because I can see practical applications for this technology doesn't make those who don't narrow-minded or short-sighted. There are people suited to discovering the new world, and there are those suited to living in it.

11 November 2008, 5:19 PM (1 year ago)report abuse Send to a friend reply

anonymous user Anonymous user


Tags