Intel bringing vision, 3D to laptop and tablet cameras

From mundane 2D devices, integrated cameras in laptops and tablets in the future will change into powerful 3D tools that can sense movement, track emotion, and even monitor reading habits of children, according to Intel.

Intel is developing a "depth sensing" camera, which is an enhanced version of a 3D camera that can go deeper inside images to "bridge the gap between the real and virtual world," said Anil Nanduri , director of perceptual products & solutions at Intel.

The webcam enhancements will help the computer understand a human better, bring new levels of interactivity to 3D games, and make webconferencing fun by blanking out the background and adding a green screen, Nanduri said.

"You'll add the ability to sense your excitement, emotion -- whether you are happy or smiling. The algorithms and technologies are there, but they are getting more refined, and as they get more robust, you'll see them," Nanduri said.

Such depth cameras will be integrated into laptops and ultrabooks in the second half of 2014. The technology will initially appear in external webcams such as Senz3D external webcam, which was jointly developed by Logitech and Intel, and will become available in the coming quarters. The camera technology will ultimately trickle down to tablets and smartphones, Nanduri said.

The camera will also be able to identify characteristics, contours and shapes of items in view. For example, the camera's ability to sense distance, size, depth, color, contours and other parameters of structures could also help in the growing area of 3D printing. A depth sensing picture of a model can be extracted to reveal exact specifications and other details of a design, which can then be printed.

"You are not going to look for a case [for a device] anymore, you'll just point that device, and the cameras will recognize what you have. It'll know the model number...and it'll print [the case] for you, or you go to the store, they will print it for you," Nanduri said.

With the help of eye tracking, it could also track how well somebody is reading and use that information as an evaluation tool. For example, it could track reading, and tell if kids are stuck on words, how much they read, or whether they need help with specific words.

"Having the capabilities to say -- they read about 80 percent of the lines, they had difficulty with these words -- that kind of intelligence for educational tools is phenomenal," Nanduri said.

Other small enhancements also include using a motion-sensing game where hands can be followed to pick up objects in the wider dimension of 3D games. The data collected by the camera could be combined with other modalities like voice recognition to improve human-computer interaction.

There are already 3D cameras out there, but Intel is trying to tack on the algorithm and hardware features that make images more meaningful.

"Kinect was a good initial version of a depth camera more from a long range perspective. When Intel started looking at it, we were primarily looking at it primarily as more personal interaction, short range, which is probably a meter or meter-and-a-half range of interaction," Nanduri said.

Integration in the thin ultrabook display panels may be a challenge. Intel is addressing the challenges with a high resolution short-range camera that focuses on a small area, and what Nanduri called "finger-level articulation."

"You need to have a lot more resolution for that zone. To really scale it to volumes, you need to get to the right form factor from the optics perspective, you need to get to the right power levels and you need to have the right cost structure to help scale it into integration," Nanduri said.

When the technology reaches devices, users may progressively forget the keyboard and mouse when interacting with computers.

"When you have depth information, what you can do with it is pretty phenomenal," Nanduri said.

Critic’s Notebook: Latest Vision for Las Vegas: A Downtown Vibe

Isaac Brekken for The New York TimesTony Hsieh, the chief executive of Zappos, in Henderson, Nev. Mr. Hsieh is determined to revitalize downtown Las Vegas.

LAS VEGAS — Tony Hsieh didn’t look much like a modern-day Bugsy Siegel. Wearing backpack, T-shirt and jeans, standing outside a downtown bar, he patrolled his future empire along East Fremont Street here one sweltering morning.

A sortable calendar of noteworthy cultural events in the New York region, selected by Times critics.

But the flamboyant Siegel changed this city for good when he built the Flamingo Hotel, the first luxury casino on the Strip. Now Mr. Hsieh, a soft-spoken 39-year-old Internet billionaire who runs Zappos, the online clothing store, plans to do something as transformative. It’s a classic American dream: a Western-scale roll of the dice in a city that suddenly conjured up Belle Époque Paris and ancient Rome out of the desert. The idea this time is to build a version of the Mission district in San Francisco or the Williamsburg section of Brooklyn in downtown Vegas.

Mr. Hsieh (pronounced shay) is relocating Zappos headquarters from Henderson, Nev., about 16 miles away, and investing hundreds of millions of his own dollars to retrofit downtown with, well, a downtown, in line with the latest trends.

I came to check out the progress. There’s not much to see yet, but his $350 million Downtown Project — a mix of investments, acquisitions and loans — envisions blocks and blocks of community-based, pedestrian-friendly, small-business-oriented, high-density, high-tech urbanism in long-depressed and troubled neighborhoods. Zappos will take over the decrepit old City Hall. That gesture alone, salvaging a local landmark, has endeared Mr. Hsieh to many in Las Vegas.

We spoke briefly the other night in the Gold Spike, a former casino near City Hall whose gambling room he stripped and converted into a chic slots-free bar and chill space. He took me to the empty motel he bought next-door, where, he speculated, a modeling agency and photography studio could take over what used to be a few of the poolside guest rooms.

On nearby blocks, which he has also gobbled up, the Downtown Project would seed tech start-ups, boutiques, mom-and-pop restaurants and bars; the world’s largest Airstream trailer park; a playground and geodesic dome; a complex of recording studios; a charter school; a doggy day care; a bike share program, even a Tesla electric car share, along with theaters for TED Talk-like lecturers and music festivals.

There’s no designer-led master plan, no single billion-dollar construction project, no star architect. The concept is top-down but preaches piecemeal, bottom-up development and reuse. It exploits a picturesque supply of abandoned flop houses, vacant offices and collapsing warehouses, capitalizing on a growing desire among young Americans for urban life: an anti-Strip vision of America.

Out on the Strip, MGM opened CityCenter in 2009, a $7.8 billion luxury development and celebrity-architect petting zoo, which in a sense is the same concept, but pegged as a theme park for tourists. I got a peek the other day. It’s a smart and sleek attraction; business has been improving. CityCenter and the Downtown Project are both visions for evolving the same city.

But unlike MGM’s development, which opened in the midst of the housing collapse, Mr. Hsieh’s timing could hardly have been better. The local economy, devastated when the bubble burst, is limping back. The population (increasingly young Asians and Hispanics) keeps rising, and wealthy out-of-towners prop up the high end of the housing market. Most properties are still under water, and the city is down 100,000 construction jobs from pre-recession highs, but the picture isn’t as bleak, or straightforward, as four years ago.

At the same time, Las Vegas suffers the pitfalls of being a one-industry town. Baked into its economy are minimal taxes and a state government inclined to ship much of what Las Vegas contributes to the rest of Nevada, which, among other consequences, insures the school system is perennially poor. Casino moguls, needing a steady supply of parking attendants, hotel maids and blackjack dealers, not college-educated workers, were once fine with that. But times are changing. Now the lack of good public schools and downtown amenities — demanded by those mobile and educated young Americans other cities are competing to attract — has become a liability.


Follow me on Twitter @sajilpl