About the SA Blog Network  

Symbiartic

Symbiartic


The art of science and the science of art.
Symbiartic HomeAboutContact

Meet the future of photography


ShareShare  ShareEmail  PrintPrint



Before you draw conclusions from my recent post that I am some bitter photography-hater, I want to set the record straight. I am not a photography-hater (although I reserve the right to be a stock-photography-stealing-good-illustration-opportunities hater), and to prove it to you, I want to introduce you to the future of photography. I recently got wind of a new technology that has the potential to overturn photography as we know it. It is still in the development stages, but if the images on their website are any indication of what they’ve accomplished so far, this technology is powerful. I daresay I’m a believer.

The camera is called Lytro and it was born of Stanford graduate Ren Ng’s 2006 dissertation on light wave physics. Basically, Ng got sick of his photography skills and rather than continue pumping out image after blurry image, he decided to do something about it. The result is a new type of photography, dubbed light field photography, that allows you to snap away, carefree as the day you were born, and focus later, in the lab.

Snap now, focus later? How the?!?

Traditional cameras function much like our eyes. Light enters through a small opening and is focused by a lens onto a plane. In an eye, this plane is our retina which collects data about color and light and sends them through our optic nerve to the visual cortex in our brains. Our brains then do some fancypants hocus pocus and dish up an image that makes sense to us. In a camera, the plane is either film (film! Remember that stuff?), or in the case of the 1.6 million digital cameras sold last year, a sensor that turns light into electrical impulses. These electrical impulses are interpreted by a computer chip and turned into points of light, or pixels, to be displayed on a screen for your viewing pleasure. Each pixel, then, is the sum of all the light that hit one point on the sensing plane. The output image is a 2-dimensional grid summary of a 3-dimensional scene.

camera & eye

Traditional cameras capture and record light in much the same way as our eyes do. Illustration © Kalliopi Monoyios

By contrast, the Lytro camera has a sensor which more closely resembles that of an insect’s compound eye. Rather than record the sum of light at each point on the sensor, each point on the sensor acts as its own independent eye. The result is that the camera can compare information from each “eye” to understand the direction that light is coming from as well as its brightness and color. Now, rather than a flat, 2-dimensional representation of a scene, it has a little more “ammo” in its arsenal. Given the right computing software and power, it can process the image after the fact, changing focus or even the position of the viewer in a scene. Dang, that’s fly!

light field sensor

If traditional digital camera sensors can be thought of as a single eye collecting 2-dimensional data, light field sensors squeeze a full eye into each point on their sensing plane, creating in effect a compound eye. Figure modified with permission from Dr. Ren Ng's 2006 thesis (not a representation of the most current technology Lytro will employ).

Linkage:
More dynamic images at the Lytro Photo Gallery
For the technically inclined: Ren Ng’s Dissertation

Kalliopi MonoyiosAbout the Author: Kalliopi Monoyios is a scientific illustrator at the University of Chicago and the illustrator of two popular science books, Neil Shubin’s Your Inner Fish, and Jerry Coyne’s Why Evolution is True. Her portfolio is at kalliopimonoyios.com. Follow her at @eyeforscience and with co-blogger Glendon Mellow at @symbiartic. Follow on Twitter @symbiartic.

The views expressed are those of the author and are not necessarily those of Scientific American.



Previous: To © is Human More
Symbiartic
Next: Science-art Scumble #20




Post a comment | Read Comments (3)

Comments 3 Comments

Add Comment
  1. 1. Alex Wild 9:43 am 07/29/2011

    I love your computer/brain “crunch crunch” graph!

    I will take issue with light field cameras being the future of photography, though, until we have a better sense of how the tradeoffs play out, particularly in regard to noise and resolution. I can certainly see the technology being revolutionary in particular applications (idiot-proof consumer cameras & wildlife camera trapping, for examples where focus problems are common). For others, we’ll have to wait and see how it performs.

    Now if I could just get my hands on a review camera…

    Link to this
  2. 2. Kalliopi Monoyios 12:39 pm 07/29/2011

    Thanks, Alex!

    You are absolutely right about this camera having limitations. Just like any technology, there will be tradeoffs. They are not at this time giving specs for the cameras, though, so I wasn’t able to elaborate on the images sizes and noise, etc. Ng’s thesis does have a chapter on dealing with noise, and they do state that sacrificing resolution is a byproduct of using a light field sensor (in fact, I bet you could elaborate on how an insect’s compound eye trades resolution for motion detection and such). But they were very insistent that they are five years ahead of that thesis work (published in 2006), so presumably they have some new tricks up their sleeves. Anywhoo, for people who are primarily sharing family photos online, I doubt the resolution will be a problem. And the noise seems to be well controlled in their gallery images – ditto your wish to get my hands on a review cam! Droool!

    Link to this
  3. 3. Glendon Mellow 1:43 am 08/6/2011

    I could easily see this as a painter’s tool, as well as a photographer’s.

    Fantasy illustrator Patrick Woodroffe used to make images he called ‘tomographs’ (not to be confused with a medical scanning term)that were painted, cut-out elements photographed against real backgrounds (often with plants in his garden) or against painted backgrounds, kept out of focus (example). It would be handy and potentially very interesting to create images that had multiple layers, with the out of focus shapes invoking paredolia and altering the entire image’s subject.

    Link to this

Add a Comment
You must log in or register as a ScientificAmerican.com member to submit a comment.