The Visual Microphone: Passive Recovery of Sound from Videos Without Sound - General

[video=youtube;FKXOucXB4a8]http://www.youtube.com/watch?v=FKXOucXB4a8[/video] EDIT: I might have been late. If the thread is there already, can someone point me to it?

Wow, now that one movie where some crazy AI used a video feed of a nearby cup of coffee to listen in on possible rebels doesn't seem so far fetched..

[QUOTE=Naelstrom;45606904]Wow, now that one movie where some crazy AI used a video feed of a nearby cup of coffee to listen in on possible rebels doesn't seem so far fetched..[/QUOTE] You thinking of Eagle Eye? I'm looking for the clip but I can't find it.

This looks similar to that technique that can see heartbeats on skin.

wow, i wasnt expecting the recovered audio to sound as good as it does

I call bullshit because how can the algorithm detect motion if the movement is less than a pixel in the video? In other words there wouldn't be [B]any[/B] visible movement on the video.

[QUOTE=Oxu365;45607194]I call bullshit because how can the algorithm detect motion if the movement is less than a pixel in the video? In other words there wouldn't be [B]any[/B] visible movement on the video.[/QUOTE] There is no visible movement to us. Computers can still read data to sub-pixel sizes even if LCD screens can't.

It's like fucking HAL 9000.

[QUOTE=Oxu365;45607194]I call bullshit because how can the algorithm detect motion if the movement is less than a pixel in the video? In other words there wouldn't be [B]any[/B] visible movement on the video.[/QUOTE] subtle but detectable color changes.

[QUOTE=FlandersNed;45607250]There is no visible movement to us. Computers can still read data to sub-pixel sizes even if LCD screens can't.[/QUOTE] [QUOTE=paul simon;45607322]subtle but detectable color changes.[/QUOTE] Allright well that clears things up a bit. Apparently i'm just illiterate :v:

[QUOTE=Oxu365;45607340]Allright well that clears things up a bit. Apparently i'm just illiterate :v:[/QUOTE] Don't feel too bad, this shit is so amazing it's pretty hard to believe. I never even imagined technology like this existing...

I like how a bag of chips sounds like it too :v: [editline]6th August 2014[/editline] they should make sounds for horror games

This is some Fringe-tier stuff, yo.

I read the title of the thread and thought about how they'd be able to do that - I came up with the same method for the high speed camera but I imagined they'd be able to actually reproduce the sound from a scene (e.g. a block of wood hitting the floor) by detecting its vibrations on the camera. Their use is far more useful :v:

Whoa, it's like that one gadget from the earlier Splinter Cell games. I guess Tom Clancy was ahead of his time.

[QUOTE=FlandersNed;45606833] EDIT: I might have been late. If the thread is there already, can someone point me to it?[/QUOTE] [url]http://facepunch.com/showthread.php?t=1414933[/url]

That is very cool. Unfortunately, there's a big aliasing problem which would be extremely hard to solve, especially when using the regular cameras - I'm quite surprised at how well it works, really.

I knew someone with a worse microphone than a plant.

Someone's gotta play some Skrillex to the chip packet and try and recover the sound.

This is way cool but any outside factors will greatly reduce the accuracy of this (i.e. circulation of air, temp, etc)

[QUOTE=KorJax;45609436]This is way cool but any outside factors will greatly reduce the accuracy of this (i.e. circulation of air, temp, etc)[/QUOTE] the camera moving, too (although if it's only vibrations, the camera is so high speed that the algorithm can probably stabilize it).