• 3 researchers at Microsoft make a new type of video Time-lapse: Hyperlapse
    29 replies, posted
[media]http://www.youtube.com/watch?v=SOpwHaQnRSY[/media] [quote] We present a method for converting first-person videos, for example, captured with a helmet camera during activities such as rock climbing or bicycling, into hyperlapse videos: time-lapse videos with a smoothly moving camera. At high speed-up rates, simple frame sub-sampling coupled with existing video stabilization methods does not work, because the erratic camera shake present in first-person videos is amplified by the speed-up. [/quote] I know that video time-lapses are called Hyperlapses already, but this method of creating and processing them is completely unique and a million times more watchable than what's available. More details here: [url]http://research.microsoft.com/en-us/um/redmond/projects/hyperlapse/[/url] Technical paper here: [url]http://research.microsoft.com/en-us/um/redmond/projects/hyperlapse/paper/hyperlapse.pdf[/url] Technical explanation video: [media]http://www.youtube.com/watch?v=sA4Za3Hv6ng[/media]
Really effective result! I should do one of these when I next go on a 20km walk. Shit that's complex!
Make everything look like a tech demo with that almost flying movement
Reminds me of a really laggy multiplayer game how those people were walking around.
that's somehow incredibly disorienting
I'm gonna remain skeptical until I see normal people who don't have a vested interest in this working so well get their hands on it.
[QUOTE=Mister Sandman;45655502]I'm gonna remain skeptical until I see normal people who don't have a vested interest in this working so well get their hands on it.[/QUOTE] Skeptical about what? It's a method of smoothing video time-lapses and all the details on implementing it yourself are in that research paper. At the most Microsoft might add it into a product or create an app or something, but someone can take the research paper and write up their own version if they so desire.
[QUOTE=ScottyWired;45655487]Make everything look like a tech demo with that almost flying movement[/QUOTE] And now I know why. It literally turns the footage into a 3D model. EDIT: "facepunch isn't a hive mind!" [IMG]https://dl.dropboxusercontent.com/u/111996868/2014/agrees.JPG[/IMG]
[QUOTE=usa;45655513]Skeptical about what? It's a method of smoothing video time-lapses and all the details on implementing it yourself are in that research paper. At the most Microsoft might add it into a product or create an app or something, but someone can take the research paper and write up their own version if they so desire.[/QUOTE] Skeptical that it works as well as they say it does. Don't mistake anything, I'm not being skeptical out of malice and I don't expect that it looks like shit, I'm just not going to get my hopes up that it's going to be as great as is presented until I actually see it being used by normal people. Also yeah, the first link has a line of text stating they're working on making a windows app out of it.
Just in time for the Evil Dead TV series too.
[QUOTE=Mister Sandman;45655527]Skeptical that it works as well as they say it does. Don't mistake anything, I'm not being skeptical out of malice and I don't expect that it looks like shit, I'm just not going to get my hopes up that it's going to be as great as is presented until I actually see it being used by normal people. Also yeah, the first link has a line of text stating they're working on making a windows app out of it.[/QUOTE] It's most probably definitely working - the worst they could do is only showing examples that worked really well.
Fuck that's beautiful. The slightly choppiness you can see reminds me of a game rendering the world lol.
The terrain rendering is a bit off - are they using a 2005 PC?
why is it called hyperlapse isn't it just a moving timelapse correct me if im wrong since i'm not good with these things
Definitely looks like a tech demo or an in-game benchmark. It even adds generic pop music! [editline]11th August 2014[/editline] [QUOTE=nnanna;45656683]why is it called hyperlapse isn't it just a moving timelapse correct me if im wrong since i'm not good with these things[/QUOTE] I'm probably wrong here but science-men like to give the stuff they make neat names so you don't have to call them moving timelapses. It's probably trademarked or something
there's a lot of anomalies in the video and errors, though. looks promising, but needs a fair bit more work
[QUOTE=Dark RaveN;45656629]The terrain rendering is a bit off - are they using a 2005 PC?[/QUOTE] No they're using modern, unoptimised, experimental technology. Extracting a 3D map from a 2D image isn't exactly easy with only a single camera.
[QUOTE=Dark RaveN;45656629]The terrain rendering is a bit off - are they using a 2005 PC?[/QUOTE] They're making 3D outta 2D automatically, thats like fucking magic.
Imagine hyperlapsing a video of someone sky diving
[QUOTE=ScottyWired;45656717]No they're using modern, unoptimised, experimental technology. Extracting a 3D map from a 2D image isn't exactly easy with only a single camera.[/QUOTE] thanks captain
[quote]Approximate computation times for various stages of the algorithm, for one of the longer sequences, BIKE3 [13:11s, 23700 input frames, 2189 output frames] In this work, we were more interested in building a proof-of-concept system rather than optimizing for performance. As a result, our current implementation is slow. It is difficult to measure the exact timings, as we distributed parts of the SfM reconstruction and source selection to multiple machines on a cluster.[/quote] [code]Match graph (kd-tree) 10-20 minutes Initial SfM reconstruction 1 hour (for a single batch) Densification 1 hour (whole dataset) Path optimization a few seconds IBR term precomputation 1-2 minutes Orientation optimization a few seconds Source selection 1 min/frame (95% spent in GMM) MRF stitching 1 hour Poisson blending 15 minutes[/code] There's still work to do before you'll be processing video like this on your PC :)
I don't get it - is it all automated? Because if not, there's still a long way before it gets anywhere near plausible for public use
I really hope they can integrate this into [url=http://photosynth.net/preview]Photosynth[/url], it's kind of a similar thing.
It seems like you could basically just cycle around a city and this could create a full and textured 3D model of the whole fucking city from the footage? without the need of expensive 3d scanning equipment and everything
[QUOTE=TNOMCat;45657198]It seems like you could basically just cycle around a city and this could create a full and textured 3D model of the whole fucking city from the footage? without the need of expensive 3d scanning equipment and everything[/QUOTE] not exactly the constructed 3D mesh is extremely raw and only really useful for the task it was created for
[QUOTE=DeEz;45657248]not exactly the constructed 3D mesh is extremely raw and only really useful for the task it was created for[/QUOTE] for [I]now[/I]
Wow...pretty much had to pick my jaw up off the floor after that explanation video.
[QUOTE=Sgt-NiallR;45657464]for [I]now[/I][/QUOTE] You could probably improve the 3D model information a lot if each frame had an accompanying depth buffer and very precise positional/rotational information. But this stuff isn't quite there yet for portable cameras.
That's so cool how they generate a 3d world and camera path from the video.
[QUOTE=nnanna;45656683]why is it called hyperlapse isn't it just a moving timelapse correct me if im wrong since i'm not good with these things[/QUOTE] Moving timelapses are often called hyperlapses.
Sorry, you need to Log In to post a reply to this thread.