I swear I saw something by Google or Microsoft doing almost the same exact thing 2-3 years ago.
holy *fuck*
This would be so cool if you could do it real time (video games mainly)
I assume it takes prolly days of rendering though. It copies the brush strokes, man that's cool.
[QUOTE=Empty_Shadow;50247259]holy *fuck*
This would be so cool if you could do it real time (video games mainly)
I assume it takes prolly days of rendering though. It copies the brush strokes, man that's cool.[/QUOTE]
[URL="http://arxiv.org/abs/1604.08610"]Here's the paper.[/URL]
It uses neural networks, so it's probably not [I]terribly[/I] slow once trained, but it doesn't work as real-time effect since the algorithm requires the video to also play backwards.
[QUOTE=Empty_Shadow;50247259]holy *fuck*
This would be so cool if you could do it real time (video games mainly)
I assume it takes prolly days of rendering though. It copies the brush strokes, man that's cool.[/QUOTE]
It would be easier if the game's textures already fit the painted artstyle.
But yeah, a game with a painted artstyle similar to this would be kinda cool, the closest I can think of is Skyward Sword, it went for a sort of impressionism art style; The farther away things were, the more they looked like they were made of blots of paint.
[IMG]http://40.media.tumblr.com/tumblr_luhbb4uvjE1r0gdwgo2_1280.jpg[/IMG]
now every movie can be anime
Still frames from this look like they'd be good for some kind of SCP article.
Neural networks ARE terribly slow, running this things on a 780 takes around 5 mins per pic.
[media]http://imgur.com/a/V0qTV[/media]
Is the source code for this published anywhere?
[QUOTE=eirexe;50248644]Neural networks ARE terribly slow, running this things on a 780 takes around 5 mins per pic.
[media]http://imgur.com/a/V0qTV[/media]
Is the source code for this published anywhere?[/QUOTE]
[url]https://github.com/manuelruder/artistic-videos[/url]
IDK if this is the source code, im dumb, but it was in the video description.
[QUOTE=Vodkavia;50248932]See I don't like them calling this "style" transfer, because it isn't. It's an awesome technique with interesting results but ultimately it's palette swap and and paint daub effect; the actual personal considerations that go into style as well as some subtle and major nuances aren't even touched on.
It's most agregious with the starwars scene, the monochrome storm troopers just become a void for the copy, colour select, paste to show its weakness[/QUOTE]
I would call it true style transfer, works specially when the style is obvious like with van gogh's starry night
[editline]3rd May 2016[/editline]
[QUOTE=Str4fe;50248763][URL]https://github.com/manuelruder/artistic-videos[/URL]
IDK if this is the source code, im dumb, but it was in the video description.[/QUOTE]
Yeah that's it, cool.
The clips with the tiny dragon come from this movie: [url]https://www.youtube.com/watch?v=HomAZcKm3Jo[/url]
It looks super cool at first but the tech isn't that mindblowing, it just seems to be based on keyframes, sort of the same stuff that causes video 'smear' artifacts in poorly compressed videos
[QUOTE=Vodkavia;50249907][img]http://i.imgur.com/sozRQGx.png?1[/img]
[B]
Nope. [/B]
[img]http://i.imgur.com/5hsZPfn.png[/img]
Here it undeniably fucks up every single element of the painting. Stars are overlayed onto clouds but not ALL of them mind you, the mammoths face, the birds ass and random rocks as well as the ground while of the blue of the night sky is just kind of everywhere? Why? Because a simple algorithm can't fucking reverse engineer a style; but it CAN overlay one image over the other, warp it and and slap elements similar elements on top of each other.[/QUOTE]
It's doing more than what you've described, it's not simply warping and overlaying it.
In any case, these are actually shallow examples of what we can achieve, this is just the beginning. Perhaps a more difficult scenario is automatic colorization: [url]http://hi.cs.waseda.ac.jp/~iizuka/projects/colorization/extra.html[/url]
Do you still think it's simply overlaying things?
[QUOTE=bunguer;50252149]It's doing more than what you've described, it's not simply warping and overlaying it.
In any case, these are actually shallow examples of what we can achieve, this is just the beginning. Perhaps a more difficult scenario is automatic colorization: [url]http://hi.cs.waseda.ac.jp/~iizuka/projects/colorization/extra.html[/url]
Do you still think it's simply overlaying things?[/QUOTE]
Exactly, this is extremely demanding and complicated technology.
Sorry, you need to Log In to post a reply to this thread.
