FlexPoser: Real-time face tracking and animation [Public testing phase] - Garry's Mod

[QUOTE=kernalk;45331796]Bad news: my beard seems to prevent proper expression detection but since my fiancée also has the same problem the fact that an addon can do this well is pretty amazing![/QUOTE] your girlfriend has a beard?

it was pretty fun while it lasted but im a little disappointed the models couldn't mouth words too well maybe it was the lighting in my room, idk

I would love linux support in the near future. Looks good so far. C:

Question Suggestion: Could you add better support for TF2 models? NonHWM/HWM Because well... When TF2 Gamemode will be released (I still have old version) Some people might want to try it out... I dont think they will like to see this.. Just sayin [IMG]http://cloud-4.steampowered.com/ugc/590286345574194851/FC793FBF0759C856536CEA38A115DE8B4D2753C3/1024x576.resizedimage[/IMG]

Damn dog, is this some OpenCV wizardry? [editline]8th July 2014[/editline] [QUOTE=john552;45318105]doesn't HAC have this anyway? (henry's animation tool)[/QUOTE] lol my tool doesn't do this awesome stuff, I'd be happy to create an interface with it though. It looks hella sick.

Brodi, woot someone checked my site. :D Thanks! Hentie, it is OpenCV wizardry but I can't take credit for the face tracking part, which is done using the "FaceTracker" library by [URL="http://jsaragih.org/"]Jason Saragih[/URL]. I added credits all over the place but somehow forgot to add it in this thread, updated it now. Your tool is awesome too, by the way. :P Kirillian, thanks for the screenshot of the TF2 model, I had no idea it was so broken. Redownloading TF2 right now and will update the server addon I within a week tops. You won't need to redownload the binary module (for this problem). Also thanks to all with the crashes for running the console commands. It clearly isn't an issue with dependencies since the module loads and the C functions are registered, so its an internal issue. I'll look into it this week.

It returns 1 by the console after using the command, Nisshoku. What exactly did that do, though?

[QUOTE=erkor;45336746]It returns 1 by the console after using the command, Nisshoku. What exactly did that do, though?[/QUOTE] Hi, it proves that the issue is not in setup or dependencies, but in execution of the module. Please give me a few days so I can put in more checks... so next version will crash less and just display errors in the GUI. When I'm done the server addon will update automatically and tell you that the DLL is outdated.

Alright!

Jesus Christ, you have made history for all of Garry's Mod addons.

[QUOTE=Adult;45325984]aw. If you need help porting it to Linux, you can give me a shout, I have plenty of experience making cross-platform code with C/C++[/QUOTE] Can you make a dylib for macs too? kthxpls [editline]9th July 2014[/editline] Glad to see this was finished so fast! Imagine the possibilities

Very cool, especially how you're using it for your Master's project. Can you tell us more about the research associated with the addon?

You sir have just made my day...

is their a way to enable the menu without using the chat? Evolve (admin tool) gets confused with !fp

I used to crash everytime I enabled FlexPoser like the others with the module working, but it was just my camera. I switched from some old logitech cam to my Galaxy S4 with IP Webcam app and now it works.

[QUOTE=Chief Martini;45338641]Very cool, especially how you're using it for your Master's project. Can you tell us more about the research associated with the addon?[/QUOTE] Hi, sure but I'll keep it brief. My aim is to prove that real-time face tracking for facial animation of game avatars offers "benefits" for multiplayer gaming experiences. Benefits is really vague but because there isn't much work yet in the combined field of face tracking and gaming experience, if I could show that there is any benefit then afterward I/others can expand on that. Since we're talking about gaming experiences, my approach is user studies. I have three subgoals: 1. Show that it can be technically achieved and that consumer hardware is already good enough. The addon is one part of the proof. The other is a video survey which I posted earlier on this forum, from which I can deduce what the delay/noise/framerate requirements are for the facial animation (some videos were artificially delayed, some were artificially noisy) for people to find the animation acceptable. 2. Test whether people do notice each other's expressions, and make expressions at each other during regular play. This will be tested by playing games with a test group in a LAN setup. 3. Identify in which game types people are more expressive. Hence the statistics tracking I mentioned in the opening post. By logging per session the game mode and map, and also computing a metric that represents how expressive people were during the match, I hope to be able to deduce whether the addon works better in crowded servers/less crowded/roleplay/non-RP, etc. I started this project hoping to be able to demonstrate that this feature is doable right now and more games need it. Kind of offering results to game companies and hoping they do something with it. :P So far so good. ^^ [QUOTE=kakizc;45342184]I used to crash everytime I enabled FlexPoser like the others with the module working, but it was just my camera. I switched from some old logitech cam to my Galaxy S4 with IP Webcam app and now it works.[/QUOTE] I suspected the crashes had to do with webcam interfacing and my next plan was to do more checks in that department. Good to hear that it works for you now. Can the other people with crashes also try a different webcam? I'll still keep improving the addon of course, but for some problems the best I can offer is that it shows an in-game error message rather than crashing. [QUOTE=Ellistron;45341085]is their a way to enable the menu without using the chat? Evolve (admin tool) gets confused with !fp[/QUOTE] I'll add other ways in the next update. Does anyone know a good suggestion? What is actually the usual way to open addon specific menus? I'm not so familiar with playing gmod with addons, actually. :P

Oh god! After kinect,now,it's the face :o. Extrem nice works guy,i tried it and it's just funny to see (pervert face and other things) using it on servers could be a GREAT and AMAZING idea xD !

[QUOTE=NisshokuZK;45342480]Hi, sure but I'll keep it brief. My aim is to prove that real-time face tracking for facial animation of game avatars offers "benefits" for multiplayer gaming experiences. Benefits is really vague but because there isn't much work yet in the combined field of face tracking and gaming experience, if I could show that there is any benefit then afterward I/others can expand on that. Since we're talking about gaming experiences, my approach is user studies. I have three subgoals: 1. Show that it can be technically achieved and that consumer hardware is already good enough. The addon is one part of the proof. The other is a video survey which I posted earlier on this forum, from which I can deduce what the delay/noise/framerate requirements are for the facial animation (some videos were artificially delayed, some were artificially noisy) for people to find the animation acceptable. 2. Test whether people do notice each other's expressions, and make expressions at each other during regular play. This will be tested by playing games with a test group in a LAN setup. 3. Identify in which game types people are more expressive. Hence the statistics tracking I mentioned in the opening post. By logging per session the game mode and map, and also computing a metric that represents how expressive people were during the match, I hope to be able to deduce whether the addon works better in crowded servers/less crowded/roleplay/non-RP, etc. I started this project hoping to be able to demonstrate that this feature is doable right now and more games need it. Kind of offering results to game companies and hoping they do something with it. :P So far so good. ^^[/QUOTE] That's very intriguing. Also just noticed you're Dutch as well. Would love to hear more regarding your results as you gather them. Best of luck!

Hey guys ! I'm on Windows 8.1. I have installed C++ x64, put the both files on the right folder and when i started the flexposer gui, all requirement was loaded, but I can't do something, my game crash before all action and go back to my windows desktop. Someone know how to resolv this problem ?

ApertureXS200, I'm glad you enjoy it! Chief Martini, sure I will post some updates on my research here as well, its the least I can do since this community has helped me in a lot of ways. AlexBoost, do you have any other webcams available to test with?

uh no why ?

[QUOTE=NisshokuZK;45348439]ApertureXS200, I'm glad you enjoy it! Chief Martini, sure I will post some updates on my research here as well, its the least I can do since this community has helped me in a lot of ways. AlexBoost, do you have any other webcams available to test with?[/QUOTE] We just need more servers to use this baby,it's sad to do it alone ;( especially on RP servers it could enhance the RPs (Ok,i'm leaving.)

I had to create the "bin" folder described in the instructions for installing as a Player (it didn't exist yet), but the game isn't picking up the .dll for some reason.

Odd, I have the modules and it still keeps asking me to retry.

THIS IS f* EPIC! The best thing to show to a friend on a server! I freaking cried laughing! Some crazy screenshots i took [QUOTE][IMG]http://cloud-2.steampowered.com/ugc/49854390359374659/B45F60A076BB1A34CF39DEC619E0ED2E50662264/1024x576.resizedimage[/IMG][IMG]http://cloud-4.steampowered.com/ugc/49854390359364733/B55A23DD1D69DD6BE716DD38797770DC778F5CA2/1024x576.resizedimage[/IMG][IMG]http://cloud-4.steampowered.com/ugc/49854390359373431/E7428DFF6D8D5A37B917B03FBE704D89C0D122FB/1024x576.resizedimage[/IMG][IMG]http://cloud-2.steampowered.com/ugc/49854390359375670/B1619FC601E065BDFF4C8A741E1E0966CF3F774B/1024x576.resizedimage[/IMG][IMG]http://cloud-4.steampowered.com/ugc/49854390359363460/32747F9A8B8B09C20756E543E82DB637001D9D65/1024x576.resizedimage[/IMG][IMG]http://cloud-4.steampowered.com/ugc/49854390359362331/B822E0914F2FD18FA4C59967330CED1B87924844/1024x576.resizedimage[/IMG][/QUOTE]

1. Incompatibility with some web-cams confirmed. 2. You could try to add more options for performance - I'd like an option to lower face refresh rate since I have a toaster. 3. You can make entry for FlexPoser near Face Poser.

I still need help :<

don't do it with gman, he looks like a complete retard

[QUOTE=similarguy;45351478]I had to create the "bin" folder described in the instructions for installing as a Player (it didn't exist yet), but the game isn't picking up the .dll for some reason.[/QUOTE] [QUOTE=thejjokerr;45359692]I have the same problem, trying to require it manually results in: [code]] lua_run_cl require"flexposer" [ERROR] LuaCmd:1: Couldn't load module library! 1. require - [C]:-1 2. unknown - LuaCmd:1 [/code] I did extract the lua from the workshop addon as I had to customize the command so it was compatible with my gamemode, but still that shouldn't matter too much for the DLL loading.[/QUOTE] Uninstall C++ x64 redistributable and install x86 one.

I showed my mum and sister this and they were genuinely impressed. Great work sir.