That's ONE technique of many. Also see EBsynth (or something similar), 360 3d-camera-tracking, 2d composites into 3d space, rotoscoping/rotobrushing...I am sure there are a bunch more. Very cool shit.
Edit; and volumetric video...holy shit.
The "Holograms" I am referring to are 4-Dimensional Volumetric Videos.
I used to work as a Director for a studio that did photogrammetry and volumetric capture commercially for games and apps.
We did a bunch of these demos to test out the tech before they eventually went under after I left the company (honestly the tech still isn't quite there yet, probably still a few years out from being a really viable).
Anyway I got access to some of the clips to make some fun demo content and this is where I went with it.
This technology is going to be a huge component in the future of filmmaking down the road, in my opinion.
Instead of capturing straight video it creates a 3D model of whatever you are filming that you can then manipulate from any angle. It's kind of like the LiDar scanning feature on the new Iphones, only the models are moving and in motion. Sort of like combining motion capture with LiDar into one neat solution.
The Texture of the Model is a carefully reconstructed video from all angles, so when it works you get a really lifelike capture.
I kept the resolution on the video at 1080 and did some post smoothing so it would look slick. For a full 4K or even 2K Cinema-style production I don't think the tech is quite there yet (unless you pull some tricks, more on that below). Your characters will fall into the uncanny valley and lack emotional depth, although it could work for some action sequences where the camera is relatively far back.
If you'd like some more examples of uses of the tech, check out my short film "**The Vanishing American Dream**" which won Most Creative VR Film at CineQuest 2021.
[https://vimeo.com/508329823](https://vimeo.com/508329823)
It was shot entirely using volumetric video and was conceived to work within the strengths and weaknesses of the tech.
It's also available in stereoscopic 3D for VR headsets and 3DTVs, I put it up on Vimeo for $1 if you're interested to check it out:
[https://vimeo.com/ondemand/vanishingamericandream](https://vimeo.com/ondemand/vanishingamericandream)
\-Mike
I’m about to go into college for Film and I would love to learn how to use this in a production. Do you have any links or recommendations? This is really fun to see in action.
What? How!? This is insanely cool. There’s data moshing, there’s 360 photography and movement and who knows what else. Did you use google dream at all? What!? Awesome stuff.
It sounds sort of like the Kinnect camera, where you set a bunch of then up around a subject, and end up with a 3 Dimensional representation of the scene.
The problem with this is sometimes you get holes and other weird oddities in the scene (which with machine learning will probably be fixed in the future), which is probably why he's saying it's not really ready for higher quality renders, but you can kind of fudge it a bit with various filtering techniques and construct some really cool scenes like he just did.
It's really really impressive from a compositing perspective. You have a lot going on. You keep momentum moving, the pacing and beats are perfect.
Even the sound design. Absolutely love it. I hope you make more shorts like this.
The equipment needed would to make this type of thing would make a tutorial functional irrelevant haha. Volumetric video is out of 99.999% of our reach, for now. This is just magic until then. So fucking cool.
Edit; my grammar shocks me sometimes. Leaving the mistakes in the remind myself that I am dumb-dumb.
Ngl I’m working on an alternative film and I’ve been really struggling with a way to transition between locations, the data merging seems like it would be an amazing way to do that! Just wondering how long this process took and if you have any tutorials or such you followed?
Whoa. Also that would be cool to just capture a scene once and then place cameras in the room in post. It would make the production days go way faster if shooting in a controlled set where everything could be captured by these cameras.
Yup that is the direction where things are going, but we are still a long way off. The Texture detail needed for that to happen is going to need to increase significantly.
There's also some reasons why this tech just might stay niche though: it could just be easier to do a single ultra high quality photogrammetry scan of a person in a t-pose. All animations would be later added in like any other animated character.
Capturing movement and turning it into perfect meshed 3D model still has a lot of hurdles that make other options more viable for a production ready environment.
Things like Virtual Production makes it easier now to bring real actors into 3G scenes using game engine technology.
I don't think any one of these solutions will be solely "the future" but more a combination of all of them working together.
That would be the dream, though, to be able to literally "SHOOT" your actors like a play and figure out the camerawork later. One less reason to leave our computers and go out into the real world.
True, but there isn’t a single convincing animation out there that perfectly mimics an actor. That also kind of defeats the purpose of hiring actors entirely.
Still, cool tech.
You said it was a microdose...
Ok this is wicked. How?
Data moshing is one of the major ones. /r/datamoshing
That's ONE technique of many. Also see EBsynth (or something similar), 360 3d-camera-tracking, 2d composites into 3d space, rotoscoping/rotobrushing...I am sure there are a bunch more. Very cool shit. Edit; and volumetric video...holy shit.
Yeah man there’s sooo much work that goes into this, wild. Incredibly vfx heavy, not for the faint of heart haha
Just fucking around with some holograms and crazy things I wanted to try for a week. This is what I ended up with.
The "Holograms" I am referring to are 4-Dimensional Volumetric Videos. I used to work as a Director for a studio that did photogrammetry and volumetric capture commercially for games and apps. We did a bunch of these demos to test out the tech before they eventually went under after I left the company (honestly the tech still isn't quite there yet, probably still a few years out from being a really viable). Anyway I got access to some of the clips to make some fun demo content and this is where I went with it. This technology is going to be a huge component in the future of filmmaking down the road, in my opinion. Instead of capturing straight video it creates a 3D model of whatever you are filming that you can then manipulate from any angle. It's kind of like the LiDar scanning feature on the new Iphones, only the models are moving and in motion. Sort of like combining motion capture with LiDar into one neat solution. The Texture of the Model is a carefully reconstructed video from all angles, so when it works you get a really lifelike capture. I kept the resolution on the video at 1080 and did some post smoothing so it would look slick. For a full 4K or even 2K Cinema-style production I don't think the tech is quite there yet (unless you pull some tricks, more on that below). Your characters will fall into the uncanny valley and lack emotional depth, although it could work for some action sequences where the camera is relatively far back. If you'd like some more examples of uses of the tech, check out my short film "**The Vanishing American Dream**" which won Most Creative VR Film at CineQuest 2021. [https://vimeo.com/508329823](https://vimeo.com/508329823) It was shot entirely using volumetric video and was conceived to work within the strengths and weaknesses of the tech. It's also available in stereoscopic 3D for VR headsets and 3DTVs, I put it up on Vimeo for $1 if you're interested to check it out: [https://vimeo.com/ondemand/vanishingamericandream](https://vimeo.com/ondemand/vanishingamericandream) \-Mike
Also, also - The hologram in the church at the alter is not Nicholas Cage...that is actually me... I will take that as a compliment though
Thank you for sharing. This is all fantastic.
I’m about to go into college for Film and I would love to learn how to use this in a production. Do you have any links or recommendations? This is really fun to see in action.
What? How!? This is insanely cool. There’s data moshing, there’s 360 photography and movement and who knows what else. Did you use google dream at all? What!? Awesome stuff.
Please give more information. No idea what you mean by “holograms” in this case. What’s going on here?
Full time video editor here; and I also have never heard the term “just using holograms” while editing lol.
It sounds sort of like the Kinnect camera, where you set a bunch of then up around a subject, and end up with a 3 Dimensional representation of the scene. The problem with this is sometimes you get holes and other weird oddities in the scene (which with machine learning will probably be fixed in the future), which is probably why he's saying it's not really ready for higher quality renders, but you can kind of fudge it a bit with various filtering techniques and construct some really cool scenes like he just did.
It's really really impressive from a compositing perspective. You have a lot going on. You keep momentum moving, the pacing and beats are perfect. Even the sound design. Absolutely love it. I hope you make more shorts like this.
plz do tutorial. plz do tutorial. this is the coolest thing I've seen on reddit in days.
The equipment needed would to make this type of thing would make a tutorial functional irrelevant haha. Volumetric video is out of 99.999% of our reach, for now. This is just magic until then. So fucking cool. Edit; my grammar shocks me sometimes. Leaving the mistakes in the remind myself that I am dumb-dumb.
i hear that it's out of reach, but i'd still love to see the process.
This is surreal, I wish I could make something like this- I'm inspired.
n a s t y y y dude.
I know they say that a magician never reveals his secrets, but you've gotta let us in on how you achieved this, it's absolutely brilliant.
I don't know what's going on anymore.
This reminds me a lot of Xavier Renegade Angel
Amazing! Listening to Failure - The Nurse Who Loved Me when scrolled onto this. Fits so well as a music vid over some psychedelic 90s grunge!
So damn cool! Great work
Ok, what drugs were you on and do you have anymore? 😀 Nice work. 👍🏼
Looks amazing, this type of visual effects have a lot of usage. Keep the good work my dude!
Ngl I’m working on an alternative film and I’ve been really struggling with a way to transition between locations, the data merging seems like it would be an amazing way to do that! Just wondering how long this process took and if you have any tutorials or such you followed?
Looks like the end of “when you die” from MGMT
This guy takes acid
I want more
Whoa. Also that would be cool to just capture a scene once and then place cameras in the room in post. It would make the production days go way faster if shooting in a controlled set where everything could be captured by these cameras.
Yup that is the direction where things are going, but we are still a long way off. The Texture detail needed for that to happen is going to need to increase significantly. There's also some reasons why this tech just might stay niche though: it could just be easier to do a single ultra high quality photogrammetry scan of a person in a t-pose. All animations would be later added in like any other animated character. Capturing movement and turning it into perfect meshed 3D model still has a lot of hurdles that make other options more viable for a production ready environment. Things like Virtual Production makes it easier now to bring real actors into 3G scenes using game engine technology. I don't think any one of these solutions will be solely "the future" but more a combination of all of them working together. That would be the dream, though, to be able to literally "SHOOT" your actors like a play and figure out the camerawork later. One less reason to leave our computers and go out into the real world.
True, but there isn’t a single convincing animation out there that perfectly mimics an actor. That also kind of defeats the purpose of hiring actors entirely. Still, cool tech.
Epilepsy warning plz
Actually upsetting to get a downvote for this
Snowflake
Please excuse my sub-par brainwave consistency
Cool but also 🤢🤢
Ernie Kovacs/Nam June Pak....redux
This is very cool, I love this. Trippy minded.
Sick
yooo can i have links?
What software did you use?
The creepy cult prayer thing would turn this into a bad trip.
saving this, for my next weed session
Who the fuck put drugs in my sandwich
Data moshing will never not be hypnotically beautiful to me.
u/savevideo
###[View link](https://redditsave.com/r/Filmmakers/comments/pbvpi4/testing_out_some_really_cool_new_things/) --- [**Info**](https://np.reddit.com/user/SaveVideo/comments/jv323v/info/) | [**Feedback**](https://np.reddit.com/message/compose/?to=Kryptonh&subject=Feedback for savevideo) | [**Donate**](https://ko-fi.com/getvideo) | [**DMCA**](https://np.reddit.com/message/compose/?to=Kryptonh&subject=Content removal request for savevideo&message=https://np.reddit.com//r/Filmmakers/comments/pbvpi4/testing_out_some_really_cool_new_things/) | [^(reddit video downloader)](https://redditsave.com)
don't do a tutorial.
Very dope
Jason Galea?
that's really well done nice
Yo this is cooool💯💯
I love this 😍
Hello LSD my old friend.
What the fuuuuuccck
Neat
r/woahdude
Awesome visuals. I would love to watch it wit better sound design.
Wow really cool.
I assume data moshing is the safe reproduction of the effects of LSD, and no one can convince me otherwise.
When the DMT hits
Lets keep it simple, Groovy man, groovy!
How does one make stuff like this?
Seems like a trip (thou i've never been on one). I love it!
Dope as hell
This is awesome
Maybe I am a crackhead...
Modern Avant Garde lol. Sick.
wild, you ever see Tipper?
DMT is a hell of a drug
ya thats what I saw in dream last night (joke-aside, what a holy moly vfx mindf**k this is)
Literally everything except that dolphin and the laugh
2008 called, they want their cool music videos back
u/savevideo
That's is really stunning
That's cool looking
That maniacal laugh, where is it from again? Gorillaz?
This is beautiful
Looks kinda like deep dream tech
This is amazing 🤩 I was looking for visuals like this for the type of psychedelic musical adventures I’m preparing, we should collab 💯🤷🏻♂️🙏🏼
Dm me lets do it
I think I’m trippin on LSD