upvote

points

by spacebanana78 hours ago |
comments
upvoteby Demiurge7 hours ago|
next
[-]
That sounds like an interesting challenge. Have you seriously considered solving it? Because in about 10 seconds I came up with a process that should work, provided enough compute power. Simply model the traditional film making process by starting with a script, character stories. Design your world, then design the storyboard, and all the scenes. Create a list of all the visual elements that need to be replicated between all the scenes. Then you have to built prompts and reference art of the objects, faces, people. Make sure to do multiple takes of each scene, and have the vLLM critique and analyze the performances and technicalities. Should work?

I think, also, like in the traditional film makers career, this process should be built iteratively, start with a fast food commercial, then do a music video, then you can probably do a short film. Continue to improve the process, and one day I’m sure the LLM film studio can make you any movie you want, provided you have enough tokens.

reply
upvoteby aabdi13 minutes ago|
parent|
next
[-]
the problem is you have to make the AI watch the whole thing to make sure it works.

I've done this sort of with comfyui/same agent factory stuff, but the verification loop only works for models like fable as planner/writer, with gemini as verifier for like a very short movie. Sub 3-5 mins. After that you burn through million tokens.

Can't go too low fidelity audio/video or it craps out. Too long video and it loses consistency. Look at only snippets, it lacks global consistency, etc.

reply
upvoteby andybak7 hours ago|
parent|
prev|
next
[-]
I'm getting a Poe's Law feeling. I'm genuinely unsure about whether this post is a stone cold parody or not. I think I need to turn off the internet and go to bed.

EDIT: Your username doesn't help, either.

reply
upvoteby 4 hours ago|
parent|
[-]
deleted
reply
upvoteby bsenftner6 hours ago|
parent|
prev|
next
[-]
Nobody wants to watch such films, they want to muck with the filmmaker, the generation apparatus. That's the product, if there is one here, and absolutely not the 3 hour epic that's spit out with 4 variations to choose between. That's work. We'll have other LLMs pointlessly tell us which should be watched, we'll view a summary, and vote the Oscar on that.
reply
upvoteby aforwardslash7 hours ago|
parent|
prev|
[-]
On that topic, check higgsfield cinema studio 4; they already provide amazing tech for the cinematic experience, somewhat similar to what you are describing.
reply
upvoteby bsenftner6 hours ago|
prev|
next
[-]
The results are boring. Not because the content is boring, but because you can so easily remix the results. Human curation is what creates value with these, not dumping and consuming. A personal perspective of a human being ups the respect, where the exact same sentences generated by an LLM carry no such value.
reply
upvoteby Zigurd6 hours ago|
prev|
next
[-]
I think this is the best and most realistic reply so far: the ability to do this is close enough, and things like AI music are hints that there is a business model for this. Maybe I'm just jaded about CGI effects in movies currently, but I think the fact that people except that kind of thing as entertainment means you might get away with a fully AI movie that people will pay for.

There are two more points in favor of this kind of AI movie project: there's zero chance that anyone would greenlight a Hollywood budget for the Silmarillion, and it is beyond human capability to write that screenplay.

reply
upvoteby RobotCaleb7 hours ago|
prev|
next
[-]
How would a computer generated video be live action?
reply
upvoteby clipsy4 hours ago|
prev|
[-]
Since live action results are acceptable, this is already possible with current day LLMs. Just instruct one to hire a writer, director, cast, and crew to make the movie.

Plus, the token costs involved should be pretty low! (Other costs may not be.)

reply