- AI-Enhanced Creator
- Posts
- 🎬 And Action: how Jeff’s CineMachine reimagines AI storytelling
🎬 And Action: how Jeff’s CineMachine reimagines AI storytelling
From first draft to final scene and everything in between 🌞
Don’t Forget: AI for Architects — Starts September 22nd!
Hey Friend 👋
Adam here — writing to you today not from a rooftop, but from behind my desk covered in notebooks, screenplays, half-sketched character arcs, and marketing magic for Lighthouse AI Academy.
If you’re a writer, storyteller, or creative thinker of any kind, this one’s for YOU.
Today, we’re pressing play on something I believe will change how we write stories forever: a modular AI-powered storytelling pipeline built by Jeff Hipolito, one of the most quietly brilliant builder-writers I’ve met.
His suite of tools covers every stage of the process: Character Builder, Story weaving, Scene and Shot Designing — and soon — auto-first-frame generation. Automated video rendering comes later… Once those first frames are locked in.
Here’s how it works in practice: you start with a logline and world notes. The system asks for genre, sub-genre, and runtime, then suggests archetypes that fit your story. From there, you can enter physical descriptions, goals, backstory, and relationships, or let the AI propose them for you.
The more detail you feed it, the more nuanced your cast becomes.
The outcome is characters that aren’t just placeholders, but rich, story-ready personas who grow with your narrative. Scene by scene. Arc by arc.
With that, it’s time for me to walk you through how it works and how you can start experimenting with similar ideas right now.
Resources for Storytellers 🎞️
Watch Jeff’s Webinar replay on our YouTube channel for a full demo + a behind-the-scenes of his workflow.
📽️ The CineMachine Pipeline: From Chaos to Camera
“Even with all the AI tools available these days, it’s still daunting to create a narrative film, having to jump from one tool to another. I built CineMachine to make the process from story development to production smoother and more accessible.”
Jeff’s CineMachine solves the most common problem for AI storytellers: long, messy, unstructured documents that collapse under their own weight.

CineMachine — Under the Hood
He’s spent months designing a modular system that handles characters, arcs, relationships, and context limits with precision.
Let’s walk through the future workflow he’s designing, and what can be done with current tools to start thinking like a system builder.

CineMachine: Basic App Walkthrough
Step 1 — Build a Character Roster
Start with a simple cast list that the AI can structure and expand.
Roster basics: name, role, desire, core world (table or markdown)
Keep structure tight so the LLM stays focused
Use in-app chat as your muse or mentor to turn rough notes into structured character blocks

Chat module prompt → structured reply
Step 2 — Map Relationships
Define how characters connect and conflict — it’s the backbone of story tension.
Add a Relationship column (mentor, rival, sibling, etc.)
Generate a relationship graph to visualize dynamics
Note shared history and current friction (keep to one line each)

Character Relationship Graph
Step 3 — Assign Arcs & Motivations
Every character needs direction — what they want, what’s in the way, and how they change.
Draft Goal → Obstacle → Change in 3 parts
Use prompt seeds: “Outline a 3-act arc for a character who wants freedom but fears responsibility.”
CineMachine’s Story Builder with 3-Act 45% completed; Hero’s Journey is on the roadmap
Step 4 — Compress for Context
The context window always runs out — CineMachine manages it intelligently.
Summarize characters + arcs into shorter blocks
Keep separate docs for acts or subplots
Trim backstory until it’s relevant to the scene at hand
Step 5 — Export for Scene & Shot Generation
Turn the Story data into a format that the Scene Builder can use to generate the camera-ready prompts.
Build a table of character + scene notes
Prompt the LLM to generate the first frames
This was the old way: Drop into ComfyUI, Midjourney, or Runway for visual prototyping
The new way still to be integrated - once first frames are locked in, side by side with the prompts reformulated for video generation, the automation kicks in.
Depending on the video model used, initial tests done with LTX video model generated 60+ shots overnight on a single RTX 4090 card.

Gradio polished stack → scene update
🕵️ Case Study: Skinwalker
Jeff is actively battle-testing CineMachine on Skinwalker: an 8-episode sci-fi detective mini-series.

Skinwalker: An 8-Episode Epic

Skinwalker Blurb
Each step of CineMachine feeds into his workflow: from character rosters and arcs, to JSON scene breakdowns, to prototype shots for each episode.

Series Overview

Core Themes

Cinematic Influences
It’s “building the plane while flying it,” as Jeff puts it, and proof that AI isn’t merely a tool, but a partner in long-form storytelling.

Workflow/Process
Why It Matters 💡

Why CineMachine Matters
Most AI storytelling still collapses after a few thousand tokens.
CineMachine is designed to fight that collapse by managing context and structure — so the AI writes with you, not over you.
This modular approach means:
Writers can track character arcs without losing them
Stories keep structural integrity beyond short form
Visual prototypes can feed directly into production
It’s a glimpse at the next era: AI as a structured co-writer, not just a clever autocomplete.

Jeff’s Vision for CineMachine
🧠 Homework: Build Your Character Engine
Try this with your current tools:
Make a roster of 5 characters
Add arcs, relationships, and key turning points
Compress into a 2,000-token summary
Prompt: “Write a 2-scene dialogue between [Character A] and [Character B] during their falling out.”
Bonus: create 3 camera angles for the same scene
🌀 Ready to Go Deeper? Here’s What’s Coming Next
We’re working closely with builders like Jeff to explore what creative tools of the future will really look like.
In the meantime, if you’re ready to sharpen your storytelling workflows, our current programs are filling fast:
👷♂️ AI for Architects: Book Your Spot Now 👷♀️
If you’re an architect, designer, or creative technologist looking to lead in the AI era, this is the course for you.
Led by former student-turned-mentor June Chow, AI for Architects teaches you to:
Build a complete AI-powered design pipeline from concept to visualization
Master workflows like Kontext Pro sketch-to-render, ComfyUI, advanced pipelines, and custom LoRA training
Join a global network of forward-thinking architects
Create a portfolio-ready architectural project
September 22 – December 12, 2025
Format: Live masterclasses, Q&A, self-paced modules, community support
For: Practicing architects, architectural visualization specialists, urban planners, architecture students, design firm partners, computational design specialists, innovators and creative technologists, agency founders and studio owners, senior creatives and marketing leaders.
📣 Further Upcoming Courses at Lighthouse Academy
Advanced ComfyUI (Cohort 2) — Starts Aug 28
👉 Apply to join now
AI for Creative Leaders (Cohort 3) — Starts September 9
👉 Apply to join now
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
That’s it for now: Thanks for reading and building this new era with us.
If you're a maestro of stories, scenes, or characters, this is your moment, and we’re ready to enjoy it with you… Just follow the light.
Step by step, node by node — and away we go!
Keep creating and always remember to have fun.
— Adam & the Lighthouse AI Academy Team ☀️

Small Team, Big Dreams