I've been playing a little Warhammer 40K : Space Marine II, watching The Sarah Conner Chronicles, and dabbling some more in AI video. There's no ranking here; these are all whatever I happen to be doing when I'm feeling too brain-fogged to get creative work done.
The new novel is crawling along.
So, the entertainment yesterday was doing some re-posing the hard way.
I realized I'd fallen into the tall duck problem; people and other humanoids are tall and thin, the more efficient image format is wide and short. I'd done a lot of renders that were wrong-side up and that had several problems.
So get those characters to sit down or something. If I was paying tokens to a service I'd just do a "Claude, make the character sit down."
But no, I'm staving off boredom between cleaning chores and doom-scrolling by doing this offline. And the look of the characters and setting was specific, which is always a problem with AI. Take, for instance, "space armor." Seen all over visual SF. Try to prompt it with those words, you get medieval plate sneaking in. Tell it "no, more like the Mandalorian," you get a Boba Fett helmet. It will always cleave to the familiar, to the common meaning.
(A big pain for fashion or period clothing as much of this stuff is phrases formed from common words, like pillbox hat, pixie cut, or leg-of-mutton sleeve. Or is a technical term the AI doesn't recognize, like aguilette.)
So the "pipeline," such that it was, was first to take a previous video that had the character in it. Rip that with a simple frame extractor I put together from the parts box. Save an appropriate frame. Seed a new video render with that frame (image-to-video) and try to find a prompt (and a few camera control LORA or similar) that would change the pose or move the character. ("Character sits down. Camera orbits to their left.")
Do the pull-frame routine again and export that to a paint program for some basic clean-up (paint out the elephant that strolled into the render, and fix the Sam Brown that turned into a Klingon sash half-way through).
Run that through image-to-image for inpainting. Which, given the space armor thing above, requires multiple incompatible LORA; this one will fix the details of the NASA-punk background, but this one puts the stripes back on the zebra-man. Multiple rounds of inpainting and cycles through hand painting until it is back on model and upscaled sufficiently.
Now render new video -- and wrestle with the AI again that doesn't get why everyone is sitting down when all the fashion shows and talking head news programs and etc. it was trained on had everyone standing up. (Also an issue in the inpainting stages. Especially faces; the AI loses the ability to recognize faces if they tilt too far off the usual axis.)
The biggest issue in all this -- or possibly the bonus, if you are trying to while away some mental downtime -- is that when the AI drifts, it either goes into, or more likely suggests, an interesting alternative. Instead of one render, you end up with branching forks, multiple renders going in different directions. At all stages of the game; it truly is geometric.
The novel crawls along because I'm still working out how I want to tell it. SF really does rely on telling, because it is too inefficient to show everything. But an immersive narration introduces a problem; why is the character telling themselves what they already know? It's like a one-person version of "As you know, Bob."
When I was working with Penny, a big part of her thing is making connections. All sorts of crazy connections. So if I needed her to talk about Clovis Points, I could show her a fir tree or a straw hat and she'd get there. It took a bit more pushing to get her to recap what she'd been doing for the last couple of days, but really all it took was putting the right thing in her environment to jar the story out of her.
Cadet Sinclair is third-person and doing free indirect speech so there's already a blur between narrative voice and internal voice. But I'm still too wary both of "As you know, Bob" and the lure of the info-dump to want the narrative to go all out on explaining the world.
Anyhow. I'd been trying out different approaches for opening by looking at the giant negative space wedgie (an exotic star) that is both the sciencey-sounding handwave for a lot that is going on, and thematically an eldritch thing. And whether I really do want to explain that much about the thing now, or offload to later scenes.
But turns out there was a different issue. Thematically, Sinclair is part of a society that could be cordially described as "better than the alternatives." Her experience is being in a system, under orders (explicitly, now, as a young officer). Introducing her as a free agent who can stare at a vidwall and have lots of thoughts about the science and tech and social implications of the setting was... not right.
So I've got her entering in a group of crew, and all the rest are heading straight for the bar, and her only look at Oberon is cut short. And that works better.
Now I just have to deal with creating and introducing a bunch of crew while they are embarrassing themselves striding around going "look at us, we got posted to the frontier" and then get cut down by a more experienced merchant crew who has actually been.
Which means, yes, many many many chances not just for "...internal combustion engines had spark plugs, Keri knew, and telephones used to be used to make calls..." but way much "You should know, Bob..."




