AI Video Generation: HTML-to-MP4 Pipeline

Hermes writes HTML video compositions with Open Design and renders them to finished MP4 files through HyperFrames, using Chrome headless plus FFmpeg instead of a timeline editor.

Hermes OpenClaw Copied: 0
1 resource

Requirements

  • Node.js is needed for the HyperFrames CLI (npx hyperframes).
  • FFmpeg must be in PATH or at /tmp/ffmpeg/.
  • Chrome or Chromium is required for headless rendering.
  • Open Design is needed, either as a cloned repository or as a Hermes skill.
  • Python 3.10 or newer is optional and is only needed when using a cloned voice through Coqui TTS.
  • Allow about 2 GB of disk space for HyperFrames, FFmpeg, and output files.

How to use

HyperFrames renders HTML compositions to MP4 with GSAP timelines, Chrome headless, and FFmpeg through npx hyperframes render.

Video elements must be muted; place audio in separate <audio> elements.

Follow the HyperFrames composition rules before rendering with npx hyperframes render:

Install HyperFrames and Open Design using either of the source-provided routes.

# HyperFrames — scaffold a project
npx hyperframes init my-video
cd my-video

# Open Design — available via Hermes skill or direct clone
git clone https://github.com/nexu-io/open-design.git

Add narration and music to the composition.

# TTS narration via HyperFrames (Kokoro, local, no API key)
npx hyperframes tts --text "Your script here" --voice af_heart --output narration.wav

# Or use Coqui TTS with cloned voice if preferred
# Background music via HeartMuLa skill

Lint the composition and preview it in a browser.

npx hyperframes lint
npx hyperframes preview   # opens in browser for quick check

Render the finished composition to MP4.

# Standard render (1920×1080, 30fps)
npx hyperframes render

# Or specific output
npx hyperframes render --fps 30 --output final.mp4

After the pipeline works, optionally automate it with a cron schedule.

Use the supplied scheduled command to generate a daily MP4 from the configured topic.

# Hermes cron job: daily AI news video
schedule: "0 8 * * *"
prompt: |
  Research top AI news from last 24 hours.
  Write a 60-second script.
  Generate HTML composition with Open Design.
  Render MP4 via HyperFrames.
  Save to ~/videos/today.mp4.

HyperFrames linting rejects overlapping clips on one track, a missing class="clip", or a root without dimensions; iterate through generation, linting, and fixes.

Wrap video elements in divs because animating <video> width or height directly breaks frame rendering.

Render time grows with duration: the source estimates three to five minutes on CPU for 60 seconds at 30 fps, while 15 fps draft mode takes about one minute.

Kokoro voices suit product demos, while the source describes cloned Coqui voices as more expressive for storytelling.

Links

Source: aliaihub/awesome-hermes-usecases and its contributors. License: CC-BY-4.0. Source license notice.

Translation and editorial adaptation by ClawCases.

>Resources

>Related Use Cases