Z-Image-Turbo on Jetson

Run Z-Image-Turbo (6B) locally on Jetson Orin NX — text-to-image and img2img via HTTP API, fully offline.

SenseCraftIntermediate15minOn-Device LMSource Code

Reusable Site Templates

Places where images must not leave the device and there is no reliable internet, but waiting a minute or two per image is acceptable.

  • Privacy-sensitive image workflows — generate or edit images inside healthcare, legal or enterprise networks; images and prompts stay on the device.
  • Offline interactive installations — photo booths and gallery pieces that draw what a visitor describes, with no cloud service.
  • On-device image generation in your app — a web app, desktop tool or automation calls the HTTP API and gets a PNG back.

Not a fit: real-time generation or many users generating at once. Each image takes 1-2 minutes, and one request runs at a time.

How it works

Z-Image-Turbo device composition: a reComputer J40 / J50 Series host returns generated images to apps over HTTP

One Jetson host is all it takes. The model and generation service sit in one Docker container and open an HTTP API on the LAN; your app sends a prompt or reference image and gets a PNG back.

Local Host

A 6-billion-parameter image model means the host needs a large-memory module.

HostModuleNotes
reComputer J40 Series (J4012)Orin NX 16GBThe published generation times are for this module
reComputer J50 SeriesAGX Orin 64GBSame deployment flow

The host needs JetPack 6, the NVIDIA container runtime and SSH access.

The first deploy downloads the model weights and the inference engine for the chosen resolution, so check disk space first.

  • Weights are about 20GB, and each resolution's inference engine adds about 12GB.
  • Downloads resume: redeploy after an interruption and only missing files are fetched; if Hugging Face is blocked it falls back to a mirror.
  • One resolution: 512px or 384px, chosen at deployment.

How well it works

Scope: whole-image generation time from sending the prompt to receiving the PNG, 4 sampling steps, one request.

What the site getsTypicalDevice
512px text-to-imageabout 100 sreComputer J40 Series (J4012, Orin NX 16GB)
384px text-to-imageabout 73 sSame
Requests handled at once1, the rest queueSame

Image-to-image takes a reference image plus a prompt; time grows with steps and edit strength, landing at 1-2 minutes per image. Set the HTTP client timeout to 180 s.

What you get out of it

Once deployed, these are the interfaces.

InterfaceWhat comes outNotes
HTTP 8000 health checkWhether the service is readyReturns success when ready
HTTP 8000 JSON generationText-to-image or image-to-image; returns mode, resolution, elapsed time and image URLFor programmatic calls
HTTP 8000 form generationSame, with the reference image as a file uploadFor sending a local image directly
HTTP 8000 image filesThe generated PNGAlso saved to the output directory on the device

The API is served on the LAN and runs one request at a time; a short client timeout disconnects before the image is done.

How to deploy

Check the setup and its product list, then follow the deployment guide.

Deployment Options

Deploy Image Generation Service

Deploy Z-Image-Turbo HTTP API to Jetson Orin NX via SSH

2 steps · ~15min

Jetson Device
recomputer_j40
recomputer_j50

FAQ

The minimum is a reComputer J40 Series model with the Orin NX 16GB module, such as J4012; the reComputer J50 Series (AGX Orin 64GB) also works. The host needs JetPack 6 and disk for about 20GB of weights plus about 12GB of inference engine per resolution.

Didn't find your answer?
Contact Us
We Are Glad to Be Your Hardware Partner !
Next