Video

Usine includes a complete real-time video processing pipeline. Load video files or camera streams, apply color corrections, blur and convolution effects, geometric transforms, mapping and projection, draw shapes and text, mix and composite layers, and output via NDI or recording. See also Video Configuration and the Video tutorial.

Categories

Category Modules Description
Player & Capture 6 Video file playback, image loading, IP camera, NDI camera, and flow streaming
Generator 4 Solid color fill, gradient, checkerboard, and color bar pattern generation
Color 28 Color correction, hue shift, temperature, levels, LUT, gradient map, grayscale, posterize, solarize, threshold, keying, noise, contour, and pixel inspection
Blur & Smoothing 8 Blur, mosaic, spray, shuffle pixels, soft border, height map, smoother, and feedback effects
Geometric 19 Resize, flip, mirror, downsample/oversample, fish eye, swirl, ripple, bulge, polar, kaleidoscope, bands, tile, shuffle, aspect ratio, and pixel distribution
Mapping & Projection 15 Crop, scale, rotate, translate, shear, perspective, grid mapping, displacement map, path masking, and vignette
Mix & Compositing 10 Blend modes, crossfade, combine (ARGB operations), alpha mask, incrustation, dimmer, concat, split, selector, and auto fade-in
Stylize 4 Edge detection, emboss, sharpen, and ASCII art rendering
Draw 12 Draw lines, rectangles, ellipses, circles, pixels, text, and paths on video frames
Convolution & Filter 2 Custom convolution matrix and anti-aliasing
Detection 5 Motion detection, optical flow, color tracking, blob detection, and pose estimation (TensorFlow)
Recording & Output 2 Record video to file and send video+audio via NDI
Conversion & Utility 8 Video to/from color arrays, video to data arrays, video to 3D points, frame buffer, delay, strobe, and pass-through
OpenGL 1 GLSL shader player (ShaderToy, ISF, GLSL Sandbox compatible)
Pixel Mapping 2 Pixel density grid and direct LED pixel mapping

Player & Capture

Load video files, images, camera streams, and NDI sources.

Module Description
Video Player Play video files with transport controls
Video Player Flow Play IP video streams with advanced configuration
Video Player Image Load image files and output as video frames
Video Player Image Multi Load and concatenate multiple images for 3D pixel mapping
Video IP Camera Capture IP camera or Internet video streams
Video NDI Camera Capture NDI video sources on the network

Generator

Generate solid colors, gradients, patterns, and test signals.

Module Description
Video Generator Fill Color Generate a plain frame filled with a solid color
Video Generator Gradient Generate a gradient image (linear, radial, or conical)
Video Generator Checkerboard Generate a parametric checkerboard pattern for calibration and testing
Video Generator Bars Generate standard color bar patterns (SMPTE, EBU, or grayscale ramp)

Color

Adjust colors, convert to grayscale, apply artistic effects, keying, and inspect pixel values.

Module Description
Video Color RGB Adjust red, green, and blue intensity individually
Video Color Contrast Adjust contrast
Video Color Lightness Adjust lightness
Video Color Saturation Adjust color saturation
Video Color Hue Shift Rotate the hue in HSL color space
Video Color Temperature Adjust color temperature (white balance)
Video Color Levels Adjust input and output levels (shadows and highlights remapping)
Video Color LUT Apply a 1D Look-Up Table from a .cube file for color grading
Video Color Gradient Map Remap grayscale luminance to a two-color gradient
Video Color Gray Scale Convert to grayscale
Video Color Black and White Convert pixels to pure black or white by intensity
Video Color Posterize Reduce color depth (posterize)
Video Color Solarize Apply adjustable solarize effect
Video Color Split Light Apply lightning effect
Video Color Threshold Set pixels to black below a lightness threshold
Video Color Semi Opaque Display every Nth pixel, fill others with a background color
Video Color Random Noise Add random noise (colored or B&W)
Video Color Contour Draw edge contours
Video Color Dilate Dilate contours (expand bright areas)
Video Color Erode Erode contours (shrink bright areas)
Video Color Extract Extract a specific color from the video
Video Color Exclude Exclude a specific color from the video
Video Color Subtract Subtract a color from the video
Video Color Chroma Key Replace a specific color (green/blue screen) with a background video
Video Color Luma Key Make pixels transparent based on their luminance
Video Color Change Pixel Mode Change the pixel mode of the video
Video Color Get Average Color Calculate the average color of a frame
Video Color Get Pixel Color Get the color of specific pixels

Blur & Smoothing

Apply blur, mosaic, spray, and temporal smoothing effects.

Module Description
Video Blur Apply a blur effect
Video Blur Mosaic Apply a mosaic (pixelate) effect
Video Blur Spray Spray pixels randomly
Video Blur Shuffle Pixels Randomize pixel positions
Video Blur Height Map Apply a pixel height-map effect
Video Blur Soft Border Apply soft border fading
Video Blur Smoother Temporal smoothing with attack and release
Video Blur Feedback Temporal smoothing that creates feedback trails

Geometric

Resize, flip, mirror, and transform the video frame geometry.

Module Description
Video Geometric Resize Change video resolution
Video Geometric Change Aspect Ratio Change image aspect ratio
Video Geometric Downsample Reduce resolution by factor 2
Video Geometric Oversample Increase resolution by factor 2
Video Geometric Get Size Get video width and height
Video Geometric Flip Horizontal Flip horizontally
Video Geometric Flip Vertical Flip vertically
Video Geometric Mirror Horizontal Mirror horizontally
Video Geometric Mirror Vertical Mirror vertically
Video Geometric Fish Eye Apply fish-eye lens effect (or inverse)
Video Geometric Bands Split video into horizontal or vertical bands
Video Geometric Tile Duplicate video into a tiled pattern
Video Geometric Swirl Apply a spiral/twirl distortion around the center
Video Geometric Ripple Apply sinusoidal wave distortions (ripple/water effect)
Video Geometric Bulge Apply a bulge or pinch distortion around a center point
Video Geometric Polar Convert between Cartesian and polar coordinate systems
Video Geometric Kaleidoscope Create a kaleidoscope effect by mirroring a sector around a center point
Video Geometric Shuffle Cut into cells and randomize positions
Video Geometric Pixels Distribution Convert to black and white pixel density

Mapping & Projection

Crop, scale, rotate, translate, and project video with advanced mapping tools.

Module Description
Video Mapping Crop Crop a rectangular region
Video Mapping Crop Resize Crop and resize the output
Video Mapping Scale Scale (zoom) the video
Video Mapping Rotation Rotate by any angle
Video Mapping Rotation Simple Rotate by 90, 180, or 270 degrees
Video Mapping Translation Translate horizontally or vertically
Video Mapping Shearing Shear on X or Y axis
Video Mapping Perspective Change the perspective view
Video Mapping Grid Map video using control points on a grid
Video Mapping Grid Projection Grid mapping with projection algorithm
Video Mapping Multi Create a new frame from coordinate arrays
Video Mapping Path Create a positive mask following a path
Video Mapping Path Mask Create a negative mask following a path
Video Mapping Vignette Draw video into a rectangle region
Video Displacement Map Displace pixels according to a second video input

Mix & Compositing

Blend, crossfade, mask, and route multiple video layers.

Module Description
Video Mix Blend Modes Blend two videos using standard compositing modes (multiply, screen, overlay, etc.)
Video Mix Crossfade Crossfade between two video flows
Video Mix Combine Combine two videos with ARGB pixel operations
Video Mix Alpha Mask Apply a transparency mask
Video Mix Incrustation Overlay one video onto another
Video Mix Dimmer Adjust overall video intensity
Video Mix Concat Concatenate two videos horizontally or vertically
Video Mix Split Split video into N sub-videos
Video Mix Selector Select between multiple video inputs
Video Mix Auto FadeIn Automatically fade in on patch activation

Stylize

Apply artistic effects to the video.

Module Description
Video Stylize Edge Detect Detect edges using Sobel or Prewitt gradient operators
Video Stylize Emboss Apply an emboss (relief) effect creating a 3D-like appearance
Video Stylize Sharpen Sharpen the video using an unsharp mask filter
Video Stylize ASCII Art Render the video as ASCII characters using an embedded bitmap font

Draw

Draw shapes, lines, text, and pixels directly onto video frames.

Module Description
Video Draw Line Draw lines
Video Draw Line to Draw incremental lines from coordinate deltas
Video Draw Line to Path Draw a path from coordinate deltas
Video Draw Path Draw a path between points
Video Draw Fill Path Draw a filled path
Video Draw Rect Draw rectangles
Video Draw Fill rect Draw filled rectangles
Video Draw Ellipse Draw ellipses
Video Draw Fill Ellipse Draw filled ellipses
Video Draw Fill Circle Draw filled circles
Video Draw Pixel Draw individual pixels
Video Draw Text Draw text on video

Convolution & Filter

Apply custom convolution matrices and anti-aliasing.

Module Description
Video Convolution Apply a custom convolution matrix to each pixel
Video Anti Aliasing Suppress aliasing artifacts

Detection

Detect motion, track objects, and analyze video content.

Module Description
Video Detection Detect motion in video (for camera interaction)
Video Detection Optical Flow Detect motion vectors across a grid by comparing consecutive frames
Video Detection Color Tracker Track the centroid position of a specific color
Video Detection Blob Detect connected bright regions (blobs) and output positions and sizes
Video Detection Pose Estimation Detect human poses using TensorFlow Pose-Detection model

Recording & Output

Record video to file and stream to network via NDI.

Module Description
Video Recorder Record a video flow to file
Video NDI Send Send video and audio to the network via NDI

Conversion & Utility

Convert between video and other data formats, delay frames, and pass through.

Module Description
Video to Color Array Crop video and convert pixels to a color array
Color Array to Video Convert a color array to a video frame
Video to Data Array Crop video and convert pixels to a float array of luminances
Video to 3D Points Convert video to XYZ point cloud for 3D modules
Video Frame Buffer Circular buffer of N frames for freeze, scrub, and slow-motion effects
Video Delay Delay video by a number of frames
Video Strobe Alternate between live and frozen frames (strobe/stutter effect)
Video Thru Pass through video unchanged

OpenGL

Module Description
Video OpenGL Shader GLSL shader player (ShaderToy, ISF, GLSL Sandbox compatible)

Pixel Mapping

Map video to LED pixel grids.

Module Description
Video Pixel Density Transform video into a pixel density grid
Video Pixel Mapper Direct pixel mapping for LED pixel screens

See also

version 7.0.250121

Edit All Pages