Add first/last frame and multi-image keyframe conditioning#67
Open
tonywestonuk wants to merge 1 commit into
Open
Add first/last frame and multi-image keyframe conditioning#67tonywestonuk wants to merge 1 commit into
tonywestonuk wants to merge 1 commit into
Conversation
Generalize image-to-video conditioning from a single source image to an arbitrary set of keyframes, each pinned to a point on the timeline. - "Use image as: First frame / Last frame" toggle for the primary source image (maps to a latent frame index). - New "Additional Keyframes" UI: add any number of extra images, each with a Position (0% = first … 100% = last) and Strength. - GenerationParameters gains a Keyframe list and imageFramePosition, with backward-compatible decoding for older saved presets/profiles. - The generation bridge routes all image conditioning through the library's repeatable --keyframe PATH|FRAME_IDX|STRENGTH flag, mapping each timeline position to a latent frame index (8x temporal compression). Batch generation now preserves keyframes/position. NOTE: this depends on the matching mlx-video-with-audio change that adds multi-image keyframe support (the --keyframe flag). It must be released/installed before image-to-video will work with this build: james-see/mlx-video-with-audio#2 Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Generalize image-to-video conditioning from a single source image to an arbitrary set of keyframes, each pinned to a point on the timeline.
GenerationParametersgains aKeyframelist +imageFramePosition, with backward-compatible decoding for older saved presets/profiles.--keyframe PATH|FRAME_IDX|STRENGTHflag, mapping each timeline position to a latent frame index (8× temporal compression). Batch generation preserves keyframes/position.mlx-video-with-audiochange that adds the--keyframeflag — it must be released/installed before image-to-video works with this build: james-see/mlx-video-with-audio#2