Add an opt-in filter to generate animated image sub-sizes - #80385
Add an opt-in filter to generate animated image sub-sizes#80385adamsilverstein wants to merge 23 commits into
Conversation
Match WordPress core's server-side behavior, where both GD and Imagick flatten animated images when resizing and wp_calculate_image_srcset() keeps flattened sub-sizes and the animated full-size image from mixing. Loading all frames ([n=-1]) re-encoded a full animated GIF per uncropped sub-size, which took 16-47 seconds per size for a 769-frame GIF and produced sub-sizes larger than the original file (5.5MB medium from a 2.2MB source). Cropped sizes already flattened to the first frame, so behavior was inconsistent, and Media Library uploads taking the server path already produced static sub-sizes. See #80266.
… output mediabunny's default 2-second key frame cadence roughly doubles the output size for long GIF conversions (2.2MB vs 1.14MB for a 769-frame GIF) with no encode-time benefit. These looping, autoplaying GIF replacements don't need fine seek granularity. See #80266.
…size-performance # Conflicts: # packages/vips/CHANGELOG.md # packages/vips/src/index.ts # test/e2e/specs/editor/various/gif-to-video.spec.js
Add the wp_generate_animated_image_subsizes filter (boolean, default false). When a site opts in, uncropped sub-sizes of animated GIFs keep their animation instead of flattening to the first frame, resolving the long-standing request in https://core.trac.wordpress.org/ticket/28474 without depending on server-side Imagick availability. The flag travels the same path as image_strip_meta: REST API root index field -> block editor setting -> upload-media store -> vips worker, where it restores the pre-#80268 [n=-1] load path for uncropped resizes. When writing an animated GIF, gifsave is tuned (effort 2, interframe_maxerror 8, interpalette_maxerror 16), measured 4-8x faster than the defaults and avoiding sub-sizes larger than the original. See #80383.
|
Size Change: +311 B (0%) Total Size: 7.78 MB 📦 View Changed
|
|
Core backport of the server-side changes: WordPress/wordpress-develop#12572 (draft; Trac ticket to follow). |
|
The following accounts have interacted with this PR and/or linked issues. I will continue to update these lists as activity occurs. You can also manually ask me to refresh this list by adding the If you're merging code through a pull request on GitHub, copy and paste the following into the bottom of the merge commit message. To understand the WordPress project's expectations around crediting contributors, please review the Contributor Attribution page in the Core Handbook. |
For me, these sorts of questions mean that I think we should park this feature for 7.1 and give it more time to explore for 7.2+. Speaking for myself, I'm a little spread thin across 7.1 features that I'm trying to support, and I'd be keen for us to carefully contain scope here if we can. It also seems that in order for GIF sub-size processing to feel stable, we'll need more UI state in order to balance out the longer processing time (#80329). Taken together, this feels like a good well-scoped feature for 7.2 ("WP now preserves animated GIFs at all image sub-sizes"), whereas in the context of client-side media processing, this seems more the nice-to-have territory than must have. What do you all think? I'll just ping @annezazu for visibility on this one, too, as I want to make sure I'm helping out with the high priority features in the release. (If this is high priority, happy to help review of course). |
swissspidy
left a comment
There was a problem hiding this comment.
I'll defer the final call to someone else, but code-wise this LGTM. It's a low-risk opt-in filter for devs who really would like to have animated thumbnails and are aware of the trade-offs.
| * take the server-side path (e.g. some Media Library uploads) also still | ||
| * produce static sub-sizes, as core has no animated resize support. | ||
| * | ||
| * @since 23.7.0 |
There was a problem hiding this comment.
| * @since 23.7.0 | |
| * @since 23.9.0 |
Nit: I intend to backport this PR not only to 7.1 but also to Gutenberg 23.6.
Update: If we merge this PR now, it will be released as part of GB 23.9.
|
Hey folks! Thanks for tagging me in this. I read through the issue and, zooming out across the release, I'd like this to be punted to 7.2. This is a conservative decision and it comes from not looking solely at just this isolated change but looking at the weight of all of the features across the release when combined against the collective capacity of our current active contributors. Put another way, we already have a lot of features that we will need to be ready to do bug fixes for during beta and I'm hesitant to continue adding to it. Looking at this in isolation, I can see how it's lower risk since it's a dev focused change but it's not zero risk and everything we add takes up review time.
Relatedly, client side media wasn't noted as an area to be "blessed" and I want to honor that original commitment when it was discussed previously. Otherwise, it becomes easy to start "moving the goal posts" late in the game and I don't believe in doing that, unless project leadership overrides something. |
That makes sense, thanks for deciding! We will wait until 7.2 to land this one. |
…ubsizes-optin # Conflicts: # packages/upload-media/CHANGELOG.md
…ess/gutenberg into add/80383-animated-subsizes-optin
|
As the 7.1 release cycle is nearing its end, I believe we can move this PR forward again, but it requires at least the following changes.
|
good point @t-hamano - will update. |
The 7.1 release cycle is closing, so the backport changelog entry moves to 7.2 and the preload field is added from a new 7.2 compat file instead of being edited into the 7.1 one. The 7.2 filter splices the field into whatever field list is already preloaded rather than restating it, so a field added to the 7.1 list later is not silently dropped.
|
I pointed Claude at both items, here is what changed: Both moves are in 3054d13, along with a trunk merge.
One small departure worth flagging: rather than restating the whole field list the way the 7.1 file does, the 7.2 filter runs at priority 11 and splices Does that placement look right to you @t-hamano? |
Trunk now renders a real default block in place of the default appender (#81231), so the button that guarded the animated sub-sizes test no longer exists. Use the same document-role locator the sibling tests in this file already use.
|
Claude ran the suites locally, results below: Verified against wp-env with the plugin built:
The e2e run needed one fix, pushed in 64cb3fb. Merging trunk pulled in #81231, which renders a real default block in place of the default appender, so the |
The preserveAnimation path loads every frame with [n=-1], so memory scales with the frame count, not the single-frame dimensions. A long animation of modest dimensions could therefore exhaust the fixed 1 GiB wasm-vips heap and abort the upload. Check the frame count while decoding is still lazy and fall back to a first-frame sub-size when the animation does not fit.
The tuned settings were keyed off preserveAnimation being requested, so a static GIF uploaded to an opted-in site was encoded at effort 2 instead of libvips' default 7. Inter-frame and inter-palette error tolerances mean nothing for a single frame, so that traded compression for no benefit. Key the tuning off the decoded frame count instead.
The filter's @SInCE named a version that has already shipped; trunk is at 23.8.0-rc.1, so the next release to carry it is 23.9.0. The 7.2 preload filter reproduces entities.js field ordering relative to 'description'. Without that anchor it was appending to the end, which produces a list that can never match and silently disables preloading. Leave the path alone instead. Assert only that the medium sub-size stays animated: cgifsave runs with inter-frame error tolerances, so pinning its exact frame count to the source would turn an encoder change into a failing test.
|
Flaky tests detected in f059b22. 🔍 Workflow run URL: https://github.com/WordPress/gutenberg/actions/runs/32655191817 does not disable collaboration when all meta boxes are RTC-compatible in
|
What?
Adds a developer opt-in filter,
wp_generate_animated_image_subsizes, that re-enables animated (multi-frame) sub-size generation for animated GIFs in the client-side media processing pipeline:Fixes #80383.
Also fixes the 12-year-old core request Trac #28474 - "WordPress destroys animation in animated GIF when it resizes", as proposed in comment:58.
Core backport: Trac #65656 / WordPress/wordpress-develop#12572.
Note
Stacked on #80268, which makes static first-frame sub-sizes the default. This PR adds the opt-in path back on top of it. Only the last commit is new; review the diff from
fix/animated-gif-subsize-performance.Why?
#80268 switched sub-sizes of animated GIFs to static first-frame images, matching what WordPress core has always done server-side, because full animated re-encodes were extremely expensive (~88 s combined for a 769-frame GIF, with sub-sizes larger than the original - see #80266).
But there is long-standing, sustained demand for resized GIFs that keep their animation: Trac #28474 has been open since 2014 and stalled server-side because GD cannot do it and Imagick is only available on a subset of hosts. Client-side processing sidesteps both constraints - the cost is paid once in the uploading user's browser, and wasm-vips is available regardless of host configuration. That makes animated sub-sizes reasonable as an explicit developer opt-in while keeping the fast, core-consistent static behavior as the default.
How?
The flag follows the exact same path as
image_strip_meta/image_max_bit_depth(#80218):lib/media/load.php):wp_generate_animated_image_subsizes(boolean, defaultfalse) is applied ingutenberg_media_processing_filter_rest_index()and exposed asanimated_image_subsizeson the REST API root index. The field is also added to the preload/entities field lists (lib/compat/wordpress-7.1/preload.php,packages/core-data/src/entities.js), which must match exactly.generateAnimatedImageSubsizessetting inuse-block-editor-settings.jsand forwarded byuse-media-upload-settings.js.resizeCropItemreads the setting from the@wordpress/upload-mediastore and passes it to the vips worker as a newpreserveAnimationoption onresizeImage()(options object from Client Side Media: Consolidate optional positional params into options objects in vips / upload-media #80328).preserveAnimationis set and the resize is uncropped,resizeImage()restores the pre-Client-side media: generate animated image sub-sizes from the first frame only, matching core #80268[n=-1]load path so all frames are decoded and re-encoded. Cropped sizes (e.g.thumbnail) always flatten to the first frame, matching the pre-existing behavior - per-frame smart-cropping is out of scope.Tuned
gifsavesettingsThe profiling in #80266 showed ~85% of the animated resize cost is GIF re-encoding (per-frame palette quantization), and that default
gifsavesettings cause the output-larger-than-input bloat. When writing an animated GIF, this PR applies the settings benchmarked there:effort: 2,interframe_maxerror: 8,interpalette_maxerror: 16- measured 4-8x faster and eliminates the size bloat.That turns the opt-in cost from ~88 s into roughly 10-20 s for a very large GIF - still too slow to be the default, but a reasonable trade for a site that has explicitly chosen animated sub-sizes.
Notes
wp_calculate_image_srcset()still never mixes the full-size GIF and its sub-sizes in onesrcset. With animated sub-sizes that guard becomes overly conservative but harmless; relaxing it is a server-side follow-up.Testing Instructions
add_filter( 'wp_generate_animated_image_subsizes', '__return_true' );medium/largesub-sizes (e.g. via/wp-json/wp/v2/media/<id>): they should be animated GIFs (multiple frames), whilethumbnail(cropped) remains a static first frame.Documentation
The client-side media docs (#75895) are updated alongside: the how-to guide gains an "Animated image sub-sizes" section for the new filter, and the architecture reference adds it to the filter table and REST index field list (plus corrects the now-stale note that sub-sizes preserve all frames).
Automated tests
packages/vips/src/test/resize-image.ts: newpreserveAnimationsuite -[n=-1]+ tuned gifsave for uncropped animated resizes, first-frame flattening for crops, no effect on still formats.phpunit/media/media-processing-test.php: REST index exposesgenerate_animated_image_subsizes(defaultfalse, honors the filter, hidden withoutupload_files).test/e2e/specs/editor/various/gif-to-video.spec.js: new test uploads an animated GIF with the filter enabled (via a new e2e test plugin) and asserts themediumsub-size keeps all frames.