Craft · Living page
AI in the edit bay: Premiere, Resolve, Avid, Final Cut
This page tracks the AI built into the four NLEs most editors cut on: Premiere Pro, DaVinci Resolve, Avid Media Composer, and Final Cut Pro. For each tool you'll find what it actually does in the timeline, where it stops, what you need to pay for it, and a link to the vendor's own documentation. It's a living reference, checked monthly against official sources, and nothing on it is ranked. The tools assist. The cut stays with the editor.
- Premiere Pro desktop 26.5 (What's new and Generative Extend overview updated 9 September 2026; generative credits FAQ updated 30 September 2026)
- DaVinci Resolve 21 and Resolve Studio, per Blackmagic's product and What's new pages (named tools from the 18.5, 20, and 21 announcements)
- Media Composer 2025.12 through 2026.8 (31 August 2026)
- Final Cut Pro for Mac 11.0 to 12.4 (12.4 released 29 September 2026; some tools still in the app date from 10.6 to 10.8)
How to use this page
Each NLE gets the same treatment: a short summary of what its AI is for and what it needs, feature notes, then links to the official release notes. The feature notes stick to tools you'd open in a working session (the timeline, Text panel, inspector, or mixer), and every note says where the tool stops, because that's usually the part that costs you time on a job.
This isn't a substitute for the manual. If anything here disagrees with the vendor's own page, trust the vendor. Generative video models that live outside these four apps aren't covered.
The page is rechecked monthly, and again in the week of any major NLE release. If the Last checked date above is more than about 90 days old, assume something has moved and check the vendor's page before you rely on a detail.
Adobe Premiere Pro
What's in, and what isn't
Premiere's built-in AI covers transcription, search, dialogue cleanup, object masks, and short generated fills on the timeline. The assistive tools come with a Creative Cloud membership. Generative Extend is different: it's a premium Firefly feature, it spends generative credits, and it needs you signed in and online. It won't run offline.
Licensing: Speech to Text, text-based editing, Enhance Speech, Media Intelligence, and Object Mask are included with a Creative Cloud membership. Generative Extend needs Firefly access and generative credits.
On the watch list: The Generative Media Tool lets you select a range on the timeline and prompt for video or sound effects, with video coming from Firefly or partner models. Adobe's help pages still label it beta, even though 26.5 lists it among feature updates, so it isn't written up below. It will be once the beta label comes off and Adobe publishes credit and duration limits in an official FAQ. Generate Music is also in beta, and Premiere AI Assistant is a public beta (Window > Assistant), linked under official notes. Auto Reframe, Morph Cut, and Scene Edit Detection are still in the app and documented, but they're older assists and not what this page is for. Generative Media Tool (beta) · Generate Music (beta)
Feature notes
- Speech to Text. Open Window > Text to generate a transcript from timeline or source audio, then turn it into captions if you need them. Speaker labelling is optional, and Translate Captions works from an existing caption track. Version 26.5 added a new voice activity detection model. It doesn't cut picture, and names, jargon, and overlapping speech still need a human read. Access: included with the membership; language packs download through Creative Cloud. Official docs · Translate captions
- Text-based editing and Paper Edit. Delete words or lift pauses in the transcript, and the matching picture and sound go with them. Paper Edit (new in 26.5) goes a step further and builds a sequence from lines you select in the Text panel. It won't write a cut from a brief, and a bad transcript makes a bad assembly, so proof first. Access: included with the membership. Text-based editing · Paper Edit
- Enhance Speech. In Essential Sound > Enhance. It cleans up dialogue and brings vocal presence forward, and the Mix Amount slider blends back toward the original. It's aimed at weak recordings: phone, laptop, or on-camera mic. It isn't a mix and it isn't a stem splitter. Analysis runs in the background. Access: included with the membership. Official docs
- Generative Extend. Drag the head or tail of a clip to add generated Firefly frames, or missing ambience and room tone, so a reaction or transition has the coverage it needs. Your original media is left unchanged. Overview · Extend FAQ · Credits FAQ
- Caps (from Adobe's Generative Extend FAQ): up to 2 seconds of picture, or up to 10 seconds of ambient audio.
- What it won't do: extend spoken dialogue (existing dialogue is muted across the extension), extend music, or run on both ends of a clip at once. Audio has to be mono or stereo.
- Source footage: 360p to 4K UHD, any aspect ratio, 12 to 60 fps, 8-bit to 16-bit, SDR or HDR, interlaced or non-square pixels. The extension itself is generated in 8-bit SDR, and anything above 30 fps is generated at 30 fps.
- Access: premium Firefly feature; needs an internet connection. Not available in Russia, Belarus, or China. K-12 and some enterprise seats (Adobe calls out CCE v3) may have no access.
- Cost: the credits FAQ (updated 30 September 2026) lists 50 credits per second at 720p 24 fps, 75 at 720p 30 fps, 100 at 1080p 24 fps, 125 at 1080p 30 fps, 150 at 4K 24 fps, and 175 at 4K 30 fps. Your monthly allowance comes from the plan, not the app: the same FAQ gives Creative Cloud Pro 4,000 premium credits a month, and a Premiere single-app plan 25 (or 500 if you subscribed before 17 June 2025).
- Do the maths before you promise a fix. Twenty two-second extensions on a 4K 30 fps job comes to 7,000 credits, well over a month of Creative Cloud Pro. On a newer single-app plan, 25 credits won't cover even one second at 720p. Check the seat before you budget the job.
- Media Intelligence. A Search panel that looks across visuals, spoken words, and embedded metadata. Visual analysis happens on your machine, then you search in plain language. It shipped in 26.0. It finds shots; it doesn't assemble them. You can switch analysis off in Preferences. Access: included with the membership. Official docs
- Object Mask. Click to isolate a person or object, then track it to drive effects. Version 26.5 added smoothness controls for the mask edge. It doesn't remove the object or fill the hole it would leave. Models download the first time you use it. Access: included with the membership. Official docs
Where to read official notes
Check monthly: What's new in Premiere on desktop (26.5, September 2026, is the latest section at this check; page updated 9 September 2026)
- Generative Extend overview (updated 9 September 2026)
- Generative Extend FAQ
- Generative credits FAQ (updated 30 September 2026)
- Firefly plans (credit packs and prices; currency depends on your region)
- Premiere desktop release notes
- Premiere AI Assistant (public beta)
Blackmagic DaVinci Resolve
What's in, and what isn't
Resolve's AI runs on the DaVinci Neural Engine, and that's a Studio feature, not part of the free app. Blackmagic's product page says Studio adds the Neural Engine, text-based editing, and Magic Mask on top of the free version, along with temporal and AI spatial noise reduction. The free app is still a full editor with colour, Fusion, and Fairlight. Studio is a one-time licence (US$295 on the product page at this check), not a subscription, and Neural Engine work runs locally.
Licensing: None of the tools below are in free Resolve. If a comparison chart lists Magic Mask, IntelliScript, or text-based editing as free, it's wrong or out of date.
Left out on purpose: Resolve 21's face tools (Face Age Transformer, Face Reshaper, Blemish Removal), CineFocus, UltraSharpen, and Motion Deblur are finishing tools rather than edit-bay assists. AI Speech Generator, which builds a voice from a Blackmagic model or from a sample as short as 10 seconds, is generative voice and sits outside this page. If you ever use it on a real person's voice, get their written consent first. Resolve 21.1 lets outside AI assistants organise media and run batch renders through conversation. That's an outside agent driving the app rather than a tool in the bay, so it's noted here rather than written up. Resolve 21.1 announcement
Feature notes
- Speech to text and auto subtitles. Transcribe clips, search on what was said, and build a subtitle track from timeline audio. You can edit from the transcript, and speaker detection lets you name voices and search by them. It won't proof names or rescue a noisy read, and it doesn't take a locked script and pick takes (that's IntelliScript, below). Documented from Resolve 18.5. Access: Studio. Official notes · Product page
- Voice Isolation. A Fairlight tool that pulls dialogue out of fan, traffic, and room noise. Dialogue Separator and Music Remixer sit alongside it in Studio. It won't rewrite a performance, and it won't split two people talking over each other into clean stems. Access: Studio (Neural Engine). Studio page · Product page
- Magic Mask. On the Color page. Point-select a person, object, or region, refine it with paint, and track it through the shot, including around obstructions. Magic Mask v2 (Resolve 20) is a single mode with a paint brush. Resolve 21 adds render in place, so a tracked mask can be cached as a travelling matte. Treat it as a mask assist, not a finished composite. Access: Studio. Resolve 20 · Resolve 21 · What's new
- AI IntelliScript. You supply the script, and Resolve matches transcribed audio to it and builds a timeline of selected takes. Resolve 21 adds Final Draft and plain-text screenplay import. It doesn't write the script, and the take choice is only as good as the match, so watch the selects. Access: Studio. Resolve 20 · Resolve 21
- AI IntelliSearch (Resolve 21). Search analysed media for people, objects, faces, or words in the dialogue, with results returned as clips in the media pool. It finds shots; it doesn't cut them. Access: Studio (Neural Engine). Resolve 21 · What's new
- AI Multicam SmartSwitch. From the multicam viewer, Resolve 20 picks angles based on who's speaking. Treat it as a first pass on speech boundaries, not a reaction cut. The same announcement adds AI IntelliCut, which strips silences, checkerboards audio by speaker, and creates ADR cues from transcript speaker info. Access: Studio. Resolve 20
Where to read official notes
Check monthly: What's new in DaVinci Resolve
- DaVinci Resolve product page (shows Resolve 21 at this check; the source for what's free and what's Studio)
- DaVinci Resolve Studio
- Resolve 21 announcement (14 April 2026)
- Resolve 20 announcement (4 April 2025)
- Resolve 18.5 announcement (speech to text, text-based editing, subtitles from audio)
- Resolve 21.1 announcement (8 September 2026)
- Support downloads
Resolve 20 also announced AI Audio Assistant and AI Animated Subtitles. They're named here rather than written up, because this page hasn't put them through a real mix yet.
Avid Media Composer
What's in, and what isn't
Avid's built-in AI is about dialogue: indexing it, searching it, and syncing it to a script. There's no generative picture. PhraseFind AI and ScriptSync AI are included with Media Composer | Ultimate and Media Composer | Enterprise, and they're an optional add-on for standard Media Composer, whether you're on a subscription or a perpetual licence. Nothing in the release notes checked here extends frames the way Firefly does.
Licensing: Included with Ultimate and Enterprise; optional add-on for standard Media Composer. Partner panels and Extensions Spotlight tools (Quickture, Flawless, Acclaim, and similar) run beside the NLE rather than inside it, so they're out of scope here.
Feature notes
- PhraseFind AI (Transcript Tool). Speech-to-text on project audio, with speaker ID and automatic language detection. Click a line to jump to it, or search a word or phrase across all your indexed dialogue; results can land in a virtual bin. It doesn't assemble a sequence from a prompt. Needs Media Composer 2023.12 or later. Access: included with Ultimate and Enterprise; optional on standard. Official page · Text-based editing
- ScriptSync AI. Indexes both the audible dialogue and the lines in an imported script, then syncs each source clip to its matching line so you can compare takes straight from the script. It can also build a script from your clips. It doesn't choose the performance. Access: same split as PhraseFind AI. Official page
- Editable transcripts. From 2025.12 you can correct words in the Transcript Tool without losing word-level timing, so ScriptSync, PhraseFind, and captions stay in sync. Edits go one sentence at a time, and Find and Replace lives in the Transcript Tool fast menu. 2026.8 adds editing while keeping the original, revert, splitting segments, and grouping a speaker's text into paragraphs. None of this re-times picture for you. 2025.12 also brought peer-to-peer transcript sharing for shared projects on Avid NEXIS file systems. What's new 2025.12 · What's new 2026.8
- PhraseFindAI Multicam Auto Cut (2026.8). Assign speakers in the Transcript Tool to cameras in a group clip, then choose Auto Cut from the Timeline multicam context menu. Media Composer cuts on speech boundaries so the active speaker's camera is up. Settings cover timing offset, minimum speech duration, and optional audio edits. It's a dialogue first pass, not a reaction cut. It needs PhraseFind AI transcripts and only works on the group clip segments you select. What's new 2026.8 · 2026.8 What's New PDF
Avid's text-based editing page also lists sequence subtitles generated from the transcript, as part of the Transcript Tool rather than a separate model. Transcript Tool access requires PhraseFind AI (included with Ultimate and Enterprise; optional add-on for standard Media Composer). ScriptSync AI alone does not include the Transcript Tool.
Where to read official notes
Check monthly: What's new in Media Composer 2026.8 (31 August 2026)
- Media Composer 2026.8 What's New (PDF)
- What's new, 2025.12 (9 January 2026)
- Text-based editing in Media Composer
- PhraseFind option
- ScriptSync option
- Media Composer documentation (Avid Knowledge Base)
Apple Final Cut Pro
What's in, and what isn't
Final Cut Pro's machine-learning tools are about analysis rather than generation. They caption speech, isolate a subject, split a rendered file back into shots, reframe, track, and clean up a voice. They don't generate new shots. Apple describes its newer intelligence features as running on device.
Licensing: Final Cut Pro for Mac is a one-time purchase on the Mac App Store, and it's also included in an Apple Creator Studio subscription (alongside Logic Pro, Pixelmator Pro, Motion, Compressor, MainStage, and others). Apple says one-time buyers and Creator Studio subscribers both get the new intelligence features in Final Cut Pro, and its list of subscriber-only intelligence features doesn't include any Final Cut Pro tools. Apple documents no generative credit pack for any of them. Final Cut Pro · About Apple Creator Studio · Intelligence features in Creator Studio
Platform: This section covers Final Cut Pro for Mac, and several of its tools need Apple silicon. Final Cut Pro for iPad is a related but separate app. iPad 3.3 (30 June 2026) has Generate Captions and Edit Detection, while Montage Maker and Auto Crop are iPad features that aren't on the Mac. Apple's Mac product page still sends iPad projects over to the Mac for Magnetic Mask and advanced colour work. iPad release notes
Not in this bay: No generative extend, no generative fill, no text-to-video, and no text-based picture editing (delete a word, ripple the cut). Image Playground (11.1) makes stylised stills from a description through Apple Intelligence (Mac with M1 or later, macOS 15.2 or later), but those are stills, not timeline video. Creator Studio's image and slide generation, powered by OpenAI and Google Cloud, lives in Keynote, Pages, Numbers, Pixelmator Pro, and Freeform rather than Final Cut Pro. Motion, Logic, Compressor, and Pixelmator aren't covered here.
Feature notes
- Generate Captions and Transcribe to Captions. Two routes to the same job: getting speech onto the timeline as text. Generate Captions (12.3, 30 June 2026) writes styled subtitles with look controls for social and platform delivery; it's US English only and needs Apple silicon. Transcribe to Captions (11.0, 13 November 2024) builds caption-role clips (CEA-608, iTT, SRT) with an on-device language model, and needs Apple silicon and macOS Sequoia or later. The 11.1 notes added support for a single audio role, so treat it as current, not retired. Version 12.3 can also convert existing closed captions to subtitles. Neither uses credits, and neither replaces a proofread. Access: included. Generate subtitles automatically · What's new in 11.0 · Release notes
- Magnetic Mask. Isolates a person, object, or shape and carries the matte through the clip, with no green screen or hand roto. Use it as an effect on its own, on a colour correction, or to limit another effect. It won't invent a clean plate, and when the matte slips you still add and brush reference frames. Apple recommends Apple silicon. Scene Removal Mask is its stricter cousin: it wants a locked-off camera, simple even light, and a few frames of empty background. Access: included, Final Cut Pro 11.0 (13 November 2024) and later. Add Magnetic Masks · Scene Removal Mask
- Auto Mask. Isolates recognised objects so you can colour or enhance them without manual tracking. Apple's user guide lists people, facial features, hair, skin, clothing, skies, foliage, and animals. Apple lists it alongside Magnetic Mask, not as a replacement. Access: included, Mac only per the 12.3 notes (30 June 2026); not listed for iPad 3.3. The guide does not add an Apple silicon requirement beyond Final Cut Pro for Mac. Use the Auto Mask · 12.3 release notes
- Edit Detection. Analyses a rendered video and splits it at shot changes, so a flattened export can come back as separate clips. Apple's guide says it splits at hard cuts and may not detect fades. It finds cuts; it doesn't recover the original project, effects, or roles, and it doesn't reconnect the pieces to separate source media. Access: included, Final Cut Pro 12.3 on Mac and Final Cut Pro for iPad 3.3. Release notes · Detect and restore edits · iPad 3.3 notes
- Enhance Light and Color. One click in Color Adjustments: machine learning sets colour balance, brightness, and contrast, and can lift a colour cast. It doesn't grade for you. The manual Light and Color controls sit in the same inspector, and Apple points precise work at Color Adjustments or a preset. Access: included, Final Cut Pro 10.8 (20 June 2024) and later. Color Adjustments
Also in the app, included, and longer established:
- Object Tracker. Drag an effect, title, or generator onto a face or object in the viewer and machine learning tracks it, using the Apple Neural Engine on Apple silicon. Shipped in 10.6 (18 October 2021), with an improved model in 10.7. Release notes
- Smart Conform. Reframes a clip whose aspect ratio doesn't match the project, favouring faces and other areas of interest. You'll still want to check the frame. Analysis is accelerated on Apple silicon (noted in 10.5). Smart Conform
- Voice Isolation. In Audio Enhancements. Prioritises detectable speech over everything else, with an Amount slider. Needs macOS Monterey 12.3 or later. Isolating several components at once can garble the result. The 10.6.2 notes describe the speech-clarity pass as machine learning. Enhance audio
- Smooth Slo-Mo. In the Retime menu. Synthesises in-between frames with a machine-learning quality mode (Best). Apple silicon only. Above 1920x1080 it needs analysis time, above 4K it needs M2 or later, and it tops out at 8K. It synthesises frames; it doesn't create a new shot. Change clip speed
- Visual Search and Transcript Search. Added in 12.0 (28 January 2026). Visual Search finds objects and actions from a natural-language query; Transcript Search finds spoken words, either exactly or by description. Both need Apple silicon, and speech search is English only per Apple's notes. They find clips; they don't edit. Release notes · Find clips
Two recent additions are left off for now. Match Color (12.3) appears under Apple's "powerful intelligence features", but the notes don't say it uses machine learning, so it stays off until the user guide explains how it works. The Cinematic mode adjustments in 12.4 apply to Final Cut Camera footage and need macOS 27. That isn't a refocus tool for any clip, so it stays off until Apple's documentation settles.
Where to read official notes
Check monthly: Final Cut Pro release notes (published 1 October 2026 at this check; 12.4 dated 29 September 2026)
- Final Cut Pro for iPad release notes
- Final Cut Pro product page
- About Apple Creator Studio
- About the intelligence features in Apple Creator Studio
- User guide: Magnetic Mask, Auto Mask, Generate subtitles, Scene Removal Mask, Smart Conform, Enhance audio, Detect and restore edits
Where AI sits in each bay
A snapshot. The limits and official links are in the feature notes above. Last checked 2026-10-02.
| Premiere Pro | DaVinci Resolve | Media Composer | Final Cut Pro | |
|---|---|---|---|---|
| What the AI is for | Transcripts, search, dialogue cleanup, masks, short Firefly fills | Neural Engine: transcripts, script-to-cut, masks, voice isolation, search | Dialogue indexing, script sync, speaker-based multicam first pass | Captions and styled subtitles, subject masks, shot detection, one-click light and colour, search by picture or speech |
| Licensing | Creative Cloud; generative work spends Firefly credits | Free app vs one-time Studio licence (most AI is Studio) | Included on Ultimate and Enterprise; add-on for standard | Included with the one-time purchase or Creator Studio; no credit pack documented |
| Generative picture or sound | Yes: Generative Extend (credits). The broader Generative Media Tool is still beta | No frame extend in the notes checked. A speech generator exists but isn't covered here | None in the 2026.8 notes | No shot extend, fill, or text-to-video. Smooth Slo-Mo synthesises in-between frames; Image Playground (11.1) makes stills only |
| Where it runs | Assists mostly on device; generative needs internet | Locally, via the Neural Engine (Studio) | Locally, on indexed project media | On device; most newer tools need Apple silicon. Generate Captions is US English only |
| Worth knowing | Your plan's credit allowance decides whether Extend is practical | Magic Mask, IntelliScript, and text-based editing are Studio only | Strong on dialogue. Partner panels (Quickture, Flawless, and others) aren't covered | Masks slip and need reference frames. Captions still need a proofread |
For editors weighing a switch
Premiere puts transcript editing, dialogue cleanup, visual search, and short Firefly fills on a subscription timeline, and bills the generative side in credits (see the rate card above). Resolve puts its Neural Engine tools (masks, isolation, transcription, script-to-timeline, speaker multicam, visual search) behind a one-time Studio licence, and the free app covers everything else in the bay. Avid stays focused on dialogue indexing and script sync, now with a speaker-based multicam first pass, and doesn't generate frames. Final Cut Pro concentrates on on-device analysis and isolation (captions, masks, edit detection, light and colour, search), with no generative extend and no credit pack, whether you buy it outright or get it through Creator Studio.
Resolve, Media Composer, and Final Cut each have some speaker-led or search-led help for finding or cutting dialogue, so that alone shouldn't decide a move. None of the four replaces the cut.
Habits that hold in every bay
- Proof the transcript before you build on it. Captions, paper edits, script sync, and transcript search all inherit whatever the transcript got wrong. Names, jargon, and crosstalk are where it usually slips.
- Treat search and auto cuts as a first pass. Visual search, speaker multicam, and edit detection save a lot of scrubbing, but they don't know what the scene is about. Watch the result through before you trust it.
- Mark anything generated. If a generated extension or other synthesised frames make the cut, give the clip a marker or a colour so it gets a proper look in review, and check the delivery spec in case the client or broadcaster wants generated material flagged.
- Check the seat before you quote. Licences, credit allowances, and hardware requirements decide what's actually available on a given machine. A tool on your own system might not be on the one you're freelancing on next week.
What this page isn't
It isn't a stock music, SFX, or footage library, and it isn't a roundup of generative video models that live outside the NLE (Sora, Runway, Kling, and the rest). It isn't an affiliate list or a ranking. Partner panels and extensions that sit beside the NLE (Quickture, Flawless, Acclaim, and similar) aren't covered either. And it doesn't replace vendor documentation: if this page and the vendor disagree, the vendor wins. Our weekly cut notes link here whenever an NLE ships something new, so this URL stays put.
Change log
- 2026-10-02: Launch. The edit bay page is now public and indexable. First check covers Premiere desktop 26.5, Resolve 21 and Studio, Media Composer 2025.12 through 2026.8, and Final Cut Pro for Mac 11.0 to 12.4. Generative Extend credit rates taken from Adobe's credits FAQ (30 September 2026). Generative Media Tool held on the Premiere watch list while it's in beta.
Method
Every feature claim on this page is backed by an official Adobe, Blackmagic, Avid, or Apple page. We don't mirror the manual. We note what each tool does, where it stops, and what it needs. The Last checked date is when those official pages were last read.
Monthly check: these four official pages, compared against the Last checked date. We don't work from blog roundups.
- Premiere: What's new in Premiere on desktop
- Resolve: What's new in DaVinci Resolve
- Avid: What's new in Media Composer (currently 2026.8)
- Final Cut Pro: Final Cut Pro release notes
We also recheck in major release weeks (Adobe MAX, NAB, IBC, and Apple's updates). Once Last checked is about 90 days old, the page is treated as stale. Spotted something wrong or out of date? Let us know through the About / contact.
Related on Field Notes
- Workflows: the hub this page lives under
- Directory: Premiere, Resolve, Avid, and Final Cut craft finds
- News: weekly cut notes, which link here when an NLE ships
- Method and FAQ: how the Last checked rule works
Living craft notes. Official vendor links only. Last checked 2026-10-02.