Contextual Understanding
Lumiere now uses AI to deeply understand what’s happening in a video—visually and audibly. This feature supports transcript creation, efficient scene creation, accurate follow-up conversation generation, and lays the foundation for future automated video setup updates.
Transcripts
You can download transcripts of your video's dialogue and audio on the insights dashboard of your video. To do this:
Navigate to your video's insights dashboard
In the bottom right corner of the video player, click on the download icon to open the download menu
Select 'transcript'
Video Analysis
Leveraging contextual understanding, Lumiere can now generate full video transcripts that include both spoken dialogue and second-by-second descriptions of visual and auditory elements. This allows researchers to better understand content context and pinpoint where reactions occur. This information can be used to aid AI prompting
To download analysis of your video:
Navigate to your video's insights dashboard
In the bottom right corner of the video player, click on the download icon to open the download menu
Select 'Analysis' to download the analysis file
Check this example analysis that Lumiere generated for this short video:
This short clip showcases various examples of interactive overlays on video content, including multiple-choice polls, simple questions, rating sliders, and comment/reply interfaces, applied to different scenes like a home setting, a fantasy background, an outdoor shot, and a sports close-up.
00:00 - 00:01: Two men stand in a living room setting with food delivery items (Uber Eats bag, pizza boxes). An interactive poll overlay appears asking "How likely are you to recommend this brand to a friend?" with options: Very likely, Somewhat likely, Somewhat unlikely, Very unlikely.
00:01 - 00:02: The scene changes to an iPhone and a Google Pixel phone placed on a yellow brick road in a Wizard of Oz-themed setting. The iPhone has a pink case and a crown (like Glinda), while the Pixel has a green case and a witch hat. A simple text overlay asks "iPhone or Pixel?".
00:02 - 00:03: A woman with curly hair, seen from behind, wears a white t-shirt with "The Ultimate Soda Serve" logo. An overlay asks "What do you think of this ad?" with a rating slider ranging from red to green.
00:03 - 00:05: A close-up shows NFL player Josh Allen in a Buffalo Bills helmet. An overlay displays a rating slider (Hate it to Love it) set to 9 (Love it) with the text "Josh Allen is the best". A "Send" button is shown. The overlay then transitions slightly, showing "Lumiere AI", a color picker, a text input field for "Your reply...", and the "Send" button again, indicating a comment interaction.