US 11,683,536 B2
Audiovisual collaboration system and method with latency management for wide-area broadcast and social media-type user interface mechanics
Anton Holmberg, Berkeley, CA (US); Benjamin Hersh, San Francisco, CA (US); Jeannie Yang, San Francisco, CA (US); Yuning Woo, San Francisco, CA (US); Wang Liang, San Francisco, CA (US); Perry R. Cook, Jacksonville, OR (US); and Jeffrey C. Smith, San Francisco, CA (US)
Assigned to Smule, Inc., San Francisco, CA (US)
Filed by SMULE, INC., San Francisco, CA (US)
Filed on Apr. 18, 2022, as Appl. No. 17/659,644.
Application 17/659,644 is a continuation of application No. 16/443,022, filed on Jun. 17, 2019, granted, now 11,310,538.
Application 16/443,022 is a continuation in part of application No. 15/944,537, filed on Apr. 3, 2018, granted, now 11,032,602, issued on Jun. 8, 2021.
Claims priority of provisional application 62/685,727, filed on Jun. 15, 2018.
Claims priority of provisional application 62/480,610, filed on Apr. 3, 2017.
Prior Publication US 2023/0007313 A1, Jan. 5, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. H04N 21/2187 (2011.01); H04N 21/233 (2011.01); H04N 21/43 (2011.01); H04L 65/75 (2022.01)
CPC H04N 21/2187 (2013.01) [H04L 65/762 (2022.05); H04N 21/233 (2013.01); H04N 21/43076 (2020.08)] 20 Claims
OG exemplary drawing
 
1. A collaboration method for a livestream broadcast of a coordinated audiovisual work of first and second performers captured at respective geographically-distributed, first and second devices, the method comprising:
receiving, at the second device, a media encoding of an audiovisual performance mixed with a first backing track and including (i) vocal audio captured at the first device from the first performer and (ii) video of the first performer that is performance synchronized with the captured first performer vocal audio;
at the second device, audibly rendering the received mixed audiovisual performance and capturing thereagainst (i) vocal audio from the second performer and (ii) video of the second performer that is performance synchronized with the captured second performer vocal audio;
mixing, at the second device, the second performer vocal audio captured at the second device with the first performer vocal audio of the mixed audiovisual performance received from the first device; and
compositing the second performer video captured at the second device with the first performer video of the mixed audiovisual performance received from the first device;
wherein the mixed vocal audio and the composited performance synchronized video of the first and second performers define an audiovisual broadcast mix for transmission to an audience as the livestream broadcast, wherein the audiovisual broadcast mix includes the captured vocal audio of the first and second performers and the first backing track without apparent temporal lag therebetween.