US 9,812,028 B1
Automated generation and presentation of lessons via digital media content extraction
Michael E. Elchik, Moon Township, PA (US); Dafyd Jones, Edgeworth, PA (US); Robert J. Pawlowski, Jr., Cranberry Township, PA (US); Jaime G. Carbonell, Pittsburgh, PA (US); Jeremy Hesidenz, McKees Rocks, PA (US); Sean Hile, Gibsonia, PA (US); and Cathy Wilson, Glenview, IL (US)
Assigned to WeSpeke, Inc., Pittsburgh, PA (US)
Filed by WeSpeke, Inc., Pittsburgh, PA (US)
Filed on May 4, 2017, as Appl. No. 15/586,906.
Claims priority of provisional application 62/331,490, filed on May 4, 2016.
Claims priority of provisional application 62/428,260, filed on Nov. 30, 2016.
Int. Cl. G06F 17/27 (2006.01); G09B 7/06 (2006.01); G10L 15/26 (2006.01); G06F 3/16 (2006.01); G09B 5/06 (2006.01); G09B 19/06 (2006.01)
CPC G09B 7/06 (2013.01) [G06F 3/167 (2013.01); G06F 17/271 (2013.01); G06F 17/274 (2013.01); G06F 17/2765 (2013.01); G06F 17/2785 (2013.01); G09B 5/065 (2013.01); G09B 19/06 (2013.01); G10L 15/265 (2013.01)] 26 Claims
OG exemplary drawing
 
1. A system for automatically generating lessons based on content of a digital programming file, comprising:
a content analysis engine comprising programming instructions that are configured to cause a processor to:
analyze a set of text corresponding to words spoken in a digital programming file, wherein the set of text comprises a transcript that includes a plurality of text segments and a plurality of timestamps each corresponding to one of the text segments,
extract a sentence from the set of text by:
extracting a sequential group of the text segments from the set of text,
parsing the group of text segments to identify the sentence within the group, and
using the timestamps of each text segment that is at least partially included within the sentence to determine a start time and a duration for the sentence by:
(i) identifying a first text segment that is at least partially included in the sentence,
(ii) determining a number of syllables of the first text segment that are in the sentence and a total number of syllables in the first text segment,
(iii) determining a ratio of the number of syllables in the first text segment that are in the sentence and the total number of syllables in the first text segment,
(iv) multiplying the ratio by a duration of the first text segment to yield a segment duration for the first text segment,
(v) repeating steps (i)-(iv) for each text segment that is at least partially included in the sentence, and
(vi) summing the segment durations for each text segment that is at least partially included in the sentence to yield the duration for the sentence,
and
generate a digital media clip that corresponds to the sentence, wherein the digital media clip has a start time in the digital programming file that corresponds to the start time of the sentence; and
a lesson generation engine comprising programming instructions that are configured to cause a processor to generate a lesson comprising an exercise that includes:
a prompt that uses one or more key words that are extracted from the sentence, and
the digital media clip.