Archives for February 2016

At Just the Right Time!

The vision of Wycliffe is to see God’s Word made accessible to all people in the language that speaks to their heart. Usually this might mean distributing a printed book. If there is a low literacy rate, then access to an audio version is important.

Audio versions of the Bible are recorded (often by Faith Comes By Hearing) and can be distributed on dedicated audio players like the Proclaimer. With the availability of smart phones, now a Scripture app created with Scripture App Builder can be distributed with the text and audio of the Bible bundled together.

What about early readers in the people group? Wouldn’t it be great if the text of the passage could be highlighted while the audio is being played?

In order to accomplish this, special timing files have to be created to let the software know which portions of the text and audio go together. Early attempts at this would take 45-60 minutes per chapter! For the Bible en Songoy de Gao App, this took weeks for a team of volunteers (listening to a language they didn’t know) to create these timing files.

Colleagues at Wycliffe searched for another way. Could software automate this process? Praise God, a solution was found! The Aeneas Library allows for the automated creation of the timing files. What used to take almost an hour can now be done in 3-5 seconds! How is this accomplished?

How does this thing work?

One word: Math

One Sentence (Layman Edition): A good deal of math and computer science, a handful of software engineering and some optimization tricks.

One Sentence (Pro Edition): Using the Sakoe-Chiba Band Dynamic Time Warping (DTW) algorithm to align the Mel-frequency cepstral coefficients (MFCCs) representation of the given (real) audio wave and the audio wave obtained by synthesizing the text fragments with a TTS engine, eventually mapping the computed alignment back onto the (real) time domain. 


Phew! The result is that, now, a whole New Testament can be processed in less than an hour instead of weeks. Wycliffe is preparing to publish hundreds of Scripture apps. Many of them already have audio. This new software process came at just the right time!


Above: Bible Dedication of the Soŋay Language of Gao, Mali included the Bible en Songoy de Gao App

Right: John 3:16 in Soŋay Language of Gao with text highlighting synchronized with audio