Help with vocal digital synthesis

Pròiseactan mar Google in Your Language, an Uicipeid, Firefox, Thunderbird, Opera, LibreOffice/OpenOffice, phpBB, Scrabble is dearbhadairean / Projects like Google in Your Language, Wikipedia, Firefox, Thunderbird, Opera, LibreOffice/OpenOffice, phpBB, Scrabble and spell checkers
Andrew9999
Posts: 3
Joined: Sat Jan 29, 2022 8:36 pm
Language Level: Learner
Corrections: Please correct my grammar
Location: Borders

Help with vocal digital synthesis

Unread post by Andrew9999 »

I'm creating a Scottish Gaelic dictionary for a popular vocal digital synthesis application (Synth V), so it can sing in Gaelic. To do this I need the Gaelic word, and its pronunciation as closely as possible in IPA or Vocaloid X-SAMPA. I note that the dictionary on this site provides near IPA for Gaelic words. Is it possible to obtain a word/IPA extract to integrate into this application? Thanks.


akerbeltz
Rianaire
Posts: 1781
Joined: Mon Nov 17, 2008 1:26 am
Language Level: Barail am broinn baraille
Corrections: Please don't analyse my Gaelic
Location: Glaschu
Contact:

Re: Help with vocal digital synthesis

Unread post by akerbeltz »

Hi Andrew. Just to check first, you do know there is a pretty good Gaelic voice?
Andrew9999
Posts: 3
Joined: Sat Jan 29, 2022 8:36 pm
Language Level: Learner
Corrections: Please correct my grammar
Location: Borders

Re: Help with vocal digital synthesis

Unread post by Andrew9999 »

That's text-to-speech, which is a much simpler challenge. What I'm using is a vocal speech synthesiser which reproduces singing from text/midi notes based on a sampled human singer. Today they can produce pretty realistic singing in a small number of languages, including English. They do this by breaking words into phonemes and then synthesising the phoneme samples from the human singer together. I can take the 44 standard phonemes for English and use them to reproduce reasonably well the sound of Gaelic words being sung - but I need a dictionary to tr*nsl*t* the written word to the spoken phoneme set. That's what I am seeking. Once complete anyone can use the Gaelic dictionary for the synthesiser to produce synthesised Gaelic singing.
Andrew9999
Posts: 3
Joined: Sat Jan 29, 2022 8:36 pm
Language Level: Learner
Corrections: Please correct my grammar
Location: Borders

Re: Help with vocal digital synthesis

Unread post by Andrew9999 »

Here's an example of an English song vocally synthesised in this way... https://m.youtube.com/watch?v=xEcLnZy1yCA
Níall Beag
Rianaire
Posts: 1432
Joined: Sun Sep 23, 2007 6:58 pm
Language Level: Fluent (non-native)
Corrections: I'm fine either way
Location: Sruighlea, Alba
Contact:

Re: Help with vocal digital synthesis

Unread post by Níall Beag »

Well that's a pretty huge task, and pretty ambitious.

I'm sure you're aware of most of the technical challenges, but how much do you know of the language-specific ones? (Genuine question -- you write in English after all, so we don't know what your level of Gaelic is.)

The biggest hurdle is that it's only the headword form that is given in the dictionary entries, and while some inflected forms are simple affixes (for which you won't get the IPA from the dictionary, but there's a limited set of them), there are inflections and derivations that change the root, most commonly by consonant mutation at the start or end of the word, but sometimes by syncope (loss of syllable) which occasionally has other knock-on effects.
(You may already know this. Not wanting to patronise, just making things clear.)
silmeth
Posts: 11
Joined: Tue Aug 11, 2020 12:47 pm
Language Level: lower intermediate, my Irish is better
Corrections: Please correct my grammar
Location: Poznań, A’ Phòlainn

Re: Help with vocal digital synthesis

Unread post by silmeth »

And the biggest challenge, the “44 standard phonemes for English” are only standard for English. Gaelic has completely different phoneme inventory, it’s impossible just to map Gaelic phonemes into English and keep authentic Gaelic pronunciation (but I guess it depends on what you mean by “reasonably well”…).
akerbeltz
Rianaire
Posts: 1781
Joined: Mon Nov 17, 2008 1:26 am
Language Level: Barail am broinn baraille
Corrections: Please don't analyse my Gaelic
Location: Glaschu
Contact:

Re: Help with vocal digital synthesis

Unread post by akerbeltz »

I'm also somewhat dubious as to what the point is. Of course with STT and TSS there are issues of accessibility i.e. they're useful to Gaelic speakers who are blind/deaf/dyslexic etc.

But I fail to see how vocal synthesis would aid Gaelic speakers? If successful, wouldn't that mean that we lose yet another domain for which a command of Gaelic is essential? There are precious few of those left, singing being on of them.
Post Reply