Module:ru-pron

--[[ This module implements the template.

Author: Originally Wyang; rewritten by Benwing; additional contributions from Atitarev and a bit from others

FIXME:

1. (DONE) Geminated /j/ from -йя-: treat as any other gemination, meaning it  may not always be pronounced geminated. Currently we geminate it very late, after all the code that reduces geminates. Should be done earlier and places that include regexps with /j/ should be modified to also include the gemination marker ː. Words with йя: аллилу́йя, ауйяма, ва́йя, ма́йя, папа́йя, парано́йя, пира́йя, ра́йя, секво́йя, Гава́йям. 2. (DONE) Should have geminated jj in йе (occurs in e.g. фойе́). Should work with gem=y (see FIXME #1). Words with йе: фойе́, колба Эрленмейера, скала Айерс, Айерс-Рок, йети, Кайенна, конве́йер, конвейерный, сайентология, фейерверк, Гава́йев. Note also Гава́йи with йи. 3. (DONE, CINEMANTIQUE OK WITH FIXES) In Асунсьо́н and Вьентья́н, put a syllable break after the н and before consonant + /j/. Use the perm_syl_onset mechanism or at least the code that accesses that mechanism. Should possibly do this also in VCʲj and V‿Cʲj and VCj and V‿Cj sequences; ask Cinemantique if this makes sense. 4. (DONE, CINEMANTIQUE OK WITH FIXES) Fix non-palatal е in льстец. Other words that will be affected (and probably wrong): льви́ца, львя́тник, льняно́й, льстить, льди́на, львиный, manual pronunciation given as lʲvʲit͡sə and lʲvʲɵnək. Ask Cinemantique. 5. (DONE, CINEMANTIQUE SAYS NO IT DOESN'T) In львёнок, rendered as ˈlʲvɵnək instead of ˈlʲvʲɵnək. Apparently same issue as льстец, having to do with ь in beginning. This apparently has to do with the "assimilative  palatalization of consonants when followed by front vowels" code, which blocks palatalization when the syllable begins with a cluster with a hard sign, or a soft sign followed by a consonant. Then "retraction of front  vowels in syllables blocking assimilative palatalization" converts e to ɛ and i to y in such cases of blocked palatalization (not needed for žcš,  which are handled by phon_respellings). Ask Cinemantique if this whole business makes any sense. 6. (DONE) In prefixes/suffixes like -ин, treat single syllable word as  unstressed. Also support tilde to force unstressed syllable. 7. (DONE) In ни́ндзя, дз becomes palatal and н should palatal-assimilate to it. 8. (DONE) In под сту́лом, should render as pɐt͡s‿ˈstuləm when actually renders as  pɐˈt͡s‿stuləm. Also occurs in без ша́пки (bʲɪˈʂ‿ʂapkʲɪ instead of  bʲɪʂ‿ˈʂapkʲɪ); has something to do with ‿. Similarly occurs in  не к ме́сту, which should render as nʲɪ‿k‿ˈmʲestʊ, and от я́блони, which should render as ɐt‿ˈjæblənʲɪ. 9. (STILL UNCLEAR) In собра́ние, Anatoli renders it as sɐˈbranʲɪ(j)ə with optional (j). Ask him when this exactly applies. Does it apply in all ɪjə sequences? Only word-finally? Also ijə? 10. (DONE) убе́жищa renders as ʊˈbʲeʐɨɕːʲə instead of ʊˈbʲeʐɨɕːə; уда́ча similarly becomes ʊˈdat͡ɕʲə instead of ʊˈdat͡ɕə. 10a. (DONE) Remove the "offending clause" just mentioned, labeled FIXME (10a), and fix it as the comment above it describes. 10b. (DONE) Remove the clause labeled "FIXME (10b)". 10c. (DONE) Investigate the clause labeled "FIXME (10c)". This relates to  FIXME #9 above concerning собра́ние. 10d. (DONE, NEEDS TESTING) Investigate the clause labeled "FIXME (10d)" and apply the instructions there about removing a line and seeing whether anything changes. 11. (DONE) тро́лль renders with geminated final l, and with ʲ on wrong side of  gemination (ːʲ instead of ʲː); note how this also occurs above in -ɕːʲə from убе́жищa. (This issue with тро́лль will be masked by the change to  generally degeminate l; use фуррь; note also галльский.) 12. (DONE, NEEDS TESTING) May be additional errors with gemination in   combination with explicit / syllable boundary, because of the code expecting that syllable breaks occur in certain places; should probably rewrite the whole gemination code to be less fragile and not depend on	exactly where syllable breaks occur in consonant clusters, which it does now (might want to rewrite to avoid the whole business of breaking by	syllable and processing syllable-by-syllable). 13. Many assimilations won't work properly with an explicit / syllable boundary. 14. (DONE, ASK WYANG FOR ITS PURPOSE) Eliminate pal=y. Consider first asking Wyang why this was put in originally. 15. (DONE) Add test cases: Цю́рих, от а́ба, others. 15a. (DONE) Add test cases: фуррь, по абази́ну (for assimilation of schwas   across ‿) 15b. (DONE) Add test case англо-норма́ннский (to make sure degemination of нн   occurs when not between vowels), multi-syllable word ending in a geminate: ато́лл (not so good because лл always degeminated), коло́сс, Иоа́нн (good	because of нн), ха́ос, эвфеми́зм, хору́гвь (NOTE: ruwikt claims гв is voiced,	I doubt it, ask Cinemantique), наря́д на ку́хню (non-devoicing of д before	н in next word, ask Cinemantique about this, does it also apply to мрл?), ко̀е-кто́ 16. (DONE, ADDED SPECIAL HACK; REMOVED WITH NEW FINAL-Е CODE, SHOULD HANDLE   THROUGH pos=pro; DOESN'T HAVE ANYTHING TO DO WITH SECONDARY STRESS ON О) Caused a change in ко̀е-кто́, perhaps because I rewrote code that accepted an acute or circumflex accent to also take a grave accent. See how кое is actually pronounced here and take action if needed. (ruwiki claims кое is	indeed pronounced like кои, ask Cinemantique what the rule for final -е	is and why different in кое vs. мороженое, anything to do with secondary	stress on о?) 17. (DONE) Rewrote voicing/devoicing assimilation; should make assimilation of   эвфеми́зм automatic and not require phon=. 18. (DONE) Removed redundant fronting-of-a code near end; make sure this doesn't change anything. 19. (DONE, ANSWER IS YES) do сь and зь assimilate before шж, and if so do they become ɕʑ? Ask Cinemantique. 20. (DONE) Add pos= to handle final -е. Possibilities appear to be neut (neuter noun), adj (adjective, autodetected whether singular or plural), comp (comparative), pre (prepositional case), adv (adverb), verb or v (2nd	plural verb forms). 21. (DONE, DEVOICE UNLESS NEXT WORD BEGINS WITH VOICED OBSTRUENT OR V+VOICED   OBSTRUENT) Figure out what to do with devoicing or non-devoicing before mnrlv vowel. Apparently non-devoicing before vowel is only in fast speech with a close juncture and Anatoli doesn't want that; but what about before the consonants? 22. (DONE) Figure out what to do with fronting of a and u after or between soft consonants, esp. when triggered by a following soft consonant with optional or compulsory assimilation. Probably the correct thing to do	in the case of optional assimilation is to give two pronunciations separated by commas, one with non-front vowel + hard consonant, the other with front vowel + soft consonant. 23. (DONE, OK) Implement compulsory assimilation of xkʲ; ask Cinemantique to   make sure this is correct. 24. (DONE, BUT ANATOLI THINKS CONJUNCTION A MIGHT NOT BE REDUCED) Add а to   list of unstressed particles, but only recognize it and о (and perhaps all	the others) when not followed by a hyphen; then fix unnecessary cases with о̂ (look at tracking cflex category) and the various hacks used in а ведь, а сейчас, а то, а не то, а также, а как же; will need to add а̂ to а капелла and possibly elsewhere; use different-pron tracking to catch this. 25. (DONE) Add / before цз, чж in Chinese words to ensure syllable boundary in   right place; ensure that this doesn't mess things up when occurring at beginning of word or whatever. 26. (DONE) Rule on voicing assimilation before v: It says in Chew "A   Computational Phonology of Russian" that v is an obstruent before obstruents and a sonorant before sonorants, i.e. v triggers voicing assimilation if followed by an obstruent; verify that our code works this way. 27. (DONE, NEEDS TESTING) Implement _ to block all assimilation; probably this will happen automatically and we just need to remove the _ at the end. 28. (NOT DONE, NOT CORRECT) Change unstressed palatal o to have values like regular o, for words like майора́т, Ога́йо, Йоха́ннесбург 29. (DONE) If we need partial reduction of non-final е/я to [ə] instead of [ɪ], one way is to use another diacritic, e.g. dot-under; or use a spelling like ьа. 30. (DONE) BUG: воѐнно-морско́й becomes [vɐˌenːə mɐrˈskoj] without [je], must be   due to ѐ being a composed character (may be a bug in the translit module;	add a test case). 31. In в Япо́нии, в Евро́пе, the initial [j] should be required not optional. 32. (DONE) Should be possible to write п(ь)я́нка, скам(ь)я́ and get optional palatalization. 33. (CODE PRESENT BUT NOT COMPLETED) Final unstressed -е that becomes [e] should become [ɪ] when not followed by end of utterance or pause. 34. In То́гане (phon=То́ганэ), final -э should be pronounced [e]. Should apply in general to -э after paired consonants, but not to e.g. се́рдце. 35. (DONE) тц,дц,тч,дч shoud be always-geminated by default. 36. (DONE) treat ! and ? as separate words so we don't have issues with word-final -е before them. 37. (DONE) Distinguish stress accents from other accents. 38. т(ь)ся not directly after the stress should be optionally geminated. 39. (DONE) нра̀вственно-эти́ческий should have optional not mandatory gemination of нн. 40. (DONE) Make дц in -дцат- be optionally-geminated, for words like одиннадцать, двадцать, тридцатый, etc. 41. (DONE) Don't show grave accents in annotations (but do in phon=). 42. (DONE) -чш- (as in лучший) should be pronounced as -тш-. 43. (DONE) Fix fronting of [au] in two syllables in a row. 44. (DONE) Add pos=imp for imperatives, use it to treat -ться differently from infinitives. 45. (DONE) CFLEX should not be treated as stress for the purpose of determining whether written а reduces to [ɐ] or [ə]. 46. (DONE) Fix [дт]ьт, [сз]ьс sequences (esp. in imperatives) and make palatalization of labials optional in [мбпфв]ь[ст][еияёю] (again esp. in   imperatives). 47. (DONE) Optional palatalization of -ся should apply only to -лся, not always. 48. (DONE) Reduction of стл -> сл should apply only in стлив, not always. 49. (DONE) Convert счит -> щит by default, as with счёт. 50. (DONE) Don't require that m_ru_translit.apply_tr_fixes be called prior to ipa, but include an argument so that text transformed this way can be passed in. 51. (DONE) pos=X/Y and gem=X/Y should require same number of elements as actual words rather than counting phonetically-joined words. 52. (DONE) Should treat suffixes as beginning with a palatalizable pseudo- consonant, so e.g. initial -е is indicated as palatalization of the preceding consonant rather than being preceding by [j], and initial -а is   rendered as [ə] not [ɐ]. 53. (DONE) Should treat prefixes as followed by a pseudoconsonant that doesn't   trigger voicing or devoicing of preceding consonants. 54. (DONE) Don't add ‿ after prefixes like из-. 55. Suffix -ёр is rendered as unstressed rather than stressed; probably because the transliteration doesn't preserve the stress mark. 56. (DONE) -дцат- should be pronounced as if -дцыт-. 57. (DONE) вь (and other palatalized labials) + /j/ should have optional patalization. 58. (DONE) Convert unstressed initial э- into и-. 59. (DONE) Implement automatic generation of secondary [ʑː] pronunciation for зж/жж except as prefix boundaries; add zhpal= to override this. 60. (DONE) When checking for prefix boundaries, check all listed prefixes + those prefixes preceded by по-, не- or непо- (cf. поссо́рить, порассужда́ть,   нерассуди́тельный, etc.). ]]

local com = require("Module:ru-common") local m_ru_translit = require("Module:ru-translit") local m_str_utils = require("Module:string utilities") local listToSet = require("Module:table/listToSet")

local export = {} local u = m_str_utils.char local rfind = m_str_utils.find local rsubn = m_str_utils.gsub local rmatch = m_str_utils.match local ulower = m_str_utils.lower local uupper = m_str_utils.upper local usub = m_str_utils.sub local ulen = m_str_utils.len local split = m_str_utils.split

local remove_grave_accents_from_phonetic_respelling = true -- Anatoli's desired value

-- version of rsubn that discards all but the first return value local function rsub(term, foo, bar) local retval = rsubn(term, foo, bar) return retval end

-- apply rsub repeatedly until no change local function rsub_repeatedly(term, foo, bar) while true do		local new_term = rsub(term, foo, bar) if new_term == term then return term end term = new_term end end

-- If enabled, compare this module with new version of module in -- Module:User:Benwing2/ru-pron to make sure all pronunciations are the same. -- To check for differences, go to Wiktionary:Tracking/ru-pron/different-pron -- and look at what links to the page. local test_new_ru_pron_module = false -- If enabled, do new code for final -е; else, the old way local new_final_e_code = true -- If enabled, do special case for final -е not before a pause local final_e_non_pausal = false

local AC = u(0x0301) -- acute = ́ local GR = u(0x0300) -- grave = ̀ local CFLEX = u(0x0302) -- circumflex = ̂ local DUBGR = u(0x030F) -- double grave = ̏ local DOTABOVE = u(0x0307) -- dot above = ̇ local DOTBELOW = u(0x0323) -- dot below = ̣ local PSEUDOCONS = u(0xFFF2) -- pseudoconsonant added to the beginning of suffixes and end of prefixes local TEMPCFLEX = u(0xFFF3) -- placeholder to be converted to a circumflex local TEMPSUB = u(0xFFF4) -- miscellaneous temporary placeholder

local vow = 'aeiouyɛəäạëöü' local ipa_vow = vow .. 'ɐɪʊɨæɵʉ' local vowels, vowels_c = '[' .. vow .. ']', '([' .. vow .. '])' -- No need to include DUBGR here because we rewrite it to CFLEX very early local acc = AC .. GR .. CFLEX .. DOTABOVE .. DOTBELOW local accents = '[' .. acc .. ']' local stress_accents = '[' .. AC .. GR .. ']'

local perm_syl_onset = listToSet({	'spr', 'str', 'skr', 'spl', 'skl',	-- FIXME, do we want sc?	'sp', 'st', 'sk', 'sf', 'sx', 'sc',	'pr', 'br', 'tr', 'dr', 'kr', 'gr', 'fr', 'vr', 'xr',	'pl', 'bl', 'kl', 'gl', 'fl', 'vl', 'xl',	-- FIXME, do we want the following? If so, do we want vn?	'ml', 'mn',	-- FIXME, dž is now converted to ĝž, which will have a syllable	-- boundary in between	'šč', 'dž', })

-- FIXME: Consider changing ӂ internally to ʑ to match ɕ (it is used externally -- in e.g. дроӂӂи (pronunciation spelling of дрожжи) local translit_conv = {	['c'] = 't͡s', ['č'] = 't͡ɕ', ['ĉ'] = 't͡ʂ',	['g'] = 'ɡ', ['ĝ'] = 'd͡ʐ',	['ĵ'] = 'd͡z', ['ǰ'] = 'd͡ʑ', ['ӂ'] = 'ʑ',	['š'] = 'ʂ', ['ž'] = 'ʐ' }

local translit_conv_j = { ['cʲ'] = 't͡sʲ', ['ĵʲ'] = 'd͡zʲ' }

-- Table of allophones. Each entry is a list of three values: -- (1) the stressed value; (2) the value immediately before primary or -- secondary stress; (3) the value elsewhere. local allophones = { ['a'] = { 'a', 'ɐ', 'ə' }, ['e'] = { 'e', 'ɪ', 'ɪ' }, ['i'] = { 'i', 'ɪ', 'ɪ' }, ['o'] = { 'o', 'ɐ', 'ə' }, ['u'] = { 'u', 'ʊ', 'ʊ' }, ['y'] = { 'ɨ', 'ɨ', 'ɨ' }, ['ɛ'] = { 'ɛ', 'ɨ', 'ɨ' }, ['ä'] = { 'a', 'ɪ', 'ɪ' }, ['ạ'] = { 'a', 'ɐ', 'ə' }, ['ë'] = { 'e', 'ɪ', 'ɪ' }, ['ö'] = { 'ɵ', 'ɪ', 'ɪ' }, ['ü'] = { 'u', 'ʊ', 'ʊ' }, ['ə'] = { 'ə', 'ə', 'ə' }, }

local devoicing = { ['b'] = 'p', ['d'] = 't', ['g'] = 'k', ['z'] = 's', ['v'] = 'f', ['ž'] = 'š', ['ɣ'] = 'x', ['ĵ'] = 'c', ['ǰ'] = 'č', ['ĝ'] = 'ĉ', ['ӂ'] = 'ɕ', }

local voicing = { ['p'] = 'b', ['t'] = 'd', ['k'] = 'g', ['s'] = 'z', ['f'] = 'v', ['š'] = 'ž', ['c'] = 'ĵ', ['č'] = 'ǰ', ['ĉ'] = 'ĝ', ['x'] = 'ɣ', ['ɕ'] = 'ӂ' }

local iotating = { ['a'] = 'ä', ['e'] = 'ë', ['o'] = 'ö', ['u'] = 'ü' }

local retracting = { ['e'] = 'ɛ', ['i'] = 'y', }

local fronting = { ['a'] = 'æ', ['u'] = 'ʉ', ['ʊ'] = 'ʉ', }

-- Prefixes that we recognize specially when they end in a geminated -- consonant. The first element is the result after applying voicing/devoicing, -- gemination and other changes. The second element is the original spelling, -- so that we don't overmatch and get cases like Поттер. We check for these -- prefixes at the beginning of words and also preceded by ne-, po- and nepo-. -- The third element should be true if the prefix produces [žž] when assimilated -- to a following ж, otherwise omitted. We use this as part of the -- implementation of automatic ӂӂ pronunciation, which shouldn't happen at -- prefix boundaries. local geminate_pref = { --'abː', --'adː', {'be[szšž]ː', 'be[sz]', true}, --'braomː', {'[vf]ː', 'v'}, {'vo[szšž]ː', 'vo[sz]', true}, {'i[szšž]ː', 'i[sz]', true}, --'^inː', {'kontrː', 'kontr'}, {'superː', 'super'}, {'tran[szšž]ː', 'trans', true}, {'na[tdcč]ː', 'nad'}, {'ni[szšž]ː', 'ni[sz]', true}, {'o[tdcč]ː', 'ot'}, --'^omː', {'o[bp]ː', 'ob'}, {'obe[szšž]ː', 'obe[sz]', true}, {'po[tdcč]ː', 'pod'}, {'pre[tdcč]ː', 'pred'}, --'^paszː', '^pozː', {'ra[szšž]ː', 'ra[sz]', true}, {'[szšž]ː', '[sz]', true}, {'me[žš]ː', 'mež', true}, {'če?re[szšž]ː', 'če?re[sz]', true}, -- certain double prefixes involving ra[zs]- {'predra[szšž]ː', 'predra[sz]', true}, {'bezra[szšž]ː', 'bezra[sz]', true}, {'nara[szšž]ː', 'nara[sz]', true}, {'vra[szšž]ː', 'vra[sz]', true}, {'dora[szšž]ː', 'dora[sz]', true}, -- '^sverxː', '^subː', '^tröxː', '^četyröxː', }

local sztab = { s='cs', z='ĵz' } local function ot_pod_sz(pre, sz) return pre .. sztab[sz] end

-- Ad-hoc phonetic substitutions to apply. Each entry is a two-element list, -- the two arguments to 'rsub'. These are applied in order, and are -- carefully ordered to work correctly; don't reorder them unless you know -- what you're doing. This is called fairly early on, after transliterating, -- splitting on words, adding ⁀ at the beginning and end of all words, and -- applying a few other changes. It mostly implements various sorts of -- assimilations. local phonetic_subs = { {'h', 'ɣ'},

{'šč', 'ɕː'}, -- conversion of šč to geminate

-- the following group is ordered before changes that affect ts	{'n[dt]sk', 'n(t)sk'}, {'s[dt]sk', 'sck'}, -- -дцат- (in numerals) has optionally-geminated дц; if unstressed, -- pronounced as -дцыт- {'dca(' .. accents .. '?)t', function(accent) if accent == '' then return 'c(c)yt' else return 'c(c)a' .. accent .. 't'		end end },

-- Add / before цз, чж sequences (Chinese words) and assimilate чж {'cz', '/cz'}, {'čž', '/ĝž'},

-- main changes for affricate assimilation of [dt] + sibilant, including ts; -- we either convert to "short" variants t͡s, d͡z, etc. or to "long" variants -- t͡ss, d͡zz, etc. -- 1. т с, д з across word boundary, also т/с, д/з with explicitly written --   slash, use long variants. {'[dt](ʹ?[ ‿⁀/]+)s', 'c%1s'}, {'[dt](ʹ?[ ‿⁀/]+)z', 'ĵ%1z'}, -- 2. тс, дз + vowel use long variants. {'[dt](ʹ?)s(j?' .. vowels .. ')', 'c%1s%2'}, {'[dt](ʹ?)z(j?' .. vowels .. ')', 'ĵ%1z%2'}, -- 3. тьс, дьз use long variants. {'[dt]ʹs', 'cʹs'}, {'[dt]ʹz', 'ĵʹz'}, -- 4. word-initial от[сз]-, под[сз]- use long variants because there is --   a morpheme boundary. {'(⁀o' .. accents .. '?)t([sz])', ot_pod_sz}, {'(⁀po' .. accents .. '?)d([sz])', ot_pod_sz}, -- 5. other тс, дз use short variants. {'[dt]s', 'c'}, {'[dt]z', 'ĵ'}, -- 6. тш, дж always use long variants (FIXME, may change) {'[dtč](ʹ?[ %-‿⁀/]*)š', 'ĉ%1š'}, {'[dtč](ʹ?[ %-‿⁀/]*)ž', 'ĝ%1ž'}, -- 7. soften palatalized hard hushing affricates resulting from the previous {'ĉʹ', 'č'}, {'ĝʹ', 'ǰ'},

-- changes that generate ɕː and ɕč through assimilation: -- зч and жч become ɕː, as does сч at the beginning of a word and in the -- sequence счёт when not following [цдт] (подсчёт); else сч becomes ɕč -- (отсчи́тываться), as щч always does (рассчитáть written ращчита́ть) {'[cdt]sč', 'čɕː'}, {'ɕːč', 'ɕč'}, {'[zž]č', 'ɕː'}, {'[szšž]ɕː?', 'ɕː'}, {'⁀sč', '⁀ɕː'}, {'sč(j?[oi]' .. accents .. '?)t', 'ɕː%1t'}, {'sč', 'ɕč'},

-- misc. changes for assimilation of [dtsz] + sibilants and affricates {'[sz][dt]c', 'sc'}, {'([rn])[dt]([cč])', '%1%2'}, -- дц, тц, дч, тч + vowel always remain geminated, so mark this with ˑ; -- if not followed by a vowel, as in e.g. путч, use normal gemination -- (it will normally be degeminated) {'[dt]([cč])(' .. vowels .. ')', '%1ˑ%2'}, {'[dt]([cč])', '%1%1'}, -- the following is ordered before the next one, which applies assimilation -- of [тд] to щ (including across word boundaries) {'n[dt]ɕ', 'nɕ'}, -- [сз] and [сз]ь before soft affricates [щч], including across word -- boundaries; note that the common sequence сч has already been handled {'[zs]ʹ?([ ‿⁀/]*[ɕč])', 'ɕ%1'}, -- reduction of too many ɕ's, which can happen from the previous {'ɕɕː', 'ɕː'}, -- assimilation before [тдц] and [тдц]ь before щ {'[cdt]ʹ?([ ‿⁀/]*)ɕ', 'č%1ɕ'}, -- assimilation of [сз] and [сз]ь before [шж] {'[zs]([ ‿⁀/]*)š', 'š%1š'}, {'[zs]([ ‿⁀/]*)ž', 'ž%1ž'}, {'[zs]ʹ([ ‿⁀/]*)š', 'ɕ%1š'}, {'[zs]ʹ([ ‿⁀/]*)ž', 'ӂ%1ž'}, -- assimilation of [сз]ь before с[еияёю] (in imperatives esp. before ся) {'[zs]ʹs([eij])', 'sˑ%1'}, -- assimilation of [тд]ь before т[еияёю] (e.g. in imperatives esp. before те) {'[td]ʹt([eij])', 'tˑ%1'},

-- optional palatalization of palatalized labials before another consonant -- in [ст][еияёю] (esp. in imperatives before -те, -ся) -- FIXME, perhaps we should either generalize this or restrict it only -- to imperatives {'([mpbfv])ʹ([st][eij])', '%1(ʹ)%2'}, {'sverxi', 'sverxy'}, {'stʹd', 'zd'}, -- this will often become degeminated {'tʹd', 'dd'},

-- loss of consonants in certain clusters {'([ns])[dt]g', '%1g'}, {'zdn', 'zn'}, {'lnc', 'nc'}, {'[sz]t(li' .. accents .. '?v)', 's%1'}, {'[sz]tn', 'sn'}, {'lvstv', 'lstv'},

-- initial unstressed э -> и; should precede backing of /i/ in close juncture {'⁀ɛ([^' .. acc .. '])', '⁀i%1'}, -- unstressed э after a vowel -> и; repeated to handle the unlikely case -- where two ээ occur in a row; FIXME, this is a type of ikanye, and we	-- mostly implement ikanye later on using the chart in 'allophones', so	-- it would be nice to merge these two cases, but I can't think of an	-- obvious way to do it {'(' .. vowels .. accents .. '?)ɛ([^' .. acc .. '])', '%1i%2'}, {'(' .. vowels .. accents .. '?)ɛ([^' .. acc .. '])', '%1i%2'}, -- backing of /i/ after hard consonants in close juncture {'([mnpbtdkgfvszxɣrlšžcĵĉĝ])⁀‿⁀i', '%1⁀‿⁀y'}, }

local cons_assim_palatal = { -- assimilation of tn, dn, sn, zn, st, zd, nč, nɕ is handled specially compulsory = listToSet({'ntʲ', 'ndʲ', 'xkʲ',	   'csʲ', 'ĵzʲ', 'ncʲ', 'nĵʲ'}), optional = listToSet({'slʲ', 'zlʲ', 'nsʲ', 'nzʲ',		'mpʲ', 'mbʲ', 'mfʲ', 'fmʲ'}) }

-- words which will be treated as accentless (i.e. their vowels will be -- reduced), and which will liaise with a preceding or following word; -- this will not happen if the words have an accent mark, cf. -- по́ небу vs. по не́бу, etc. local accentless = { -- class 'pre': particles that join with a following word pre = listToSet({'bez', 'bliz', 'v', 'vo', 'da', 'do',      'za', 'iz', 'iz-pod', 'iz-za', 'izo', 'k', 'ko', 'mež',       'na', 'nad', 'nado', 'ne', 'ni', 'ob', 'obo', 'ot', 'oto',       'pered', 'peredo', 'po', 'pod', 'podo', 'pred', 'predo', 'pri', 'pro',       's', 'so', 'u', 'čerez'}), -- class 'prespace': particles that join with a following word, but only --  if a space (not a hyphen) separates them; hyphens are used here --  to spell out letters, e.g. а-эн-бэ́ for АНБ (NSA = National Security	--   Agency) or о-а-э́ for ОАЭ (UAE = United Arab Emirates) prespace = listToSet({'a', 'o'}), -- class 'post': particles that join with a preceding word post = listToSet({'by', 'b', 'ž', 'že', 'li', 'libo', 'lʹ', 'ka',	  'nibudʹ', 'tka'}), -- class 'posthyphen': particles that join with a preceding word, but only --  if a hyphen (not a space) separates them posthyphen = listToSet({'to'}), }

-- Pronunciation of final unstressed -е, depending on the part of speech and --  exact ending. Also used for pronunciation of -ться in imperatives vs. --  infinitives. -- -- Endings: --  oe = -ое --  ve = any other vowel plus -е (FIXME, may have to split out -ее) --  je = -ье --  softpaired = soft paired consonant + -е --  hardsib = hard sibilant (ц, ш, ж) + -е --  softsib = soft sibilant (ч, щ) + -е -- -- Parts of speech: --  def = default used in absence of pos --  n/noun = neuter noun in the nominative/accusative singular (but not ending --     in adjectival -ое or -ее; those should be considered as adjectives) --  pre = prepositional case singular --  dat = dative case singular (treated same as prepositional case singular) --  voc = vocative case (currently treated as 'mid') --  nnp = noun nominative plural in -е (гра́ждане, боя́ре, армя́не); not --    adjectival plurals in -ие or -ые, including adjectival nouns --    (да́нные, а́вторские) --  inv = invariable noun or other word (currently treated as 'mid') --  a/adj = adjective or adjectival noun (typically either neuter in -ое or --     -ее, or plural in -ие, -ые, or -ье, or short neuter in unpaired --     sibilant + -е) --  c/com = comparative (typically either in -ее or sibilant + -е) --  adv = adverb --  p = preposition (treated same as adverb) --  v/vb/verb = finite verbal form (usually 2nd-plural in -те), but not --    imperatives (use pos=imp) and not participle forms, which should be --     treated as adjectives --  pro = pronoun (кое-, какие-, ваше, сколькие) --  num = number (двое, трое, обе, четыре; currently treated as 'mid') --  pref = prefix (treated as 'high' because integral part of word) --  hi/high = force high values ([ɪ] or [ɨ]) --  mid = force mid values ([e] or [ɨ]) --  lo/low/schwa = force low, really schwa, values ([ə]) -- -- Possible values: --  1. ə [ə], e [e], i [ɪ] after a vowel or soft consonant --  2. ə [ə] or y [ɨ] after a hard sibilant -- -- If a part of speech doesn't have an entry for a given type of ending, --  it receives the default value. If a part of speech's entry is a string, --  it's an alias for another way of specifying the same part of speech --  (e.g. n=noun). local pos_properties = { def={oe='ə', ve='e', je='e', softpaired='e', hardsib='y', softsib='e', tsjapal='n'}, noun={oe='ə', ve='e', je='e', softpaired='e', hardsib='ə', softsib='e'}, n='noun', pre={oe='e', ve='e', softpaired='e', hardsib='y', softsib='e'}, dat='pre', voc='mid', nnp={softpaired='e'}, -- FIXME, not sure about this inv='mid', --FIXME, not sure about this (e.g. вице-, кофе) adj={oe='ə', ve='e', je='ə'}, -- FIXME: Not sure about -ее, e.g. neut adj си́нее; FIXME, not sure about short neuter adj, e.g. похо́же from похо́жий, дорогосто́яще from дорогосто́ящий, should this be treated as neuter noun? a='adj', com={ve='e', hardsib='y', softsib='e'}, c='com', adv={softpaired='e', hardsib='y', softsib='e'}, p='adv', --FIXME, not sure about prepositions verb={softpaired='e'}, v='verb', vb='verb', -- Imperatives like other verbs except that final -ться is palatalized imp={softpaired='e', tsjapal='y'}, impv='imp', pro={oe='i', ve='i'}, --FIXME, not sure about ваше, сколькие, какие-, кое- num='mid', --FIXME, not sure about обе pref='high', -- forced values high={oe='i', ve='i', je='i', softpaired='i', hardsib='y', softsib='i'}, hi='high', mid={oe='e', ve='e', je='e', softpaired='e', hardsib='y', softsib='e'}, low={oe='ə', ve='ə', je='ə', softpaired='ə', hardsib='ə', softsib='ə'}, lo='low', schwa='low' }

local function track(page) local m_debug = require("Module:debug") m_debug.track("ru-pron/" .. page) return true end

-- remove accents that we don't want to appear in the phonetic respelling function phon_respelling(text, remove_grave) text = rsub(text, '[' .. CFLEX .. DUBGR .. DOTABOVE .. DOTBELOW .. '‿]', '') -- Remove grave accents from annotations but maybe not from phonetic respelling if remove_grave then text = com.remove_grave_accents(text) end return text end

-- Direct implementation of. function export.ru_IPA(frame) local parent_args = frame:getParent.args local params = { [1] = {},		phon = {}, pos = {}, gem = {}, ann = {}, noadj = {type = "boolean"}, noshto = {type = "boolean"}, raw = {type = "boolean"}, zhpal = {type = "boolean"}, -- treated as 3-way: true, false, nil bracket = {type = "boolean", default = "true"}, a = {type = "labels"}, aa = {type = "labels"}, q = {type = "qualifier"}, qq = {type = "qualifier"}, }

local args = require("Module:parameters").process(parent_args, params)

local text = args[1] or args.phon or mw.loadData("Module:headword/data").pagename local origtext, transformed_text = m_ru_translit.apply_tr_fixes(text, args.noadj, args.noshto) local pronunciations = export.ipa(transformed_text, args.adj, args.gem, args.bracket, args.pos, args.zhpal,		"transformed") local maintext if args.raw then return table.concat(pronunciations, ", ") else local anntext = (args.ann == "y" and "" .. phon_respelling(text, "remove grave") .. ":&#32;" or			args.ann and "" .. args.ann .. ":&#32;" or			"") local lang = require("Module:languages").getByCode("ru") for i, pronunciation in ipairs(pronunciations) do			pronunciations[i] = { pron = pronunciation } end maintext = require("Module:IPA").format_IPA_full { lang = lang, items = pronunciations, a = args.a,			aa = args.aa, q = args.q,			qq = args.qq, separator = " ~ ", }		local respelling if args.phon then respelling = args.phon elseif origtext ~= transformed_text then respelling = transformed_text end local respelling_text = "" if respelling then respelling = phon_respelling(respelling, remove_grave_accents_from_phonetic_respelling) respelling_text = respelling and " (phonetic respelling: " .. require("Module:script utilities").tag_text(respelling, lang) .. ")" end return anntext .. maintext .. respelling_text end end

-- Forward function declarations local ru_ipa_main

-- Return the actual IPA corresponding to Cyrillic text. ADJ, GEN, BRACKET -- POS and ZHPAL are as in Template:ru-IPA. If IS_TRANFORMED is true, the -- text has already been passed through m_ru_translit.apply_tr_fixes; -- otherwise, this will be done. Note that the return value is a list of one or -- more valid pronunciations. function export.ipa(text, adj, gem, bracket, pos, zhpal, is_transformed) local new_module_result -- Test code to compare existing module to new one. if test_new_ru_pron_module then local m_new_ru_pron = require("Module:User:Benwing2/ru-pron") new_module_result = m_new_ru_pron.ipa(text, adj, gem, bracket, pos, zhpal, is_transformed) end

if type(text) == "table" then local params = { [1] = {},			phon = {}, adj = {type = "boolean"}, gem = {}, bracket = {type = "boolean", default = "true"}, pos = {}, zhpal = {type = "boolean"}, }		local args = require("Module:parameters").process(text, params) text, adj, gem, bracket, pos, zhpal = (args.phon or args[1]), args.adj, args.gem, args.bracket, args.pos, args.zhpal if not text then text = mw.loadData("Module:headword/data").pagename end end

if not is_transformed then local origtext, transformed_text = m_ru_translit.apply_tr_fixes(text) text = transformed_text end gem = gem or "" -- If a multipart gemination spec, split into components. if rfind(gem, "/") then gem = split(gem, "/", true) for i=1,#gem do			gem[i] = usub(gem[i], 1, 1) end else gem = usub(gem, 1, 1) end -- Verify that gem (or each part of multipart gem) is recognized for _, g in ipairs(type(gem) == "table" and gem or {gem}) do		if g ~= "" and g ~= "y" and g ~= "o" and g ~= "n" then error("Unrecognized gemination spec '" .. g .. ": Should be y, yes, o, opt, n, no, or empty") end end

pos = pos or "def" -- If a multipart part of speech, split into components, and convert -- each blank component to the default. if rfind(pos, "/") then pos = split(pos, "/", true) for i=1,#pos do			if pos[i] == "" then pos[i] = "def" end end end -- Verify that pos (or each part of multipart pos) is recognized for _, p in ipairs(type(pos) == "table" and pos or {pos}) do		if not pos_properties[p] then error("Unrecognized part of speech '" .. p .. "': Should be n/noun/neut, a/adj, c/com, pre, dat, adv, inv, voc, v/verb, pro, hi/high, mid, lo/low/schwa or omitted") end end

text = ulower(text)

local combined_gem = type(gem) == "table" and table.concat(gem, "/") or gem if combined_gem ~= "" then track("gem") track("gem/" .. combined_gem) end if adj then track("adj") end -- don't include h here because we allow it as a legitimate alternative -- for ɣ. Include vowels with all of the accents that have special meaning -- for this module. (FIXME, maybe should also include double-grave accents,	-- although probably not used anywhere.) if rfind(text, "[a-gi-zščžáéíóúýàèìòùỳâêîôûŷạẹịọụỵȧėȯẏ]") then track("latin-text") end if rfind(text, "[сз]ч") then track("sch") end if rfind(text, "[шж]ч") then track("shch") end if rfind(text, CFLEX) then track("cflex") end if rfind(text, DUBGR) then track("dubgr") end

text = rsub(text, "``", DUBGR) text = rsub(text, "`", GR) text = rsub(text, "@", DOTABOVE) text = rsub(text, "%^", CFLEX) text = rsub(text, DUBGR, CFLEX)

-- translit doesn't always convert э to ɛ (depends on whether a consonant	-- precedes), so do it ourselves before translit text = rsub(text, 'э', 'ɛ') -- vowel + йе should have double jj, but the translit module will translit -- it the same as vowel + е, so do it ourselves before translit text = rsub(text, '([' .. com.vowel .. ']' .. com.opt_accent .. ')й([еѐ])',		'%1йй%2') -- transliterate and decompose Latin vowels with accents, recomposing -- certain key combinations; don't include accent on monosyllabic ё, so -- that we end up without an accent on such words. NOTE: Not clear we	-- need to be decomposing like this any more, although it is still -- useful if the user supplies Latin text, which we allow (although	-- undocumented). text = com.decompose(m_ru_translit.tr_after_fixes(text))

-- handle old ě (e.g. сѣдло́), ǒ (e.g. сѣ̈дла) and ǫ (e.g. ея̈) text = text:gsub("ě", "e") :gsub("ǒ", "o") :gsub("ǫ", "o") -- handle sequences of accents (esp from ё with secondary/tertiary stress) text = rsub(text, accents .. '+(' .. accents .. ')', '%1')

-- convert commas and en/en dashes to IPA foot boundaries text = rsub(text, '%s*[,–—]%s*', ' | ')

-- canonicalize multiple spaces text = rsub(text, '%s+', ' ')

-- Add primary stress to single-syllable words preceded or followed by -- unstressed particle or preposition. Add "tertiary" stress to remaining -- single-syllable words that aren't a particle, preposition, prefix or	-- suffix and don't already bear an accent (including force-reduction	-- accents, i.e. dot-above/dot-below); "tertiary stress" means a vowel is	-- treated as stressed for the purposes of vowel reduction but isn't	-- marked with a primary or secondary stress marker; we repurpose a	-- circumflex for this purpose. We need to preserve the distinction -- between spaces and hyphens because (1) we only recognize certain -- post-accentless particles following a hyphen (to distinguish e.g.	-- 'то' from '-то'); (2) we only recognize certain pre-accentless -- particles preceding a space (to distinguish particles 'о' and 'а' from	-- spelled letters о and а, which should not be reduced); and (3) we	-- recognize hyphens for the purpose of marking unstressed prefixes and -- suffixes. local word = split(text, "([ %-]+)") for i = 1, #word do		-- check for single-syllable words that need a stress; they must meet -- the following conditions: -- 1. must not be an accentless word, which is any of the following: --        1a. in the "pre" class, or		if not (accentless['pre'][word[i]] or				-- 1b. in the "prespace" class if followed by space and another word, or				i < #word - 1 and accentless['prespace'][word[i]] and word[i+1] == " " or				-- 1c. in the "post" class if preceded by another word and				--    not followed by a hyphen (this is because words like --    ка and же are also used for spelling initialisms), or				i > 2 and accentless['post'][word[i]] and word[i+1] ~= "-" or				-- 1d. in the "posthyphen" class preceded by a hyphen and another word				--     (and not followed by a hyphen, see 1c);				i > 2 and accentless['posthyphen'][word[i]] and word[i-1] == "-" and word[i+1] ~= "-") and -- 2. must be one syllable; ulen(rsub(word[i], '[^' .. vow .. ']', '')) == 1 and -- 3. must not have any accents (including dot-above, forcing reduction); not rfind(word[i], accents) and -- 4. must not be a prefix or suffix, identified by a preceding or trailing hyphen, i.e. one of the following: --        4a. utterance-initial preceded by a hyphen, or			not (i == 3 and word[2] == "-" and word[1] == "" or			   -- 4b. non-utterance-initial preceded by a hyphen, or				i >= 3 and word[i-1] == " -" or			    -- 4c. utterance-final followed by a hyphen, or				i == #word - 2 and word[i+1] == "-" and word[i+2] == "" or			    -- 4d. non-utterance-final followed by a hyphen;				i <= #word - 2 and word[i+1] == "- ") then

-- OK, we have a stressable single-syllable word; either add primary -- or tertiary stress: -- 1. add primary stress if preceded or followed by an accentless word, if (i > 2 and accentless['pre'][word[i-2]] or				i > 2 and word[i-1] == " " and accentless['prespace'][word[i-2]] or				i < #word - 1 and accentless['post'][word[i+2]] and word[i+3] ~= "-" or				i < #word - 1 and word[i+1] == "-" and accentless['posthyphen'][word[i+2]] and word[i+3] ~= "-") then word[i] = rsub(word[i], vowels_c, '%1' .. AC) -- 2. else add tertiary stress else word[i] = rsub(word[i], vowels_c, '%1' .. CFLEX) end end end

-- count number of words and make sure we have correct number of	-- gemination and part-of-speech specs if a multipart spec is given local num_real_words = 0 for i = 1, #word do		if (i % 2) == 1 and word[i] ~= "" then num_real_words = num_real_words + 1 end end if type(gem) == "table" and #gem ~= num_real_words then error("Number of gemination specs (" .. #gem .. ") should match number of words (" .. num_real_words .. ")")	end if type(pos) == "table" and #pos ~= num_real_words then error("Number of parts of speech (" .. #pos .. ") should match number of words (" .. num_real_words .. ")")	end

-- make unaccented prepositions and particles liaise with the following or	-- preceding word; in the process, fix up number of elements in gem/pos -- tables so there's a single element for the combined word local real_word_index = 0 for i = 1, #word do		if (i % 2) == 1 and word[i] ~= "" then real_word_index = real_word_index + 1 end if i < #word - 1 and (accentless['pre'][word[i]] or accentless['prespace'][word[i]] and word[i+1] == " ") and -- don't add ‿ onto the end of a prefix; a prefix is a word followed by a hyphen that is in turn -- followed by a space or end of terms; note that ends of terms after a hyphen are marked by a blank -- string due to the way split works not (word[i+1] == "-" and (word[i+2] == " " or word[i+2] == "" and i == #word - 2)) then word[i+1] = '‿' if type(gem) == "table" then table.remove(gem, real_word_index) end if type(pos) == "table" then table.remove(pos, real_word_index) end elseif i > 2 and (accentless['post'][word[i]] and word[i+1] ~= "-" or				accentless['posthyphen'][word[i]] and word[i-1] == "-" and word[i+1] ~= "-") then word[i-1] = '‿' -- for unaccented words that liaise with the preceding word, -- remove the gemination spec corresponding to the unaccented word -- because the gemination in question is almost certainly in the -- preceding word, but remove the POS spec corresponding to the -- preceding word because it's the final -е of the unaccented word -- that the POS will refer to			if type(gem) == "table" then table.remove(gem, real_word_index) end if type(pos) == "table" then table.remove(pos, real_word_index - 1) end end end

-- rejoin words, convert hyphens to spaces and eliminate stray spaces -- resulting from this; but convert hyphens at the beginning of suffixes -- to a pseudoconsonant, so we treat vowels at the beginning of suffixes -- as if they are followed by a consonant, not word-initial. Similarly -- convert hyphens at the end of prefixes to a pseudoconsonant. text = table.concat(word, "") text = rsub(text, '^%-', PSEUDOCONS) text = rsub(text, '%s%-', ' ' .. PSEUDOCONS) text = rsub(text, '%-$', PSEUDOCONS) text = rsub(text, '%-%s', PSEUDOCONS .. ' ') text = rsub(text, '[%-%s]+', ' ') text = rsub(text, '^ ', '') text = rsub(text, ' $', '')

-- add a ⁀ at the beginning and end of every word and at close juncture -- boundaries; we will remove this later but it makes it easier to do	-- word-beginning and word-end rsubs text = rsub(text, ' ', '⁀ ⁀') text = rsub(text, '([!?])', '⁀%1⁀') text = '⁀' .. text .. '⁀'	text = rsub(text, '‿', '⁀‿⁀')

-- At this point, the spelling has been normalized (see the comment to	-- ru_ipa_main below). Now we need to handle any pronunciation-spelling -- variants (particularly, handling зж and жж, which have both	-- non-palatalized and palatalized variants except at prefix boundaries) -- and convert each variant to IPA.

local alltext

-- If zž or žž occur not at a prefix boundary, then generate two variants, -- the first with non-palatal [ʐː] and the second with [ʑː] (potentially	-- with nearby vowels affected appropriately for the palatalization	-- difference). But don't do this if zhpal=n. if zhpal == false or not rfind(text, 'ž') then -- speed up the majority of cases where ž doesn't occur alltext = {text} else -- First, go through and mark all prefix boundaries where a ž directly -- follows the prefix by inserting a ˑ between prefix and ž. This -- prevents us from generating the [ʑː] variant (notated internally as		-- ӂӂ). Don't do this if zhpal=y, which defeats this check. if zhpal ~= true then for _, gempref in ipairs(geminate_pref) do				local origspell = gempref[2] local is_zh = gempref[3] if is_zh then -- allow all vowels to have accents following them origspell = rsub(origspell, vowels_c, '%1' .. accents .. '?') text = rsub(text, '(⁀' .. origspell .. ')ž', '%1ˑž') text = rsub(text, '(⁀po' .. origspell .. ')ž', '%1ˑž') text = rsub(text, '(⁀ne' .. origspell .. ')ž', '%1ˑž') text = rsub(text, '(⁀nepo' .. origspell .. ')ž', '%1ˑž') end end end -- Then, if zž or žž are present (which will exclude prefix boundaries		-- because a ˑ marker will intervene), generate the two possibilities, -- else generate only one. local alltext1 if rfind(text, '[zž]ž') then alltext1 = {text, rsub(text, '[zž]ž', 'ӂӂ')} else alltext1 = {text} end -- Finally, remove the ˑ marker. alltext = {} for _, text in ipairs(alltext1) do			table.insert(alltext, rsub(text, 'ˑ', '')) end end

-- Now generate the pronunciation(s) for each of the spelling variants -- we generate above. (In some cases there are multiple pronunciation	-- variants generated, e.g. in the sequence palatalized consonant + a/u +	-- optionally palatalized consonant.) local allpron = {} for _, text in ipairs(alltext) do		local thispron = ru_ipa_main(text, adj, gem, bracket, pos) for _, pron in ipairs(thispron) do			table.insert(allpron, pron) end end

-- Handle test_new_ru_pron_module if specified (tracking for changed	-- pronunciations). if test_new_ru_pron_module then local string_version = table.concat(allpron, ", ") if new_module_result ~= string_version then --error(string_version .. " || " .. new_module_result) track("different-pron") else track("same-pron") end end

return allpron end

-- Convert normalized spelling into actual pronunciation. Return value is a -- list of one or more valid pronunciations. "Normalized" means that various -- normalization transformations have been applied, e.g. -- (1) text is transliterated and accents decomposed; -- (2) ‿ is added where appropriate to join clitics to normally-stressed words; -- (3) ⁀ is added at the beginning and end of all words; -- (4) primary or tertiary stress may have been added to single-syllable words --    as appropriate; -- (5) punctuation is removed and replaced with spaces and/or IPA foot --    boundaries; -- (6) etc. -- Note that normalization does *not* implement assimilations, conversion of -- vowels or consonants to their IPA equivalents, or other intra-word changes. ru_ipa_main = function(text, adj, gem, bracket, pos) -- save original word spelling before respellings, (de)voicing changes, -- geminate changes, etc. for implementation of geminate_pref local orig_word = split(text, " ", true) local word -- remove any apostrophes, since any still present at this stage -- are purely cosmetic (e.g. in foreign names) -- any apostrophes in the input that are standing in for hard signs -- should have already been dealt with by the transliteration -- module text = rsub(text, '[\'’]', '') -- insert or remove /j/ before [aou] so that palatal versions of these -- vowels are always preceded by /j/ and non-palatal versions never are -- (do this before the change below adding tertiary stress to final	-- palatal о): -- (1) Non-palatal [ou] after always-hard шж (e.g. in брошю́ра, жю́ри) --    despite the spelling (FIXME, should this also affect [a]?) text = rsub(text, '([šž])j([ou])', '%2%3') -- (2) Palatal [aou] after always-soft щчӂ and voiced variant ǰ (NOTE:	--    this happens before the change šč -> ɕː in phonetic_subs) text = rsub(text, '([čǰӂ])([aou])', '%1j%2') -- (3) ьо is pronounced as ьйо, i.e. like (possibly unstressed) ьё, e.g.	--    in Асунсьо́н text = rsub(text, 'ʹo', 'ʹjo')

-- add tertiary stress to some final -о (this needs to be done before	-- eliminating dot-above, after adding ⁀, after adding /j/ before palatal о): -- (1) after vowels, e.g. То́кио text = rsub(text, '(' .. vowels .. accents .. '?o)⁀', '%1' .. CFLEX .. '⁀') -- (2) when palatal, e.g. ра́нчо, га́учо, ма́чо, Ога́йо text = rsub(text, 'jo⁀', 'jo' .. CFLEX .. '⁀')

-- eliminate dot-above, which has served its purpose of preventing any -- sort of stress (needs to be done after adding tertiary stress to	-- final -о) text = rsub(text, DOTABOVE, '') -- eliminate dot-below (needs to be done after changes above that insert	-- j before [aou] after always-soft щчӂ) text = rsub(text, 'ja' .. DOTBELOW, 'jạ') if rfind(text, DOTBELOW) then error("Dot-below accent can only be placed on я or palatal а") end

text = adj and rsub(text, '(.[aoe]́?)go(' .. AC .. '?)⁀', '%1vo%2⁀') or text text = adj and rsub(text, '(.[aoe]́?)go(' .. AC .. '?)sja⁀', '%1vo%2sja⁀') or text

function fetch_pos_property(i, ending) local thispos = type(pos) == "table" and pos[i] or pos local chart = pos_properties[thispos] while type(chart) == "string" do -- handle aliases chart = pos_properties[chart] end assert(type(chart) == "table") local sub = chart[ending] or pos_properties['def'][ending] assert(sub) return sub end

-- Pos-specific handling of final -ться: palatalized if pos=imp, else not -- (infinitives). If we have multiple parts of speech, we need to be -- trickier, splitting by word. local function final_tsja_processing(pron, i)		local tsjapal = fetch_pos_property(i, 'tsjapal') if tsjapal == 'n' then -- FIXME!!! Should these also pay attention to grave accents? pron = rsub(pron, '́tʹ?sja⁀', '́cca⁀') pron = rsub(pron, '([^́])tʹ?sja⁀', '%1ca⁀') end return pron end if type(pos) == "table" then --split by word and process each word word = split(text, " ", true) for i = 1, #word do			word[i] = final_tsja_processing(word[i], i)		end text = table.concat(word, " ") else text = final_tsja_processing(text, 1) end

--phonetic substitutions of various sorts for _, phonsub in ipairs(phonetic_subs) do		text = rsub(text, phonsub[1], phonsub[2]) end

--voicing, devoicing --NOTE: v before an obstruent assimilates in voicing and triggers voicing --assimilation of a preceding consonant; neither happens before a sonorant --1. absolutely final devoicing text = rsub(text, '([bdgvɣzžĝĵǰӂ])(ʹ?⁀)$', function(a, b)		return devoicing[a] .. b end) --2. word-final devoicing before another word text = rsub(text, '([bdgvɣzžĝĵǰӂ])(ʹ?⁀ ⁀[^bdgɣzžĝĵǰӂ])', function(a, b)		return devoicing[a] .. b end) --3. voicing/devoicing assimilation; repeat to handle recursive assimilation while true do		local new_text = rsub(text, '([bdgvɣzžĝĵǰӂ])([ ‿⁀ʹːˑ/]*[ptkfxsščɕcĉ])', function(a, b)			return devoicing[a] .. b end) new_text = rsub(new_text, '([ptkfxsščɕcĉ])([ ‿⁀ʹːˑ/]*v?[ ‿⁀ʹːˑ/]*[bdgɣzžĝĵǰӂ])', function(a, b)			return voicing[a] .. b end) if new_text == text then break end text = new_text end

--re-notate orthographic geminate consonants text = rsub(text, '([^' .. vow .. '.%-_])' .. '%1', '%1ː') text = rsub(text, '([^' .. vow .. '.%-_])' .. '%(%1%)', '%1(ː)')

--rewrite iotated vowels text = rsub(text, '(j[%(ːˑ%)]*)([aeou])', function(a, b)		return a .. iotating[b] end) -- eliminate j after consonant and before iotated vowel (including	-- semi-reduced ạ) text = rsub(text, '([^' .. vow .. acc .. 'ʹʺ‿⁀ ]/?)j([äạëöü])', '%1%2')

--split by word and process each word word = split(text, " ", true)

for i = 1, #word do		local pron = word[i]

-- Check for gemination at prefix boundaries; if so, convert the -- regular gemination symbol ː to a special symbol ˑ that indicates -- we always preserve the gemination unless gem=n. We look for -- certain sequences at the beginning of a word, but make sure that -- the original spelling is appropriate as well (see comment above		-- for geminate_pref). if rfind(pron, 'ː') then -- optimize by only doing when gemination present local orig_pron = orig_word[i] local deac = rsub(pron, accents, '') local orig_deac = rsub(orig_pron, accents, '') -- the following two are optimizations to reduce the number of regex -- checks in the majority of cases with words not beginning with ne- -- or po-. local is_ne = rfind(orig_deac, '⁀ne') local is_po = rfind(orig_deac, '⁀po') for _, gempref in ipairs(geminate_pref) do				local newspell = gempref[1] local oldspell = gempref[2] -- FIXME! The rsub below will be incorrect if there is				-- gemination in a joined preposition or particle if rfind(orig_deac, '⁀' .. oldspell) and rfind(deac, '⁀' .. newspell) or is_po and rfind(orig_deac, '⁀po' .. oldspell) and rfind(deac, '⁀po' .. newspell) or is_ne and rfind(orig_deac, '⁀ne' .. oldspell) and rfind(deac, '⁀ne' .. newspell) or is_ne and rfind(orig_deac, '⁀nepo' .. oldspell) and rfind(deac, '⁀nepo' .. newspell) then pron = rsub(pron, '(⁀[^‿⁀ː]*)ː', '%1ˑ') end end end

--degemination, optional gemination local thisgem = type(gem) == "table" and gem[i] or gem if thisgem == 'y' then -- leave geminates alone, convert ˑ to regular gemination; ˑ is a			-- special gemination symbol used at prefix boundaries that we			-- remove only when gem=n, else we convert it to regular gemination pron = rsub(pron, 'ˑ', 'ː') elseif thisgem == 'o' then -- make geminates optional, except for ɕӂ, also ignore left paren -- in (ː) sequence pron = rsub(pron, '([^ɕӂ%(%)])[ːˑ]', '%1(ː)') elseif thisgem == 'n' then -- remove gemination, except for ɕӂ pron = rsub(pron, '([^ɕӂ%(%)])[ːˑ]', '%1') else -- degeminate l's			pron = rsub(pron, '(l)ː', '%1') -- preserve gemination between vowels immediately after the stress, -- special gemination symbol ˑ also remains, ɕӂ remain geminated, -- žn remain geminated between vowels even not immediately after -- the stress, n becomes optionally geminated when after but not -- immediately after the stress, ssk and zsk remain geminated -- immediately after the stress, else degeminate; we signal that -- gemination should remain by converting to special symbol ˑ, -- then removing remaining ː not after ɕӂ and left paren; do			-- various subs repeatedly in case of multiple geminations in a word -- 1. immediately after the stress pron = rsub_repeatedly(pron, '(' .. vowels .. stress_accents .. '[^ɕӂ%(%)])ː(' .. vowels .. ')', '%1ˑ%2') -- 2. remaining geminate n after the stress between vowels pron = rsub_repeatedly(pron, '(' .. stress_accents .. '.-' .. vowels .. accents .. '?n)ː(' .. vowels .. ')', '%1(ː)%2') -- 3. remaining ž and n between vowels pron = rsub_repeatedly(pron, '(' .. vowels .. accents .. '?[žn])ː(' .. vowels .. ')', '%1ˑ%2') -- 4. ž word initially before vowels (жжение, жжём, etc.) pron = rsub_repeatedly(pron, '(⁀ž)ː(' .. vowels .. ')', '%1ˑ%2') -- 5. ssk (and zsk, already normalized) immediately after the stress pron = rsub(pron, '(' .. vowels .. stress_accents .. '[^' .. vow .. ']*s)ː(k)', '%1ˑ%2') -- 6. eliminate remaining gemination, except for ɕː and ӂː pron = rsub(pron, '([^ɕӂ%(%)])ː', '%1') -- 7. convert special gemination symbol ˑ to regular gemination pron = rsub(pron, 'ˑ', 'ː') end

-- handle soft and hard signs, assimilative palatalization -- 1. insert j before i when required pron = rsub(pron, 'ʹi', 'ʹji') -- 2. insert glottal stop after hard sign if required pron = rsub(pron, 'ʺ([aɛiouy])', 'ʔ%1') -- 3. (ь) indicating optional palatalization pron = rsub(pron, '%(ʹ%)', '⁽ʲ⁾') -- 4. assimilative palatalization of consonants when followed by		--   front vowels or soft sign pron = rsub(pron, '([mnpbtdkgfvszxɣrl' .. PSEUDOCONS ..'])([ː]*[eiäạëöüʹ])', '%1ʲ%2') pron = rsub(pron, '([cĵ])([ː]*[äạöüʹ])', '%1ʲ%2') -- 5. remove hard and soft signs pron = rsub(pron, "[ʹʺ]", "")

-- reduction of unstressed word-final -я, -е; but special-case -- unstressed не, же. Final -я always becomes [ə]; final -е may -- become [ə], [e], [ɪ] or [ɨ] depending on the part of speech and -- the preceding consonants/vowels. pron = rsub(pron, '[äạ]⁀', 'ə⁀') pron = rsub(pron, '⁀nʲe⁀', '⁀nʲi⁀') pron = rsub(pron, '⁀že⁀', '⁀žy⁀') -- function to fetch the appropriate value for ending and part of		-- speech, handling aliases and defaults and converting 'e' to 'ê' -- so that the unstressed [e] sound is preserved function fetch_e_sub(ending) local sub = fetch_pos_property(i, ending) if sub == 'e' then -- add TEMPCFLEX (which will be converted to CFLEX) to preserve -- the unstressed [e] sound, which will otherwise be converted -- to [ɪ]; we do this instead of adding CFLEX directly because -- we later convert some instances of the resulting 'e' to				-- 'i', and we don't want to do this when the user explicitly -- wrote a Cyrillic е with a circumflex on it. [NOTE that -- formerly applied when we added CFLEX directly: DO NOT -- use ê here directly because it's a single composed char, -- when we need the e and accent to be separate.] return 'e' .. TEMPCFLEX else return sub end end if new_final_e_code then -- as requested by Atitarev, final unstressed -ɛ should be unreduced pron = rsub(pron, 'ɛ⁀', 'ɛ' .. TEMPCFLEX .. '⁀') -- handle substitutions in two parts, one for vowel+j+e sequences -- and the other for cons+e sequences pron = rsub(pron, vowels_c .. '(' .. accents .. '?j)ë⁀', function(v, ac)				 local ty = v == 'o' and 'oe' or 've'				 return v .. ac .. fetch_e_sub(ty) .. '⁀'			end) -- consonant may palatalized, geminated or optional-geminated pron = rsub(pron, '(.)(ʲ?[ː]*)[eë]⁀', function(ch, mod)				 local ty = ch == 'j' and 'je' or					rfind(ch, '[cĵšžĉĝ]') and 'hardsib' or					rfind(ch, '[čǰɕӂ]') and 'softsib' or					'softpaired'				 return ch ..mod .. fetch_e_sub(ty) .. '⁀'			end) if final_e_non_pausal then -- final [e] should become [ɪ] when not followed by pause or				-- end of utterance (in other words, followed by space plus				-- anything but a pause symbol, or followed by tie bar). pron = rsub(pron, 'e' .. TEMPCFLEX .. '⁀‿', 'i⁀‿') if i < #word and word[i+1] ~= '⁀|⁀' then pron = rsub(pron, 'e' .. TEMPCFLEX .. '⁀$', 'i⁀') end end -- now convert TEMPCFLEX to CFLEX; we use TEMPCFLEX so the previous -- two regexps won't affect cases where the user explicitly wrote -- a circumflex pron = rsub(pron, TEMPCFLEX, CFLEX) else -- Do the old way, which mostly converts final -е to schwa, but -- has highly broken retraction code for vowel + [шжц] + е (but			-- not with accent on vowel!) before it that causes final -е in -- this circumstance to become [ɨ], and a special hack for кое-. pron = rsub(pron, vowels_c .. '([cĵšžĉĝ][ː]*)[eë]', '%1%2ɛ') pron = rsub(pron, '⁀ko(' .. stress_accents .. ')jë⁀', '⁀ko%1ji⁀') pron = rsub(pron, '[eë]⁀', 'ə⁀') end

-- retraction of е and и after цшж pron = rsub(pron, '([cĵšžĉĝ][ː]*)([ei])', function(a, b)			return a .. retracting[b] end)

--syllabify, inserting @ at syllable boundaries --1. insert @ after each vowel pron = rsub(pron, '(' .. vowels .. accents .. '?)', '%1@')		--2. eliminate word-final @ pron = rsub(pron, '@+⁀$', '⁀') --3. move @ forward directly before any ‿⁀, as long as at least --  one consonant follows that; we will move it across ‿⁀ later pron = rsub(pron, '@([^@' .. vow .. acc .. ']*)([‿⁀]+[^‿⁀@' .. vow .. acc .. '])', '%1@%2')		--4. in a consonant cluster, move @ forward so it's before the --  last consonant pron = rsub(pron, '@([^‿⁀@' .. vow .. acc .. ']*)([^‿⁀@' .. vow .. acc .. 'ːˑʲ]ʲ?[ːˑ]*‿?[' .. vow .. acc .. '])', '%1@%2')		--5. move @ backward if in the middle of a "permanent onset" cluster, --  e.g. sk, str, that comes before a vowel, putting the @ before --  the permanent onset cluster pron = rsub(pron, '([^‿⁀@_' .. vow .. acc .. ']?)(_*)([^‿⁀@_' .. vow .. acc .. '])(_*)@([^‿⁀@' .. vow .. acc .. 'ːˑʲ])(ʲ?[ːˑ]*[‿⁀]*[' .. vow .. acc .. '])', function(a, aund, b, bund, c, d)			if perm_syl_onset[a .. b .. c] or c == 'j' and rfind(b, '[čǰɕӂʲ]') then				return '@' .. a .. aund .. b .. bund .. c .. d			elseif perm_syl_onset[b .. c] then				return a .. aund .. '@' .. b .. bund .. c .. d			end end) --6. if / is present (explicit syllable boundary), remove any @ --  (automatic boundary) and convert / to @ if rfind(pron, '/') then pron = rsub(pron, '[^' .. vow .. acc .. ']+', function(x)				if rfind(x, '/') then					x = rsub(x, '@', '')					x = rsub(x, '/', '@')				end				return x			end) end --7. remove @ followed by a final consonant cluster pron = rsub(pron, '@([^‿⁀@' .. vow .. ']+⁀)$', '%1')		--8. remove @ preceded by an initial consonant cluster (should only		--  happen when / is inserted by user or in цз, чж sequences) pron = rsub(pron, '^(⁀[^‿⁀@' .. vow .. ']+)@', '%1')		--9. make sure @ isn't directly before linking ‿⁀ pron = rsub(pron, '@([‿⁀]+)', '%1@')

-- handle word-initial unstressed o and a; note, vowels always -- followed by at least one char because of word-final ⁀ -- do after syllabification because syllabification doesn't know -- about ɐ as a vowel pron = rsub(pron, '^⁀[ao]([^' .. acc .. '])', '⁀ɐ%1')

--split by syllable local syllable = split(pron, '@', true)

--create set of 1-based syllable indexes of stressed syllables --(acute, grave, circumflex) local stress = {} for j = 1, #syllable do			if rfind(syllable[j], stress_accents) then stress[j] = "real" elseif rfind(syllable[j], CFLEX) then stress[j] = "cflex" end end

-- iterate syllable by syllable to handle stress marks, vowel allophony local syl_conv = {} for j = 1, #syllable do			local syl = syllable[j]

local alnum

--vowel allophony if stress[j] then -- convert acute/grave/circumflex accent to appropriate -- IPA marker of primary/secondary/unmarked stress alnum = 1 syl = rsub(syl, '(.*)́', 'ˈ%1') syl = rsub(syl, '(.*)̀', 'ˌ%1') syl = rsub(syl, CFLEX, '') elseif stress[j+1] == "real" then -- special-casing written а immediately before the stress, -- but only for primary/secondary stress, not circumflex alnum = 2 else alnum = 3 end syl = rsub(syl, vowels_c, function(a)				if a ~= '' then					return allophones[a][alnum]				end end) syl_conv[j] = syl end

pron = table.concat(syl_conv, "")

-- Optional (j) before ɪ, which is always unstressed; not following -- consonant across a joined word boundary pron = rsub(pron, '([^' .. ipa_vow .. ']⁀‿⁀)jɪ', '%1' .. TEMPSUB .. 'ɪ') pron = rsub(pron, '⁀jɪ', '⁀(j)ɪ') pron = rsub(pron, '([' .. ipa_vow .. '])jɪ', "%1(j)ɪ") pron = rsub(pron, TEMPSUB, 'j')

--consonant assimilative palatalization of tn/dn/sn/zn, depending on		--whether [rl] precedes pron = rsub(pron, '([rl]?)([ːˈˌ]*[dtsz])([ːˈˌ]*nʲ)', function(a, b, c)			if a == '' then				return a .. b .. 'ʲ' .. c			else				return a .. b .. '⁽ʲ⁾' .. c			end end)

--consonant assimilative palatalization of st/zd, depending on		--whether [rl] precedes pron = rsub(pron, '([rl]?)([ˈˌ]?[sz])([ːˈˌ]*[td]ʲ)', function(a, b, c)			if a == '' then				return a .. b .. 'ʲ' .. c			else				return a .. b .. '⁽ʲ⁾' .. c			end end)

--general consonant assimilative palatalization pron = rsub_repeatedly(pron, '([szntdpbmfcĵx])([ːˈˌ]*)([szntdpbmfcĵlk]ʲ)', function(a, b, c)			if cons_assim_palatal['compulsory'][a..c] then				return a .. 'ʲ' .. b .. c			elseif cons_assim_palatal['optional'][a..c] then				return a .. '⁽ʲ⁾' .. b .. c			else				return a .. b .. c			end end)

-- further assimilation before alveolopalatals pron = rsub(pron, 'n([ːˈˌ]*)([čǰɕӂ])', 'nʲ%1%2')

-- optional palatal assimilation of вп, вб only word-initially pron = rsub(pron, '⁀([ːˈˌ]*[fv])([ːˈˌ]*[pb]ʲ)', '⁀%1⁽ʲ⁾%2')

-- optional palatal assimilation of бв but not in обв- pron = rsub(pron, 'b([ːˈˌ]*vʲ)', 'b⁽ʲ⁾%1') if rfind(word[i], '⁀o' .. accents .. '?bv') then -- ə in case of a word with a preceding preposition pron = rsub(pron, '⁀([ːˈˌ]*[ɐəo][ːˈˌ]*)b⁽ʲ⁾([ːˈˌ]*vʲ)', '⁀%1b%2') end

-- palatalized labials before /j/ should be optionally palatalized pron = rsub(pron, '([mpbfv])ʲ([ːˈˌ]*j)', '%1⁽ʲ⁾%2')

-- Word-final -лся (normally in past verb forms) should have optional -- palatalization. Need to rewrite as -лсьа to defeat this. -- FIXME: Should we move this to phonetic_subs? if rfind(word[i], 'ls[äạ]⁀') then pron = rsub(pron, 'lsʲə⁀', 'ls⁽ʲ⁾ə⁀') end

word[i] = pron end

text = table.concat(word, " ") if bracket then text = '[' .. text .. ']'	end

-- Front a and u between soft consonants. If between a soft and -- optionally soft consonant (should only occur in that order, shouldn't	-- ever have a or u preceded by optionally soft consonant), -- split the result into two. We only split into two even if there -- happen to be multiple optionally fronted a's and u's to avoid -- excessive numbers of possibilities (and it simplifies the code). -- 1. First, temporarily add soft symbol to inherently soft consonants. text = rsub(text, '([čǰɕӂj])', '%1ʲ') -- 2. Handle case of [au] between two soft consonants text = rsub_repeatedly(text, '(ʲ[ː]*)([auʊ])([ˈˌ]?.ʲ)', function(a, b, c)		return a .. fronting[b] .. c end) -- 3. Handle [au] between soft consonant and optional j, which is still fronted text = rsub_repeatedly(text, '(ʲ[ː]*)([auʊ])([ˈˌ]?%(jʲ%))', function(a, b, c)			return a .. fronting[b] .. c end) -- 4. Handle case of [au] between soft and optionally soft consonant if rfind(text, 'ʲ[ː]*[auʊ][ˈˌ]?.⁽ʲ⁾') then local opt_hard = rsub(text, '(ʲ[ː]*)([auʊ])([ˈˌ]?.)⁽ʲ⁾', '%1%2%3') local opt_soft = rsub(text, '(ʲ[ː]*)([auʊ])([ˈˌ]?.)⁽ʲ⁾', function(a, b, c)			return a .. fronting[b] .. c .. 'ʲ' end) text = { opt_hard, opt_soft } else text = { text } end

for i, pronunciation in ipairs(text) do -- 5. Undo addition of soft symbol to inherently soft consonants. pronunciation = rsub(pronunciation, '([čǰɕӂj])ʲ', '%1')

-- convert special symbols to IPA pronunciation = rsub(pronunciation, '[cĵ]ʲ', translit_conv_j) pronunciation = rsub(pronunciation, '[cčgĉĝĵǰšžɕӂ]', translit_conv)

-- Assimilation involving hiatus of ɐ and ə pronunciation = rsub(pronunciation, 'ə([‿⁀]*)[ɐə]', 'ɐ%1ɐ')

-- Use ɫ for dark l		pronunciation = rsub(pronunciation, 'l([^ʲ])', 'ɫ%1')

-- eliminate ⁀ symbol at word boundaries -- eliminate _ symbol that prevents assimilations -- eliminate pseudoconsonant at beginning of suffixes or end of prefixes text[i] = rsub(pronunciation, '[⁀_' .. PSEUDOCONS ..']', '') end

return text end

-- Return the actual IPA corresponding to Cyrillic text as a single string. -- This is a wrapper around export.ipa, which returns a list; if that -- function returns more than one item, they are separated by ", ". function export.ipa_string(text, adj, gem, bracket, pos, zhpal, is_transformed) local ipa_list = export.ipa(text, adj, gem, bracket, pos, zhpal, is_transformed) return table.concat(ipa_list, ", ") end

return export