《关于数学公式语音项目的调研》由会员分享，可在线阅读，更多相关《关于数学公式语音项目的调研（42页珍藏版）》请在金锄头文库上搜索。
1、关于数学公式语音 项目的调研报告人：彭云辉 2010-4-8纲要国外关于数学语音的一些相关的研究这些项目表示数学公式所采用的语言/格 式相关项目的大体思路及意图如何消除歧义项目的优点和局限性及对项目的改进意 见主要相关项目及对应机构或人物项目或成果机构或人物AsTeR（1994）T.V. Raman MathTalk（2007）Robert StevensMathSpeakAbraham Nemeth MathGenie（2004 ）Arthur KarshmerMathPlayer（2005 ）Design ScienceTechRead Fitzpatrick TalkMathsKings
2、ton University LAMBDA（2006）European Union AudioMath （2004 ）葡萄牙波尔图大学 另外，还有一些机构、团体对数学公式语音作了深入的 研究，并取得了一定的成果。如University of California at Berkeley(How can we speak math/Math Speak & Write, a Computer Program to Read and HearMathematical Input) 和 School of Computing, Dublin City University (Mathematics:
3、 How and What to Speak) 等。RETURN数学表达式源语言项目数学表达式源语言 AsTeRLatex MathTalkLatexMathSpeak MathMLMathGenie(a auditory browser)MathMLMathPlayerPresentation MathML TechRead LaTeX TalkMathsExport to Latex or MathML LAMBDA ProjectContent MathML AudioMath ProjectMathML RETURNan excellent prototype for speaking
4、 mathematicsLaTeX to audio documents.Can speak both literary texts and highly technical documents that contain complex mathematics.the adequacy of the audio rendering depends on how well the electronic document captures the essential internal structure of the information.produced a structured repres
5、entation and an audio formatting language (AFL) to provide an interactive environment for listening to and browsing technical documents. uses the Emacs(文本编辑器) front-end (Linux). 有关有关AsTeRAsTeR(Audio System for Technical Readings ) (Raman 1994)AsTeR（续）AsTeRAsTeRLatex parserthe audio module that uses
6、AFLa browsercreates an internal representationeasier used to help theaudio renderingMathtalk的大体思路及意图1. a set of rules to insert prosodic cues into spoken algebraic expressions.2. analyzed the way mathematics teachers speak mathematical expressions and integrated these natural voice inflections（音调变化）
7、. 3. only insertion of prosodic cues (pitch, amplitude, and pauses) into computer-spoken mathematical expressions ,none insertion of lexical cues. creates the necessary HTML/XML tags for visually-impaired and blind users to use their current screen-reading tools (e.g. JAWS and Window-Eyes for Window
8、s) to read HTML and MathML/XML pages that contain math expressions, to read them in a spoken language. This markup is not displayed in the browser. Only the MathML visual markup, or a PNG image, or a LiveMath Plug-In interactive image - whatever the author intended, is shown. The “MathSpeak This“ fu
9、nction makes it possible to hear the expression read during the creation/editing process大体思路：1. deriving Braille and Spoken Output from LaTeX Documents 2. render spoken mathematics from MathML using prosodic features such as pauses and speaking rate . 3. the use of prosody in synthesized speech to i
10、ndicate nesting structure. 主要意图：To take a subset of LaTeX and produce both Braille and Spoken out from it. To accurately model a document and to present this to the blind user using a simple and intuitive interface. To harness the capabilities of synthetic speech devices to give more meaningful spok
11、en output to the user. TechReadTechRead的大体思路及意图的大体思路及意图AudioMath的大体思路及意图made use of its own database of prosodic rules in the generation of the spoken expressions. Available in 4 different ways:- ActiveX DLL- .NET component- CGI interface- Executable EXEAuto-Discovery (the “brain” of the operation t
12、hat recognizes or identifies elements in the document and calls the respective conversion modules )Numerals (conversion of several types of numeric forms) Abbreviations Acronyms Network ReferencesMathematical (MathML expressions )6 modules for the conversion partAudioMathAudioMath设计流程图设计流程图MathPlaye
13、ra plug-in to Microsoft Internet Explorer (IE) andAdobe Acrobat/Reader that renders MathML visually.is able to dynamically display a mathematical expression according to its font and the color set, users can choose the most suitable font or color scheme for their reading needs. For example, visually
14、 impaired readers are likely to set a large font and high color contrast. 上述公式在 MathPlayer中的读 法为：cap U bar sup h equals one minus exponent open minus fraction 8 cap T sup h over end fraction close读法： equals ln open fraction n over s end close plus open fraction k sup h over k prime sup h end fractio
15、n close ln open s close minus zero point seven five plus open two l z minus z squared close fraction k sup h over q sup w end fraction.MathSpeak Project的大体思路及意图The project is one of the proposed methods, consisting of a group of rules to dictate mathematical contents. However it is not a standard an
16、d it is intended to serve blind people that want to transcribe their documents into Nemeth Code 18, and later on into Braille. RETURN如何消除歧义两大策略：Use of lexical indicators(a) x plus begin fraction one over x end fraction minus one (b) begin fraction xplusone over x end fraction minus one Use of prosodic indicators(pauses, modifications of pitch and tempo, rhythm
