Welcome to Sab-AI lab

A boutique AI lab in Nagoya-Japan.

This is a brief of the Reading-Rater technical narrative developed for
UP INC-OSAKA Japan
.

The narrative sets about the technology's scope of works, accuracy, the-best-use and wayforwards.

...

Source code download:

By downloading this source code I acknowledge that I have fully read and understood the below system's scope and description as well as its behaviour/acceptance test criteria in its entirety and am considering all requirements when I build upon/use the system to keep it performing as expressed.

...

...

The technical narrative of Rater for UP INC-OSAKA Japan

This version of Rater is customized for UP, an English School in Osaka-Japan. This version can measure the “Reading Rate” of a user (reader) and compare it with the average rate of non-native and native speakers.

Introduction

  • In this narrative, we explain how Reading-Rate works and look at the factors which influence the users’ Reading-Rate.

  • The chief goal is to deploy Speaking-Rate in three phases, by which we measure the users’ Speaking-Rate, a critical component of the language delivery.

  • In phase-1, we focus on measuring only five types of suprasegmental features in utterances.
  • * Inappropriate pausing (IP),
  • * Absence of pausing (AP),
  • * Absence of CV linking (AL),
  • * Inappropriate lexical stress (ILS),
  • * Inappropriate intonation (II).

...

Definition

Total reading fluency refers to the ability of readers to read the words in text effortlessly and efficiently (automaticity) with meaningful expression that enhances the meaning of the text (prosody). Fluency takes phonics or word recognition to the next level. While many readers can decode words accurately, they may not be fluent or automatic in their word recognition. These readers tend to expend too much of their limited mental energy on figuring out the pronunciation and meaning of words, energy that is taken away from that more important task in reading comprehension — getting to the text’s overall meaning. Thus, the lack of fluency often results in poor comprehension.

Fluent readers, on the other hand, are able to read words accurately and effortlessly. They recognize words and phrases instantly on sight. A minimal amount of cognitive energy is expended in decoding the words. This means, then, that the maximum amount of a reader’s cognitive energy can be directed to the all-important task of making sense of the text.

The second component to fluency is prosody , or reading with expression. A key characteristic of fluent oral reading (or speech, for that matter) is the ability to embed appropriate expression into the reading.Fluent readers raise and lower the volume and pitch of their voices, they speed up and slow down at appropriate places in the text, they read words in meaningful groups or phrases, they pause at appropriate places within the text. All these are elements of expression, or what linguists have termed prosody. Prosody is essentially the melody of language as it is read or spoken. By embedding prosody in our oral language (read or spoken), we are adding meaning to the text.

...

Reading Rate

The scientific way to measure one’s Reading/Speaking rate is in syllables per second.

Rater’s estimate of the “Reading Rate” is obtained by timing the user while reading a selection of text with a known syllables count.

Rater evaluates the competency of the user by employing mathematical formulas and ETS’s independent speaking rubrics and philosophy (Educational Testing Service-USA).

Rater went through a Machine learning session, with an audio dataset of non-native and native English speakers. These audios ranged from just 2 minutes in length to just under 5 minutes. Speakers' topics vary widely, total 9036 minutes audios.

...

Scope and limitations

  • Note, this is not the ”Speaking Rate”. Even if the user reads out loud, it’s not the same thing as a speaking rate.

  • The best way to determine the user’s speaking rate is to time the user’s delivering a free speech.

  • All the annotations that will been analyzed by the current Reading are based on the mentioned rubrics and the non-native English speaker audios. We do not claim that these are 100% accurate or the only way the speech can be analyzed. We will upgrade the algorithm. Your comments and feedback are most welcome. Please feel free to contact us and let us know your thoughts about the corpus.

  • The evaluation mode could be adjusted either to Flexible or stringent. The stringent mode is sensetive to high accuracy of the language production, the standard rate of reading, and the ability to read sentences effortlessly, and automatically with little conscious attention to the mechanics of reading, such as decoding. While the flexible mode was originally designed for beginners to allow them build their confidence along with growing their skills.

...

High quality recording

  • Step 1. Find a quiet place for recording. Make sure to turn off all background machinery and electronic appliances, such as your TV set.
  • Step 2. Set up your recording equipment Plug in and test your microphone. Please do not put the microphone too close to your mouth(10-12 inches from the speaker is preferred)to avoid “p pops".
  • Step 3. Adjust the recording settings. Before starting your recording, you must be certain that your machine sound recorder will record at DVD quality mono settings (44.10 kHz., 24-bit, mono).

For each session of the student training, we recommend teachers select five types of sentences: wh- questions, declarative sentences, yes-no questions, tag questions, closed-choice alternative questions

which can help eliminate or counterbalance the effects of different sentence types on suprasegmental features produced by learners and reveal the segmental features in different sentence types.

Suggested pausing
Suggested intonation
Suggested linking
Suggested lexical stress for multisyllabic words

...

A quick perfrmance report on ML

Dataset Metric Accuracy Precision Recall (Sensitivity)
For native Reading Rate 70% 83% 68%
For Japanese-English speaker Reading Rate 84% 88% 95%

...

The Rater-OSAKA-Reading source code is licensed under the Apache License 2.0

...

Contact us

Office

〒466-0834 Hirojichō, Umezono Nagoya City Aichi. Japan

sabailabo@gmail.com

Sab-AI Lab 愛知県 名古屋市 昭和区 広路町字梅園 10-4