Greetings to all Blind Voices Coalition members:
To follow up on Bill’s message, yes we covered too much material and we will work to improve our presentations.
This message is to provide some reference notes concerning the topics we attempted to cover during our January 21st meeting. I apologize for the length of this message but there is a large amount of material to discuss.
The choices available to the Blind as to the type of services Apple provides and the way we use our iPhones to increase our Independence and Mobility is quickly changing! Bill and I understand the importance for the Blind to both be aware of and able to use all the tools being introduced to the Blind by Apple and all their competitors.
Below is a list of the important take away bullets and notes from our presentations on Siri Search, Siri Shortcuts and Voice Control.
Siri Search Info Bullets:
* Siri search requests are made through the Siri Apple search engine.
* Siri searches the web evidently using Apple exclusive protocols.
* Search results returned through Siri and Google are often different!
* A “No Results” from a Siri search often can yield Results through a Google search.
* Do not accept “No Results” as a “Final Result” from a single search engine.
Siri Search Notes:
A perfect example for needing to understand the way Siri search is structured is that when searching for our website “blind voices coalition.org” will yield No Results through a Siri search but will be easily found through a Google search!
Safari Search Notes:
Safari is not a search provider but exists as the Apple’s “Gateway” to the web when not using Siri voice search. Safari allows web searches using the users designated chosen search engine within the Safari section of iPhone Settings.
Siri Shortcuts”
Shortcuts are simply assigning a word or phrase to act as an activation request allowing multiple actions to be stringed together that are activated by running a stored sequence of actions when the assigned activation word or phrase is requested through Siri. The reason for use is to limit the number of screen interactions to execute a desired result through minimal interaction.
Example of use is the shortcut that Bill shared to connect to the Blind Voices Coalition website that only requires a Siri voice request of BVC to finalize this web site search request result.
Untrusted Shortcut Bullets:
* All Non Apple reviewed Shortcuts are treated as “Untrusted Shortcuts”.
* Untrusted Shortcuts must be handled identical to unknown email attachments.
* If unsure of the source ask sender to state shared shortcut steps to allow self creation.
Initial activation to allow for shared “Untrusted Shortcuts” require a “Trusted Apple Shortcut” to be run initially allowing the “Untrusted Shortcut” key in the Shortcut Utility Application to be activated to accept any shared “Untrusted Shortcuts”.
Hey Siri Notes”
“Hey Siri” allows for voice activation of Siri Key if this function has been set up within the Siri Setting Application within iPhone Settings. Once setup the iPhone is always listening for the phrase “Hey Siri” to activate Siri key allowing hands free usage of Siri. Once “Hey Siri” voice request is recognized the iPhone is connected to the Siri Apple server to process and execute command.
Note both Siri and Hey Siri require a WiFi or Cellular connection for usage.
Command Notes”
Commands are action requests that are present both as Siri and/or Voice Control actions.
Voice Control Notes:
Voice Control holds great promise for the Blind to interface with the iPhone without the need for physical interface, creating a hands free means to accomplish finger swipes and taps, execute actions within applications and execute many of the common text manipulation and editing functions all through voice commands. Use of Voice Control by the Blind offers a new means to interact with the iPhone that can dramatically increase independence and mobility.
Voice Control was introduced by Apple for those with motor skill limitations with the release of iPhone 4, this feature has been evidently enhanced with the release of IOS 13 with promotion of use by all. So when Blind VoiceOver users attempted to use Voice Control incompatibility issues with VoiceOver were reported, followed by Apple Accessibility temporarily stating that Voice Control should not be used by Blind VoiceOver users. After some additional attempts for use by the Blind was there a realization that a simple work around had been programmed into Voice Control allowing the Blind to start experimenting with this tool.
Evidently; there are two modes within Voice Control, a “Dictation Mode” that is not compatible with VoiceOver and a “Command Mode” that is compatible with VoiceOver. The incompatibility only occurs when VoiceOver is activated and Voice Control is in Dictation Mode when a text box or document is opened as the IPhone microphone is active when Voice Control is turned on meaning any word that is associated with a command will cause Voice Control to capture that spoken word and insert it into the text box followed by VoiceOver speaking the inserted word or phrase, followed by Voice Control capturing the spoken text and reinserting it once again into the Text box causing a continuation of this action; an obvious problem that the Blind VoiceOver user must avoid. The Solution is simple and resolvable by placing Voice Control into Command Mode when Voice Control is turned on allowing access for use of Voice Control by the Blind VoiceOver user.
Voice Control Commands are different from Siri Shortcut Commands in the following ways:
* Voice Control requests are processed internally on the iPhone.
* Siri requests are powered through an Apple external server.
* Voice Control requires no WiFi or Cellular connection to operate.
* Siri requires a WiFi or cellular connection to operate.
Voice Control Bullets:
* Control iPhone hands free by voice.
* Execute requests and actions by voice.
* No WiFi or Cellular connection required.
* Execute defined key tab actions within third party apps by voice.
* Interface with iPhone using Default Basic Navigation Commands by voice.
* Interface with iPhone through default Basic Gesture Commands by voice.
* Interface with iPhone through Default Advanced Gesture Commands by voice.
* Interface with iPhone using Overlay ID Grids by voice.
* Navigate Text Documents by voice.
* Make Text Selections for editing by voice.
* Edit Text by voice commands.
* Edit text using Default Deletion Commands by voice.
* Interface with iPhone using default stored VC commands.
* Control iPhone functions using Default Device Commands by Voice.
* Control iPhone Accessibility Functions using Default Accessibility Commands by voice.
* Set VO off to control Dictation Functions using Default Dictation Commands by voice.
* Interface with iPhone using custom user developed VC commands by voice.
I have been informed that when using dictation through Voice Control the results can be improved over dictation using Siri since Voice Control evidently is better at understanding the spoken word of the user as all actions occur within the iPhone instead of requiring the external Apple server to interpret the spoken word of the user through the Siri interface.
The example of use of Voice Control to enhance mobility and walking safety can be given when applying Voice Control to Microsoft’s SoundScape 3D Audio App.
Many Blind walkers rely on SoundScape as their Mobility App of Choice. Other than having default announcements provided to the Blind walker when using SoundScape requires hands on interfacing but with Voice Control activated in App information is accessible without the need to stop, drop the guide dog harness, pull iPhone out of your pocket and perform gestures to extract information prior to returning the iPhone to your pocket, refocusing your guide dog to resume walk. The ability to just speak commands on the fly is a major improvement in safety as information can be accessed quickly without loss of focus equating into a better walking experience!
So all I ask you to experiment and learn these abilities that Apple has provided us in the iPhone; yes I understand this material is complicated, yes I understand this will require a time commitment to master these skills but you will be rewarded by your efforts as once these skills are learned you will be on the road to achieve more independence, better able to compete in the sighted society and be better positioned to understand how to use the really cool new technologies for the Blind that are just around the corner!
Note; at some future date i will write training modules for Voice Control to be disbursed through the Blind Voices Coalition website.
Additionally I will attempt to answer questions to my best ability concerning Voice Control as i too am learning all this myself!
I can be reached at 252-269-2352 normally Monday through Friday between 9 and 4 Eastern, leave a voice message and I will return your call.
Email me at peter.crumley@yahoo.com