Showing posts with label Kelly and Company. Show all posts
Showing posts with label Kelly and Company. Show all posts

Wednesday, March 6, 2019

The Camera Which Helped The Blind;

What Is This;

Identifying Objects, People, and More with Apps and The Camera in Your iOS Device:

Handkerchiefs are splendid things to have handy when you need to wipe off messy fingers so you can then use your iPHONE without getting guck all over it. They have made my day more bearable on many occasions when I couldn’t come up with facial tissue when allergies got the better of me. They are, however, the most unbelievably frustrating objects on Earth to try finding once dropped. They make no sound at all when landing on apartment carpet or even hard floor for that matter. I had ben given a dozen handkerchiefs and slowly lost most of them over the past six or seven years since. Eventually, I would step on the thing or else vacuum it by mistake and have to dig it out of the fluff if I even had the good fortune to realize this happened. Of course, there was always the possibility that it had fallen on hard floor and was now a hazard awaiting my unwary footfall to send me slipping or sprawling headlong into an apartment wall. At least, this time around, I was pretty certain that the handkerchief was lost somewhere in the apartment. I couldn’t be certain how many days ago it had fallen from my pocket though so that meant it could have been in any number of places.

There are, of course, time tested methods for dealing with searching for dropped objects. The grid pattern search is the most thorough and laborious. I resigned myself to goodness knows how many minutes or hours of doing such a search of my entire apartment by feel. And then… it dawned on me.

Around the time I got my first iPHONE, my father had gotten an iPAD. We had chatted using the FaceTime app. I remembered that I could switch it so it used the rear-facing camera. Rather than fruitlessly crawling around the floor searching, I called my father on FaceTime. He began telling me where to point the camera so he could see the apartment floor and furniture where it could have fallen. It literally took him no more than a couple of minutes to look over the floor through my phone’s camera and tell me where to reach down and retrieve the handkerchief. He didn’t even have to leave his living room to help with finding stuff or reading printed documents. A few times, he even helped me restore my obstinately silent computer to working status by telling me where to point the camera and what was on the screen.

Finding my lost handkerchief was my first mind-blowing experience of how very useful the tiny camera in the corner of my iPHONE could be to blind people. Over time, it became habit to FaceTime my father whenever I needed his eyes for tasks requiring working eyes. For quite a while, that was where things basically stood regarding useful applications of the camera. It took a while for the technology to get better and for Apple to give enough camera control to app developers before the really awesome stuff started. Slowly, the first specially built apps started to appear which were designed specifically to help blind an visually impaired people through use of the camera. These apps made use of artificial intelligence, big data, and the ability to connect people in need of sighted help with sighted people willing to help when called. In this section, we’ll look at the most popular apps which attempt to bring aspects of sight to blind people through the technology built into every iOS device.

Object Identification:

Sadly, not all blind people have sighted friends or family in their lives who are so willing to lend their eyes when needed. There are also times when, for instance, due to the lateness of the hour, it would be inadvisable to call upon one’s friends to quickly find out what kind of cake you pull from the fridge in order to partake in a midnight snack. Being able to have the benefits of sight for crucial moments here and there without inconveniencing people has always been a strongly held desire among blind people. Tapping into the capabilities built into your iOS device, app developers have now largely made this dream a reality.

Digit-Eyes:

Apps such as Digit-Eyes attempt to identify objects using the bar codes most objects are now adorned with. The user must simply move the camera over the surfaces of an item until the software detects the bar code. The app then taps into a database which is usually online. The bar code is matched to an entry in this database and the blind person is then informed what the object is. Being managed online, the database of bar codes an app like Digit-Eyes can tap into is always kept up to date and takes no storage space on your device.

Although still available in the app store, this app hasn’t been updated in over two years. It has existed for nearly a decade and was the first app of its kind that I experienced. The database of codes which the current version can identify stands at over thirty seven million. The ability to purchase and/or create labels to be attached to objects and speak or type text which is spoken when the labels are encountered might well make this somewhat older system a good choice in some circumstances. Since the text or recordings you create are stored on your device, this system can work even when you’re not connected to the Internet. This approach may also be less intimidating and easier to master for people les skilled with technology or fearful of giving away information to large corporations. It is, however, quite slow by the standards of today’s apps.

Tap Tap See:

https://taptapseeapp.com

Another approach is used by apps such as Tap Tap See. Rather than using a bar code which can be hard to find on some objects, the app assists blind people in taking a good enough picture of the object to allow artificial intelligence or a human assistant to identify the object. The user is then informed, usually within seconds of taking the picture, what the object is. This app detects when an object is clearly in focus and emits a short beep to inform the blind person that an object is firmly in focus. You must go into the “more” tab and then double-tap the “settings” button to access the configuration area of this app where this feature can be enabled. This can help tremendously if people have never had occasion to take a picture before. Tap Tap See can also analyze up to ten seconds of video in order to identify objects in the camera view.

Tap Tap See was king of the proverbial block for quite some time. It was once a paid service where you had to keep re-stocking the amount of pictures you could have described for you. It has long since become free for all users to use as much as they like and still comes in handy every now and then.

For my wife Sara and I, Tap Tap See was well worth paying for photos while that was actually necessary. To just be able to pull out one’s phone, snap a picture of a bottle of beer, box of crackers or cup of noodles and find out what kind it was within seconds, that was absolute unadulterated magic. No longer was it necessary to label so many things that would only be used once. No longer did we have to be so very careful about where we put which soup cans. Provided we had our iPHOnEs, we could make informed choices without having to open something to find out what it was.

KNFB Reader;

A Reading Revolution In Your Pocket: https://knfbreader.com

Being able to read print easily wherever you might happen to encounter it has been another long-standing ardent wish for many blind people. My second truly mind-blowing experience with the camera on my iPHONE happened on September 18, 2014, on the same day as the Scottish referendum. Thanks to the generosity of John Morgan, a philanthropist who I’ve had the honour and good fortune to call friend, I felt able to afford the most expensive app I’ve ever acquired. for quite a while, I had been hearing about a remarkable new app called KNFB Reader. An early demonstration of its capabilities involved someone taking a picture of a screen at the front of a large auditorium and having the print on the screen read out perfectly. This app could also help guide your hand as you positioned your iPHONE above a sheet of paper to get that optimum shot for best recognition results. It was one of those things that felt either too good to be true or too revolutionary and life-changing to be available to ordinary people like me.

I was using an iPHONE5S by this point so I had the capability to run it. People were almost too ecstatic about what it could do. I heard stories of people effortlessly photographing even large poster-sized documents and getting nearly perfect OCR results. People talked of snapping pictures of signs on the street and learning what they said. It all sounded too good to be true. The price of over $100 Canadian certainly gave me pause. I could buy a good portion of a month’s groceries or a lot of Kindle books with that sort of money. I would, in all likelihood have ultimately made the purchase. However, what decided me that day was an email and donation from John Morgan. He had heard of this remarkable app and wondered if I’d be interested in taking it for a spin an telling him what I thought of it. Naturally, at that point, I agreed. I purchased the app from the app store without difficulty and it installed without any issues.

I opened the app and read through the instructions. For an experienced user like me, or even a beginner, it all struck me as very simple and well thought through. I could use a feature called “field of view report” to get a sense of how well a document was in the camera’s focus. Once I had gotten it in good position, I could take a picture and the document in focus would be read out to me. This would apparently happen within seconds of my taking the picture. Testing it out on some smaller flyers I had gotten in the mail, I happily found that the app was as good and easy to use as people said it was. To really put my new app through the ringer, I found a large poster-sized paper that the Ontario government had sent me. I had used my older version of Kurzweil 1000 and the OCR scanner on my desk to partially scan the document. It wouldn’t all fit in the scanner but I had gotten enough read out to know it wasn’t something I needed to wrestle with in order to hear the rest. However, if this new app worked like people had raved about, it wouldn’t be nearly so hard and time consuming to get the full document readable.

I laid out the large sheet on my dining room table and made certain the room light was on. For once, it would actually be helpful to me rather than the occasional sighted visitors I had. Using the field of view feature as well as vibrations which gave me a sense of how tilted my iPHONE was, it took a number of attempts before I found a position which let the camera take in the whole paper. Moving my iPHONE farther above the paper and then getting another report, I was able to hone in on the perfect position for my iPHONE. Then, I carefully double-tapped the “take picture” button. The camera sound played and I waited hoping I hadn’t disturbed the position of the iPHONE by tapping too hard. It took around ten seconds. I was just beginning to wonder if I had crashed the app when a synthetic voice began reading the document. The contents were about as deadly dull and unimportant to my life as humanly possible. Nevertheless, I was still absolutely spellbound. The paper was read out absolutely perfectly. I had never read anything like this without there being a number of OCR recognition errors. You’d encounter them at least once every couple of sentences. There’d be a couple of nonsense characters or letters instead of numbers. It had been this way since my days in secondary school when I had gotten my very first scanner. That still certainly happens even with KNFB Reader but it’s a lot less frequent. However, on that day, the stars must have been right. I stood there at the table utterly amazed waiting for a mistake that never came as perfect sentence followed perfect sentence. I couldn’t help but think back to the weekend I had spent scanning a copy of The Elements of Style so I’d have it in time for my creative writing class in university. A good portion of my ongoing perhaps unfair seething hatred of that book can be traced back to the wrecked weekend of effort it took to get a far from perfect but useable copy scanned into my laptop one page at a time. How much easier and less painful it would have been with an app like KNFB Reader.

The implications for today’s students are absolutely profound. It might actually be useful for them to go to a library, borrow a book and find the information they needed in it. They could read through forms and merely need sighted help to fill them in properly. All of the work of character recognition happens on your own device. This means that your data is kept absolutely private and doesn’t need to travel anywhere for processing. You can also export the text to other apps and share documents when you want to. The vibration feedback plus the field of view report features makes the process of learning to take good pictures of sheets a lot easier to master than with apps which cost less.

Compared to other apps in the app store, KNFB Reader is one of the most expensive purchases you’re likely to make even if you manage to get it while on sale. However, consider this more carefully. I needed government funding to obtain the Kurzweil 1000 software I had been using for over a decade. Each time I wanted to get the latest update, I needed to pay over $100 in order to have it sent to me. The government agency spent over $1000 initially to purchase my user license for the software. However, for the cost of a single update for Kurzweil 1000, I had gotten an app which consistently yielded results as good as or better than Kurzweil 1000. These results were obtained in a fraction of the time that software and scanner took to even scan a sheet let alone interpret what it saw. Rather than a bulky scanner taking up desk space, I could pull my iPHONE out of my pocket and read print anywhere. I’ve never had to pay once for updates to the KNFB Reader app. They just keep coming every so often. While there may be less overall need to read print as more documents become electronically available, I’m still very happy to have this app for when I need a full and accurate scan of something in print. I use this app every day to read my physical mail and notes from the staff of my apartment building. The KNFB Reader app was and still is an absolute game changer.

App Store Expedition:

Prizmo Go; A Cheeper Alternative Reading Solution:

https://creaceed.com/prizmogo

While KNFB Reader was certainly the first really noteworthy print reading app, it wasn’t the only kid on the block for very long. Other apps appeared attempting to offer OCR capabilities more affordably. These days, unlike when I picked up the app, KNFB Reader has some good competition. By far, the most successful of these is one called Prizmo Go. It was designed to cater more to the sighted user. However, Creaceed SPRL, the app developer, took great care to incorporate support for VoiceOver and special guidance to help blind users orient their cameras to get good pictures of text. You can try the app free of charge enough to get a sense of whether the app would suit your needs. Should you need more of its capabilities, you can purchase some outright such as the ability to export and share text. Other capabilities take advantage of cloud-based processing to offer enhanced accuracy above and beyond the already superb performance of the built-in OCR capabilities. Prizmo Go also offers language translation capabilities. If you hesitate to pay an ongoing subscription, you can instead pay for a limited amount of cloud-enhanced accurate scans and/or translations. Otherwise, simply pay a one-time fee to unlock the exporting capabilities of Prizmo Go and you’ll have yourself a very robust and portable OCR solution.

This illustrates the power of large-scale economics. While you won’t find quite the same level of intuitiveness as with KNFB Reader, Prizmo Go offers very comparable OCR results for people who are comfortable and proficient with using the camera of their device. The “scene description” button at the bottom right offers similar guidance to the “field of view” report feature of KNFB Reader. It also gives a sense of the number of lines of text in view. There are VoiceOver hints throughout the app as well as other help offered in the “app settings” button found at the top left. For a lot of people who feel comfortable using the camera, Prizmo Go will be more than sufficient to meet their OCR needs and will cost them a whole lot less money. For plenty of others, the more intuitive feedback and guidance that only an app designed from the ground up for blind users provides will be well worth the extra one-time expense. I’m happy that we as blind people can now regularly make such choices in the iOs ecosystem.

Seeing A I:

Putting It All Together:

Www.seingai.com

To really propel things forward takes a partnership. This partnership is between blind people who own iOS devices that need to know about things in their lives and a gigantic globe-spanning company working on cutting edge artificial intelligence with mind-boggling resources. One Summer, the blind community was absolutely stunned when the Seeing A I app from Microsoft appeared in the app store. As a means of conducting ongoing research into accessibility and artificial intelligence, Microsoft had managed to leverage its artificial intelligence, massive image database and computing power to come up with what is still the current must-have app for blind people. It’s called Seeing A I. This app is the Swiss army knife of handy tools making use of the camera. It has a number of channels which each perform different tasks. The channel you start on is for reading short text as the camera sees it. Touch the channel selector in the bottom right and flick up or down to get to other channels. More are added as new features are deemed ready for public experimentation. Other available channels include ones for reading larger documents, identifying objects or people, identifying currency, detecting the level of ambient light, describing scenes and even reading hand writing. Some of these features are still in what is called “preview” status which basically means they’re available for you to try but not yet judged fully developed. This app is available free from the app store and using it is free of any charges other than possibly cellular data.

It’s impossible to properly convey the tremendous usefulness of the Seeing A I app. Nor can the impact on the social media using blind community be overstated. All through the first months during which the app was available, it seemed that there were torrents of tweets, Facebook posts and podcasts about this small but monumental app. Nothing could knock Seeing A I off of the five most recently recommended app slots on the Applevis home page. And this despite the fact that users in the UK weren’t included initially. The envy from across the pond was thick enough to cut.

When you first run the app, you are presented with tutorials which pop up as you explore. They have videos produced by the app developers at Microsoft which explain how the various features work.. Once you’ve gone through those, the app will open into the default channel for reading short text. Touch the channel selector on the bottom right and flick up or down with one finger to change to different channels. The next two channels above short text reading are for reading whole pages and product identification via bar codes.

Keep in mind that Seeing A I is a research project. Basically, this means that you’re paying for the assistance you receive with the data you’re generating. You are the product. As Microsoft’s artificial intelligence assists you by reading text or describing people or objects, it learns from the images. Human app developers working on Seeing A I and other Microsoft products might make use of the image of a coffee cup you take a picture of and have described to improve the ability of products using artificial intelligence to recognize coffee cups. A blind person might well have taken a picture of a coffee cup from a different unusual angle than most images in an image library. I feel pretty safe in using it for most things but wouldn’t use it to get the security number of my credit card or anything sensitive like that. Always be aware of where images and data are going and mindful of the motivations of people or companies who have access to it.

Speaking of being aware of who gets data, consider the case of my mother in law. Soon after my wife Sara and I began using the Seeing A I app, we visited with her family and showed them the app. With her eager permission, we decided to try the person description channel and take a picture of my mother in law. Upon examining that picture, my iPHONE calmly informed her that she was a good couple of decades older than was actually the case. She was less than thrilled with that description and jokingly warned me not to leave my iPHONE unattended in her presence.

The Eyes have It;

Bringing Willing Sighted Help Where It’s Needed:

Lets face it. There are times when no amount of fancy artificial intelligence will do the trick. You need to hunt for something, complete a process, figure out where to write on a form, etc. There are problems which require an ongoing dialogue with a sighted person to be solved efficiently. With FaceTime, you must have someone in your family or circle of friends willing to help when needed. Not everyone has an iOs device. Nor are the sighted people in our lives always free or knowledgeable enough to help. There are currently a number of apps which seek to remove these limitations. We’ll focus on two very popular apps which attempt to connect those who need sighted help with people who are willing and able to assist.

Be My Eyes:

Www.bemyeyes.com

The Be My Eyes app connects you via a video call similar to FaceTime with the first available volunteer who has made him or herself available to assist. The app shows the volunteer what the camera on the back of your device sees. The real utility in the Be My Eyes app is its ability to connect people needing help with available volunteers who have time to offer assistance at any given moment. This is great for finding lost objects or picking out clothes that look good on you.

Keep in mind that these are volunteers. All they have to do is a simple tutorial about how the app works. They aren’t vetted for security and are unpaid. Don’t use them for anything requiring sensitive information. While it is unlikely that people would volunteer with sinister motives, You never know. Someone could, for instance, se and make use of a credit card number you had the volunteer read to you. There are certainly ways in which this app and the blind people who use it might be abused by unscrupulous people.

To write this section of the guide, I wanted to test out the Be My Eyes app for myself. I found signing up to be very easy. You do need to agree to the terms of use and use the app in abidance with them. Volunteers are never responsible for your safety. Nor can the developers of Be My Eyes be held liable for any misuse of the app. Once I had signed up, I placed a call by finding and double-tapping a button called “Call first available volunteer”. I have a collector’s coin which I got after participating in a documentary called Get Lamp. It’s available on Youtube and is about text adventure games. I asked the volunteer to describe each side of the coin. She did a nice job of it and told me how to move my iPHONE so she could read me the small writing on the coin as well as describe the pictures. She had time for a brief chat and was curious about the documentary. I asked what she had to do in order to volunteer and she described the simple tutorial she had completed.

The experience was very simple and unhurried. However, one is certainly conscious of taking up a volunteer’s time. Personally, I wouldn’t want to use them for anything too lengthy. That call certainly gave me an idea of the ability of the camera on my iPHONE7 to focus on small images and what feels to me like tiny writing on the coin faces.

Aira;

Competent Secure and On-demand Visual Help For Rent: Www.aira.io

Aira, pronounced “eye”ra, puts everything on a business footing. Aira hires agents who help blind people with everyday tasks. These people are vetted for security so you can feel safer about sensitive information. Also, you as a blind client pay a subscription for a certain number of minutes each month. You can use them for whatever you like without feeling guilty for taking up somebody’s time. The software used by Aira agents is more sophisticated and allows them to pull up maps or tap into your social media to recognize faces of people. Aira agents are trusted with your data due to their having been vetted for security and this makes Aira potentially much more useful depending on your individual needs. Aira can be used in conjunction with smart glasses giving a head level hand-free view more similar to eye sight to Aira agents. Imagine walking down a street and a voice in your ear telling you about a restaurant sign coming up ahead. The agent could also tell you that your friend John is approaching you from the left. That’s what happens in one of the promotional videos you’ll find on their web site. Because these agents can access your location and other information, they can help you make travel decisions. During the setup process, Aira makes it very clear that they aren’t responsible for your safety. They won’t help you while you’re travelling unless you are using a mobility aid like a guide dog or cane. They can, however, describe your surroundings and suggest different routes. They could tell you about signs of businesses you’re passing, where a taxi stand or bus stop is, or any number of details which might prove useful. They could help you operate and otherwise inaccessible ticket machine or read information from a restaurant’s display.

While writing this guide, Aira offered a free trial for everyone which gave you thirty minutes that had to b used in seven days or les once your trial started. I took advantage of this to take Aira for a casual spin. Some of my thirty minutes were taken with going through the rules and answering some questions to set up my profile. After that, the agent asked what she could help me with.

In advertising the trial, people were encouraged to knock something off their bucket list. During the years I’ve lived in my apartment, I had often been told that I had a “good view” from my balcony. I decided to have the agent who took my call describe for me the view from the balcony of my apartment. I figured this would give me an idea of how wide an area could be seen from my iPHONE’s camera as well as a sense of how well Aira trained its agents in the art of description. She spent a few minutes describing what she saw and answering some questions I asked. I was impressed by how much could be seen and with the detailed description I was given. She agreed to type up some descriptive text and attach it to a picture she took and shared with my iPHONE. Unfortunately, to access such pictures, you need to be a paid subscriber to the service so I couldn’t access this little souvenir. however, I at least got an idea of what it was like to stand and look out on a snowy afternoon from my balcony.

As things currently stand, using the Aira service is an expense your bank account will feel the sting of even for people with steady working incomes. As of March 2019, a standard subscription without smart glasses would cost around $100 US per month giving you 120 minutes of Aira time which can be used for nearly anything you want to do with the assistance of an Aira agent. This doesn’t cover any costs you’d pay for the cellular data used. Those could be prohibitive if you don’t have a high or unlimited amount of data in your monthly plan.

Putting things on a business footing has a more profound psychological effect than you might think. While you might hesitate to use a volunteer’s time for anything lengthy or complex, the mindset changes when you’re paying for a service. As fate would have it, a friend of mine posted a perfect example of this on Facebook while I was working on this section of the guide. Michelle McQuigge doesn’t consider herself particularly handy with tools or good at assembling things. However, she had bought a heavy-duty laundry cart and decided to use an Aira agent’s help to try assembling the cart without help from her more mechanically inclined sighted friends. The agent was able to find the assembly instructions on the Internet and then talk Michelle through the process of putting her new cart together. That just floored me. I can’t count the times in life where I’ve sat still or stood out of the way while someone sighted has tired him or herself out putting some piece of furniture together for me. An experience common to blind people is that sense of bing more than willing to do the work for oneself if a sighted person would just patiently say what needed to be done and where things were. For Michelle, Aira made that dream come true.

The idea of attending an event and being able to get to your seat or know what’s around at a festival independently is very compelling. You could tour a convention haul or have paintings in a gallery describe to you. Aira really pushes this active and engaged lifestyle in its advertising. The company is doing a lot to try and lower costs and make Aira useful for people who can’t afford to subscribe to one of their plans. Businesses can sign up so that blind people can be helped by Aira agents while in their establishments at no cost other than cellular data. Airports and other places can be designated free for Aira use by anybody. Also, people can use Aira for job hunting tasks at no charge and without losing minutes if they’re subscribed. There’s an entry level plan for $30 US per month for 30 minutes. That might be useful for a few quick tasks around the home but you wouldn’t want to go on an expedition with that plan.

Camera Conclusions:

Over the past eight years, I’ve continued to be delighted by the many ways in which the camera in my iPHONE has proved a vital part of my everyday life. As the costs of artificial intelligence, computing power, internet connectivity and camera technology go down, the possibilities for even those of us on low incomes will continue to grow. Thankfully, ways are being found to tap willing people and the vast resources of companies to improve lives not only of blind people, but of everyone who gains from artificial intelligence made smarter about identifying things for us.

These are still very early days. Things are moving quite quickly. This section of guide may very well be the first to become obsolete due to changes in this area. I’m fascinated to see where both the charitable and business efforts to put the cameras on iOS devices in the service of improving the lives of blind people end up going over the next decade. There’s quite a lot of potential for amazing helpful ideas. What really excites me is how all of this is done through a piece of technology commonly used by all sorts of people be they blind, sighted, disabled in other ways, or fully able-bodied. This brings large scale economics to bear on problems which formerly relied on smaller niche markets and special charity or government economics. That in itself is a massive game changer whose implications are still very much in their infancy.

Sadly, I things there is some cause for worry about an increased divide between blind people who succeed in finding steady enough employment to tap into what paid services like Aira offer and those who aren’t as successful. On lower income levels, you quickly hit a catch22 where you spend so much on the service that you have no money to go places to put it to good use. However, I think the costs will fall over time as more businesses join as sponsors or partners. I’m also hopeful that these services will have a trickle-down effect through changing public attitudes about the possibilities for blind participation in spheres of life.

The fear surrounding what governments and massive corporations will do with the data we generate is still, I believe, a limiting force on what’s possible. Personally, I think a lot of that fear is misplaced. People aren’t really weighing up the benefits and hesitate to reach for the ready help that artificial intelligence can provide. For blind people, I seem more of a danger from the one-on-one connections between them and the sighted people they connect to. It’s far more likely that an unscrupulous person would take advantage of a bank account number accidentally revealed while trying to bring a package of oatmeal on a cluttered countertop into focus or something of that nature. In such a case though, is that very slight risk more or less dangerous than not knowing whether that package of oatmeal contains ingredients you’re allergic to? Might it be worth trusting a volunteer or paid agent to help you use that otherwise inaccessible vending machine to get a snack or pay for a ticket you need in a hurry? In exchange for a bit of mindful sensible trust, that help is now available through your iOS device.

Above my discussion of each app covered in this section, you’ll find a link to the web site about it. There are all kinds of podcasts, videos and other information for each app so you can get a sense of whether it suits your particular needs. A simple Google search can yield more independent reviews and demonstrations of these apps. People tend to talk a lot about things which have positive impacts on their lives. Take advantage of that to get a good sense of what’s possible and how you might use that little round camera in the corner of your iOS device.

Remember to think out of the box. Nothing stops you as a Blind person from using the camera for the same social purposes as a sighted person. From pictures posted to online dating sites to Facebook photos, blind people are getting up to all kinds of social activity. There are even blind Youtube stars who have lots of sighted followers. We’ll cover that in greater detail in the section dealing with social media. There are lots of implications for making friends and sharing experiences with that little camera and other technology in your iOs device. new possibilities are emerging all the time so keep an ear out for them.

Friday, June 23, 2017

Communicating with Others using iOS Devices

Your iOS device can make communication with others on your own terms very easy to do. This is especially true once you have mastered typing, dictation using Siri, and navigating apps using VoiceOver. No matter which iOS device you get, it can be used to communicate with others. This includes the iPOD Touch which is basically and iPHONE minus the phone. There are a set of apps included in iOS especially for this purpose. In addition to these, there are more apps for various social media such as Twitter available in the app store. All of these apps tie into contact information and most of the time, tie into Siri as well. This makes communicating as effortless as possible even when you're just getting started.

The Contacts App:

The Contacts app on the home screen is your first stop. This is where you should put any contact information you have about people who you want to communicate with. iOS can then make use of that information via other apps. The more information you put in this repository, the better your iOS device will serve you as a communications aid. It is quite possible to add contacts to different groups such as for personal and work. Personally, I just have them all in a single list within the app.

Unless you change settings, contacts will be kept in alphabetical order. By using the VoiceOver rotor and turning it to headings, you can then flick up and down to the next or previous lettres. This makes for a quick and efficient browsing experience. For more control over how contacts are displayed and organised, go into the Settings app and doubletap on "contacts". You'll see settings for whether contacts are sorted by last name first or by first name. There are also settings regarding the use of short names and/or nicknames. For some languages, these settings won't apply since names are always ordered the same way.

How to Add Contacts:

Beginners may find it a chore to enter contact information. Dictation can certainly help but often, the virtual keyboard is simply the best way to do things. However, the rewards of this labour will very quickly become apparent. There is an "add" button near the top left of the screen. Double-tapping this button takes you to a form which you fill in. There are edit fields for all sorts of information. You can also use the "insert" buttons next to fields to add more things like additional phone numbers or email addresses. It's very comprehensive. You can specify different ringtones for contacts if you desire. My parents have a different ringtone assigned so I always know when it's them calling.

Some apps such as Facebook will present you with opportunities to integrate your contacts. This adds information from companies like Google and Facebook where you may have contact lists into the library of contacts on your iOS device. They will then populate your list in the "Contacts" app. Before this step is ever taken, you will always be asked to be certain you want this to happen. Generally speaking, iOS is very careful when it comes to your privacy. On that note, look in the "privacy" settings and you'll find a "contacts" category. This lets you control which apps have access to your contacts. Further along, you'll find similar buttons for Facebook and Twitter. No decision you make is ever written in stone regarding contact integration.

How to access and edit contact information:

As your contact list grows, you may want to use the "search" field near the top left of the app to quickly narrow down the selections. Type any part of the contact name into the field and you'll likely see it pop up. Flick right through the choices to arrive at the contact. Double-tapping on a contact opens it giving access to its information. You can then perform actions such as sending a message, initiating a Facetime call, sending an email, etc. The "back" button gets you out of that contact's information back to the general pool of contacts. Before doing that though, notice the edit button near the back button. This lets you access and edit the information. You can also completely delete the contact.

Once information is in the Contacts app, iOS will start using it to make the social part of life easier in many different ways. If you have an iPHONE, the first result of these efforts you're likely to notice is that you'll know who's calling. Phone calls will be identified by name. You will also be able to make use of that information from within apps like the Phone app, mail, Facetime or Messages apps. Also, Siri can use this information. This lets you order Siri to do things which is lots easier than swiping and typing especially as you're masterring the basics of VoiceOver. You can teach Siri about relationships. For example, it knows that Sara is my wife and Dan is my brother. This lets me say things like "Tell my wife I'll be late for dinner" and be understood. You can dictate text messages, emails, and Facebook posts without having to go into the respective apps first. A lot of work has gone into making Siri a good communications aid. The Contacts app is how you give your iOS device and Siri what they need to help you keep in contact with people who matter to you.

Any time you need address information, chances are you'll find an option to get it from your contacts. For instance, I sent my mother a gift from the app store and quickly got her email address thanks to the information about her in the Contacts app. Contact information is also used by the Maps and other GPS apps. This lets you ask for directions to reach addresses stored in the Contacts app. This can include transit, walking and driving directions via the Maps app, BlindSquare, or other apps which can take advantage of this pool of information.

The Phone App:

People who have iPHONEs will be happy to know that the Phone app is very comprehensive and easy to use. It was originally one of the centrepieces of the iPHONE. Making, receiving and managing calls are all very easily achieved presuming you have mastered operating the touchscreen with VoiceOver. Siri is fully integrated with this app so you can call anybody in your contacts by simply asking Siri to call the person's name. Indeed, it is perfectly possible to ask Siri to call a number which you recite. Just don't pause for too long or it will presume you've finished and won't realise you're having trouble remembering the rest of the number.

There are five tabs across the bottom of this app. They are Favourites, Recent, Contacts, Keypad, and Voicemail. Double-tapping on a tab takes you to that particular area which will occupy the rest of the screen.

Dealing With Calls:

If a call comes in, a screen pops up with numerous options. If you simply want to answer it, just double-tap with two fingers anywhere on the screen. This is also how you hang up. If you're wearing wired earpods or other headsets, there should be a button you can press to answer or end a call. On the Earpods which come with your device, it's the long indented section which fels like it's been carved out of the remote in between the two round parts which can raise or lower volume. If you're wearing AirPods, double-tap either one to answer or end a call.

You can also do other things. At the top of the incoming call screen are message and remind buttons. These will make a reminder to return the call later or respond to the call with a message you can type in. Declining a call will pass the caller on to your voicemail where he or she can leave a message. At the bottom left and right corners are decline and accept buttons. Double-tap the button you want to use. You can press the sleep-wake button twice quickly to decline a call. Pressing that button once will allow you to lock your screen so you don't hit keypad buttons.

Favourites:

Having contacts added to your favourites has a couple of implications. First of all, you can call them by going into the Favourites tab flicking through the list of names and simply double-tapping on the one you want. Your iPHONE will then make the call for you. Nice and speedy. Also, there are different rules regarding favourites when it comes to Do Not Disturb settings. You can have these set to always allow people on your favourites list through when they call even when in Do Not Disturb mode. I'm rather thankful for this as I would typically rather not miss a call from afamily member, good friend or my landlord.

REcents:

Any calls you have missed, made or received are all shown in this tab. They are organised in chronological order with the most recent call at the top. Flick right or scroll up with three fingers to quickly move through the list of calls. It is a handy way of easily returning calls especially if the number hasn't yet been added to your contacts. Simply double-tap on the number or name to return the call. Alternatively, flick right and you'll find a "more info" button next to each item in the list. Double-tap this button to obtain any known information plug find options to add the number to your contacts thereby creating a new contact. There are other options similar to what you'll find in the Contacts app.

Contacts:

This tab is basically like the Contacts app. Double-tapping on a contact name will move you into that contact's entry where you'll find the usual options.

Keypad:

This tab gives you access to a virtual phone keypad. As you input a number, you'll even hear touchtone beeps as you would if using an actual telephone. This is good for blind people as you'll know when you've successfully entered the right digits. If you need to delete a digit, You'll find the button you need near the top right of the screen. Just below the numeric keypad but above the row of tabs, you'll find a "call" button in the middle. It's right above the Contacts tab. Double-tap that button to make a call.

During a call, the keypad is display so that you can make use of touchtone systems. There are occasions, however, when this is less than desireable as it's possible to accidentally press keys with your cheek. There is a button which hides the keypad if you wish. You'll find options right below the keypad to end the call, mute, or hide that keypad.

Voicemail:

This last tab is a very nice addition presuming your carrier supports it. Not all phone plans come with what is called visual voicemail. Presuming you have it, this tab will be where you to go receive your messages, set your greeting, etc. Messages will be downloaded to your phone for you to easily review at your leisure. I've become quite attached to this feature and pay a small fee for a package of additional features which includes visual voicemail as part of my phone plan.

If, for whatever reason, you don't wish to use this or can't get a plan which has it, you are still able to use the normal voicemail offered by pretty much all phone companies. You simply use the keypad discussed earlier to enter your passcode and operate the menus as you would with an ordinary touchtone phone. This may prove stressful for beginners as they have yet to gain proficiency with finding and enterring digits on their touchscreens. Visual voicemail eliminates this hastle and does away with any time pressure.

To use visual voicemail, double-tap the tab and you'll find a "greeting" button near the top of the screen. This lets you record your voicemail greeting which people hear when you miss or decline their call. I don't recall needing to do any other things to set up visual voicemail. I got it some years ago and have kept it ever since. You may need to get help from your carrier. When you receive messages, they are put in a chronoligical list with the most recent messages at the top. You can simply flick through them and double-tap on a message to start it playing. Double-tap on the "more info" button next to a message if you want to get to the same contact page as you'd arrive at though the Contacts tab or the "more info" button found in the Recents tab.

You can pause a message during playback, move back or forward through it, and do other things like return the call, delete the message, etc. This makes it easy to manage messages even if you have yet to deal with the rotor and flicking gestures. It makes for a very efficient stress-free way of dealing with messages.

There are other options such as call waiting, ending a first call and receiving a call that has come in while you're on a first call, adding people to calls, etc. I suspect that carriers need to support these features. In appropriate circumstances, options will appear on the screen displayed while you are in a call.

It is also possible to be in a call while still using other apps. Simply press the home button to get out of the phone app. Your call will continue even as you do other things. There is a bar near the top left of the screen which you can double-tap to return to the call screen if you like.

FaceTime:

This app is used to make audio or video calls to others who use iOS devices or computers supporting FaceTime. To use FaceTime, you need an Apple ID for yourself. Presuming your device has been set up, you have already created your Apple ID. You'll also need to know an Email address and/or phone number of people who you want to contact via FaceTime. This information may be found in the Contacts app or added in directly from within the FaceTime app. Once done, that person will be found in the Contacts app.

How to make a FaceTime call:

You can do this in a few ways. From inside the FaceTime app, you can double-tap on the "audio", or "video" buttons near the top of the screen. Next, double-tap a contact's name. This will make a call to that person. You can also use Siri from anywhere on your iOS device to make a call. Simply invoke Siri and then say "FaceTime" or "FaceTime audio" followed by the person's name. This will initiate a call. Also, you can initiate a FaceTime call from within the Contacts app. Simply go into the contact entry you're interested in and flick right until you reach the "faceTime call" button. Double-tap to initiate the call.

There are options you can use during a FaceTime call. Video calls can make use of the front or rear-facing cameras built into your iOS device. You'll find buttons to choose which camera to use on the call screen which appears. You can also end a call in progress, sswitch to an incoming or waiting call, or mute your microphone. Double-tapping with two fingers will accept or end a call. You don't have to be in the FaceTime app to receive a FaceTime call. A two-fingered double-tap will accpt the call from anywhere. Also, a menu pops up giving you options which you can flick over should you want to decline the call for example.

Near the top of the screen, you'll find an edit button letting you delete FaceTime contacts. You'll find a search field letting you look for contacts by name, email or number.

Also, look in the Settings app where you'll find specific settings for FaceTime. These let you turn the feature on or off, choose which information people can use to contact you through FaceTime, and more. To specify whether FaceTime can use cellular data look in the "cellular" setting. Remember that FaceTime must use either WiFi or cellular data. Also, video calls use more data than strictly audio ones.

I have found FaceTime to be especially useful in a few ways of particular interest to blind people. I've used it to show distant relatives what my apartment was like using the ability to switch to the rear-facing camera on the back of my iPHONE. This has also been a useful way to have a sighted person help read things my OCR apps can't understand. Also, they can help me look for lost items. You could also theoretically use FaceTime to have someone sighted help you navigate somewhere or at least see where you were in order to find you more easily.


A Closer Look at Do Not Disturb:

As we learn how to communicate with people, it is important to make certain that we remain in control of when we communicate. The "do not disturb" mode is extremely useful when sleeping, attending meetings, visiting with friends or at other times when you don't want to be interrupted by your device. Airplane mode is easy to activate but completely cuts all transmition to and from your device. Most of the time, this isn't what you want. We often don't want to be distracted but still want to be able to make calls, check email, shop online, or surf the web. Do Not Disturb mode makes certain that no external calls or messages nor any alerts generated by apps on our devices will interrupt us. Unlike airplane mode, your device remains connected. You can still use Siri, receive calls and other information. This means that you don't miss out on notifications. They wait for you when you're ready to deal with them.

How to turn on Do Not Disturb mode?

You can simply tell Siri to do it. You can also go to the control centre by touching the status bar at the top of the touchscreen and swiping upward with three fingers. Flick right until you find the "do not disturb" button and double-tap it to turn the mode on or off.

 Adjusting how Do Not Disturb works:

Go into the Settings app and flick right until you come to a "do not disturb" button. It's right before the "general" button completely separate from Privacy settings. In the Do Not Disturb settings, you'll find options letting you do several things. You can schedule a time of day when your device will audomatically go into Do Not Disturb mode. This is useful for sleeping. I schedule my iPHONE to enter this mode at 11 PM and come out of the mode at 6 AM. You can also control who is still able to reach you even in Do Not Disturb mode. I allow contacts in my favorites such as my landlord, family members, etc, to reach me. There's also a setting to allow repeated calls through. If people call more than once within a few minutes, they'll be allowed through. You can turn this off if you don't want that to happen. Another option lets you choose whether your device will be silent always or just when it's locked.

The Messages App:

This is where any text, video or audio messages are sent, received and managed. You can send messages to groups or individuals. These are organised as conversations. Messages are sent through Apple's service if they're to other Apple devices. These can be Mac computers or other iOS devices. You need to be connected to the Internet to use the Messages app. These go through WIFI or cellular Internet connection and don't count against your texting plan. Otherwise, if they're to non-Apple phones, they are regular text messages and will use your texting plan. You can attach media from other apps, record audio or video messages, and decorate your text messages in all sorts of ways.

True to form, Apple keeps things as free of complexity as possible. There are no tabs in this app. At the top, you'll find edit, compose and search buttons. Between the edit and compose buttons is the app title which is a heading. You can always turn your rotor to headings and get right back to the top easily. Flicking right past the compose button, you come to a search field. This lets you look for contacts and conversations. Useful as you have more of these. Past the search field, you start with the main area filled with the names of groups or people and previews of the most current messages of each conversation. It is organised with the most recent conversation first. This keeps expanding as you communicate more. Double-tap on a conversation to enter it.

How to send a message:

There are a few ways to send messages. The easiest is to simply use Siri. Say something like "Tell Norman I'll be late for lunch." Siri will compose the message, ask if it understood you correctly, and then offer you a chance to cancel or change the message. Otherwise, you can just say "yes" and it'll send the message. You can also ask Siri to read messages to you. This would be especially useful for beginners still getting used to VoiceOver.

Double-tapping on the compose button opens a screen letting you make full use of the app's capabilities. You can add one or more names from your contacts. Typing a partial name will cause likely candidates from your contacs to be listed. You can flick right to get to these and double-tap the one you want to add. There are plenty of possibilities when it comes to creating your messages. You can type and edit your message in the edit field after double-tapping on it. Flicking over the field when it's ready to receive input, you should hear VoiceOver say "is editing". You can type your message or find the dictate button to the left of the space buttton on the virtual keyboard. Double-tap and speak your message finishing by double-tapping again to stop. Messages can have more than one line so use the return button if you want. When finished, flick right to get to the "send" button and double-tap it. Recording an audio message is also very simple. Double-tap with one finger and hold on the "record audio" button. While doing this, speak your message and release your finger when you're done. You can then play what you've recorded to make certain it's correct before sending the message via the "send" button.

Receiving messages and viewing conversations:

When messages arrive, VoiceOver will read them to you presuming you haven't changed any settings in notifications to stop this from happening or have do not disturb mode turned on. This makes it possible to carry out conversations without ever typing or swiping. All fine and good for curent simple stuff. When you want to look back through a conversation, double-tap on it and go into that conversation's screen. You can then flick right through the messages from oldest to most recent. At the end of the messages, you'll find tools to compose your next reply in that conversation. This will always be at the bottom right. You can also see if messages have been delivered and whether any additional content has been added such as stickers, files, etc. Near the top left by the contact name, you'll find a "more info" button. This shows you anything you've entered about the contact and gives you a series of optionssuch as making a FaceTime call, sending an email, etc.

Participating in Group conversations:

Once you've added more than one contact to a message you've composed, you will start a group conversation when you send that message. You can also receive a message which involves you in a group conversation when you reply to it. You can name groups once they're created. To do this, go into the group conversation and use the "more info" button. Flick right from the top left and you'll find a "name" field. This is where you can enter a group name. The "more info" screen also has other options letting you add new group members or leave a group conversation you no longer wish to participate in.

Concerning Emojis:

VoiceOver will describe any emojis other people use in their messages to you. If you want to use them yourself, while you're in an edit field, find the space bar at the bottom of the keyboard and flick left past the dictate button. You'll find a "next keyboard" button. One such keyboard is full of these emoji immages. Once you've switched to that keyboard, you can find whatever emoji you want and double-tap it. Use the "next keyboard" button to cycle through any keyboards you've added and get back to your normal preferred keyboard. Descriptions for emojis are generally well thought out and brief so this is perhaps the easiest way to clarify your meaning through imagery for sighted people. It also doesn't cost anything.

Settings Associated with the Messages app:

Go into the Setttings app and double-tap on messages. These let you control a lot of aspects about how the Messages app behaves. For instance, you can choose whether subject fields are shown. You can also turn on a setting which sends images in low quality in order to save data. You'll also find a "blocked" button which lets you manage blocked contacts you don't want to hear from. There's another setting letting you choose not to be notified when people not on your contacts list send you messsages They are kept in a separate list for you to review at your convenience. There are many more settings. Also, remember that settings in other areas like privacy can influence how the Messages app functions. It's one of those central apps which ties into a lot in iOS.

More To the Messages App:

Apple has built considerably more capabilities into their Messages app. The Digital Touch aspects allows people to add drawings, backgrounds and things to their messages. That was what I used to accidentally send my good friend an angry fireball. I haven't had any success using this effectively with VoiceOver. The sketching and drawing aspects seem to be the real core of digital touch. If you receive messages with drawing or digital touch elements, you'll be told the elements are there but not what they are.

Using Background Effects:

There are a set of effects you can attach to your messages. They can either be contained in boubles or else occupy the whole screen along with your messages. To use these, write your message first. Next, double-tap and hold on the send button or press firmly on it if you have 3d touch enabled. This adds a panel to your message screen containing choices. There are a more limited number of choices for bouble effects. These include slam, gentle, loud, and invisible ink. It may be possible to add more choices here. Screen effects include lasers, balloons, confetti, and many more. It will default to one effect but if you flick right past this, you'll come to a page slider which changes the effect to be sent. After choosing the desired effect, find the send button and double-tap it. If you get a message with an effect, you may hear appropriate sounds as the message is read. The effects have descriptions which VoiceOver will read out in addition to your message.

Adding Stickers:

One of the easier elements to make use of for blind people are stickers. Think of these like stamps. Using them is just as simple as sticking a stamp onto paper. Next to the "digital touch" button, you'll find a "messaging apps" button. Double-tap on this and more options will appear on the touchscreen. If you're already in a message, you need to flick left to find a "show more" button and double-tap that. Then, you can access the "messaging apps" button. This gives you access to a whole lot. Once you enter this area, a slider moves you between pages of options. You start on a "recents" page but if you've never used messaging appps and stickers before, nothing will be on it. Go to the next page and you can look through options. Near the bottom of the screen, there are buttons for browsing apps and stickers. You default in the stickers section which will contain any stickers you've acquired. Some apps come with stickers. For instance, the Weather Gods app is popular among blind people and it has a number of well-described weather stickers. There are also stickers you can purchase depicting favourite movie characters, locations, and much more. Flick right through the stickers you have and double-tap the one you want to add. It's possible to add more than one sticker but I don't think you can position them manually.

Stickers are designed for decoration whereas emojis are images carefully chosen and constructed to make the emotional context of messages clear. Think of stickers like stamps and emojis like psychological punctuation marks. There are a far more limited number of emoji symbols. They are all included in the Emoji virtual keyboard included as part of ioS. Emojis are free and available for use in any app capable of accepting typing. You won't find a Luke Skywalker emoji since Star Wars images are trademarked and don't clearly convey emotional meaning to people unfamiliar with that fictional universe. One emoji is a slice of pizza. While this is a food of western civilization, you can easily tell that it's food and conclude that the message sender may be expressing he or she is hungry. You can realise this even if you've never encountered pizza before. Emojis can certainly be use decoratively and often are but that isn't their primary purpose like it is with stickers.

The messages app store and Integrated Apps:

These apps plus others you already have are capable of enhancing your messages or making use of the Messages app to let you do things. Once you acquire an app with this kind of capability, it will be put in your app drawer. This is also where you'll find your stickers. You can manage the contents of this app drawer. Find the "manage" button and you can hide what you don't find useful removing it from the drawer. You can also re-order contents of the drawer. The first time you visit the messages app store, you can choose to automatically add apps which integrate with Messages into the drawer. I recommend doing this. Presuming the app in question is accessible, the part which integrates with the Messages app should also be.

One good example is the Music app which comes with iOS. After finding it in my app drawer, I was able to send a message to my wife Sara and add a clip of the song I was listening to. She could hear that music as she read the message. I only had a short poke around but it looks like I could have also sent clips of recently heard songs and not just the one I happened to be hearing as I wrote the message. The Dropbox app lets you send links to files you have uploaded to that service sharing them via messages. There are lots of other apps. Many of them are free. I urge people to experiment with people who know you as you try these apps out. Before spending any money, look on

www.applevis.com

The forums and app recommendations will be helpful in avoiding spending money on more visual apps or on stickers which haven't been labelled accessibly. Exploration of screens is key. Take time to flick and feel around to get a sense of what's possible with messages apps in the drawer. VoiceOver doesn't read out all your choices but encourages you to explore and find out where they are on the touchscreen.


The Mail App:

Apple has created a good simple app for dealing with email which is completely accessible. It can organise your mail by thread which can really help if you get a lot of email. You can also make use of different mail boxes to make certain you get to all your important mail. As with all of Apple's included apps, it covers the basics well and steers clear of too much complexity. It pays to have the rotor gestures mastered as they are helpful in reading and editing messages.

How to Set Up The Mail App:

Go into the Settings app and flick right to get to the mail settings. Double-tap on that and you'll be where all the setup and preference options are. You can then enter the needed information if it isn't there already. Presuming you've created an Apple ID, you'll have already given it an email account or have had one created for you by Apple. You may need information such as your smtp server, password, etc if you want to use an email account from another email service like Gmail.

There are settings for deciding how messages are organized. You can have them grouped into threads or simply placed in your mailboxes in chronological order. You can also choose how many lines are shown as a preview of messages. You can decide whether you want to be warned before deleting messages. There are options in the account area to decide how frequently new mail is checked for and pushed to your iOS device. There are also composition settings which include the ability to create an email signature which is automatically included below every message you send.

Layout of the Mail App:

This is another case where Apple didn't separate everything into tabs. Everything is on one main screen with various options like composing email taking you to a separate screen focussed on a given task. At the top, you'll find the mailbox selection. You default to the inbox but double-tapping the mailbox back button takes you out of that and into the mailbox list. Presuming you're in the right box, flick right and you'll find an edit button. This lets you do things like select a bunch of messages and move them to another box, delete them, etc. There's also an edit button near the top of the list of mail boxes. This lets you re-order, add and remove boxes as your needs change.

Right of the edit button is the search field. This lets you search for specific messages. Next comes the main area where messages are listed. You can flick through messages or threads if you choose to deal with messages thread by thread. Double-tap to go into a message fully. There's no limit to the size of your message list.

How to Browse messages within a thread:

Turn your rotor to the messages setting and you'll be able to quickly navigate through messages by flicking up or down. This lets you get a handle on discussions easier letting you quickly skip over to the next or prior message within a thread.

Composing emails:

The bottom right corner always contains the compose button. Double-tap this to get to the message composition screen. There are various fields. Getting around the screen is pretty simple. Double-tap to go into a field. You default in the "to" field where you can enter a full or partial name or email address. Flick right after typing some of a contact's name or email and you'll be presented with any options which might be who you're trying to contact. Double-tap on the ones you want to add to the message and their names will be added. Flick to the right past any such options to get to other fields like CC, BCC, subject, and finally, the message body. Remember that rather than flicking, you can feel around the screen to find out where fields are and double-tap on them to enter them. When done composing, feel around the top left of the screen and you'll likely find yourself on the "back" button. Flick right and you'll come to the "new message heading. To the right of that is the "send" button. Double-tap that to send your message.

Filtering Messages:

Touch the bottom right corner to find the "compose" button. Flick once to the left of this and you'll come to the "filters" button. This lets you filter messages so that only messages you're particularly wanting to focus on are shown. For instance, I have my filter set to unread messages so that I'm not bothered by ones I've already read. There are many more possible filters so take the time to look around the options after double-tapping the filters button.

To get back out of areas, simply check the top left corner of the screen for a "back" button. You'll never be trapped anywhere. There should always be a back button. Also, one of the drawbacks of the Mail app is that there doesn't seem to be any way to simply delete all mail in your inbox. You have to actively delete or archive messages individually. This is by far my biggest gripe with the app. Once you're done with a message and have archived or deleted it, you are automatically taken into the next messages. For more of an overview to pick what to tackle next, double-tap the back button to return to the mailbox you're working with.

One other gripe is that it doesn't look like you can compose a message and then deside to attach something later. Instead, you have to go to the file you want to attach, use the "share" option to and choose "mail". You'll then be put in the composition field and the file you want to share will be attached.

App Store Expedition:

If you want to expand your communications reach beyond what comes included on your iOS device, the app store has you well covered. For contacting people with devices other than iOS ones, there are always options like Skype,. That's a very popular communication method now owned by Microsoft. They have a very accessible app for iOS users. For private group conversations, there are apps like Zoom which again have software available for Android, Windows, and other platforms. Beyond these, for more public widespread communication, there are a whole range of social media options with often many different app choices to use them. We'll discuss social media in depth later in this guide.

Personally, I mainly use the Gmail app created by Google. I find this works better for me than the Mail app which comes with iOS. There are many other email app choices in the app store. These will offer different options and ways to help you manage your inbox without going nuts. For instance, Google created the Inbox app which automatically organizes your messages into related bundles. Your email provider may have created a special app for its customers to use. Also, other developers have taken their own crack at doing email differently. I haven't seen much discussion of different email apps regarding how accessible they are. People seem happy with things in general. As always, people interested in finding something different should look at:

www.applevis.com

Look in the app directory. It's well categorized. You can also search by keyword on the Applevis site which will also look into discussion forums where people talk about their experiences with different apps.

Conclusion:

I hope this helps get people started using their iOS devices to communicate with others. It's one of the primary ways these portable and powerful flat objects have changed many lives for the better including my own. Whether I'm stuck in an elevator, in a car, or walking around the man-made lake near my building, I can be in touch with whoever I might need to. Should I drop something onto a patch of carpet where I couldn't hear it land, I could use FaceTime to contact a sighted friend or family member to literally look around for the object without leaving his or her home. There are just so many implications.

When you bring in apps made by others and offered in the app store, the possibilities grow vast indeed. There are special apps made to help deafblind people communicate more easily with others. There are apps like Google Translate which can render words spoken or written in another language understandable in mere fractions of a second. Combine these sorts of capabilities with the stupendous amount of information available from the Internet, and the implications for collaborative creativity seem endless. Once you've mastered the mechanics of VoiceOver and using a touchscreen, there are no other barriers to expressing yourself well.


Wednesday, May 24, 2017

Lifestyle Apps

With their extreme portability, iOS devices are uniquely positionned to be of help in many ways. From working out your share of a bill at a restaurant table with the handy calculator app to keeping track of appointments with the included calendar app, you'll be surprised how much you can do with apps that are automatically included with iOS. These are useful in everyday life and are helpful for students. These apps are simple and offer basic functionality. Beginners can feel comfortable practicing their skills using VoiceOver and exploring the screen.

Should you need more functionality or a different approach to these everyday tasks than the included apps offer, fear not. Chances are that you can get a more suitable app for your needs in the app store. I've found a number of apps offerring alternative approaches which suit me better. Later in this section, we'll go on two app store expeditions. I'll tell you about a couple of these alternative apps. I'll also explain how I found out about them. For lack of a better category term, I'm calling these lifestyle apps since they are useful in everyday situations. Calling them utilities just doesn't seem quite right.

Before we take a closer look at the various apps, remember that you can use Siri, Apple's built in personal assistant, to perform many of the tasks these apps can do. In fact, Siri makes use of these apps on your behalf. If you tell Siri to create a reminder or appointment, it will be done using the Calendar or Reminders app which come standard in iOS. Beginners who struggle with navigating and typing will be able to use Siri to enter appointments, create reminders and check what's due or coming up. More on Siri later. pause or cancel timers, do calculations for you, etc. Try asking it math questions. You can do quite a lot without ever going into the Clock and Calculator apps. Siri isn't as versatile when it comes to reviewing information in detail. If you want an overview of your scheduled events for the month, you are well advised to become familiar with the Calendar app.

The Calendar App:

The calendar app has a reasonably simple layout keeping everything on one screen. There are no tabs separating different areas like you'll find in other apps. Starting at the very topleft of the touchscreen below the status bar, you'll find Search and Add buttns. These let you search for and add events to the calendar. At the bottom right are "Today", "Calendars" and "Inbox" buttons.

So far, so good. However, things get a little tricky in the middle. The rest of the screen is taken up with a scrolling calendar. Years are separated by headings. Setting your rotor to the "headings" setting will therefore let you scroll easily through years. Each month is a button so flicking left or right goes backward or forward by month. You can scroll indefinitely backwards and forwards to past or future years. Touching a month at the top of the screen and flicking left won't get you to the search and add buttons. It will just keep scrolling. The same goes for when you're at the bottom of the screen and flick right. It takes a bit of getting used to. To reliably get to the option buttons, it's best to touch the top left or bottom right corners landing you on the "search" and "Inbox" buttons respectively. You then flick right from the "search" or left from the "inbox" buttons respectively to reach the additional buttons.

When you're at a month you want a closer look at, double-tap on it. You will be taken into that month's calendar. The current month and day are always indicated when you go over them in their respective levels detail. There are no headings in the month calendar. However, each week has its own row of days. Turn the rotor to "vertical navigation" to move quickly through the weeks of a month by flicking up or down. This keeps you on the same day of the week. Double-tap on a day to see events taking place on it. They appear at the bottom right just before the "today" button when the day is highlighted. However, you can get into an even more detailed daily view where any events in a day are shown along with their times. You can navigate this list by heading or by a special "event" setting which appears on your rotor. Double-tapping on an event will show all its details and any notes. For instance. St. George's Day is a holiday celebrated in some parts of Canada on April 23. A note included in the Canadian Holidays calendar indicates that it may not be celebrated in your area. Double-tap and hold on an event to change its start and end times.

 You can scroll through different weeks by three-finger swipes left and right.

The calendar gives good functionality but takes time and experimentation to really master. I only learned about some included capabilities while preparing this section of the guide and consulting the user guide written by Apple as part of that process. That's something you'll find as you use iOS extensively. Unless you take the time to read the user guide, there's not always a lot to point you towards useful features. It really pays to take the time to do that and also explore within various apps you use.

To add an event, double-tap the "add" button. An entry screen will appear with a number of edit fields and options. You can get around it by flicking lef and right. Double-tap on an edit field like "title" in order to enter information about the event. Once you're satisfied with the contents of the fields, find the "add" button at the top left of the screen right below the "New event" heading. Once you've entered sufficient information, this button will become active and nno longer be dimmed as it was when you began creating your event. Once you double-tap the "add" button, the event will appear in your calendar. Nothing is carved in stone. It is quite possible to change an event. Double-tap on it while in the day view where events are listed. You can also search for it and double-tap on it in the search results. You can then edit it easily and/or remove it.

The Reminders App:

This gives you the ability to create and deal with reminders. These can be repeating or once-only reminders. You can group reminders in different lists. For example, a list for work-related reminders and a separate list for home or personal reminders. This app is very basic. There's a heading at the top to get you back there quickly with the rotor. This app has no tabs. There are buttons to edit reminders, add a new reminder, and show your different lists.

Creating a reminder involves double-tapping the "new reminder" button. Type information into the edit field and flick right. Double-tap on the "more info" button to get to the details section. This lets you specify time, location, and other details needed to trigger the reminder. Otherwise, the reminder will merely contain the text in the preceding field. You can put a checkmark when you're done with a reminder to mark it as completed.

Reminders can be location specific. You could have one trigger when at the grocery store to remind you to get certain foods. Reminders which have completed or which you don't need anymore can be set to checked. This puts a checkmark beside the reminder and marks it as complete. As with the calendar app, you are able to edit and delete reminders when you need to.

App Store Expedition: Fantastical 2 and VO Calendar:

Whzat if it were possible to combine the information accessed through the calendar and reminders into a single app? All of your time management would be right there in the same place. While producing this guide, I was a regular contributor to a show called Kelly and Company. So was my colleague Tom Dekker. He runs a web site and service well worth checking out at:

www.ihabilitation.com

By complete coincidence, both of us use our fifteen minutes of fame that week to discuss different apps which approached simplifying personal organization on iOS devices in two different ways. This provided a golden opportunity to illustrate a major advantage of the iOS ecosystem; The ability to choose and develop approaches suitable for people with varying abilities and skill levels. There's almost never just one way to do things.

Sadly, spreading the word about these choices, particularly ones designed for smaller markets, is tricky for app developers. Word of mouth is priceless advertising. Sites like:

www.applevis.com

are an essential resource for app developers and new users looking to learn about and make the best app choices with their limited funds.

Fantastical 2:

For those who are comfortable with VoiceOver and wish to use an app designed for sighted users, Fantastical is one attempt to combine calendar and reminder into something greater than the sum of its parts. This app is made by Flexibits and costs $7 Canadian. It uses the data from the calendar and reminders apps giving you a better univfied organizer. It also has a natural language parser capable of understanding event or reminder-related sentences you can type or speak into the app. At present, this works even better than Siri when it comes to understanding naturally phrased events and reminders.

To dictate an event, you must first use the "new event" button. Once you're in the edit field, find the "dictate" button on the virtual keyboard on your iOS device to the left of the space bar. If you're using a Bluetooth keyboard and want to dictate an event, you need to deactivate that keyboard so the virtual one pops up on your iOS device. The virtual keyboard is only present once you've entered an edit field. Fantastical doesn't replace Siri so holding down the "home" button or saying "hey Siri" will still behave as always. This lets you stil use Siri when you're hurrying through your day. However, if you can get into the habit of going into the Fantastical app and using its "new event" button instead, you gain the advantage to speak or type very naturally about the event or reminder and have Fantastical understand you perfectly and do the right thing. Once you're certain you've been properly understood, find the "add" button near the top left of the screen and double-tap it to complete the operation.

Fantastical has all the control buttons at the top of the screen. Below is the day ticker which displays days with events or reminders. You can choose whether empty days are shown or not. Each day starts with a heading so turn the rotor to headings to scroll quickly through days. You can scroll infinitely back or forward. A two-finger swipe downward while on the top of the day ticker will transform it into a month calendar. You can then turn the rotor to vertical navigation to examine days and weeks flicking up or down through weeks and left or right through days. Use a three-finger swipe left or right moving back and forth through months. On the day ticker, flick right to go over each event or reminder within a day. Flick down when on an event or reminder to accesss a context menu allowing you to select the default action, "more", or delete it. Double-tap on your choice to execute it or flick right or left to leave the menu.

 Creating events is very intuitive with Fantastical. The "new event" button is to the right of the "go to today" button. Double-tap it and you'll be in an edit field. Type or dictate your event in sentence form. If it's repeating, you need to be specific. For example, it doesn't automatically know that birthdays happen every year so you have to say: "Michael's birthday is on October 29th each year". It will then fill in all the fields for you. If you're happy with the result, flick right to get to the "add" button. You can also edit details to get exactly the event or reminder you want. If you want a reminder rather than an event, include the words "reminder", "todo", or "task" in the sentence.

the buttons at the top are "settings", "go to today", and "new event". There are also buttons allowing you to sort and filter what is displayed by "title", "location", and "invitees". All of these buttons will always be displayed at the top of the screen starting with "settings" at the top left.

VO Calendar:

For some people, a better approach to combining calendar and reminder into an easier overall app would be the Vo Calendar app. Produced by Devista D.B. in partnership with a Dutch agency for the blind, this app will cost you around $14. This app is only useful to people who make use of the VoiceOver screen-reader. It cannot be used without it by sighted users. The aim was to make it as simple as possible for blind users to use the built-in calendar and reminder functions of iOS. Like Fantastical, it makes use of data stored in other apps included with iOS. You can therefore share the data with other users of not only Fantastical but any apps making use of the same data sources. You can share events with friends and family who can incorporate them into their own preferred calendars. Calendar events shared by others can also be incorporated into your own calendar.

What really sets this app apart is the screen layout and ability to summarise your events so you don't need to go through them one by one. The screen is divided in two halves so you can use one hand to scan events and your other hand to tap and activate things. If you prefer, you may also use ordinary VoiceOver gestures to operate the app. Those who find it hard to master typing can record events thanks to Vo Calendar being able to tigh into the Voice Memo app included in iOS. You can hear events in your own voice.

App Store Expedition Souvenirs

This glance at two very different approaches to simplifying personal life organization demonstrates the value of looking beyond what is included in iOS. People have taken the basic building blocks Apple came up with and have produced some very innovative tools which greatly enhance your capabilities. Beginers who struggle with the basic calendar and reminder apps have alternative ways of keeping life on track. These apps could make a very big difference to people who have frequent appointments to attend and need reminders every day to take various medications at regular times. Students whose lives are filled with assignments, deadlines and social engagements will also appreciate having calendar and reminder functions enhanced and accessed in a single app.

It pays to take the time to see if apps exist which may do more of what you want with greater ease. All apps in the store have reviews and descriptions. These are quite helpful but are generally written with sighted users in mind. Not all apps offer good support for VoiceOver. This is especially important for beginners who are still learning VoiceOver gestures and getting used to how things are supposed to behave. I strongly recommend that before you make a purchase, take the time to look at:

www.applevis.com

There, you can check the app directory to see if the app you are interested in has an entry. These entries are written with blind users in mind typically by blind users. You'll find plenty of accessibility information including any discovered workarounds for elements of apps which are less accessible than they could be. As you become more experienced, you might eventually want to try apps which have yet to find their way into the app directory, podcasts and reviews on Applevis.

Once awareness spreads through the blind community about a particularly good app, it doesn't take much effort to find out about it yourself. I first heard of Fantastical 2 through online acquaintances I've made over the years. I wasn't much interested at the time and took no immediate action. However, it seemed to keep coming up in reviews of other apps and in conversation. Comments were pretty much always favourable. I did quite well with the calendar and reminders apps which came with iOS. However, when working on this guide, I thought I should get it and see how good an example it would make of an alternative and better accessible approach to personal life organization. Ever since, I've been using Fantastical 2 exclusively. I wish I had gotten it much sooner. The app developers are very responsive to ideas and/or accessibility issues.

Due to my skill level with VoiceOver, I felt no need to acquire VO Calendar. It doesn't really offer anything other than greatly simplifying calendar and reminder tasks. Others could easily come to the completely opposite conclusion especially if they struggle to use the touchscreen in general. The work which has gone into minimising the need for navigation is somewhat lost on me. However, for people just getting started or those who have motion difficulties, it could make all the difference.


The Calculator

This app is included in iOS and will likely fill the mathematical needs of most people. The calculator works well with VoiceOver. It has two different modes:

Basic Calculator:

If your iOS device is in portrait mode, you will have access to a basic calculator. Functions include addition, subtraction, multiplication, division, and percent.

You'll find a numeric keypad at the left of the screen covering most of the surface. Lower digits are at the bottom and higher are at the top. Decimal is right of 0. Equals is right of decimal.

Above the equals sign, you'll find functions proceeding up the far right of the screen. Adition, subtraction, multiplication and division at the top. Above the 7, 8 and 9 keys are clear, plus-minus and percent keys. Above this is where the results are shown. Voiceover automatically announces results. You can also read them more carefully with the rotor after touching the result space.

The layout is simple enough to be mastered quickly. Very handy for most day to day stuff.

The Scientific Calculator:

As long as orientation is unlocked, turning your device sideways transforms the basic calculator into a scientific calculator with many more functions.

The basic stuff is all still there but is condensed onto an area at the right side of the screen. To the left of the numbers, you'll find the rest of the screen taken up by all sorts of higher math functions. This includes parentheses, geometric functions, exponents, and lots more.

This layout will take longer to master as it crams a lot more onto the screen. I recommend the use of touch typing mode. Set this with the rotor. This way, nothing is entered until you lift your finger from the surface of your device. This gives you a chance to feel around for the right digit or function and makes entry mistakes less likely.

The Clock App:

This app packs a bunch of handy time tools into a single app. It includes a world clock, an alarm clock, a "bed time" sleep analysis, a timer, and a stopwatch. Each of these functions have their own tab. From a blindness perspective, there are a few unfortunately missing abilities. There is no way to tell time through vibrative tactile feedback like with the AppleWatch. Also, there is no facility to set chimes.

The World Clock:

The left most tab on the bottom of the screen accesses this clock which can display current time in many different cities around the world. The "Edit" button is found at the top left of the screen. Double-tapping this brings you to an edit mode which lets you arrange the order cities are displayed in as well as delete cities you don't want. Double-tap and hold on the "re-order" button next to a city's name and slide your finger up or down to move it. Hit the "done" button when you're finished.

The "add" button is one flick right of the words "world clock". It lets you add new cities from a large list. You may not find your particular city but you'll find one close enough. I have Toronto, Cupertino California and London England on my world clock. Helpful for catching online events like Apple presentations.

The Alarm Clock:

This is a very easy alarm clock to operate. You can have multiple alarms for various days and times. For each of them, you can choose which of them are on or off. You can add new alarms with the "add" button. There's an "edit" button at the top left. Use that to change the characteristics of alarms by double-tapping on an alarm and flicking right through the various options. There are plenty of options including snooze, sound choice, etc allowing quite a bit of latitude in constructing your alarm. You can select different sounds, any ringtones you have, or songs from your music library.

Bedtime:

This lets you schedule a reminder to go to bed plus a wakeup time. You can select from a number of attractive wakeup sounds as a more gentle approach to wakefullness than the alarm clock. Also, you can set things so you're not woken up on weekends. It's pretty flexible. It analyzes your usage of your device to help determine when you're actually sleeping or when you might perhaps have gotten up early. Data is recorded and placed in the Health app.

Stopwatch:

You can perform all stopwatch functions easily. No automatic reading of time is done but you can easily check it by touching the screen near the middle. There's a heading at the top so you can set the rotor to headings, flick up to get to the heading and then flick right to get quickly to the stopwatch time. Double-tapping the "lap" button will quickly give you the current progress reading the exact moment the button was pressed. There are also stop and reset buttons.

Timer:

This is your basic timer. There are no announcements as the timer counts down. You can set duration and choose the sound which plays when the timer expires. Also, you can choose to have it stop playback of whatever music, podcasts, etc that you're listening to. Handy if apps don't have their own sleep timers.

Like the stopwatch, you can check timer progress while in this tab of the clock app. Also, presuming nothing eclipses it, you can find the timer on the lock screen. Music track information can have this effect as track information seems to get priority.

App Store Expedition:

If the clock and calendar functions aren't quite meeting your needs, Look on Applevis and the app store. There are some useful discoveries. For people needing more flexibility or a different layout approach to calculating, Adam Croser has developed three different talking calculators. These can read out large numbers better than Voiceover and have other accessibility considerations such as different contrast modes. Functions are divided up into panels rather than being all crammed onto one screen. To get these, look for "talking scientific calculator", "talking statistical calculator" or "talking calculator" in the app store search field. All of these support VoiceOver. Price for these calculators is around $6.

The clock is great for basic use. However, many blind people would very much like to be reminded of the time by hourly chimes or tactile vibration. I have yet to hear of an app which gives tactile feedback helpful for keeping track of time. The Apple Watch will do this but purchasing one for this ability alone seems crazy. However, my Twitter followers pointed me to "Westminster Chimes Full", a $1.39 app made by LutherSoft. This gives audible chimes in five different traditional English styles. The app fully supports VoiceOver and is quite simple to use. The developers are well aware of VoiceOver and have taken stepts to make their app fully accessible. Even beginners will have little difficulty setting the chimes how they prefer.

For timers with more capabilities, I have an app called Timeglass. I can build more intricate multi-stage timers with that app. For instance, I schedule work time and breaks for when I'm working on these notes, blog entries, or my guide. It has the ability to construct timers with multiple stages which can have spoken or sound cues. As I go through my work time, I hear signals letting me know when it's time to take a break. The app includes many pre-made timers for everything from doing laundry to safely cooling beer in the freezer. How epically thoughtful is that? Some timers can be had for free. However, to unlock the full functionality of the app requires an in-app purchase. To complete this, you'll need your Apple ID and password plus around $6 in available funds.

App Store Expedition Souvenirs:

Again, we see that it pays to keep current on what's out there. I found out about Timeglass through word of mouth. Somebody else stumbled on it and let his Twitter followers know. Thankfully, I happened to be one of them. Quite often, you won't be able to find precisely what you're after. You'll have to make do with what the included apps offer or choose between apps which each do part of what you want. That's when it might very well pay to let developers of apps which come close to meeting your ideal about what you wish their app would do. Developers are often eager for feedback and open to suggestions. These two app store expeditions have yielded some powerful extentions to capabilities included in iOS. There are many more treasures to be found. Keep an ear out for more app store expeditions in this guide.