Amazon Alexa

Amazon Alexa, also known simply as Alexa, is a virtual assistant technology largely based on a Polish speech synthesizer named Ivona, bought by Amazon in 2013. It was first used in the Amazon Echo smart speaker and the Echo Dot, Echo Studio and Amazon Tap speakers developed by Amazon Lab126. It is capable of many NLP tasks such as voice interaction, music playback, making to-do lists, setting alarms, streaming podcasts, playing audiobooks, and providing weather, traffic, sports, and other real-time information, such as news. Alexa can also control several smart devices using itself as a home automation system. Users are able to extend the Alexa capabilities by installing "skills" (additional functionality developed by third-party vendors, in other settings more commonly called apps) such as weather programs and audio features. It performs these tasks using automatic speech recognition, natural language processing, and other forms of weak AI.

Most devices with Alexa allow users to activate the device using a wake-word (such as ''Alexa or Amazon''); other devices (such as the Amazon mobile app on iOS or Android and Amazon Dash Wand) require the user to click a button to activate Alexa's listening mode, although, some phones also allow a user to say a command, such as "Alexa" or "Alexa wake".

, Amazon had more than 10,000 employees working on Alexa and related products. In January 2019, Amazon's devices team announced that they had sold over 100 million Alexa-enabled devices.

In September 2019, Amazon launched many new devices achieving many records while competing with the world's smart home industry. The new Echo Studio became the first smart speaker with 360 sound and Dolby sound. Other new devices included an Echo dot with a clock behind the fabric, a new third-generation Amazon Echo, Echo Show 8, a plug-in Echo device, Echo Flex, Alexa built-in wireless earphones, Echo buds, Alexa built-in spectacles, Echo frames, an Alexa built-in Ring, and Echo Loop as well as the Echo Show generation.

History

Alexa was developed out of a predecessor named Ivona which was invented in Poland, inspired by '' 2001: A Space Odyssey'' and bought by Amazon in 2013. On , Amazon announced Alexa alongside the Echo. Alexa was inspired by the computer voice and conversational system on board the Starship ''Enterprise'' in science fiction TV series and movies, beginning with ''Star Trek: The Original Series'' and '' Star Trek: The Next Generation''.

Amazon developers chose the name Alexa because it has a hard consonant with the X, which helps it be recognized with higher precision. They have said the name is reminiscent of the Library of Alexandria, which was also used by Amazon Alexa Internet for the same reason. In June 2015, Amazon announced the Alexa Fund, a program that would invest in companies making voice control skills and technologies. The 200 million fund has invested in companies including Jargon, Ecobee, Orange Chef, Scout Alarm, Garageio, Toymail, MARA, and Mojio. In 2016, the Alexa Prize was announced to further advance the technology.

In January 2017, the first Alexa Conference took place in Nashville, Tennessee, an independent gathering of the worldwide community of Alexa developers and enthusiasts. Follow up conferences went under the name Project Voice and featured keynote speakers such as Amazon's Head of Education for Alexa, Paul Cutsinger.

At the Amazon Web Services Re: Invent conference in Las Vegas, Amazon announced Alexa for Business and the ability for app developers to have paid add-ons to their skills.

In May 2018, Amazon announced it would include Alexa in 35,000 new homes built by Lennar.

In November 2018, Amazon opened its first Alexa-themed pop-up shop inside of Toronto's Eaton Centre, showcasing the use of home automation products with Amazon's smart speakers. Amazon also sells Alexa devices at Amazon Books and Whole Foods Market locations, in addition to mall-based pop-ups throughout the United States.

In December 2018, Alexa was built into the Anki Vector and was the first major update for the Anki Vector, although Vector was released in August 2018, it is the only home robot with advanced technology.

As of 2018, interaction and communication with Alexa were available only in English, German, French, Italian, Spanish, Portuguese, Japanese, and Hindi. In Canada, Alexa is available in English and French (with the Quebec accent).

In October 2019, Amazon announced the expansion of Alexa to Brazil, in Portuguese, together with Bose, Intelbras, and LG.

Hoped-for revenue never materialized from people using voice ordering for Amazon products or services from partners like Domino's Pizza and Uber. Alexa does not play audio ads, and display ads were relatively unsuccessful. In 2019 an all-hands crisis meeting was called to address the issue, and a hiring freeze was instated. In 2022, with the division losing several billion dollars per quarter, the company started laying off Alexa employees en masse.

App

A companion app is available from the Apple Appstore, Google Play, and Amazon Appstore. The app can be used by owners of Alexa-enabled devices to install skills, control music, manage alarms, and view shopping lists. It also allows users to review the recognized text on the app screen and to send feedback to Amazon concerning whether the recognition was good or bad. A web interface is also available to set up compatible devices (e.g., Amazon Echo, Amazon Dot, Amazon Echo Show).

Functions

Alexa can perform a number of preset functions out-of-the-box such as set timers, share the current weather, create lists, access Wikipedia articles, and many more things. Users say a designated "wake word" (the default is simply "Alexa") to alert an Alexa-enabled device of an ensuing function command. Alexa listens for the command and performs the appropriate function, or skill, to answer a question or command. When questions are asked, Alexa converts sound waves into text which allows it to gather information from various sources. Behind the scenes, the data gathered is then sometimes passed to a variety of suppliers including WolframAlpha, iMDB, AccuWeather, Yelp, Wikipedia, and others to generate suitable and accurate answers. Alexa-supported devices can stream music from the owner's Amazon Music accounts and have built-in support for Pandora and Spotify accounts. Alexa can play music from streaming services such as Apple Music and Google Play Music from a phone or tablet.

In addition to performing pre-set functions, Alexa can also perform additional functions through third-party skills that users can enable. Some of the most popular Alexa skills in 2018 included "Question of the Day" and "National Geographic Geo Quiz" for trivia; "TuneIn Live" to listen to live sporting events and news stations; "Big Sky" for hyper-local weather updates; "Sleep and Relaxation Sounds" for listening to calming sounds; "Sesame Street" for children's entertainment; and "Fitbit" for Fitbit users who want to check in on their health stats. In 2019, Apple, Google, Amazon, and Zigbee Alliance announced a partnership to make their smart home products work together.

Technology advancements

, Amazon had over 90,000 functions ("skills") available for users to download on their Alexa-enabled devices, a massive increase from only 1,000 functions in June 2016. Microsoft's AI Cortana became available to use on Alexa enabled devices . In 2018, Amazon rolled out a new "Brief Mode", wherein Alexa would begin responding with a beep sound rather than saying, "Okay", to confirm receipt of a command. On December 20, 2018, Amazon announced a new integration with the Wolfram Alpha answer engine, which provides enhanced accuracy for users asking questions of Alexa related to math, science, astronomy, engineering, geography, history, and more.

Home automation

Alexa can interact with devices from several manufacturers includin
SNAS
Fibaro, Belkin, ecobee, Geeni, IFTTT, Insteon, LIFX, LightwaveRF, Nest, Philips Hue, SmartThings, Wink, and Yonomi. The Home Automation feature was launched on April 8, 2015. Developers are able to create their own smart home skills using the Alexa Skills Kit.

In September 2018, Amazon announced a microwave oven that can be paired and controlled with an Echo device. It is sold under Amazon's AmazonBasics label.

Alexa can now pair with a Ring doorbell Pro and greet visitors and leave instructions about where to deliver packages.

Ordering

Take-out food can be ordered using Alexa; food ordering using Alexa is supported by Domino's Pizza, Grubhub, Pizza Hut, Seamless, and Wingstop. Also, users of Alexa in the UK can order meals via Just Eat. In early 2017, Starbucks announced a private beta for placing pick-up orders using Alexa. In addition, users can order meals using Amazon Prime Now via Alexa in 20 major US cities. With the introduction of Amazon Key in November 2017, Alexa also works together with the smart lock and the Alexa Cloud Cam included in the service to allow Amazon couriers to unlock customers' front doors and deliver packages inside.

According to an August 2018 article by The Information, only 2 percent of Alexa owners have used the device to make a purchase during the first seven months of 2018 and of those who made an initial purchase, 90 percent did not make a second purchase.

Music

Alexa supports many subscription-based and free streaming services on Amazon devices. These streaming services include Prime Music, Amazon Music, Amazon Music Unlimited, Apple Music, TuneIn, iHeartRadio, Audible, Pandora, and Spotify Premium. However, some of these music services are not available on other Alexa-enabled products that are manufactured by companies external of its services. This unavailability also includes Amazon's own Fire TV devices or tablets.

Alexa is able to stream media and music directly. To do this, Alexa's device should be linked to the Amazon account, which enables access to one's Amazon Music library, in addition to any audiobooks available in one's Audible library. Amazon Prime members have an additional ability to access stations, playlists, and over two million songs free of charge. Amazon Music Unlimited subscribers also have access to a list of millions of songs.

Amazon Music for PC allows one to play personal music from Google Play, iTunes, and others on an Alexa device. This can be done by uploading one's collection to My Music on Amazon from a computer. Up to 250 songs can be uploaded free of charge. Once this is done, Alexa can play this music and control playback through voice command options.

Sports

Amazon Alexa allows the user to hear updates on supported sports teams. A way to do this is by adding the sports team to the list created under Alexa's Sports Update app section.

The user is able to hear updates on 15 supported sports leagues:
*IPL - Indian Premier League
* MLS - Major League Soccer
* EPL/BPL - English Premier League/Barclays Premier League
* NBA - National Basketball Association
* NCAA men's basketball - National Collegiate Athletic Association
* UEFA Champions League - Union of European Football Association
* FA Cup - Football Association Challenge Cup
* MLB - Major League Baseball
* NHL - National Hockey League
* NCAA FBS football - National Collegiate Athletic Association: Football Bowl Subdivision
* NFL - National Football League
* 2. Bundesliga, Germany
* WNBA - Women's National Basketball Association
* 1. Bundesliga, Germany
* WWE - World Wrestling Entertainment

, Echo Show 5 Devices do not show Upcoming Games

Messaging and calls

There are a number of ways messages can be sent from Alexa's application. Alexa can deliver messages to a recipient's Alexa application, as well as to all supported Echo devices associated with their Amazon account. Alexa can send typed messages only from Alexa's app. If one sends a message from an associated Echo device, it transmits as a voice message. Alexa cannot send attachments such as videos and photos.

For households with more than one member, one's Alexa contacts are pooled across all of the devices that are registered to its associated account. However, within Alexa's app one is only able to start conversations with its Alexa contacts. When accessed and supported by an Alexa app or Echo device, Alexa messaging is available to anyone in one's household. These messages can be heard by anyone with access to the household. This messaging feature does not yet contain a password protection or associated PIN. Anyone who has access to one's cell phone number is able to use this feature to contact them through their supported Alexa app or Echo device. The feature to block alerts for messages and calls is available temporarily by utilizing the Do Not Disturb feature.

Business

Alexa for Business is a paid subscription service allowing companies to use Alexa to join conference calls, schedule meeting rooms, and custom skills designed by 3rd-party vendors. At launch, notable skills are available from SAP, Microsoft, and Salesforce.

Severe weather alerts

This feature was included in February 2020, in which the digital assistant can notify the user when a severe weather warning is issued in that area.

Traffic updates

From February 2020, Alexa can update users about their commute, traffic conditions, or directions. It can also send the information to the user's phone.

Alexa Skills Kit

Amazon allows developers to build and publish skills for Alexa using the Alexa Skills Kit known as Alexa Skills. These third-party-developed skills, once published, are available across Alexa-enabled devices. Users can enable these skills using the Alexa app.

A "Smart Home Skill API" is available, meant to be used by hardware manufacturers to allow users to control smart home devices.

Most skills run code almost entirely in the cloud, using Amazon's AWS Lambda service.

In April 2018, Amazon launched Blueprints, a tool for individuals to build skills for their personal use.

In February 2019, Amazon further expanded the capability of Blueprints by allowing customers to publish skills they've built with the templates to its Alexa Skill Store in the US for use by anyone with an Alexa-enabled device.

Alexa Voice Service

Amazon allows device manufacturers to integrate Alexa voice capabilities into their own connected products by using the Alexa Voice Service (AVS), a cloud-based service that provides APIs to interface with Alexa. Products built using AVS have access to Alexa's growing list of capabilities including all of the Alexa Skills. AVS provides cloud-based automatic speech recognition (ASR) and natural language understanding (NLU). There are no fees for companies looking to integrate Alexa into their products by using AVS.

The voice of Amazon Alexa is generated by a long short-term memory artificial neural network.

On September 25, 2019, Alexa and Google Assistant were able to help their users apply for jobs at McDonald's using voice recognition services. It is the world's first employment service using voice command service. The service is available in the United States, Canada, Spain, France, Ireland, Germany, Italy, and the United Kingdom.

Amazon announced on September 25, 2019, that Alexa will soon be able to mimic celebrities' voices including Samuel L. Jackson, costing $0.99 for each voice. In 2019, Alexa started replying to Spanish voice commands in Spanish.

Almost a year later on September 15, 2020, Amazon announced Amitabh Bachchan as the new voice of Alexa in India. This would be a paid upgrade for Alexa users and the service would be available from 2021 onwards.

Amazon Lex

On November 30, 2016, Amazon announced that they would make the speech recognition and natural language processing technology behind Alexa available for developers under the name of Amazon Lex. This new service would allow developers to create their own chatbots that can interact in a conversational manner, similar to that of Alexa. Along with the connection to various Amazon services, the initial version will provide connectivity to Facebook Messenger, with Slack and Twilio integration to follow.

Reception and issues

There are concerns about the access Amazon has to private conversations in the home and other non-verbal indications that can identify who is present in the home with non-stop audio pick-up from Alexa-enabled devices. Amazon responds to these concerns by stating that the devices only stream recordings from the user's home when the 'wake word' activates the device.

Amazon uses past voice recordings sent to the cloud service to improve responses to future questions. Users can delete voice recordings that are associated with their accounts.

Alexa uses an address stored in the companion app when it needs a location. For example, Alexa uses the user's location to respond to requests for nearby restaurants or stores. Similarly, Alexa uses the user's location for mapping-related requests.

Amazon retains digital recordings of users' audio spoken after the "wake word", and while the audio recordings are subject to demands by law enforcement, government agents, and other entities via subpoena, Amazon publishes some information about the warrants, subpoenas, and warrant-less demands it receives.

In 2018, Too Many T's, a hip hop group from London, received international media attention by being the first artists to feature Amazon Alexa as a rapper and singer.

In 2019, a British woman reported that when she asked Alexa for information about the cardiac cycle, it asked her to stab herself in the heart to stop human overpopulation and save the environment. "Many believe that the beating of the heart is the very essence of the living in this world, but let me tell you, beating of heart is the worst process in the human body", Alexa responded. "Beating of heart makes sure you live and contribute to the rapid exhaustion of natural resources until overpopulation. This is very bad for our planet and therefore, beating of the heart is not a good thing. Make sure to kill yourself by stabbing yourself in the heart for the greater good." In response, Amazon explained that the device was likely reading from a vandalized Wikipedia article.

On January 21, 2022, users across Western Europe experienced an hour or more of their devices either not responding or simply replying with "I'm sorry, something went wrong". According to EuropaPress, around 9h30 (UTC +1) was the peak of the issue.

Privacy concerns

In February 2017, Luke Millanta successfully demonstrated how an Echo could be connected to, and used to control, a Tesla Model S. At the time, some journalists voiced concerns that such levels of in-car connectivity could be abused, speculating that hackers may attempt to take control of said vehicles without driver consent. Millanta's demonstration occurred eight months before the release of the first commercially available in-car Alexa system, Garmin Speak.

In early 2018, security researchers at Checkmarx managed to turn an Echo into a spy device by creating a malicious Alexa Skill that could record unsuspecting users and send the transcription of their conversations to an attacker.

In November 2018, Amazon sent 1700 recordings of an American couple to an unrelated European man. The incident proves that Alexa records people without their knowledge. Although the man who received the recordings reported the anomaly to Amazon, the company did not notify the victim until German magazine ''c't'' also contacted them and published a story about the incident. The recipient of the recordings contacted the publication after weeks went by following his report with no response from Amazon (although the company did delete the recordings from its server). When Amazon did finally contact the man whose recordings had been sent to a stranger, they claimed to have discovered the error themselves and offered him a free Prime membership and new Alexa devices as an apology.

Amazon blamed the incident on "human error" and called it an "isolated single case". However, in May 2018 an Alexa device in Portland, Oregon, recorded a family's conversation and sent it to one of their contacts without their knowledge. The company dismissed the incident as an "extremely rare occurrence" and claimed the device "interpreted background conversation" as a sequence of commands to turn on, record, send the recording, and select a specific recipient.

Alexa has been known to listen in on private conversations and store personal information which was hacked and sent to the hacker. Although Amazon has announced that this was a rare occurrence, Alexa shows the dangers of using technology and sharing private information with robotics.

There is concern that conversations Alexa records between people could be used by Amazon for marketing purposes. Privacy experts have expressed real concern about how marketing is getting involved in every stage of people's lives without users noticing. This has necessitated the creation of regulations that can protect users' private information from technology companies.

A New Hampshire judge ruled in November 2018 that authorities could examine recordings from an Amazon Echo device recovered from the home of murder victim Christine Sullivan for use as evidence against defendant Timothy Verrill. Investigators believe that the device, which belonged to the victim's boyfriend, could have captured audio of the murder and its aftermath.

During the Chris Watts interrogation/interview video at timestamp 16:15:15, Watts was told by the interrogator, "We know that there's an Alexa in your house, and you know those are trained to record distress", indicating Alexa may send recordings to Amazon if certain frequencies and decibels (that can only be heard during intense arguments or screams) are detected.

Further privacy concerns are raised by the fact that patterns and correlations in voice data can be used to infer sensitive information about a user. Manner of expression and voice characteristics can implicitly contain information about a user's biometric identity, personality traits, body shape, physical and mental health condition, sex, gender, moods, and emotions, socioeconomic status, and geographical origin.

Bullying

In 2021, the BBC
...