AWS Glue is an
event-driven,
serverless computing
Serverless computing is "a cloud service category in which the customer can use different cloud capability types without the customer having to provision, deploy and manage either hardware or software resources, other than providing customer appli ...
platform provided by
Amazon
Amazon most often refers to:
* Amazon River, in South America
* Amazon rainforest, a rainforest covering most of the Amazon basin
* Amazon (company), an American multinational technology company
* Amazons, a tribe of female warriors in Greek myth ...
as a part of
Amazon Web Services
Amazon Web Services, Inc. (AWS) is a subsidiary of Amazon.com, Amazon that provides Software as a service, on-demand cloud computing computing platform, platforms and Application programming interface, APIs to individuals, companies, and gover ...
. It was introduced in August 2017.
Overview
The primary purpose of Glue is to scan other services in the same
Virtual Private Cloud
A virtual private cloud (VPC) is an on-demand configurable pool of shared resources allocated within a '' public cloud'' environment, providing a certain level of isolation between the different organizations (denoted as ''users'' hereafter) usi ...
(or equivalent accessible network element even if not provided by AWS), particularly
S3. The jobs are billed according to compute time, with a minimum count of 1 minute. Glue discovers the source data to store associated meta-data (e.g. the table's
schema
Schema may refer to:
Science and technology
* SCHEMA (bioinformatics), an algorithm used in protein engineering
* Schema (genetic algorithms), a set of programs or bit strings that have some genotypic similarity
* Schema.org, a web markup vocab ...
of field names, types lengths) in the AWS Glue Data Catalog (which is then accessible via AWS console or APIs).
Languages supported
Scala and
Python
Python may refer to:
Snakes
* Pythonidae, a family of nonvenomous snakes found in Africa, Asia, and Australia
** ''Python'' (genus), a genus of Pythonidae found in Africa and Asia
* Python (mythology), a mythical serpent
Computing
* Python (prog ...
are officially supported .
Catalog interrogation via API
The catalog can be read in AWS console (via browser) and via
API
An application programming interface (API) is a connection between computers or between computer programs. It is a type of software interface, offering a service to other pieces of software. A document or standard that describes how to build ...
divided into topics including:
* Database API
* Table API
* Partition API
* Connection API
* User-Defined Function API
* Importing an
Athena
Athena or Athene, often given the epithet Pallas, is an ancient Greek religion, ancient Greek goddess associated with wisdom, warfare, and handicraft who was later syncretism, syncretized with the Roman goddess Minerva. Athena was regarde ...
Catalog to AWS Glue
See also
*
Event-driven architecture
Event-driven architecture (EDA) is a software architecture paradigm concerning the production and detection of Event (computing), events. Event-driven architectures are Continuous design, evolutionary in nature and provide a high degree of fault to ...
*
Serverless Framework
*
Function as a service
Function as a service is a "platform-level cloud capability" that enables its users "to build and manage microservices applications with low initial investment for scalability," according to ISO/IEC 22123-2.
Function as a Service is a subset of t ...
*
Google Cloud Functions
*
Azure Function
*
Oracle Cloud Platform
Oracle Cloud Platform refers to a Platform as a Service (PaaS) offerings by Oracle Corporation as part of Oracle Cloud Infrastructure. These offerings are used to build, deploy, integrate and extend applications in the cloud. The offerings supp ...
References
External links
*
AWS Course
{{Amazon
Serverless computing
Amazon Web Services