HOME

TheInfoList



OR:

Oracle Grid Engine, previously known as Sun Grid Engine (SGE), CODINE (Computing in Distributed Networked Environments) or GRD (Global Resource Director), was a
grid computing Grid computing is the use of widely distributed computer resources to reach a common goal. A computing grid can be thought of as a distributed system with non-interactive workloads that involve many files. Grid computing is distinguished fro ...
computer cluster A computer cluster is a set of computers that work together so that they can be viewed as a single system. Unlike grid computers, computer clusters have each node set to perform the same task, controlled and scheduled by software. The newes ...
software system (otherwise known as a batch-queuing system), acquired as part of a purchase of Gridware, then improved and supported by
Sun Microsystems Sun Microsystems, Inc., often known as Sun for short, was an American technology company that existed from 1982 to 2010 which developed and sold computers, computer components, software, and information technology services. Sun contributed sig ...
and later
Oracle An oracle is a person or thing considered to provide insight, wise counsel or prophetic predictions, most notably including precognition of the future, inspired by deities. If done through occultic means, it is a form of divination. Descript ...
. There have been open source versions and multiple commercial versions of this technology, initially from Sun, later from Oracle, then from
Univa Univa was a software company that developed workload management and cloud management products for compute-intensive applications in the data center and across public, private, and hybrid clouds, before being acquired by Altair Engineering in Septe ...
Corporation, and later from HPC Gridware as Gridware Cluster Scheduler. The open source version is still under active development under the SISSL license as Open Cluster Scheduler. On October 22, 2013 Univa announced it acquired the
intellectual property Intellectual property (IP) is a category of property that includes intangible creations of the human intellect. There are many types of intellectual property, and some countries recognize more than others. The best-known types are patents, co ...
and trademarks for the Grid Engine technology and that Univa will take over support. Univa has since evolved the Grid Engine technology, e.g. improving scalability as demonstrated by a 1 million core cluster in
Amazon Web Services Amazon Web Services, Inc. (AWS) is a subsidiary of Amazon.com, Amazon that provides Software as a service, on-demand cloud computing computing platform, platforms and Application programming interface, APIs to individuals, companies, and gover ...
(AWS) announced on June 24, 2018. The original Grid Engine open-source project website closed in 2010, but versions of the technology are still available under its original Sun Industry Standards Source License (SISSL). Those projects were forked from the original project code and are known as Son of Grid Engine, Open Grid Scheduler, Univa Grid Engine., Open Cluster Scheduler, and Gridware Cluster Scheduler. Grid Engine is typically used on a computer farm or
high-performance computing High-performance computing (HPC) is the use of supercomputers and computer clusters to solve advanced computation problems. Overview HPC integrates systems administration (including network and security knowledge) and parallel programming into ...
(HPC)
cluster may refer to: Science and technology Astronomy * Cluster (spacecraft), constellation of four European Space Agency spacecraft * Cluster II (spacecraft), a European Space Agency mission to study the magnetosphere * Asteroid cluster, a small ...
and is responsible for accepting, scheduling, dispatching, and managing the remote and distributed execution of large numbers of standalone, parallel or interactive user jobs. It also manages and schedules the allocation of distributed resources such as processors, memory, disk space, and
software license A software license is a legal instrument governing the use or redistribution of software. Since the 1970s, software copyright has been recognized in the United States. Despite the copyright being recognized, most companies prefer to sell lic ...
s. Grid Engine used to be the foundation of the
Sun Grid Sun Cloud (also known as Network.com) was an on-demand cloud computing service operated by Sun Microsystems prior to Sun's acquisition by Oracle Corporation. The Sun Cloud Compute Utility provided access to a substantial computing resource over the ...
utility computing Utility computing, or computer utility, is a service provisioning model in which a service provider makes computing resources and infrastructure management available to the customer as needed, and charges them for specific usage rather than a fl ...
system, made available over the
Internet The Internet (or internet) is the Global network, global system of interconnected computer networks that uses the Internet protocol suite (TCP/IP) to communicate between networks and devices. It is a internetworking, network of networks ...
in the
United States The United States of America (USA), also known as the United States (U.S.) or America, is a country primarily located in North America. It is a federal republic of 50 U.S. state, states and a federal capital district, Washington, D.C. The 48 ...
in 2006, later becoming available in many other countries and having been an early version of a public
cloud computing Cloud computing is "a paradigm for enabling network access to a scalable and elastic pool of shareable physical or virtual resources with self-service provisioning and administration on-demand," according to International Organization for ...
facility predating AWS, for instance.


History

In 2000, Sun acquired Gridware a privately owned commercial vendor of advanced computing resource management software with offices in San Jose, Calif., and Regensburg, Germany. Later that year, Sun offered a free version of Gridware for Solaris and Linux, and renamed the product Sun Grid Engine. In 2001, Sun made the
source code In computing, source code, or simply code or source, is a plain text computer program written in a programming language. A programmer writes the human readable source code to control the behavior of a computer. Since a computer, at base, only ...
available, and adopted the open source development model. Ports for Mac OS X and *BSD were contributed by the non-Sun open source developers. In 2010, after the purchase of Sun by Oracle, the Grid Engine 6.2 update 6 source code was not included with the binaries, and changes were not put back to the project's source repository. In response to this, the Grid Engine community started the Open Grid Scheduler project to continue to develop and maintain a free implementation of Grid Engine. On January 18, 2011, it was announced that
Univa Univa was a software company that developed workload management and cloud management products for compute-intensive applications in the data center and across public, private, and hybrid clouds, before being acquired by Altair Engineering in Septe ...
had recruited several principal engineers from the former Sun Grid Engine team and that Univa would be developing their own forked version of Grid Engine. The newly announced Univa Grid Engine did include commercial support and would compete with the official version of Oracle Grid Engine. On October 22, 2013 Univa has announced that it had acquired the
intellectual property Intellectual property (IP) is a category of property that includes intangible creations of the human intellect. There are many types of intellectual property, and some countries recognize more than others. The best-known types are patents, co ...
and trademarks pertaining to the Grid Engine technology and that Univa will take over support for Oracle Grid Engine customers. In September 2020,
Altair Engineering Altair Engineering Inc. is an American Multinational corporation, multinational information technology company headquartered in Troy, Michigan. It provides software and cloud solutions for simulation, Internet of Things, IoT, high performance com ...
, a global technology company providing solutions in data analytics, product development, and high-performance computing (HPC) acquired Univa. 2023 the lead developers of Sun Grid Engine, Oracle Grid Engine, Univa Grid Engine and successor decided to build Gridware Cluster Scheduler(GCS) based on their open source Open Cluster Scheduler which is 100% "SGE" backward compatible.


Cluster architecture

A typical Grid Engine cluster consists of a master host and one or more execution hosts. Multiple ''shadow masters'' can also be configured as
hot spare A hot spare or warm spare or hot standby is a component used as a failover mechanism to provide reliability in system configurations. The hot spare is active and connected as part of a working system. When a key component fails, the hot spare ...
s, which take over the role of the master when the original master host crashes.


Support and training

Univa Univa was a software company that developed workload management and cloud management products for compute-intensive applications in the data center and across public, private, and hybrid clouds, before being acquired by Altair Engineering in Septe ...
is providing commercial support and training for Univa Grid Engine and Oracle Grid Engine. Below is a description of some of the historic options. Sun provided support contracts for the commercial version of Grid Engine on most
UNIX Unix (, ; trademarked as UNIX) is a family of multitasking, multi-user computer operating systems that derive from the original AT&T Unix, whose development started in 1969 at the Bell Labs research center by Ken Thompson, Dennis Ritchie, a ...
platforms and
Windows Windows is a Product lining, product line of Proprietary software, proprietary graphical user interface, graphical operating systems developed and marketed by Microsoft. It is grouped into families and subfamilies that cater to particular sec ...
. Professional services, consulting, training, and support were provided by Sun Partners. Sun partners with
Georgetown University Georgetown University is a private university, private Jesuit research university in Washington, D.C., United States. Founded by Bishop John Carroll (archbishop of Baltimore), John Carroll in 1789, it is the oldest Catholic higher education, Ca ...
to deliver Grid Engine administration classes. ''The Bioteam'' runs short SGE training workshops that are 1 or 2 days long. Users obtained community support on the Grid Engine mailing lists. Grid Engine Workshops were held in 2002, 2003, 2007, 2009, and 2012 in Regensburg, Germany.


Other Grid Engine based products

The below contains historic information and some of the products and solutions are no longer available: * Sun Constellation System *
Sun Visualization System Sun Visualization System was a sharable visualization product introduced by Sun Microsystems in January 2007. It used other Sun technologies, including Sun servers, Solaris, Sun Ray Ultra-Thin Clients, and Sun Grid Engine. The Sun Visualization S ...
* Sun Compute Cluster * ClusterVisionOS Distribution *
Rocks Cluster Distribution Rocks Cluster Distribution (originally NPACI Rocks) is a Linux distribution intended for high-performance computing (HPC) clusters. It was started by National Partnership for Advanced Computational Infrastructure and the San Diego Supercompute ...
*
Univa Univa was a software company that developed workload management and cloud management products for compute-intensive applications in the data center and across public, private, and hybrid clouds, before being acquired by Altair Engineering in Septe ...
's UniCluster Express * Univa Grid Engine * Some Grid Engine active free fork of SGE with "some" further modifications, Michigan Neuroscience Institute, University of Michigan (2021). * Son of Grid Engine inactive free fork of SGE with some enhancements, University of Liverpool, default Ubuntu/CentOS/RHEL gridengine package (2021). * Open Cluster Scheduler active free fork based on the Univa Open Core Grid Engine, which in turn is based on the open source Sun Grid Engine (2025). * BioTeam's iNquiry * Nimbus uses Grid Engine as a virtual machine scheduler in a cloud computing environment


See also

* Sun Ops Center - Sun's datacenter automation tool *
Open Grid Forum The Open Grid Forum (OGF) is a community of users, developers, and vendors for standardization of grid computing. It was formed in 2006 in a merger of the Global Grid Forum and the Enterprise Grid Alliance. The OGF models its process on the In ...


References

{{Oracle FOSS Sun Microsystems software Job scheduling Parallel computing Grid computing Cross-platform software Cluster computing 2000 software