|
Databricks
Databricks is an American enterprise software company founded by the creators of Apache Spark. Databricks develops a web-based platform for working with Spark, that provides automated cluster management and IPython-style notebooks. History Databricks grew out of the AMPLab project at University of California, Berkeley that was involved in making Apache Spark, an open-source distributed computing framework built atop Scala. The company was founded by Ali Ghodsi, Andy Konwinski, Arsalan Tavakoli-Shiraji, Ion Stoica, Matei Zaharia, Patrick Wendell, and Reynold Xin. In November 2017, the company was announced as a first-party service on Microsoft Azure via the integration Azure Databricks. The company develops Delta Lake, an open-source project to bring reliability to data lakes for machine learning and other data science use cases. In June 2020, Databricks acquired Redash, an open-source tool designed to help data scientists and analysts visualize and build interactive dashb ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Ali Ghodsi
Ali Ghodsi is an Iranian-Swedish computer scientist and entrepreneur specializing in distributed systems and big data. He is a co-founder and CEO of Databricks and an adjunct professor at UC Berkeley. Ideas from his academic research in the area of resource management and scheduling and data caching have been applied in popular open source projects such as Apache Mesos, Apache Spark, and Apache Hadoop. Ghodsi received his PhD from KTH Royal Institute of Technology in Sweden, advised by Seif Haridi. He was a co-founder of Peerialism AB, a Stockholm-based company developing peer-to-peer systems to transport and store data on the Internet. He was also an assistant professor at KTH from 2008 to 2009. He joined UC Berkeley in 2009 as a visiting scholar and worked with Scott Shenker, Ion Stoica, Michael Franklin, and Matei Zaharia on research projects in distributed systems, database systems, and networking. During this period, he helped start Apache Mesos and Apache Spark projects. He a ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Reynold Xin
Reynold Xin is a computer scientist and engineer specializing in big data, distributed systems, and cloud computing. He is a co-founder and Chief Architect of Databricks. He is best known for his work on Apache Spark, which is the top open-source Big Data project. He designed and lead development of the GraphX, Project Tungsten, and Structured Streaming components and he co-designed DataFrames—all of which are part of the core Apache Spark distribution—plus served as the release manager for Spark's 2.0 release. Biography UC Berkeley Xin started his work on the Spark open source project while he was a PhD candidate at the UC Berkeley AMPLab. The first research project, Shark, created a system that was able to efficiently execute SQL and advanced analytics workloads at scale. Shark won Best Demo Award at SIGMOD 2012. Shark was one of the first open source interactive SQL on Hadoop systems, with claims that it was between 10 and 100 times faster than Apache Hive. Shark wa ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Matei Zaharia
Matei Zaharia is a Romanian-Canadian computer scientist, educator and the creator of Apache Spark. As of April 2022, Forbes ranked him and Ion Stoica as the 3rd- richest people in Romania with a net worth of $1.6 billion. Biography Zaharia graduated from secondary school at Jarvis Collegiate Institute before moving to become an undergraduate at the University of Waterloo. Zaharia was a gold medalist at the International Collegiate Programming Contest, where his team University of Waterloo placed fourth in the world and first in North America in 2005. During his undergraduate degree at the University of Waterloo, he also greatly contributed to water rendering physics in the now open-source game called 0 A.D. While at University of California, Berkeley's AMPLab in 2009, he created Apache Spark as a faster alternative to MapReduce. He received the 2014 ACM Doctoral Dissertation Award for his PhD research on large-scale computing. In 2013 Zaharia was one of the co-founders of Dat ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Notebook Interface
A notebook interface (also called a computational notebook) is a virtual notebook environment used for literate programming, a method of writing computer programs. Some notebooks are WYSIWYG environments including executable calculations embedded in formatted documents; others separate calculations and text into separate sections. Modular notebooks may connect to a variety of computational back ends, called "kernels". Notebook interfaces are widely used for statistics, data science, machine learning, and computer algebra. At the notebook core is the idea of literate programming tools which "let you arrange the parts of a program in any order and extract documentation and code from the same source file.", the notebook takes this approach to a new level extending it with some graphic functionality and a focus on interactivity. According to Stephen Wolfram: "The idea of a notebook is to have an interactive document that freely mixes code, results, graphics, text and everything else ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Ion Stoica
Ion Stoica is a Romanian-American computer scientist specializing in distributed systems, cloud computing and computer networking. He is a professor of computer science at the University of California, Berkeley and co-director of AMPLab. He co-founded Conviva and Databricks with other original developers of Apache Spark. As of April 2022, Forbes ranked him and Matei Zaharia as the 3rd- richest people in Romania with a net worth of $1.6 billion. Education Stoica was born in Romania, where he grew up and attended Polytechnic University of Bucharest, receiving a MS in Electrical Engineering and Computer Science in 1989. He moved to the USA in 1994 to start a PhD at Old Dominion University with computer-science professor Hussein Abdel-Wahab. In 1996, he transferred to Carnegie Mellon University (CMU), where in 2000 he received a PhD in Electrical & Computer Engineering supervised by Hui Zhang. Subjects included Chord (peer-to-peer), Core-Stateless Fair Queueing (CSFQ), and Inter ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Apache Spark
Apache Spark is an open-source unified analytics engine for large-scale data processing. Spark provides an interface for programming clusters with implicit data parallelism and fault tolerance. Originally developed at the University of California, Berkeley's AMPLab, the Spark codebase was later donated to the Apache Software Foundation, which has maintained it since. Overview Apache Spark has its architectural foundation in the resilient distributed dataset (RDD), a read-only multiset of data items distributed over a cluster of machines, that is maintained in a fault-tolerant way. The Dataframe API was released as an abstraction on top of the RDD, followed by the Dataset API. In Spark 1.x, the RDD was the primary application programming interface (API), but as of Spark 2.x use of the Dataset API is encouraged even though the RDD API is not deprecated. The RDD technology still underlies the Dataset API. Spark and its RDDs were developed in 2012 in response to limitations in the M ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Andreessen Horowitz
Andreessen Horowitz (also called a16z, legal name AH Capital Management, LLC) is a private American venture capital firm, founded in 2009 by Marc Andreessen and Ben Horowitz. The company is headquartered in Menlo Park, California. Andreessen Horowitz invests in both early-stage start-ups and established growth companies. Its investments span the mobile, cryptocurrency, gaming, social, e-commerce, education and enterprise IT (including cloud computing, security, and software as a service) industries. Founding and partnering Between 2006 and 2010, Marc Andreessen and Ben Horowitz actively invested in technology companies. Separately, and together, they invested $4 million in 45 start-ups including Twitter. During this time, the two became known as "super angel" investors. On July 6, 2009, Andreessen and Horowitz launched their venture capital fund with an initial capitalization of $300 million. In November 2010, at a time when the field of venture capitalism was contracting, ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Scala (programming Language)
Scala ( ) is a strong statically typed general-purpose programming language that supports both object-oriented programming and functional programming. Designed to be concise, many of Scala's design decisions are aimed to address criticisms of Java. Scala source code can be compiled to Java bytecode and run on a Java virtual machine (JVM). Scala can also be compiled to JavaScript to run in a browser, or directly to a native executable. On the JVM Scala provides language interoperability with Java so that libraries written in either language may be referenced directly in Scala or Java code. Like Java, Scala is object-oriented, and uses a syntax termed '' curly-brace'' which is similar to the language C. Since Scala 3, there is also an option to use the off-side rule (indenting) to structure blocks, and its use is advised. Martin Odersky has said that this turned out to be the most productive change introduced in Scala 3. Unlike Java, Scala has many features of functional prog ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
New Enterprise Associates
New Enterprise Associates (NEA) is an American-based venture capital firm. NEA focuses investment stages ranging from seed stage through growth stage across an array of industry sectors. With ~$25 billion in committed capital, NEA is one of the world's largest venture capital firms.NEA - History (Company Website)New Enterprise Associates Closes $2.6 Billion In One Of Largest Venture Funds Ever Forbes, July, 2012 Description The firm is headquartered in[...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Privately Held Company
A privately held company (or simply a private company) is a company whose shares and related rights or obligations are not offered for public subscription or publicly negotiated in the respective listed markets, but rather the company's stock is offered, owned, traded, exchanged privately, or Over-the-counter (finance), over-the-counter. In the case of a closed corporation, there are a relatively small number of shareholders or company members. Related terms are closely-held corporation, unquoted company, and unlisted company. Though less visible than their public company, publicly traded counterparts, private companies have major importance in the world's economy. In 2008, the 441 list of largest private non-governmental companies by revenue, largest private companies in the United States accounted for ($1.8 trillion) in revenues and employed 6.2 million people, according to ''Forbes''. In 2005, using a substantially smaller pool size (22.7%) for comparison, the 339 companies on ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
O'Reilly Media
O'Reilly Media (formerly O'Reilly & Associates) is an American learning company established by Tim O'Reilly that publishes books, produces tech conferences, and provides an online learning platform. Its distinctive brand features a woodcut of an animal on many of its book covers. Company Early days The company began in 1978 as a private consulting firm doing technical writing, based in the Cambridge, Massachusetts area. In 1984, it began to retain publishing rights on manuals created for Unix vendors. A few 70-page "Nutshell Handbooks" were well-received, but the focus remained on the consulting business until 1988. After a conference displaying O'Reilly's preliminary Xlib manuals attracted significant attention, the company began increasing production of manuals and books. The original cover art consisted of animal designs developed by Edie Freedman because she thought that Unix program names sounded like "weird animals". Global Network Navigator In 1993 O'Reilly Media creat ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Amazon Web Services
Amazon Web Services, Inc. (AWS) is a subsidiary of Amazon.com, Amazon that provides Software as a service, on-demand cloud computing computing platform, platforms and Application programming interface, APIs to individuals, companies, and governments, on a metered pay-as-you-go basis. These cloud computing web services provide distributed computing processing capacity and software tools via AWS server farms. One of these services is Amazon Elastic Compute Cloud (EC2), which allows users to have at their disposal a Virtualization, virtual Computer cluster, cluster of computers, available all the time, through the Internet. AWS's virtual computers emulate most of the attributes of a real computer, including hardware central processing units (CPUs) and graphics processing units (GPUs) for processing; local/Random-access memory, RAM memory; hard-disk/Solid-state drive, SSD storage; a choice of operating systems; networking; and pre-loaded application software such as web servers, dat ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
