Presto (SQL query engine)
This article contains content that is written like an advertisement. (February 2017) (Learn how and when to remove this template message)
Facebook commenced development efforts on Presto in 2012, and announced its release as open source for Apache Hadoop in 2013. In 2014, Netflix disclosed they used Presto on 10 petabytes of data stored in the Amazon Simple Storage Service (S3). Airbnb released the source to web interface software called Airpal for Presto in March, 2015. In June 2015, data-warehousing company Teradata promoted its commercial support, using the Apache License for the software. In December 2017, Teradata announced its partnership with Starburst, an enterprise Presto company that will continue advancing this open source project going forward.
Presto’s architecture is very similar to a classic database management system using cluster computing. It can be visualized as one coordinator node working in sync with multiple worker nodes. Clients submit SQL statements that get parsed and planned following which parallel tasks are scheduled to workers. Workers jointly process rows from the data sources and produce results that are returned to the client. Compared to the original Apache Hive execution model which used the Hadoop MapReduce mechanism on each query, Presto does not write intermediate results to disk resulting in a significant speed improvement. Presto is written in the Java programming language.
A single Presto query can combine data from multiple sources. Presto offers connectors to data sources including files in Hadoop Distributed File System, Amazon S3, MySQL, Apache Kafka, Apache Cassandra, PostgreSQL and Redis. Unlike other Hadoop distribution-specific tools, such as Cloudera Impala, Presto can work with any flavor of Hadoop or without it. Presto supports separation of compute and storage and may be deployed both on premises and in the cloud.
- Joab Jackson (November 6, 2013). "Facebook goes open source with query engine for big data". Computer World. Retrieved April 26, 2017.
- Jordan Novet (June 6, 2013). "Facebook unveils Presto engine for querying 250 PB data warehouse". Giga Om. Retrieved April 26, 2017.
- Eva Tse, Zhenxiao Luo, Nezih Yigitbasi (October 7, 2014). "Using Presto in our Big Data Platform on AWS". Netflix technical blog. Retrieved April 26, 2017.
- Doug Henschen (March 5, 2015). "Airbnb Boosts Presto SQL Query Engine For Hadoop". Information Week. Retrieved April 26, 2017.
- James Mayfield (March 4, 2015). "Airpal: a Web UI for PrestoDB". Airbnb blog post. Archived from the original on March 6, 2015. Retrieved April 26, 2017.
- "Teradata Launches First Enterprise Support for Presto". Press release. June 8, 2015. Retrieved April 26, 2017.
- "Teradata Partners with Starburst, a New Company Focused on Continuing the Success of the Presto Open Source Project". Press release. Dec 13, 2017. Retrieved 2017-12-14.
- "Presto - Next Chapter". Starburst blog post. Dec 13, 2017. Retrieved 2017-12-14.