Elasticsearch

From Wikipedia, the free encyclopedia
Jump to navigation Jump to search
Elasticsearch
Elasticsearch logo.svg
Original author(s)Shay Banon
Developer(s)Elastic NV
Initial releaseFebruary 8, 2010; 9 years ago (2010-02-08)
Stable release
6.6.0 / January 29, 2019; 54 days ago (2019-01-29)[1]
Repository Edit this at Wikidata
Written inJava
Operating systemCross-platform
TypeSearch and index
LicenseVarious (open-core model), e.g. Apache License 2.0 (partially; open source), Elastic License (commercial)
Websitewww.elastic.co/products/elasticsearch
Elastic NV
Public
Traded asNYSEESTC
IndustrySoftware development
HeadquartersAmsterdam
ProductsElasticsearch, Logstash, Kibana, APM[2], Beats (Filebeat, MetricBeat, Packetbeat, Winlogbeat, Auditbeat, Heartbeat, Functionbeat)[3] (FileBeat)[4][5]
ServicesElasticsearch commercial solutions
Websitewww.elastic.co/products/elasticsearch Edit this on Wikidata
Shay Banon talking about Elasticsearch at Berlin Buzzwords 2010

Elasticsearch is a search engine based on the Lucene library. It provides a distributed, multitenant-capable full-text search engine with an HTTP web interface and schema-free JSON documents. Elasticsearch is developed in Java. Following an open-core business model, parts of the software are licensed under various open source licenses (mostly the Apache License)[6], while other parts[7] fall under the commercial (source-available) Elastic License. Official clients are available in Java, .NET (C#), PHP, Python, Apache Groovy, Ruby and many other languages.[8] According to the DB-Engines ranking, Elasticsearch is the most popular enterprise search engine followed by Apache Solr, also based on Lucene.[9]

History[edit]

Shay Banon created the precursor to Elasticsearch, called Compass, in 2004.[10] While thinking about the third version of Compass he realized that it would be necessary to rewrite big parts of Compass to "create a scalable search solution".[10] So he created "a solution built from the ground up to be distributed" and used a common interface, JSON over HTTP, suitable for programming languages other than Java as well.[10] Shay Banon released the first version of Elasticsearch in February 2010.[11]

Elasticsearch BV was founded in 2012 to provide commercial services and products around Elasticsearch and related software.[12] In June 2014, the company announced raising $70 million in a Series C funding round, just 18 months after forming the company. The round was led by New Enterprise Associates (NEA). Additional funders include Benchmark Capital and Index Ventures. This round brings total funding to $104M.[13]

In March 2015, the company Elasticsearch changed their name to Elastic.[14]

In June 2018, Elastic filed for an initial public offering with a estimated valuation of between 1.5 and 3 billion dollars.[15] On 5 October 2018, Elastic was listed on the New York Stock Exchange.[16]

Features[edit]

Elasticsearch can be used to search all kinds of documents. It provides scalable search, has near real-time search, and supports multitenancy.[8] "Elasticsearch is distributed, which means that indices can be divided into shards and each shard can have zero or more replicas. Each node hosts one or more shards, and acts as a coordinator to delegate operations to the correct shard(s). Rebalancing and routing are done automatically".[8] Related data is often stored in the same index, which consists of one or more primary shards, and zero or more replica shards. Once an index has been created, the number of primary shards cannot be changed.[17]

Elasticsearch is developed alongside a data collection and log-parsing engine called Logstash, and an analytics and visualisation platform called Kibana. The three products are designed for use as an integrated solution, referred to as the "Elastic Stack" (formerly the "ELK stack").

Elasticsearch uses Lucene and tries to make all its features available through the JSON and Java API. It supports facetting and percolating,[18] which can be useful for notifying if new documents match for registered queries.

Another feature is called "gateway" and handles the long-term persistence of the index;[19] for example, an index can be recovered from the gateway in the event of a server crash. Elasticsearch supports real-time GET requests, which makes it suitable as a NoSQL datastore,[20] but it lacks distributed transactions.[21]

Managed services[edit]

AWS offers Elasticsearch as a managed service since 2015.[22][23][24] Such managed services provide hosting, deployment, backup and other support.[25] Most managed services also include support for Kibana.[citation needed]

Elasticsearch is the basis of Pangeanic's contribution to the EU's Marie Curie research project "EXPERT"[26] called ActivaTM. Pangeanic built a bilingual database compatible with Computer-Assisted Translation tools, which could offer real-time access via API from a variety of tools. The project received further funding from the EU as the National and European Central Translation Memory project [27] under the Connecting Europe Facility (CEF) programme. NEC TM aims to centralise national translation assets in all the EU's Member States so countries can re-use bilingual translation data produced as a result of public procurement contracts.

Reported Elasticsearch security breaches[edit]

  • 2018-11-15 Elasticsearch database belonging to VoxOx exposed tens of millions of text messages, including password reset links, two-factor codes, shipping notifications and more.[28]
  • 2018-11-27 Elasticsearch database belonging to Urban Massage exposed more than 309,000 user records, including names, email addresses and phone numbers.[29]
  • 2019-01-21 Elasticsearch database belonging to Youth-run agency AIESEC exposed over 4 million intern applications including the applicant’s name, gender, date of birth, and the reasons why the person was applying for the internship.[30]
  • 2019-01-12 Elasticsearch server belonging to do-it-yourself chain, B&Q exposed personal details of individuals caught or suspected of stealing goods from stores. [31][32]
  • 2019-01-23 Elasticsearch database belonging to Ascension Data and Analytics exposed 24 million financial and banking documents, representing tens of thousands of loans and mortgages from some of the biggest banks in the U.S.[33]

See also[edit]

References[edit]

  1. ^ "Releases · elastic/elasticsearch". Retrieved 29 January 2019 – via GitHub.
  2. ^ https://www.elastic.co/solutions/apm
  3. ^ "Beats". elastic.co.
  4. ^ "Filebeat". elastic.co.
  5. ^ ":tropical_fish: Beats: Lightweight shippers for Elasticsearch & Logstash - elastic/beats". 21 January 2019. Retrieved 21 January 2019 – via GitHub.
  6. ^ Open Source, Distributed, RESTful Search Engine. Contribute to elastic/elasticsearch development by creating an account on GitHub, elastic, 2019-03-14, retrieved 2019-03-14
  7. ^ "No, Elastic X-Pack is not going to be open source - according to Elastic themselves -". Flax. 2018-03-02. Retrieved 2019-03-14.
  8. ^ a b c "Official Website". Elasticsearch.org. Retrieved 2014-02-04.
  9. ^ "DB-Engines Ranking - popularity ranking of search engines". db-engines.com. Retrieved 10 January 2016.
  10. ^ a b c Banon, Shay. "The Future of Compass & ElasticSearch".
  11. ^ Banon, Shay (2010-02-08). "You Know, for Search". Archived from the original on 2013-01-16.
  12. ^ "Immediate Insight from Data Matters". elastic.co. Retrieved 25 March 2015.
  13. ^ "ElasticSearch Scores $70M In Series C To Fund Growth Spurt". TechCrunch. AOL. Retrieved 25 March 2015.
  14. ^ "Elasticsearch Changes Name to Elastic to Reflect Wide Adoption Beyond Search". Elastic. Retrieved 19 October 2016.
  15. ^ Schleifer, Theodore (21 June 2018). "The IPOs keep coming: The search company Elastic has filed to go public". Recode. Retrieved 22 June 2018.
  16. ^ Banon, Shay (5 October 2018). "Ze Bell Has Rung: Thank You Users, Customers, and Partners". Elastic (NV). Retrieved 24 October 2018.
  17. ^ "How to monitor Elasticsearch performance".
  18. ^ "percolate at elasticsearch.org reference". Elasticsearch.org. Retrieved 2014-02-04.
  19. ^ "elasticsearch Guide: Gateway". elasticsearch. Retrieved 19 April 2013.
  20. ^ "Elasticsearch as database". Karussell.wordpress.com. Retrieved 2014-02-04.
  21. ^ "No transaction support". Elasticsearch-users.115913.n3.nabble.com. 2010-07-08. Retrieved 2014-02-04.
  22. ^ https://aws.amazon.com/blogs/aws/new-amazon-elasticsearch-service/
  23. ^ "Amazon Elasticsearch Service – Amazon Web Services (AWS)". Amazon Web Services, Inc. (in Latin). Retrieved 2019-02-08.
  24. ^ "Hosted Elasticsearch & Kibana on AWS". elastic.co. Retrieved 2016-10-16.
  25. ^ "Elasticsearch Setup". ctovision.com. Retrieved 2016-10-16.
  26. ^ "EXPERT (EXPloiting Empirical appRoaches to Translation" (PDF). http://expert-itn.eu/?q=content/researchers. Retrieved 13 February 2019. External link in |website= (help)
  27. ^ "National and European Central Translation Memory NEC TM". nec-tm.eu. Retrieved 13 February 2019.
  28. ^ Zack, Whittaker. "A leaky database of SMS text messages exposed password resets and two-factor codes". TechCrunch. Retrieved 24 January 2019.
  29. ^ Zack, Whittaker. "Urban Massage exposed a huge customer database, including sensitive comments on its creepy clients". TechCrunch. Retrieved 24 January 2019.
  30. ^ Zack, Whittaker. "Youth-run agency AIESEC exposed over 4 million intern applications". TechCrunch. Retrieved 24 January 2019.
  31. ^ "B&Q 'exposed data about store thieves'". BBC News. Retrieved 28 January 2019.
  32. ^ Lee Johnstone (24 January 2019). "When Security Fails, 70,000 Offender and Incident Logs Exposed". Ctrlbox Information Security. Ctrlbox Information Security. Retrieved 5 February 2019.
  33. ^ Zack, Whittaker. "Millions of bank loan and mortgage documents have leaked online". TechCrunch. Retrieved 24 January 2019.

External links[edit]