Search, analyze, and visualize big data on a cluster with Elasticsearch, Logstash, Beats, Kibana, and more. Includes 10.5 hours of on-demand video and a certificate of completion.
Buy This Course
Lifetime access to all videos and materials for this course with a one-time payment.
THERE IS A NEW VERSION OF THIS COURSE FOR ELASTICSEARCH 8 AVAILABLE.
Elasticsearch 7 is a powerful tool not only for powering search on big websites, but also for analyzing big data sets in a matter of milliseconds! It’s an increasingly popular technology, and a valuable skill to have in today’s job market. This comprehensive course covers it all, from installation to operations, with over 100 lectures including 11 hours of video. We’ve partnered with Coralogix to co-produce the most up-to-date, extensive Elasticsearch course we’ve seen.
We’ll cover setting up search indices on an Elasticsearch 7 cluster (if you need Elasticsearch 5 or 6 – we have other courses on that), and querying that data in many different ways. Fuzzy searches, partial matches, search-as-you-type, pagination, sorting – you name it. And it’s not just theory, every lesson has hands-on examples where you’ll practice each skill using a virtual machine running Elasticsearch on your own PC.
We’ll explore what’s new in Elasticsearch 7 – including index lifecycle management, the deprecation of types and type mappings, and a hands-on activity with Elasticsearch SQL. We’ve also added much more depth on managing security with the Elastic Stack, and how backpressure works with Beats.
We cover, in depth, the often-overlooked problem of importing data into an Elasticsearch index. Whether it’s via raw RESTful queries, scripts using Elasticsearch API’s, or integration with other “big data” systems like Spark and Kafka – you’ll see many ways to get Elasticsearch started from large, existing data sets at scale. We’ll also stream data into Elasticsearch using Logstash and Filebeat – commonly referred to as the “ELK Stack” (Elasticsearch / Logstash / Kibana) or the “Elastic Stack“.
Elasticsearch isn’t just for search anymore – it has powerful aggregation capabilities for structured data. We’ll bucket and analyze data using Elasticsearch, and visualize it using the Elastic Stack’s web UI, Kibana.
You’ll learn how to manage operations on your Elastic Stack, using X-Pack to monitor your cluster’s health, and how to perform operational tasks like scaling up your cluster, and doing rolling restarts. We’ll also spin up Elasticsearch clusters in the cloud using Amazon Elasticsearch Service and the Elastic Cloud.
Elasticsearch is positioning itself to be a much faster alternative to Hadoop, Spark, and Flink for many common data analysis requirements. It’s an important tool to understand, and it’s easy to use! Dive in with me and I’ll show you what it’s all about.
Frank Kane
Author
Our courses are led by Frank Kane, a former Amazon and IMDb developer with extensive experience in machine learning and data science. With 26 issued patents and 9 years of experience at the forefront of recommendation systems, Frank brings real-world expertise to his teaching. His ability to explain complex concepts in accessible terms has helped over one million students worldwide gain valuable skills in machine learning, data engineering, and AI development.
Buy This Course
Lifetime access to all videos and materials for this course with a one-time payment.
Installing and Understanding Elasticsearch
Lesson 1 of 11 within section Installing and Understanding Elasticsearch.
You must enroll in this course to access course content.
Installing Elasticsearch [Step by Step]
Lesson 2 of 11 within section Installing and Understanding Elasticsearch.
You must enroll in this course to access course content.
Intro to HTTP and RESTful API’s
Lesson 4 of 11 within section Installing and Understanding Elasticsearch.
You must enroll in this course to access course content.
Elasticsearch Basics: Logical Concepts
Lesson 5 of 11 within section Installing and Understanding Elasticsearch.
You must enroll in this course to access course content.
Term Frequency / Inverse Document Frequency (TF/IDF)
Lesson 6 of 11 within section Installing and Understanding Elasticsearch.
You must enroll in this course to access course content.
Lesson 7 of 11 within section Installing and Understanding Elasticsearch.
You must enroll in this course to access course content.
What’s New in Elasticsearch 7
Lesson 8 of 11 within section Installing and Understanding Elasticsearch.
You must enroll in this course to access course content.
Quiz: Elasticsearch Concepts and Architecture
Lesson 10 of 11 within section Installing and Understanding Elasticsearch.
You must enroll in this course to access course content.
Lesson 11 of 11 within section Installing and Understanding Elasticsearch.
You must enroll in this course to access course content.
Mapping and Indexing Data
Lesson 1 of 16 within section Mapping and Indexing Data.
You must enroll in this course to access course content.
Connecting to your Cluster
Lesson 2 of 16 within section Mapping and Indexing Data.
You must enroll in this course to access course content.
Introducing the MovieLens Data Set
Lesson 3 of 16 within section Mapping and Indexing Data.
You must enroll in this course to access course content.
Lesson 4 of 16 within section Mapping and Indexing Data.
You must enroll in this course to access course content.
Import a Single Movie via JSON / REST
Lesson 5 of 16 within section Mapping and Indexing Data.
You must enroll in this course to access course content.
Insert Many Movies at Once with the Bulk API
Lesson 6 of 16 within section Mapping and Indexing Data.
You must enroll in this course to access course content.
Updating Data in Elasticsearch
Lesson 7 of 16 within section Mapping and Indexing Data.
You must enroll in this course to access course content.
Deleting Data in Elasticsearch
Lesson 8 of 16 within section Mapping and Indexing Data.
You must enroll in this course to access course content.
[Exercise] Insert, Update and Delete a Movie
Lesson 9 of 16 within section Mapping and Indexing Data.
You must enroll in this course to access course content.
Lesson 10 of 16 within section Mapping and Indexing Data.
You must enroll in this course to access course content.
Using Analyzers and Tokenizers
Lesson 11 of 16 within section Mapping and Indexing Data.
You must enroll in this course to access course content.
Data Modeling and Parent/Child Relationships, Part 1
Lesson 12 of 16 within section Mapping and Indexing Data.
You must enroll in this course to access course content.
Data Modeling and Parent/Child Relationships, Part 2
Lesson 13 of 16 within section Mapping and Indexing Data.
You must enroll in this course to access course content.
Lesson 14 of 16 within section Mapping and Indexing Data.
You must enroll in this course to access course content.
Lesson 15 of 16 within section Mapping and Indexing Data.
You must enroll in this course to access course content.
Lesson 16 of 16 within section Mapping and Indexing Data.
You must enroll in this course to access course content.
Searching with Elasticsearch
Lesson 1 of 16 within section Searching with Elasticsearch.
You must enroll in this course to access course content.
Lesson 2 of 16 within section Searching with Elasticsearch.
You must enroll in this course to access course content.
Lesson 3 of 16 within section Searching with Elasticsearch.
You must enroll in this course to access course content.
Lesson 4 of 16 within section Searching with Elasticsearch.
You must enroll in this course to access course content.
[Exercise] Querying in Different Ways
Lesson 5 of 16 within section Searching with Elasticsearch.
You must enroll in this course to access course content.
Lesson 6 of 16 within section Searching with Elasticsearch.
You must enroll in this course to access course content.
Lesson 7 of 16 within section Searching with Elasticsearch.
You must enroll in this course to access course content.
Lesson 8 of 16 within section Searching with Elasticsearch.
You must enroll in this course to access course content.
Lesson 9 of 16 within section Searching with Elasticsearch.
You must enroll in this course to access course content.
Lesson 10 of 16 within section Searching with Elasticsearch.
You must enroll in this course to access course content.
Lesson 11 of 16 within section Searching with Elasticsearch.
You must enroll in this course to access course content.
Lesson 13 of 16 within section Searching with Elasticsearch.
You must enroll in this course to access course content.
Lesson 14 of 16 within section Searching with Elasticsearch.
You must enroll in this course to access course content.
Search-As-You-Type Field Type
Lesson 15 of 16 within section Searching with Elasticsearch.
You must enroll in this course to access course content.
Lesson 16 of 16 within section Searching with Elasticsearch.
You must enroll in this course to access course content.
Importing Data into your Index – Big or Small
Lesson 1 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Importing Data with a Script
Lesson 2 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Importing with Client Libraries
Lesson 3 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
[Exercise] Importing with a Script
Lesson 4 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Lesson 5 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Lesson 6 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Lesson 7 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Logstash and MySQL, Part 1
Lesson 8 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Logstash and MySQL, Part 2
Lesson 9 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Lesson 10 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Importing CSV Data with Logstash
Lesson 11 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Importing JSON Data with Logstash
Lesson 12 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Parsing and Filtering Logstash with Grok
Lesson 13 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Logstash Grok Examples for Common Log Formats
Lesson 14 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Logstash Input Plugins, Part 1: Heartbeat
Lesson 15 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Logstash Input Plugins, Part 2: Generator and Dead Letter Queue
Lesson 16 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Logstash Input Plugins, Part 3: HTTP Poller
Lesson 17 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Logstash Input Plugins, Part 4: Twitter
Lesson 18 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Lesson 19 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Elasticsearch and Apache Hadoop
Lesson 20 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Elasticsearch and Kafka, Part 1
Lesson 21 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Elasticsearch and Kafka, Part 2
Lesson 22 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Elasticsearch and Apache Spark, Part 1
Lesson 23 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Elasticsearch and Apache Spark, Part 2
Lesson 24 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
[Exercise] Importing Data with Spark
Lesson 25 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Lesson 26 of 26 within section Importing Data into your Index – Big or Small.
You must enroll in this course to access course content.
Aggregation
Lesson 1 of 8 within section Aggregation.
You must enroll in this course to access course content.
Aggregations, Buckets, and Metrics
Lesson 2 of 8 within section Aggregation.
You must enroll in this course to access course content.
Lesson 3 of 8 within section Aggregation.
You must enroll in this course to access course content.
Lesson 4 of 8 within section Aggregation.
You must enroll in this course to access course content.
[Exercise] Generating Histogram Data
Lesson 5 of 8 within section Aggregation.
You must enroll in this course to access course content.
Nested Aggregations, Part 1
Lesson 6 of 8 within section Aggregation.
You must enroll in this course to access course content.
Nested Aggregations, Part 2
Lesson 7 of 8 within section Aggregation.
You must enroll in this course to access course content.
Lesson 8 of 8 within section Aggregation.
You must enroll in this course to access course content.
Using Kibana
Lesson 1 of 9 within section Using Kibana.
You must enroll in this course to access course content.
Lesson 2 of 9 within section Using Kibana.
You must enroll in this course to access course content.
Lesson 3 of 9 within section Using Kibana.
You must enroll in this course to access course content.
[Exercise] Exploring Data with Kibana
Lesson 4 of 9 within section Using Kibana.
You must enroll in this course to access course content.
Lesson 5 of 9 within section Using Kibana.
You must enroll in this course to access course content.
Lesson 6 of 9 within section Using Kibana.
You must enroll in this course to access course content.
Lesson 7 of 9 within section Using Kibana.
You must enroll in this course to access course content.
Lesson 8 of 9 within section Using Kibana.
You must enroll in this course to access course content.
Lesson 9 of 9 within section Using Kibana.
You must enroll in this course to access course content.
Analyzing Log Data with the Elastic Stack
Lesson 1 of 8 within section Analyzing Log Data with the Elastic Stack.
You must enroll in this course to access course content.
Lesson 2 of 8 within section Analyzing Log Data with the Elastic Stack.
You must enroll in this course to access course content.
FileBeat and the Elastic Stack Architecture
Lesson 3 of 8 within section Analyzing Log Data with the Elastic Stack.
You must enroll in this course to access course content.
Lesson 4 of 8 within section Analyzing Log Data with the Elastic Stack.
You must enroll in this course to access course content.
Lesson 5 of 8 within section Analyzing Log Data with the Elastic Stack.
You must enroll in this course to access course content.
Analyzing Logs with Kibana Dashboards
Lesson 6 of 8 within section Analyzing Log Data with the Elastic Stack.
You must enroll in this course to access course content.
Lesson 8 of 8 within section Analyzing Log Data with the Elastic Stack.
You must enroll in this course to access course content.
Elasticsearch Operations
Lesson 1 of 18 within section Elasticsearch Operations.
You must enroll in this course to access course content.
Choosing the Right Number of Shards
Lesson 2 of 18 within section Elasticsearch Operations.
You must enroll in this course to access course content.
Adding Indices as a Scaling Strategy
Lesson 3 of 18 within section Elasticsearch Operations.
You must enroll in this course to access course content.
Lesson 4 of 18 within section Elasticsearch Operations.
You must enroll in this course to access course content.
Index Lifecycle Management
Lesson 5 of 18 within section Elasticsearch Operations.
You must enroll in this course to access course content.
Choosing your Cluster’s Hardware
Lesson 6 of 18 within section Elasticsearch Operations.
You must enroll in this course to access course content.
Lesson 7 of 18 within section Elasticsearch Operations.
You must enroll in this course to access course content.
Lesson 8 of 18 within section Elasticsearch Operations.
You must enroll in this course to access course content.
Troubleshooting Common Issues
Lesson 9 of 18 within section Elasticsearch Operations.
You must enroll in this course to access course content.
Failover in Action, Part 1
Lesson 10 of 18 within section Elasticsearch Operations.
You must enroll in this course to access course content.
Failover in Action, Part 2
Lesson 11 of 18 within section Elasticsearch Operations.
You must enroll in this course to access course content.
Lesson 12 of 18 within section Elasticsearch Operations.
You must enroll in this course to access course content.
Lesson 13 of 18 within section Elasticsearch Operations.
You must enroll in this course to access course content.
Snapshot Lifecycle Management
Lesson 14 of 18 within section Elasticsearch Operations.
You must enroll in this course to access course content.
Lesson 15 of 18 within section Elasticsearch Operations.
You must enroll in this course to access course content.
Lesson 16 of 18 within section Elasticsearch Operations.
You must enroll in this course to access course content.
Uptime Monitoring with Heartbeat
Lesson 17 of 18 within section Elasticsearch Operations.
You must enroll in this course to access course content.
Lesson 18 of 18 within section Elasticsearch Operations.
You must enroll in this course to access course content.
Elasticsearch in the Cloud
Lesson 1 of 6 within section Elasticsearch in the Cloud.
You must enroll in this course to access course content.
Amazon Elasticsearch Service is now Amazon Opensearch Service…
Lesson 2 of 6 within section Elasticsearch in the Cloud.
You must enroll in this course to access course content.
Amazon Elasticsearch Service, Part 1
Lesson 3 of 6 within section Elasticsearch in the Cloud.
You must enroll in this course to access course content.
Amazon Elasticsearch Service, Part 2
Lesson 4 of 6 within section Elasticsearch in the Cloud.
You must enroll in this course to access course content.
Lesson 5 of 6 within section Elasticsearch in the Cloud.
You must enroll in this course to access course content.
Lesson 6 of 6 within section Elasticsearch in the Cloud.
You must enroll in this course to access course content.
ELK on Kubernetes with Elastic Cloud on Kubernetes (ECK)
Introducing Elastic Cloud on Kubernetes, and Setting Up our Cluster
Lesson 1 of 3 within section ELK on Kubernetes with Elastic Cloud on Kubernetes (ECK).
You must enroll in this course to access course content.
Setting Up Elasticsearch and Kibana on Kubernetes with ECK, viewing logs, and installing plugins.
Lesson 2 of 3 within section ELK on Kubernetes with Elastic Cloud on Kubernetes (ECK).
You must enroll in this course to access course content.
Using Kubernetes Persistent Volumes with Elasticsearch, and Setting up an ECK Multi-Node Cluster
Lesson 3 of 3 within section ELK on Kubernetes with Elastic Cloud on Kubernetes (ECK).
You must enroll in this course to access course content.
You Made It!
Lesson 1 of 2 within section You Made It!.
You must enroll in this course to access course content.
Lesson 2 of 2 within section You Made It!.
You must enroll in this course to access course content.
Hello,
Thank you for this course. I am interested to know if ElasticSearch also means the new OpenSearch. I know about the name change, but I also know that they forked it. So, will my OpenSerach work exactly through this course?
The other question I have is related to AWS. Do you through this course using OpenSearch on AWS or are we using OpenSearch through a Docker Container?
I await your reply.
Kind regards,
Daniel
This course covers Elasticsearch from Elastic.co. AWS forked it into OpenSearch to avoid licensing issues. Right now they are largely the same thing, although OpenSearch has extended it in several ways to integrate more closely with other AWS services and features.
So, no, this is not using AWS’s forked Elasticsearch. The course actually has you install Elasticsearch from elastic.co on an Ubuntu VM (we don’t assume the student is familiar with Docker so we just install it directly.)
Greetings, I would like the course, I would like to be able to link Elasticsearch with a Zimbra server, do you think that this course is the guide to be able to do it? Thanks
This course will get you familiar with how the Elastic stack works, but we don’t cover integration with Zimbra. The only resource I could find on that is https://github.com/Zimbra/elastic-stack
thank you