Learn A to Z of Prometheus & Grafana from Basic to ADVANCE level; Complete Guide to Master DevOps Monitoring & Alerting

What you'll learn

Learn Full In & Out of Prometheus toolkit with proper HANDS-ON examples from scratch.

Start with the implementation of Prometheus core concepts - Architecture, Installation, PromQL, Exporters, Functions, Operators, etc.

ADVANCE Prometheus concepts, the explanation to which is not very clear even in Prometheus' Official Documentation.

Instrument Python & Go web applications to expose Prometheus metrics with Client Libraries.

Implement the Monitoring & Alerting Design of Real-Time case studies using Prometheus.

Pushgateway, Service Discovery, Recording Rules, Routing Trees, Create Custom Exporter, HTTP API, and many more.

Monitor the Amazon Cloud (AWS) with Prometheus.

Integration with many Alert Notifiers - Gmail, PagerDuty, Slack.

Build value added dashboards with GRAFANA

Codes and Resources are available in resources tab. This will save your typing efforts.

Requirements

A very basic knowledge of YAML will be an add-on.

Rest everything on Prometheus is covered in this course with line to line explanations.

Description

"Prometheus is an open source tool used for event monitoring and alerting."Prometheus has changed the way of monitoring systems and that is why it has become the Top-level project of Cloud Native Computing Foundation (CNCF).What's included in the course ?Complete Prometheus concepts explained from Scratch to ADVANCE with Real-Time implementation.Each and every Prometheus concept is explained with HANDS-ON examples.Includes each and every, even thin detail of Prometheus.For every concept, first, we will cover its theoretical stuff, followed by their running example. Include even those concepts, the explanation to which is not very clear even in Prometheus' Official Documentation.Technicalities Many (official & 3rd party) exporters.In-and-out of Functions, Operators, Clauses, etc, in Prometheus Query Language (PromQL).Instrument the Python or Go applications to expose custom metrics with Client Libraries. Dynamically add or remove scrape targets using Service Discovery. Recording Rules.Monitor the Amazon Cloud (AWS) with Prometheus.Creating an end to end Routing Tree for Alerting systems.*Exclusive*- Create your own Custom ExporterIntegration with many Alert Notifiers - Gmail, PagerDuty, Slack.How to scrape from batch jobs using Pushgateway.Build monitoring & alerting design pattern of a Real-Time case study using Prometheus.Build value added dashboards with GRAFANA.Learn Best practices / Do's & Dont's to follow while monitoring in Real-Time DevOps Projects.After completing this course, you can start working on any Prometheus project with full confidence.Add-OnsQuestions and Queries will be answered very quickly.Prometheus codes and other resources used in lectures are attached in the course for your convenience.I am going to update it frequently, every time adding new components of Prometheus.

Overview

Section 1: Introduction

Lecture 1 Introduction to Prometheus

Lecture 2 Alternate Monitoring Tools

Lecture 3 Basic Terminologies in Prometheus

Section 2: Architecture of Prometheus Server

Lecture 4 Architecture of Prometheus

Lecture 5 How Prometheus Works behind the scenes (Life Cycle)

Section 3: Installation and UI Tour

Lecture 6 Virtual Machine Installation

Lecture 7 Prometheus Installation

Lecture 8 First Look of Prometheus UI

Lecture 9 Understanding Prometheus Configuration File

Lecture 10 Prometheus First Run

Section 4: Exporters - Set 1

Lecture 11 What are Exporters?

Lecture 12 Node Exporter - Monitoring Linux Systems

Lecture 13 WMI Exporter - Monitoring Windows Systems

Section 5: PromQL - Prometheus Query Language

Lecture 14 Data Types in PromQL

Lecture 15 Selectors & Matchers

Lecture 16 Binary Operators

Lecture 17 'ignoring' and 'on' keywords

Lecture 18 Aggregation Operators

Lecture 19 Functions - 'rate' & 'irate'

Lecture 20 Functions - changes, deriv, predict_linear

Lecture 21 Functions continued

Section 6: Client Libraries - Adding Instrumentation to Python Application

Lecture 22 What are Client Libraries and Metric Types

Lecture 23 Python app Boilerplate Code

Lecture 24 Exposing Metrics from Python app using Prometheus Client

Lecture 25 Counter Metrics Exposition

Lecture 26 Adding Labels to Exposed Metrics

Lecture 27 Gauge Metrics Exposition

Lecture 28 Summary Metrics Exposition

Lecture 29 Histogram Metrics Exposition

Section 7: Client Libraries - Instrumenting GO Applications

Lecture 30 GO app Boilerplate Code

Lecture 31 Counter Metrics Exposition

Lecture 32 Gauge Metrics Exposition

Lecture 33 Summary Metrics Exposition

Lecture 34 Histogram Metrics Exposition

Section 8: Quantification of Instrumentation

Lecture 35 What to Instrument?

Lecture 36 How much to Instrument?

Section 9: Recording Rules

Lecture 37 What are Recording Rules?

Lecture 38 Reload Prometheus Configurations on-the-fly

Lecture 39 Writing Recording Rules

Lecture 40 Writing Recording Rules continued

Lecture 41 Add Multiple Rules

Lecture 42 Best Practices for Recording Rules

Section 10: Alerting

Lecture 43 What is Alerting?

Lecture 44 Writing & Firing the first Alert

Lecture 45 'for' clause

Lecture 46 Adding Labels to Alerts

Lecture 47 Installing Alertmanager

Lecture 48 Adding Alert Notifier - Gmail

Lecture 49 Sending Alert Notifications - Gmail

Lecture 50 Templating the Alerts

Section 11: Create Routing Tree for Alerts - Case Study

Lecture 51 Case Study - Problem Statement

Lecture 52 Understanding the Use Case for Routing Tree

Lecture 53 Write Alerting Rules for the Use Case

Lecture 54 Coding the Routing Tree - Part 1

Lecture 55 Coding the Routing Tree - Part 2

Lecture 56 Coding the Routing Tree - Part 3

Lecture 57 Run the Routing Tree

Lecture 58 Grouping the Alerts

Lecture 59 Throttling the Alerts

Lecture 60 Inhibiting the Alerts

Lecture 61 Silencing the Alerts

Lecture 62 'continue' clause

Section 12: PagerDuty & Slack - Alert Notifiers

Lecture 63 Slack integration with Prometheus

Lecture 64 PagerDuty integration with Prometheus

Section 13: Blackbox Exporter & Relabeling

Lecture 65 What is Blackbox exporter

Lecture 66 Download Blackbox exporter

Lecture 67 'http' probe module

Lecture 68 'tcp' & 'icmp' probe module

Lecture 69 'dns' probe module

Lecture 70 Scraping targets via Blackbox

Lecture 71 Relabelling

Section 14: Pushgateway

Lecture 72 Introduction to Pushgateway

Lecture 73 Getting Started with Pushgateway

Lecture 74 Push metrics to Pushgateway

Lecture 75 Automate Pushing metrics using Cron job

Lecture 76 Python App pushing metrics to Pushgateway

Lecture 77 Pushgateway Pitfalls

Section 15: Service Discovery

Lecture 78 Introduction to Service Discovery

Lecture 79 Static Service Discovery

Lecture 80 File-based Service Discovery

Section 16: Amazon Cloud (AWS) with Prometheus

Lecture 81 Create Prometheus User in AWS

Lecture 82 Spinning up AWS EC2 instance

Lecture 83 Node Exporter on EC2 instance

Lecture 84 Relabeling the private IP to public

Lecture 85 'keep' and 'drop' targets with Relabeling

Section 17: AWS Cloudwatch Exporter

Lecture 86 AWS Cloudwatch & UI tour

Lecture 87 Installation & Configuration

Lecture 88 Running the Cloudwatch Exporter

Section 18: Exporters - Set 2

Lecture 89 'mysql' Exporter

Section 19: Create Custom Exporter

Lecture 90 Introduction

Lecture 91 Creating Target application

Lecture 92 Writing Custom Exporter

Section 20: Prometheus HTTP API

Lecture 93 Running Prometheus with HTTP API

Section 21: Grafana Dashboards

Lecture 94 Grafana Installation

Lecture 95 Adding Data source to Grafana

Lecture 96 Implementing default dashboards of Grafana

Lecture 97 Create Custom Dashboard - Part 1

Lecture 98 Create Custom Dashboard - Part 2

Section 22: Additional Learnings

Lecture 99 When to use Prometheus and When NOT to

Lecture 100 Create Gmail App Passwords

Lecture 101 ThankYou

Section 23: BONUS

Lecture 102 Bonus

Experienced techies who want to add a hot & demanding technology in their technology stack.,DevOps Engineers who want to switch their career from conventional monitoring tools to a full-fledged monitoring system.