arrow_back
Introduction to the Course
Welcome to the Course
What are World Development Indicators (WDI)?
What You Will Learn
Tools We’ll Use: Apache Spark, Spark SQL, Apache Zeppelin
World Development Indicators Deep Dive
WDI Dataset Overview – Countries, Regions, and Indicators
Types of Indicators in WDI (Economic, Social, Demographic, Health, Environment)
Understanding the WDI Dataset Structure (Attributes, Years, Metadata)
Data Sources of WDI – World Bank & Other International Organizations
Setting Up the Environment
Requirements
(Hands On) Installing JAVA
Steps for Installing JAVA
(Hands On) Setting JAVA environments
Steps for Setting JAVA environments
(Hands On) Apache Zeppelin Installation Steps on Ubuntu machine
Steps for Installing Apache Zeppelin on Ubuntu machine
(Hands On) Installing Docker Desktop on Windows 10/11
Steps for Installing Docker on Windows
(Hands On) Running Apache Zeppelin on Docker
Steps for Running Apache Zeppelin on Docker
(Hands On) Configure and Connect to Spark interpreter
Steps for Configure and Connect to Spark Interpreter
Download Resources
Download Resources
Country
Indicators.csv
World+Development+Indicators_old
Importing Zeppelin file in Zeppelin Environment
Zeppelin Basics
What is Zeppelin
Features & Benefits
Notebook UI Overview
Markdown and text formatting
Creating and Running Paragraphs
Hands on Creating and Running paragraphs
Visualization Options (Tables, Bar chart, Pie chart, etc.)
Hands On - Types of Default Chart in Zeppelin
Zeppelin with Apache Spark
Spark interpreter details
Working with RDDs and DataFrames
Spark SQL queries and caching
Visualizing Spark outputs
Job tracking and performance tuning basics
Data Exploration with Spark
Loading CSV Data into Spark DataFrames (Country Dataset)
Creating Temporary Views for Spark SQL Queries
Analyzing Income Inequality with Gini Index in WDI
Analyzing Youth Literacy Rates with Spark SQL
Comparing Trade (% of GDP) for India and China
Analyzing Exports of Goods and Services for India and China
Analyzing Imports of Goods and Services for India and China
Analyzing GDP per Capita (PPP) for India and China
Analyzing Poverty Alleviation in India and China
Analyzing Life Expectancy at Birth in India and China
Analyzing Urban Population Growth in India and China
Analyzing Infant Mortality as a Measure of Healthcare in India and China
The 10 Poorest Countries in 1962 vs 2014
The 10 Richest Countries in 1962 vs 2014
Analyzing Average Income in Rich Countries (1960–2014)
Average Income in Poor Countries (1960–2014)
Comparing Average Incomes in 1962 (Case Study: 4 Countries)
Comparing Average Incomes in 2014 (Case Study: 4 Countries)
Life Expectancy in France (1960–2013)
Birth Rates in G7 Countries (1960–2013)
Introduction
Introduction
Download Resources
Download Source Code for Apache Spark Project
Download Data file 1 for Apache Spark Project
Download Data file 2 for Apache Spark Project
Project Begins
File level details
(Old) Free Account creation in Databricks
(New) Free Account creation in Databricks
Importing Databricks Notebook
Overview and Project Objective
File Content Explaination
Launch Spark Cluster
Spark Notebook Basics
Loading Data Into Spark Dataframe
GINI Index
Youth Literacy Rate
Trade as a percentage of GDP for China and India
Exports of goods and services
Import of goods and services
GDP per capita
Poverty Alleviation
Life Expectancy at birth, total (years)
Urban Population growth
Infant Mortality
The 10 Countries with Lowest Average Income in 1962/2014
The 10 Countries with Highest Average Income
Average Income from 1960-2014 in Rich Countries
Average Income from 1960-2014 in Poor Countries
Average Income in 1962
Average Income in 2014
Life Expectancy in France 1960-2013
G-7 Country Birth Rates 1960-2013
World Per Capita Income in 2013
Publish Notebook to the Web