Categories

There are currently no items in your shopping cart.

User Panel

Forgot your password?.

Learn Web Scraping with NodeJs in 2019 – The Crash Course


Introduction :
Introduction
Tools & Project Setup
Writing a Simple IMDB Scraper

More Info & Concepts :
Why & When to Choose Scraping
The biggest "problem" with scraping
Running with Terminal / CMD & Basics on VSCode Debugger
The Request library / method
The Browser Automation method

IMDB Simple Scraper ( Request Method ) :
01 - How to spoof / add custom request headers
02 - Deal with GZIP Compression enabled websites
03 - Selectors & More Parsing
04 - Multiple Movies & Saving JSON to File
05 - Exporting data to CSV
06 - Easiest method of getting the proper selectors
07 - Downloading Images Locally
08 - Promisifying callback based functions

Request Method :
Using a Proxy Server
Status Codes & Error Handling
Manual Login with CSRF Protection & Cookie Parsing

Instagram User Simple Scraper ( Request Method ) :
01 - Introduction and inspecting the structures
02 - Building the scraper
03 - Parsing latest posts of an ig user

The Puppeteer Method :
01 - Installation, introduction and testing
02 - Writing a simple automated task
03 - Generating PDF's, Emulating Phone Views, Getting Title & Url of pages
04 - Using Puppeteer to login on Instagram
05 - Making Websites Load Much Faster with a simple trick
06 - HTTP Basic Authentication
07 - Ignoring HTTPS / SSL Errors & Changing the ViewPort
08 - Learning how to use Proxies
09 - Exposing and working with Custom Functions in Puppeteer

Twitter Scraper with Puppeteer :
01 - How to login on Twitter
02 - Refactoring code and improving it
03 - How to post Tweets with Puppeteer
04 - Scraping Twitter User Details
05 - Scraping More User Details
06 - Scraping User Tweets
07 - Scraping More Tweet Details ( Likes, Replies..etc )
08 - Handling The Infinite Loader of the Tweets

Amazon Scraper with Puppeteer :
01 - Creating the Module Structure
02 - Parsing Product Details
03 - More Details and Tricks on the Product Details page of Amazon

The NightmareJs Method :
01 - Installation, introduction and testing
02 - Talking and testing more about NightmareJs
03 - Scraping Ycombinator News with Vanilla Javascript
04 - Scraping Ycombinator News - More details
05 - Scraping Ycombinator News - Modulate & Pagination
06 - Handling Downloads
07 - Injecting Custom Javascript

The end :
Congratulations!