Modern Web Scraping with Python using Scrapy Splash Selenium

Become an expert in web scraping and web crawling using Python 3, Scrapy, Splash and Selenium 2nd EDITION (2019/2020) in this Modern Web Scraping with Python using Scrapy Splash Selenium Udemy Course.

What you’ll learn

  • Understand the fundamentals of Web Scraping
  • Scrape websites using Scrapy
  • Understand Xpath & CSS Selectors
  • Build a complete Spider from A to Z
  • Store the extracted Data in MongoDb & SQLite3
  • Scrape JavaScript websites using Splash & Selenium
  • Build a CrawlSpider
  • Understand the Crawling behavior
  • Build a custom Middleware
  • Web Scraping best practices
  • Avoid getting banned while scraping websites
  • Bypass cloudflare
  • Scrape APIs
  • Scrape infinite scroll websites
  • Working with Cookies
  • Deploy spiders locally and to the cloud
  • Run spiders periodically
  • Prevent storing duplicated data
  • Build datasets
  • Login to websites using Scrapy
  • Download images and files using Scrapy


  • Basics of Python
  • Internet access


Web Scraping nowadays has actually turned into one of the most popular topics, there are a lot of paid tools out there in the market that do not show you anything how things are done as you will be constantly restricted to their performances as a customer.

In this Modern Web Scraping with Python using Scrapy Splash Selenium course, you will not be a customer any longer, I’ll teach you how you can develop your own scraping tool (spider) using Scrapy.

You will learn:

  1. The basics of Web Scraping
  2. How to develop a complete spider
  3. The basics of XPath & CSS Selectors
  4. How to find content/nodes from the DOM making use of XPath & CSS
  5. How to save the data in JSON, CSV … and even to an external database( MongoDb & SQLite3).
  6. How to compose your own custom-made Pipeline.
  7. Basics of Splash.
  8. How to scrape Javascript web sites making use of Scrapy Splash & Selenium.
  9. The Crawling behavior.
  10. How to develop a CrawlSpider.
  11. How to prevent getting banned while scraping web sites.
  12. How to develop a custom-made Middleware.
  13. Web Scraping finest practices.
  14. How to scrape APIs.
  15. How to make use of Request Cookies.
  16. How to scrape limitless scroll web sites.
  17. Host spiders in Heroku totally free.
  18. Run spiders regularly with a custom-made script.
  19. Avoid saving duplicated data.
  20. Deploy Splash to Heroku.
  21. Compose data to Excel files.
  22. Login to web sites making use of Scrapy.
  23. Download Files & Images making use of Scrapy.
  24. Use Proxies with Scrapy Spider.
  25. Use Crawlera with Scrapy & Splash.
  26. Use Proxies with CrawlSpider.
Trending Now:   Learn Python Programming Masterclass

What makes this Modern Web Scraping with Python using Scrapy Splash Selenium course unique from the others, and why you should sign up?

  • This is the most upgraded course. You will be using Python 3.7, Scrapy 1.6 and Splash 3.0
  • You will have a thorough step by step guide on how to end up being an expert web scraper.
  • You will know how to use Splash & Selenium to scrape JavaScript sites and I can guarantee you, you will not discover any tutorials out there that teaches how to truly use Splash like I’ll be carrying out in this course.
  • You will know how to host spiders in Heroku in addition to Splash( Exclusive).
  • You will know how to produce a customized script so spiders can run regularly with no intervention from you.

Whether you are an information expert who desires to include web scraping to his tool set or somebody else who desires to know how to draw out disorganized information from disorganized HTML web pages and then shop back that information in a structured method to use some information analysis on it then you are welcome to join this Modern Web Scraping with Python using Scrapy Splash Selenium course.


Trending Now:   Learn Python & Ethical Hacking From Scratch

” I was especially searching for web scraping using XPATHs and this course is dealing with that. It likewise covers vibrant paging. An appropriate mix of theory and useful. An essential for those who wishes to do web scraping. TERRIFIC knowing experience!!! “. By Hiran Kumar

” 90% of what I was looking for!!! Great task!! Clear descriptions and fantastic interaction with Ahmed”. By Raylyson Estanista

” Admed’s Web scraping course is incredible. His method using Python with scrapy and splash works well with all sites specifically those that make heavy use of JavaScript. Ahmed is a talented teacher: professional communicator, enthusiastic, diligent and available to his trainees. I extremely suggest this Modern Web Scraping with Python using Scrapy Splash Selenium course and any of Ahmed Rafik’s Udemy courses. “. By Richard Blackmon

” Great course, and a great intro to Scrapy (I’m somebody without any Python experience whatsoever).”. By I S.

” Excellent course. Quick and comprehensive at the same time. Ahmed is exceptionally responsive to the trainees and typically responds to concerns within minutes! Greatest suggestion.” By Robert Nolte.

” That course is excellent and description is clear! The trainer is really helpful in case of concerns. Extremely advised.” By Shubina Ekaterina.

” I like the Modern Web Scraping with Python using Scrapy Splash Selenium course. Clear descriptions and excellent comunication with Ahmed. All subjects is intriguing and loaded with info. I enhanced my skils in Scrapy. Author upgrade course material by brand-new videos. It’s a huge perk) Explained more advance subjects I never ever see in other courses. Thank you, Ahmed. Awaiting brand-new videos)”. By Ruslan Romanenko.

Trending Now:   Selenium Java Test Framework & Best Practices - Masterclass

Who this course is for:

  • Anyone who wants to scrape data from any website
  • Anyone who wants to learn Scrapy
  • Anyone who wants to automate the task of copying contents from websites
  • Anyone who wants to learn how to scrape Javascript websites using Scrapy-Splash & Selenium

Created by Ahmed Rafik
Last updated 1/2020
English [Auto-generated]

Size: 3.24 GB

Download Course

Leave a Reply

Your email address will not be published.

Related Courses

Back to top button
v cta