• For Individuals
  • For Businesses
  • For Universities
  • For Governments
Coursera
  • Online Degrees
  • Careers
  • Log In
  • Join for Free
    Coursera
    • Browse
    • Web Crawler

    Web Crawler Courses Online

    Learn to build web crawlers for data extraction. Understand how to collect and analyze web data using automated scripts.

    Skip to search results

    Filter by

    Subject
    Required
     *

    Language
    Required
     *

    The language used throughout the course, in both instruction and assessments.

    Learning Product
    Required
     *

    Level
    Required
     *

    Duration
    Required
     *

    Skills
    Required
     *

    Subtitles
    Required
     *

    Educator
    Required
     *

    Explore the Web Crawler Course Catalog

    • C

      Coursera Project Network

      HTML for Beginners: Getting Started

      Skills you'll gain: Hypertext Markup Language (HTML), Web Content Accessibility Guidelines, Semantic Web, Web Content, Information Architecture, Web Design and Development

      4.7
      Rating, 4.7 out of 5 stars
      ·
      20 reviews

      Beginner · Guided Project · Less Than 2 Hours

    • Status: Free Trial
      Free Trial
      U

      University of London

      Introduction to Meteor.js Development

      Skills you'll gain: MongoDB, JavaScript Frameworks, Web Applications, Authentications, Web Development, Database Application, User Accounts, Application Security, Database Systems, Package and Software Management, Software Installation

      4.6
      Rating, 4.6 out of 5 stars
      ·
      1.2K reviews

      Mixed · Course · 1 - 3 Months

    • Status: Free Trial
      Free Trial
      U

      University of London

      How Computers Work

      Skills you'll gain: Computer Science, Computer Systems, Web Applications, Computer Networking, Computational Thinking, Theoretical Computer Science, Human Computer Interaction, Hardware Architecture, Operating Systems, Cybersecurity, Problem Management, Software Architecture

      4.6
      Rating, 4.6 out of 5 stars
      ·
      565 reviews

      Beginner · Course · 1 - 4 Weeks

    • U

      University of Cape Town

      Julia Scientific Programming

      Skills you'll gain: Box Plots, Jupyter, Statistical Analysis, Data Visualization, Scientific Visualization, Exploratory Data Analysis, Descriptive Statistics, Data Manipulation, Data Science, Other Programming Languages, Data Import/Export, Computer Programming, Mathematical Modeling, Package and Software Management

      4.4
      Rating, 4.4 out of 5 stars
      ·
      433 reviews

      Beginner · Course · 1 - 4 Weeks

    • Status: Free Trial
      Free Trial
      U

      University of Washington

      Data Manipulation at Scale: Systems and Algorithms

      Skills you'll gain: Big Data, Relational Databases, Database Systems, Dataflow, Data Science, Data Manipulation, Data Processing, NoSQL, Apache Spark, Analytics, Distributed Computing, Apache Hadoop, SQL, Data Analysis, Query Languages, Cloud Computing, Scalability, Graph Theory, Algorithms

      4.3
      Rating, 4.3 out of 5 stars
      ·
      767 reviews

      Mixed · Course · 1 - 3 Months

    • Status: Free Trial
      Free Trial
      M

      Microsoft

      Foundations of AI and Machine Learning

      Skills you'll gain: Data Management, Artificial Intelligence and Machine Learning (AI/ML), Infrastructure Architecture, Cloud Infrastructure, MLOps (Machine Learning Operations), Application Deployment, Data Processing, Data Cleansing, Artificial Intelligence, Data Security, Application Frameworks, PyTorch (Machine Learning Library), Machine Learning, Tensorflow, Data Pipelines, Scikit Learn (Machine Learning Library), Scalability

      4.6
      Rating, 4.6 out of 5 stars
      ·
      122 reviews

      Intermediate · Course · 1 - 3 Months

    • Status: Free Trial
      Free Trial
      U

      University of Michigan

      Django Features and Libraries

      Skills you'll gain: Application Deployment, Django (Web Framework), Application Development, Web Development, Web Applications, Object-Relational Mapping, Database Design, Data Modeling, Authentications, User Accounts, Relational Databases

      4.8
      Rating, 4.8 out of 5 stars
      ·
      394 reviews

      Intermediate · Course · 1 - 3 Months

    • Status: New
      New
      P

      Packt

      Playwright Python and Pytest for Web Automation Testing

      Skills you'll gain: Test Automation, Authentications, Continuous Integration, Software Testing, Unit Testing, Event-Driven Programming, Scripting, Browser Compatibility, Behavior-Driven Development, Test Tools, Test Execution Engine, Test Case, GitHub, Cascading Style Sheets (CSS), User Interface (UI), Verification And Validation, Debugging

      4.5
      Rating, 4.5 out of 5 stars
      ·
      6 reviews

      Intermediate · Course · 3 - 6 Months

    • Status: Free Trial
      Free Trial
      Y

      Yonsei University

      Emerging Technologies: From Smartphones to IoT to Big Data

      Skills you'll gain: Apache Spark, Augmented Reality, Cloud Computing Architecture, Big Data, Wireless Networks, SPSS, Augmented and Virtual Reality (AR/VR), Cloud Computing, Cloud Services, Internet Of Things, Live Streaming, Analytics, Real Time Data, Apache Hadoop, Telecommunications, Multimedia, Emerging Technologies, Mobile Development, Apple iOS, Display Devices

      4.7
      Rating, 4.7 out of 5 stars
      ·
      1.9K reviews

      Beginner · Specialization · 3 - 6 Months

    • Status: Free
      Free
      C

      Coursera Project Network

      Use WordPress to Create a Blog for your Business

      Skills you'll gain: WordPress, Blogs, Content Management Systems, Web Content, Editing, Business Writing, Content Creation, User Accounts, E-Commerce

      4.5
      Rating, 4.5 out of 5 stars
      ·
      1.6K reviews

      Beginner · Guided Project · Less Than 2 Hours

    • Status: Free Trial
      Free Trial
      J

      Johns Hopkins University

      Developing Data Products

      Skills you'll gain: Shiny (R Package), Rmarkdown, Leaflet (Software), Plotly, Interactive Data Visualization, Data Visualization, Data Presentation, Data Visualization Software, R Programming, Statistical Reporting, User Interface (UI), Web Applications, Hypertext Markup Language (HTML), GitHub, Package and Software Management

      4.6
      Rating, 4.6 out of 5 stars
      ·
      2.3K reviews

      Mixed · Course · 1 - 3 Months

    • Status: Free Trial
      Free Trial
      G

      Google Cloud

      API Security on Google Cloud's Apigee API Platform

      Skills you'll gain: OAuth, Cloud API, Application Programming Interface (API), Restful API, Security Controls, Application Security, Network Security, Data Security, JSON, Identity and Access Management, Threat Management

      4.7
      Rating, 4.7 out of 5 stars
      ·
      835 reviews

      Beginner · Course · 1 - 4 Weeks

    Web Crawler learners also search

    Web Development
    Web Design
    Web Technologies
    Front-end Web Development
    Beginner Web Development
    Web Development Projects
    Beginner Web Design
    Web Design Projects
    1…363738…259

    In summary, here are 10 of our most popular web crawler courses

    • HTML for Beginners: Getting Started: Coursera Project Network
    • Introduction to Meteor.js Development : University of London
    • How Computers Work: University of London
    • Julia Scientific Programming: University of Cape Town
    • Data Manipulation at Scale: Systems and Algorithms: University of Washington
    • Foundations of AI and Machine Learning: Microsoft
    • Django Features and Libraries: University of Michigan
    • Playwright Python and Pytest for Web Automation Testing: Packt
    • Emerging Technologies: From Smartphones to IoT to Big Data: Yonsei University
    • Use WordPress to Create a Blog for your Business: Coursera Project Network

    Skills you can learn in Software Development

    Programming Language (34)
    Google (25)
    Computer Program (21)
    Software Testing (21)
    Web (19)
    Google Cloud Platform (18)
    Application Programming Interfaces (17)
    Data Structure (16)
    Problem Solving (14)
    Object-oriented Programming (13)
    Kubernetes (10)
    List & Label (10)

    Other topics to explore

    Arts and Humanities
    338 courses
    Business
    1095 courses
    Computer Science
    668 courses
    Data Science
    425 courses
    Information Technology
    145 courses
    Health
    471 courses
    Math and Logic
    70 courses
    Personal Development
    137 courses
    Physical Science and Engineering
    413 courses
    Social Sciences
    401 courses
    Language Learning
    150 courses

    Coursera Footer

    Technical Skills

    • ChatGPT
    • Coding
    • Computer Science
    • Cybersecurity
    • DevOps
    • Ethical Hacking
    • Generative AI
    • Java Programming
    • Python
    • Web Development

    Analytical Skills

    • Artificial Intelligence
    • Big Data
    • Business Analysis
    • Data Analytics
    • Data Science
    • Financial Modeling
    • Machine Learning
    • Microsoft Excel
    • Microsoft Power BI
    • SQL

    Business Skills

    • Accounting
    • Digital Marketing
    • E-commerce
    • Finance
    • Google
    • Graphic Design
    • IBM
    • Marketing
    • Project Management
    • Social Media Marketing

    Career Resources

    • Essential IT Certifications
    • High-Income Skills to Learn
    • How to Get a PMP Certification
    • How to Learn Artificial Intelligence
    • Popular Cybersecurity Certifications
    • Popular Data Analytics Certifications
    • What Does a Data Analyst Do?
    • Career Development Resources
    • Career Aptitude Test
    • Share your Coursera Learning Story

    Coursera

    • About
    • What We Offer
    • Leadership
    • Careers
    • Catalog
    • Coursera Plus
    • Professional Certificates
    • MasterTrack® Certificates
    • Degrees
    • For Enterprise
    • For Government
    • For Campus
    • Become a Partner
    • Social Impact
    • Free Courses
    • ECTS Credit Recommendations

    Community

    • Learners
    • Partners
    • Beta Testers
    • Blog
    • The Coursera Podcast
    • Tech Blog

    More

    • Press
    • Investors
    • Terms
    • Privacy
    • Help
    • Accessibility
    • Contact
    • Articles
    • Directory
    • Affiliates
    • Modern Slavery Statement
    • Do Not Sell/Share
    Learn Anywhere
    Download on the App Store
    Get it on Google Play
    Logo of Certified B Corporation
    © 2025 Coursera Inc. All rights reserved.
    • Coursera Facebook
    • Coursera Linkedin
    • Coursera Twitter
    • Coursera YouTube
    • Coursera Instagram
    • Coursera TikTok