• For Individuals
  • For Businesses
  • For Universities
  • For Governments
Coursera
  • Online Degrees
  • Careers
  • Log In
  • Join for Free
    Coursera
    • Browse
    • Web Crawler

    Web Crawler Courses Online

    Learn to build web crawlers for data extraction. Understand how to collect and analyze web data using automated scripts.

    Skip to search results

    Filter by

    Subject
    Required
     *

    Language
    Required
     *

    The language used throughout the course, in both instruction and assessments.

    Learning Product
    Required
     *

    Level
    Required
     *

    Duration
    Required
     *

    Skills
    Required
     *

    Subtitles
    Required
     *

    Educator
    Required
     *

    Explore the Web Crawler Course Catalog

    • Status: Free Trial
      Free Trial
      G

      Google

      Build Dynamic User Interfaces (UI) for Websites

      Skills you'll gain: Responsive Web Design, User Experience Design, Design Reviews, Wireframing, Usability Testing, User Research, User Centered Design, User Interface (UI) Design, Prototyping, Mockups, User Flows, Information Architecture

      4.8
      Rating, 4.8 out of 5 stars
      ·
      3.7K reviews

      Beginner · Course · 1 - 4 Weeks

    • Status: Free Trial
      Free Trial
      I

      IBM

      Key Technologies for Business

      Skills you'll gain: Cloud Computing Architecture, Cloud Services, Cloud Security, Cloud Technologies, Data Literacy, Cloud Infrastructure, Data Mining, Cloud Platforms, Cloud Hosting, Cloud Engineering, OpenAI, Cloud Solutions, Cloud Computing, Generative AI, Big Data, Data Analysis, Data Science, ChatGPT, Natural Language Processing, Business

      4.7
      Rating, 4.7 out of 5 stars
      ·
      102K reviews

      Beginner · Specialization · 3 - 6 Months

    • Status: Free Trial
      Free Trial
      Status: AI skills
      AI skills
      I

      IBM

      IBM Back-End Development

      Skills you'll gain: Istio, Open Web Application Security Project (OWASP), Software Development Life Cycle, Linux Commands, Application Deployment, NoSQL, Kubernetes, Bash (Scripting Language), MongoDB, Restful API, Shell Script, Django (Web Framework), Software Architecture, Object-Relational Mapping, Development Environment, Git (Version Control System), Jupyter, Grafana, Microservices, Python Programming

      4.6
      Rating, 4.6 out of 5 stars
      ·
      50K reviews

      Beginner · Professional Certificate · 3 - 6 Months

    • Status: Free Trial
      Free Trial
      I

      IBM

      Data Engineering Foundations

      Skills you'll gain: Web Scraping, Database Design, SQL, MySQL, Data Transformation, Data Store, IBM DB2, Extract, Transform, Load, Jupyter, Data Architecture, Data Pipelines, Big Data, Databases, Database Management, Data Warehousing, Data Governance, Relational Databases, Stored Procedure, Python Programming, Data Structures

      4.6
      Rating, 4.6 out of 5 stars
      ·
      57K reviews

      Beginner · Specialization · 3 - 6 Months

    • A

      Amazon Web Services

      AWS Cloud Technology Consultant

      Skills you'll gain: AWS Identity and Access Management (IAM), Infrastructure as Code (IaC), Amazon CloudWatch, AWS CloudFormation, Amazon DynamoDB, Software Development Life Cycle, CI/CD, Amazon Web Services, Professional Networking, IT Automation, Cloud Computing, Amazon S3, Extract, Transform, Load, DevOps, Software Architecture, Cloud Computing Architecture, Cloud Management, Data Management, Problem Solving, Teamwork

      Build toward a degree

      4.8
      Rating, 4.8 out of 5 stars
      ·
      6.7K reviews

      Beginner · Professional Certificate · 3 - 6 Months

    • Status: Free Trial
      Free Trial
      I

      IBM

      Generative AI Fundamentals

      Skills you'll gain: Prompt Engineering, Generative AI, ChatGPT, OpenAI, Data Ethics, Large Language Modeling, Leadership and Management, Business Leadership, Strategic Leadership, Business Ethics, Legal Risk, IBM Cloud, Tensorflow, Artificial Intelligence, Program Development, Artificial Neural Networks, Business Development, Deep Learning, Content Creation, Business Transformation

      4.7
      Rating, 4.7 out of 5 stars
      ·
      7.8K reviews

      Beginner · Specialization · 3 - 6 Months

    • Status: Free Trial
      Free Trial
      I

      IBM

      IBM Applied DevOps Engineering

      Skills you'll gain: User Story, CI/CD, Istio, Open Web Application Security Project (OWASP), Continuous Integration, Application Deployment, Test Driven Development (TDD), Gherkin (Scripting Language), Jenkins, Kubernetes, Agile Software Development, DevOps, Code Coverage, OpenShift, Cloud Applications, Containerization, Secure Coding, Grafana, System Monitoring, Agile Methodology

      Build toward a degree

      4.7
      Rating, 4.7 out of 5 stars
      ·
      7.3K reviews

      Intermediate · Professional Certificate · 3 - 6 Months

    • Status: Free Trial
      Free Trial
      A

      Adobe

      Design Fundamentals with AI

      Skills you'll gain: Typography, Logo Design, Digital Design, Creative Design, Visual Design, Branding, Graphic Design, User Interface and User Experience (UI/UX) Design, Color Theory, Content Creation, Creativity, Generative AI Agents

      4.7
      Rating, 4.7 out of 5 stars
      ·
      839 reviews

      Beginner · Course · 1 - 4 Weeks

    • Status: Free Trial
      Free Trial
      I

      IBM

      Applied Software Engineering Fundamentals

      Skills you'll gain: Software Development Life Cycle, Linux Commands, Bash (Scripting Language), Restful API, Shell Script, Software Architecture, Development Environment, Git (Version Control System), GitHub, Flask (Web Framework), Version Control, File Management, Engineering Software, Jupyter, Unix Shell, Application Deployment, Software Design, Linux, Python Programming, Data Structures

      4.6
      Rating, 4.6 out of 5 stars
      ·
      48K reviews

      Beginner · Specialization · 3 - 6 Months

    • Status: Free Trial
      Free Trial
      G

      Google

      Google IT Automation with Python

      Skills you'll gain: Git (Version Control System), GitHub, Version Control, Cloud Services, Debugging, Puppet (Configuration Management Tool), Infrastructure as Code (IaC), Bash (Scripting Language), CI/CD, Cloud Computing, Technical Communication, Unit Testing, Web Services, Configuration Management, Scripting, Automation, Python Programming, Interviewing Skills, Professional Development, Programming Principles

      4.8
      Rating, 4.8 out of 5 stars
      ·
      49K reviews

      Advanced · Professional Certificate · 3 - 6 Months

    • Status: Free Trial
      Free Trial
      M

      Microsoft

      Introduction to Web Development

      Skills you'll gain: GitHub, HTML and CSS, Git (Version Control System), Microsoft Copilot, Web Development, Web Content Accessibility Guidelines, Responsive Web Design, Javascript, Front-End Web Development, JSON, Semantic Web

      3.6
      Rating, 3.6 out of 5 stars
      ·
      20 reviews

      Beginner · Course · 1 - 3 Months

    • Status: New
      New
      Status: Free Trial
      Free Trial
      Status: AI skills
      AI skills
      I

      IBM

      IBM Relational Database Administrator

      Skills you'll gain: Data Engineering, Data Warehousing, Extract, Transform, Load, Apache Airflow, Web Scraping, Linux Commands, Database Design, SQL, Database Administration, MySQL, Data Pipelines, Apache Kafka, Database Management, Bash (Scripting Language), Shell Script, Database Architecture and Administration, Data Store, Jupyter, Generative AI, Data Security

      4.6
      Rating, 4.6 out of 5 stars
      ·
      59K reviews

      Intermediate · Professional Certificate · 3 - 6 Months

    1…567…267

    In summary, here are 10 of our most popular web crawler courses

    • Build Dynamic User Interfaces (UI) for Websites: Google
    • Key Technologies for Business: IBM
    • IBM Back-End Development: IBM
    • Data Engineering Foundations: IBM
    • AWS Cloud Technology Consultant: Amazon Web Services
    • Generative AI Fundamentals: IBM
    • IBM Applied DevOps Engineering: IBM
    • Design Fundamentals with AI: Adobe
    • Applied Software Engineering Fundamentals: IBM
    • Google IT Automation with Python: Google

    Skills you can learn in Software Development

    Programming Language (34)
    Google (25)
    Computer Program (21)
    Software Testing (21)
    Web (19)
    Google Cloud Platform (18)
    Application Programming Interfaces (17)
    Data Structure (16)
    Problem Solving (14)
    Object-oriented Programming (13)
    Kubernetes (10)
    List & Label (10)

    Other topics to explore

    Arts and Humanities
    338 courses
    Business
    1095 courses
    Computer Science
    668 courses
    Data Science
    425 courses
    Information Technology
    145 courses
    Health
    471 courses
    Math and Logic
    70 courses
    Personal Development
    137 courses
    Physical Science and Engineering
    413 courses
    Social Sciences
    401 courses
    Language Learning
    150 courses

    Coursera Footer

    Technical Skills

    • ChatGPT
    • Coding
    • Computer Science
    • Cybersecurity
    • DevOps
    • Ethical Hacking
    • Generative AI
    • Java Programming
    • Python
    • Web Development

    Analytical Skills

    • Artificial Intelligence
    • Big Data
    • Business Analysis
    • Data Analytics
    • Data Science
    • Financial Modeling
    • Machine Learning
    • Microsoft Excel
    • Microsoft Power BI
    • SQL

    Business Skills

    • Accounting
    • Digital Marketing
    • E-commerce
    • Finance
    • Google
    • Graphic Design
    • IBM
    • Marketing
    • Project Management
    • Social Media Marketing

    Career Resources

    • Essential IT Certifications
    • High-Income Skills to Learn
    • How to Get a PMP Certification
    • How to Learn Artificial Intelligence
    • Popular Cybersecurity Certifications
    • Popular Data Analytics Certifications
    • What Does a Data Analyst Do?
    • Career Development Resources
    • Career Aptitude Test
    • Share your Coursera Learning Story

    Coursera

    • About
    • What We Offer
    • Leadership
    • Careers
    • Catalog
    • Coursera Plus
    • Professional Certificates
    • MasterTrack® Certificates
    • Degrees
    • For Enterprise
    • For Government
    • For Campus
    • Become a Partner
    • Social Impact
    • Free Courses
    • ECTS Credit Recommendations

    Community

    • Learners
    • Partners
    • Beta Testers
    • Blog
    • The Coursera Podcast
    • Tech Blog

    More

    • Press
    • Investors
    • Terms
    • Privacy
    • Help
    • Accessibility
    • Contact
    • Articles
    • Directory
    • Affiliates
    • Modern Slavery Statement
    • Manage Cookie Preferences
    Learn Anywhere
    Download on the App Store
    Get it on Google Play
    Logo of Certified B Corporation
    © 2025 Coursera Inc. All rights reserved.
    • Coursera Facebook
    • Coursera Linkedin
    • Coursera Twitter
    • Coursera YouTube
    • Coursera Instagram
    • Coursera TikTok