Get the App
SLTechnology News&Howtos  ›  Internet Technology  › 

Use Python to climb Douban reading page and share the source code.

Shulou Source: shulou.com Published: 2022-06-02 04:10:30 10月02日 Update

This article introduces the knowledge of "using Python to climb Douban reading page source code sharing", in the actual case operation process, many people will encounter such a dilemma, then let the editor lead you to learn how to deal with these situations! I hope you can read it carefully and be able to achieve something!

The source code is as follows:

# coding:utf-8from selenium import webdriverclass DouBan:

Def _ init__ (self):

Self.dr = webdriver.Chrome () # specifies that Google browser is selected when selenium automates operations.

Self.dr.get ('https://book.douban.com/tag/%E5%B0%8F%E8%AF%B4/') # the web page to open

Def print_content (self):

Total_book = self.dr.find_element_by_id ('wrapper') # navigate to the div box containing all books first

Books = total_book.find_elements_by_class_name ('info') # find each sub-div in the located div box that contains the book introduction

I = 1

For book in books: # extract the contents of each book in turn through the for loop

Print (str (I) + book.text +'

') # print the crawled content

I + = 1

Def quit (self):

Self.dr.quit () # close the browser after crawling the data

DouBan (). Print_content () "use Python to climb Douban reading page source code sharing" content is introduced here, thank you for reading. If you want to know more about the industry, you can follow the website, the editor will output more high-quality practical articles for you!

Tags: Content books source code Douban pages more browsers boxes knowledge positioning browsing practical successful learning next dilemma reality situation data articles cases Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno MariaDB Docker Shulou Information Apple Huawei