Get the App
SLTechnology News&Howtos  ›  Development  › 

How to use python to climb the Top50 data of Zhihu Hot list

Shulou Source: shulou.com Published: 2022-06-03 09:40:12 11月15日 Update

This article will explain in detail how to use python to climb the Top50 data of Zhihu hot list. The editor thinks it is very practical, so I share it with you as a reference. I hope you can get something after reading this article.

1. Import the third-party library import urllib.request Urllib.error # request web page from bs4 import BeautifulSoup # parse data import sqlite3 # import database import re # regular expression import time # get the current time 2, the program's main function def main (): # declare crawled web page baseurl = "https://www.zhihu.com/hot" # crawled web page datalist = getData (baseurl) # save data dbname = time.strftime ("% Y-%m-%d " Time.localtime () # dbpath = "zhihuTop50" + dbname saveData (datalist,dbpath) 3, regular expression matching data # regular expression findlink = re.compile (r'

Tags: Data questions web pages regular expressions articles programs articles hot more title brief link score good practical content function database time Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno Shulou Information NVidia Microsoft Redmi vpn