Get the App
SLTechnology News&Howtos  ›  Development  › 

How to Model scrapy in python

Shulou Source: shulou.com Published: 2022-06-03 16:31:50 09月30日 Update

This article will explain in detail how to model scrapy in python. The editor thinks it is very practical, so I share it with you for reference. I hope you can get something after reading this article.

Description

1. Define the fields extracted from the items.py file.

2. Scrapy.Item can be understood as a more advanced dictionary, which can restrict and verify key names. But remember, it's not a dictionary. If you need to manipulate a dictionary, you can use dict () to cast scrapy.Item.

Example

Import scrapy class MyspiderItem (scrapy.Item): # define the fields for your item here like: name = scrapy.Field () # lecturer's name title = scrapy.Field () # lecturer's professional title desc = scrapy.Field () # lecturer's introduction # if _ _ name__ = ='_ main__':# item = MyspiderItem () # item ['name'] =' lqr' # ok# item [' Nama'] = 'lqr' # KeyError:' MyspiderItem does not support field: nama' 's article on "how to model scrapy in python" ends here Hope that the above content can be helpful to you, so that you can learn more knowledge, if you think the article is good, please share it for more people to see.

Tags: Dictionaries articles lecturers more good practical advanced content names fields examples documents articles knowledge professional titles references help compulsion related restrictions Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno MySQL MariaDB Redmi vpn macOS