How to read large files by python

This article mainly introduces the relevant knowledge of "how python reads large files". The editor shows you the operation process through actual cases. The operation method is simple, fast and practical. I hope this article "how to read large files by python" can help you solve the problem.

You can use python to read large files in two ways: the first is to use the yield generator to read; the second is to use the open () native method to generate iterative objects, which is an one-line read.

1. Use yield generator to read

Def readPart (filePath,size = 1024, encoding= "utf-8"): with open (filePath, "r", encoding=encoding) as f: while True: part = f.read (size) if part: yield part else: return NonefilePath = r "filePath" size= 2048 # each time the specified size is read into the memory encoding= 'utf-8'for part in readPart (filePath,size Encoding): print (part) # Processing data

2. Use the open () built-in method to generate an iterative object, which is read one by one.

With open (filePath) as f: for line in f: print (line) # Processing data on "how python reads large files" ends here. Thank you for reading. If you want to know more about the industry, you can follow the industry information channel. The editor will update different knowledge points for you every day.