Shulou(Shulou.com)06/01 Report--

This article mainly explains "Python how to count words", the content of the explanation is simple and clear, easy to learn and understand, now please follow the editor's ideas slowly in depth, together to study and learn "Python how to count words" bar!

1. Python project PythonSparkWordCount

2. The text file test.txt in the input directory

3. Create a word_count.py file to achieve word frequency statistics import osimport shutilfrom pyspark import SparkContextinputpath = 'input'outputpath =' result'sc = SparkContext ('local',' wordcount') # read the file input = sc.textFile (inputpath) # syncopate the word words = input.flatMap (lambda line: line.split (')) # convert and count counts = words.map (lambda word: (word, 1)) .reduceByKey (lambda x Y: X + y) # output result counts.foreach (print) # Delete the output directory if os.path.exists (outputpath): shutil.rmtree (outputpath, True) # write the statistical results to the result file counts.saveAsTextFile (outputpath)

Run the program and the result is as follows:

The statistical results are also saved in the part-00000 file in the result directory:

Thank you for your reading, the above is the content of "how Python counts words". After the study of this article, I believe you have a deeper understanding of how Python counts words, and the specific use needs to be verified in practice. Here is, the editor will push for you more related knowledge points of the article, welcome to follow!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.