Data Analysis of python's docker- Douyin Analysis Interface of "docker practical stories" (21)
Original articles, welcome to reprint. Reprint please indicate: reproduced from IT Story Association, thank you!
Original link address: "docker practical stories" python's docker- Douyin Analysis Interface data Analysis (21)
Xposed has been installed in the previous section, set the corresponding android version and proxy server.
Preparatory work
Installation of 1.xposed and JustTruestMe
two。 Douyin installation completed
Start fildder
Click to enter the specified fan interface
View data
Get the request connection
Https://api.amemv.com/aweme/v1/user/follower/list/?user_id=108719454702&max_time=1549012794&count=20&retry_type=no_retry&iid=62172089966&device_id=66011631779&ac=wifi&channel=aweGW&aid=1128&app_name=aweme&version_code=251&version_name=2.5.1&device_platform=android&ssmix=a&device_type=MI+6+&device_brand=Xiaomi&language=zh&os_api=19&os_version=4.4.2&uuid=863254011212197&openudid=1d4bed921e800405&manifest_version_code=251&resolution=1080*1920&dpi=320&update_version_code=2512&_rticket=1549012860987&ts=1549012860&as=a165c0050cb76ccf644355&cp=017bcd54cc4b54f4e1gkoo&mas=01cb98bea6c9a2c3a8d5faf856a795b13dacaccc2c2c6c66c6c66c
GET https://api.amemv.com/aweme/v1/user/follower/list/?user_id=108719454702&max_time=1549012794&count=20&retry_type=no_retry&iid=62172089966&device_id=66011631779&ac=wifi&channel=aweGW&aid=1128&app_name=aweme&version_code=251&version_name=2.5.1&device_platform=android&ssmix=a&device_type=MI+6+&device_brand=Xiaomi&language=zh&os_api=19&os_version=4.4.2&uuid=863254011212197&openudid=1d4bed921e800405&manifest_version_code=251&resolution=1080*1920&dpi=320&update_version_code=2512&_rticket=1549012860987&ts=1549012860 & as=a165c0050cb76ccf644355&cp=017bcd54cc4b54f4e1gkoo&mas=01cb98bea6c9a2c3a8d5faf856a795b13dacaccc2c2c6c66c6c66c HTTP/1.1Accept-Encoding: gzipCache-Control: max-stale=0Host: api.amemv.comConnection: Keep-AliveCookie: install_id=62172089966 Ttreq=1 $c26b0505a13059d50206f39916d5eaee910a25e9; qh [360] = 1; odin_tt=e7eabe3bd71cee75718b6ab8dea9e67e78b97933017ff975f92ca1198179dfea0553012386575dce721502cc0d378c0c65a733783a7888440928643796139b6cUser-Agent: okhttp/3.10.0.1
It is not available in the browser at all, try to enter the URL in the browser and view the data.
I said earlier that a tool called mitmdump mode can be added to python scripts.
If you are using pycharm, I recommend using the command
Pip install mitmproxy
Mitmdump-s file name. py-p port number
You can print out a list of background python background output.
Import jsontry: from douyin.handle_mongo import save_taskexcept: from handle_mongo import save_taskdef response (flow): # get the followers for user in json.loads (flow.response.text) in the analysis acquisition node of the request interface if 'aweme/v1/user/follower/list' in flow.request.url: # data through fildder [' followers']: douyin_info = {} # shared id douyin_info ['share_id'] = user [' uid'] douyin_info ['douyin_id'] = user [' short_id'] douyin_info ['nickname'] = user [' nickname'] print (douyin_info) save_task (douyin_info)
PS: find the directory of the project and execute the mitmdump-s python file-p to specify the port. Then the data spit out by the corresponding agent can be obtained. The process fildder is to obtain the url address, and the mitmdump goes out and the data spit out by the response. It is then processed and stored in mongodb. The technical goal is not to need human participation! After slowly getting the data, the next step is to use appium to simulate the machine to click and slide!
