pytrends | Pseudo API for Google Trends | REST library

I have a script that runs my_func(list), which runs my_request() that hits a public API server to get data, but this query fails randomly and I get a ResponseError. And I have to re-run the script until all the partitions are collected (the length of tmp_lst is equal to the length of df_list).

I am curious if there is a way for me to run this script once and have the script retry N times until all the partitions are collected without having to re-run it every time I run into a ResponseError.

I tried to insert a while loop, but this didn't solve the issue, and I still had to manually re-run it.

I'm trying to collect the 150 rows of data from the text that appears at the bottom of a given Showbuzzdaily.com web page (example), but my script only collects 132 rows.

I'm new to Python. Is there something I need to add to my loop to ensure all records are collected as intended?

To troubleshoot, I created a list (program_count) to verify this is happening in the code before the CSV is generated, which shows there are only 132 items in the list, rather than 150. Interestingly, the final row (#132) ends up being duplicated at the end of the CSV for some reason.

I experience similar issues scraping Google Trends (using pytrends), where only about 80% of the data I try to scrape ended up in the CSV. So I'm suspecting there's something wrong with my code or that I'm overwhelming my target with requests.

Adding time.sleep(0.1) to for while loop in this code didn't produce different results.

I'm looping through a dictionary from the Pytrends Google trends API and aiming to populate a dataframe.

I'm able to print within the loop - but when I try and pass the same printed value to a dataframe, only one result is returned and the loop doesn't execute - so I'm having to manually create and concatenate a lot of dataframes outside the loop.

The below prints all of the 'rising' search terms for all queries looped through:

so I am using this code to get the frequency of searched words in Google Trends:

I have simple time series data comparing two search terms (banana bread and pumpkin bread) which I'm getting from the pytrends module:

I have to get google trends data from a list of KEWYWORDS. I'm used to analyze data with STATA and this is my first time that I'm using Python (via project jupiter notebook). I cannot do it via STATA since it doesn't have a package to download google trends data. It seems that Python it does via "pytrends" Here my codes

I am writing a for loop that is fetching Google Trends from the pytrends package. Now I want the for loop to create a dataframe for every keyword it is finding in the list of keywords. But I want the dataframes to be named after the number of the list item instead of the actual string in the list.

Right now this is my code:

i'm trying to use pytrend to get several keywords from different countries over weekly periods i don't know why but a much simpler code works, I'm not sure if it's the for loop or something else.

this is the code:

Looking through previously asked questions, I couldn't find the answer that helped, since my columns are generated by using a mix of both pytrends and yfinance values.

Here is the code to get the dataframe in question: