tweets | This is a library for accessing the public/filter twitter | Runtime Evironment library

I know this question has been asked many times, but I still can't figure out what to do (more below).

I'm trying to spawn a new thread using std::thread::spawn and then run an async loop inside of it.

The async function I want to run:

Problem

I have a large JSON file (~700.000 lines, 1.2GB filesize) containing twitter data that I need to preprocess for data and network analysis. During the data collection an error happend: Instead of using " as a seperator ' was used. As this does not conform with the JSON standard, the file can not be processed by R or Python.

Information about the dataset: Every about 500 lines start with meta info + meta information for the users, etc. then there are the tweets in json (order of fields not stable) starting with a space, one tweet per line.

This is what I tried so far:

1. A simple data.replace('\'', '\"') is not possible, as the "text" fields contain tweets which may contain ' or " themselves.
2. Using regex, I was able to catch some of the instances, but it does not catch everything: re.compile(r'"[^"]*"(*SKIP)(*FAIL)|\'')
3. Using literal.eval(data) from the ast package also throws an error.

As the order of the fields and the legth for each field is not stable I am stuck on how to reformat that file in order to conform to JSON.

Normal sample line of the data (for this options one and two would work, but note that the tweets are also in non-english languages, which use " or ' in their tweets):

When ever I submit a from to login in or get registered I get 400 bad request. But in register route the user get registered but it also gives bad request. When we go to login route same as register route I get BAD REQUEST. 0

I am using the following dependencies:

express session passport passport-local passport-local-mongoose

Is there something wrong with the implementation of the passport-local-mongoose or its passport side or serialize or deserialize the user. Can anybody help me with this problem I am stuck on this for three days. Here is some code.

The model I used to collect tweets from API V1.1 was like this:

I'd like to get Tweets using the v2 full archive search. I don't understand the error I got from the code below. Did I request too many times?

Here's config.py

I am using API version 2.0 and unable to fetch the user.fields results. All other parameters seem to be returning results correctly. I'm following this documentation.

I have uploaded some tweets in a Mongo DB collection and I would like to extract the following information with PyMongo:

• lowercase(entities.hashtags.text)
• count

i.e. I would like to know how many time an hashtag has been used. However, since hashtags are case sensitive, I would like to consider them as lowercase (so that myTag and MyTag are considered and counted together).

I used the following pipeline to get the most used hashtags but I'm not able to apply the lowercase function:

I have uploaded some tweets in a Mongo DB collection and I would like to extract the following information with PyMongo:

• user.screen_name
• entities.user_mentions.screen_name
• count

i.e. I would like to know who has mentioned whom and how many times, in order to create some kind of network.

I used the following pipeline to get the most mentioned users but I'm not able to introduce also the user.screen_name:

I am trying to collect only a specific part of the result obtained from the Twitter V2 API, the details regarding the return and the script I am trying to use will be placed below:

The result data is: