filesize | small ruby class for handling filesizes

Problem

I have a large JSON file (~700.000 lines, 1.2GB filesize) containing twitter data that I need to preprocess for data and network analysis. During the data collection an error happend: Instead of using " as a seperator ' was used. As this does not conform with the JSON standard, the file can not be processed by R or Python.

Information about the dataset: Every about 500 lines start with meta info + meta information for the users, etc. then there are the tweets in json (order of fields not stable) starting with a space, one tweet per line.

This is what I tried so far:

1. A simple data.replace('\'', '\"') is not possible, as the "text" fields contain tweets which may contain ' or " themselves.
2. Using regex, I was able to catch some of the instances, but it does not catch everything: re.compile(r'"[^"]*"(*SKIP)(*FAIL)|\'')
3. Using literal.eval(data) from the ast package also throws an error.

As the order of the fields and the legth for each field is not stable I am stuck on how to reformat that file in order to conform to JSON.

Normal sample line of the data (for this options one and two would work, but note that the tweets are also in non-english languages, which use " or ' in their tweets):

I'm running java application(ksqldb 0.15.0) on GKE cluster, and passed the java opts -Xms3G and -Xmx5G.

-Xmx option is working well, but -Xms options seems not to be effected.

The running command is as follows;

find the code attached below, so the ReadCBOE function reads information from investing.com and saves it to string str, Update news function then analyzes the information obtained from ReadCBOE and stores it into relevant arrays, the code is running without any errors just cant figure out why information is not being stored correctly into the arrays. ps the same code works perfectly on mt4

I have this very strange issue with my express app, i simply want to access req.body data that are send through post request via form-data but unfortunately i get undefined error when i try to access those values in request.body but what is strange about this is if i use multer middleware (i used this on another route to upload files) i don't get this error. i have configured default body parser provided by express.

I have a problem uploading an image file to my server, I watched some tutorials on YouTube about multer and I do exactly the same thing that is done in the tutorial and for whatever reason I get an error: ("Cannot read property 'buffer' of undefined"), and req.file is also undefined. I googled for the error and found some people having the same issue and I tried to solve it like them, but it didn't work for me.

COMPONENT Data App

I was trying to come up with good solution to convert string to json format but I don't know if it is good enough.

String str = "[(Name:"What We "Need" In Life"Author:"David D."FileSize:2.17)(Name:"The House Of Owls"Author:"Carlos")(Name:"A Poor Wise Man"Author:"Steve Bark"FileSize:1.31)]";

I think maybe I will use str.replace from ( to { and insert comma between the }{ but how can I find the index to insert? and what about the "" for Name,Author,FileSize? After converting to readable json string then I can serialize to json (by gson/jackson).

So I'm trying to alert myself if a certain file ever gets to big, but I didn't really find anything related to filesize on the internet. I know you could theoretically use a shell find command or something similar, but I don't really like using shell in combination with applescript.

I have try to insert some data into mongodb database using node js REST API but I got an error Unexpected field Im new to node please help me. whitePaper is my pdf file If I upload data like title, description and image only it gives the Correct answer with status code 201 but I try to upload all data and pdf but it gives the error

model code:

I am trying to upload more than 7mb sized image which throwing before hit the server side action method '500 Internal Server Error' where below 7mb images are easily get uploaded.

below I am Serializing the file in angular to Base64 string.