fbid | Show info about the author by facebook photo url

You can use the wp_set_object_terms function to save the custom taxonomy terms.

I found out that Firebase's photoURL is Facebook's Graph API URL: http://graph.facebook.com/user_id/picture. So, to get other sizes, all I need to do is to append a query string like ?type=normal to the photoURL.

To use GraphRequest, consider @jnpdx's suggestion:

Seems like you have at least a couple of options: 1) Use the GraphRequest and don't set your User model until you get the result back. 2) Set your User model as you are now and then update it with a new URL once your GraphRequest comes back.

Your problem is, that you have a Unique key over the fbid and the id column. So when you insert a new Row into the table you have a unique combination of id and fbid, because when you insert the same data again, you get an updated id value, so the constraint is met.

Your constraint should only contain the fbid

Or, when you want more than one entry for an fbid you should look if you have any other value in the response from api that can be used for the constraint (like a timestamp )

The account_creation_date part that has colon chars will confuse the BULK INSERT operation. That's why here is a different approach by using OPENROWSET() and handling the entire line as whole via T-SQL, and XML tokenization.

I saved your data as a e:\Temp\Rupa.txt file.

Issue is you are mixing xpath and CSS. The selector you used is a CSS selector and then you are passing it as a XPATH. So you can do it in two ways

XPATH

Your proposal is:

• Step 1 read json file
• Step 2 load to dataframe
• Step 3 save file as a csv
• Step 4 load csv to sql
• Step 5 load data to django to search

The problem with your second example is that you still use global lists (data_phone, data_name), which grow over time.

Here's what you should try, for huge files:

• Step 1 read json
  • line by line
  • do not save any data into a global list
  • write data directly into SQL
• Step 2 Add indexes to your database
• Step 3 use SQL from django

You don't need to write anything to CSV. If you really want to, you could simply write the file line by line:

You should pass an object with form fields values in reset method.

As I already mentioned in the question, gstreamer's tsdemux isn't able to handle synchronous KLV data.
This leads to the following possibilites

• roll your own gstreamer plugin
• help fixing tsdemux and have a look at the PR in their gitlab
• use ffmpeg. I successfully tested ffmpeg with the stream in question.

Since my C and gstreamer knowledge is nowhere near enough to continue with the first two options I settled for the third option.

You can use ffprobe to determine index: