uber_data | Uber web interface crawler / scraper - Convert the trips | Scraper library

I am trying to use multiprocessing library to speed up CSV reading from files. I've done so using Pool and now I'm trying to do it with Process(). However when concatenating the list to create a dataframe, it's giving me the following error:

ValueError: No objects to concatenate

To me it looks like the processes are overwriting the uber_data list. What am I missing here?

I am trying to use multiprocessing library to speed up CSV reading from files. I've done so using Pool and now I'm trying to do it with Process(). However when running the code, it's giving me the following error:

AttributeError: 'tuple' object has no attribute 'join'

Can someone tell me what's wrong? I don't understand the error.

I have a dataset uber_data having columns as [START_DATE* ,END_DATE* CATEGORY* , START* ,STOP* ,MILES* ]where START* is the starting location and STOP* is the ending location. I have to get the most frequent route taken by uber driver.

And below is the code that I m using to get the required.

uber_data[['START*','STOP*','START_DATE*']].groupby(['START*','STOP*']).count().max()

This is getting me the number of routes which comes to be 201. But I could not figure it how to get the combination for which this 201 is coming. I have to manually see through the data to know the combination which comes out to be Agnew-Cary

I want my output in this way

**START* STOP* START_DATE*

Agnew Cary 201**

I tried getting the value using index() but did not get the desired result.

I'm trying to load new rows into a table and then update other columns in the table with the uploaded IDs. I'm only uploading IDs and then joining other tables to pull other data into the table. Query I tried:

I'm just getting started with Spark and Scala. I wrote the below from scratch by hand but it is pretty close to an example I was working from. When I run it, I keep getting errors that seemingly conflict with each other when I make changes to the code. I'm looking to add up the number of miles driven grouped by purpose of the trip. Pretty simple but no matter what index I set fields too, it never seems happy. If I set it to (fields(6).toString, fields(5).toFloat), I get an out of bounds exception. If i set it to (fields(5).toString, fields(4).toFloat) it's very obviously the wrong index values. Here is the scheme of the data:

I am attempting stream data over a socket with Java in an attempt to write a Kafka producer. I've written a class to pull the data in but I'm not getting the results I'd expect. I've got it set up so the data is being streamed from a Linux box. The source of the data is a csv file that I'm using the nc utility to stream. The class is running on a Windows 10 machine from Eclipse. When I run the class I see two weird things.

1. The column headers don't get transmitted.
2. I can only run the class once. If I want to run it again, I have to stop nc and restart it.

Below is my code. Am I missing anything? At this point I'm just trying to connect to the socket and pull the data over.

I run nc with the following command: $ nc -kl 9999 < uber_data.csv

Below is my class