Heapy | A Simple Heap Profiler for Windows C/C Applications | Monitoring library

I have different datasets with different sizes and I want to calculate the memory usage of the sorting algorithms implemented in Python against these data sets. For each type of sorting algorithms,I want to know the memory usage for each data set so that I can plot a graph.

I tried using psutil.virtual_memory() but it is not giving the expected results.

I tried to install heapy but anaconda is telling me that no such library exists.

I'm running a tensorflow model which is exhausting 60G of RAM in about 10 minutes while processing large images.

I've run Heapy to try to pin down a leak, but heapy shows only 90M of memory usage and remains constant.

I noted this article: Python process consuming increasing amounts of system memory, but heapy shows roughly constant usage

That suggested that the issue might be in python (2.7 here) with memory fragmentation. But that doesn't sound like a reasonable explanation for this case.

• I have 2 python Queues. In one I read an image from disk and load it to the raw queue using a thread.
• In another thread I read the raw queue, preprocess, and load it into a ready queue.
• In my main thread I draw batches of 8 images from the ready queue and run them through tensorflow training.
• With batches of 8 images (each ~25MB numpy matrices) I should have at least 24 * 25MB worth of memory being held between current processing and the two queues at any given time. But heapy only shows 90M of consumption.

So heapy is failing to see at least the 600M of memory that I know must be held at any given moment.

Hence, if heapy can't see the memory I know is there, I can't trust it to see where the leak is. At the rate it's leaking it's a virtual certainty that the batches of images are causing it.

I'm using the threading module in python to kick off the loader and preprocessor threads. I've tried calling print h.heap() from within the threads code and the main code, all with the same results.

I'm beginner in RoR, I have an error When I run rspec in rails I'm getting this error message:

You have already activated json 2.0.2, but your Gemfile requires json 1.8.6. Prepending bundle exec to your command may solve this. (Gem::LoadError)

I have tried to update json gem by "bundle update json", but still getting the same error message.

Could someone helps me on this. I'm using:- Ruby 2.3.0 - Rails 4.2.7.1 - gem version 2.5.1 Thank you!

Here is my Gemfile content: