fbpca | Fast Randomized PCA/SVD | Machine Learning library

by facebook Python Version: Current License: Non-SPDX

X-Ray Key Features Code Snippets Community Discussions(1)Vulnerabilities Install Support

kandi X-RAY | fbpca Summary

fbpca is a Python library typically used in Artificial Intelligence, Machine Learning, Example Codes applications. fbpca has no bugs, it has no vulnerabilities, it has build file available and it has low support. However fbpca has a Non-SPDX License. You can download it from GitHub.

Fast Randomized PCA/SVD

Support

Quality

Security

License

Reuse

Support

fbpca has a low active ecosystem.

It has 419 star(s) with 88 fork(s). There are 32 watchers for this library.

It had no major release in the last 6 months.

There are 1 open issues and 3 have been closed. There are 1 open pull requests and 0 closed requests.

It has a neutral sentiment in the developer community.

The latest version of fbpca is current.

Quality

fbpca has 0 bugs and 68 code smells.

Security

fbpca has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

fbpca code analysis shows 0 unresolved vulnerabilities.

There are 2 security hotspots that need review.

License

fbpca has a Non-SPDX License.

Non-SPDX licenses can be open source with a non SPDX compliant license, or non open source licenses, and you need to review them closely before use.

Reuse

fbpca releases are not available. You will need to build from source code and install.

Build file is available. You can build the component from source.

fbpca saves you 415 person hours of effort in developing the same functionality from scratch.

It has 985 lines of code, 26 functions and 3 files.

It has high code complexity. Code complexity directly impacts maintainability of the code.

Top functions reviewed by kandi - BETA

kandi's functional review helps you automatically verify the functionalities of the libraries and avoid rework.
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of fbpca

Get all kandi verified functions for this library.

fbpca Key Features

No Key Features are available at this moment for fbpca.

fbpca Examples and Code Snippets

No Code Snippets are available at this moment for fbpca.

Community Discussions

Trending Discussions on fbpca

Why is my NumPy array taking much *less* memory than it should?

QUESTION

Why is my NumPy array taking much *less* memory than it should?

Asked 2019-Jul-25 at 11:37

I am working with large matrices, like the Movielens 20m dataset. I restructured the online file such that it matches the dimensions mentioned on the page (138000 by 27000), since the original file contains indices that are more of the size (138000 by 131000), but contain a lot of empty columns. Simply throwing out those empty columns and re-indexing yields the desired dimensions.

Anyways, the snippet to cast the sparse csv file to a dense format looks like this:

...

ANSWER

Answered 2019-Jul-25 at 11:37

I think your problem lies in the todense() call, which uses np.asmatrix(self.toarray(order=order, out=out)) internally. toarray creates its output with np.zeros. (See toarray, _process_toarray_args)

So your question can be reduced to: Why doesn't np.zeros allocate enough memory?

The answer is probably lazy-initialization and zero pages:

Why does numpy.zeros takes up little space
Linux kernel: Role of zero page allocation at paging_init time

So all zero-regions in your matrix are actually in the same physical memory block and only a write to all entries will force the OS to allocate enough physical memory.

Source https://stackoverflow.com/questions/51748215

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install fbpca

You can download it from GitHub.
You can use fbpca like any standard Python library. You will need to make sure that you have a development environment consisting of a Python distribution including header files, a compiler, pip, and git installed. Make sure that your pip, setuptools, and wheel are up to date. When using pip it is generally recommended to install packages in a virtual environment to avoid changes to the system.

Support

For any new features, suggestions and bugs create an issue on GitHub. If you have any questions check and ask questions on community page Stack Overflow .

Find more information at: