spark-infotheoretic-feature-selection | package contains a generic implementation
kandi X-RAY | spark-infotheoretic-feature-selection Summary
kandi X-RAY | spark-infotheoretic-feature-selection Summary
The present framework implements Feature Selection (FS) on Spark for its application on Big Data problems. This package contains a generic implementation of greedy Information Theoretic Feature Selection methods. The implementation is based on the common theoretic framework presented in [1]. Implementations of mRMR, InfoGain, JMI and other commonly used FS filters are provided. In addition, the framework can be extended with other criteria provided by the user as long as the process complies with the framework proposed in [1]. Please cite as: S. Ramírez-Gallego; H. Mouriño-Talín; D. Martínez-Rego; V. Bolón-Canedo; J. M. Benítez; A. Alonso-Betanzos; F. Herrera, "An Information Theory-Based Feature Selection Framework for Big Data Under Apache Spark," in IEEE Transactions on Systems, Man, and Cybernetics: Systems, in press, pp.1-13, doi: 10.1109/TSMC.2017.2670926 URL:
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of spark-infotheoretic-feature-selection
spark-infotheoretic-feature-selection Key Features
spark-infotheoretic-feature-selection Examples and Code Snippets
Community Discussions
Trending Discussions on spark-infotheoretic-feature-selection
QUESTION
I am trying to use MRMR feature of InfoGain third-party (https://github.com/sramirez/spark-infotheoretic-feature-selection) package of Spark. But my cluster is 2.0 and I am getting this exception. Even though I added all the required Jar files to spark class path. But still it is not working. Although it's working on local machine properly but not on cluster.
Exception:
...ANSWER
Answered 2018-Mar-30 at 14:13It was problem with the version of breeze. I was adding an old version breeze_2.11_0.11 and by changing it to breeze_2.11-0.13.2.jar solved the problem.
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install spark-infotheoretic-feature-selection
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page