pmd | An extensible multilanguage static code analyzer. | Code Analyzer library

by pmd Java Version: pmd_releases/6.43.0 License: Non-SPDX

Download this library from

kandi X-RAY | pmd Summary

pmd is a Java library typically used in Code Quality, Code Analyzer applications. pmd has no bugs, it has no vulnerabilities, it has build file available and it has high support. However pmd has a Non-SPDX License. You can download it from GitHub, Maven.

PMD is a source code analyzer. It finds common programming flaws like unused variables, empty catch blocks, unnecessary object creation, and so forth. It supports many languages. It can be extended with custom rules. It uses JavaCC and Antlr to parse source files into abstract syntax trees (AST) and runs rules against them to find violations. Rules can be written in Java or using a XPath query. It supports Java, JavaScript, Salesforce.com Apex and Visualforce, Modelica, PLSQL, Apache Velocity, XML, XSL, Scala. Additionally it includes CPD, the copy-paste-detector. CPD finds duplicated code in C/C++, C#, Dart, Fortran, Go, Groovy, Java, JavaScript, JSP, Kotlin, Lua, Matlab, Modelica, Objective-C, Perl, PHP, PLSQL, Python, Ruby, Salesforce.com Apex, Scala, Swift, Visualforce and XML. In the future we hope to add support for data/control flow analysis and automatic (quick) fixes where it makes sense.

Support

Quality

Security

License

Reuse

kandi-support Support

pmd has a highly active ecosystem.
It has 3763 star(s) with 1268 fork(s). There are 139 watchers for this library.
There were 1 major release(s) in the last 6 months.
There are 574 open issues and 1235 have been closed. On average issues are closed in 377 days. There are 15 open pull requests and 0 closed requests.
It has a negative sentiment in the developer community.
The latest version of pmd is pmd_releases/6.43.0

pmd Support

Best in #Code Analyzer

Average in #Code Analyzer

pmd Support

Best in #Code Analyzer

Average in #Code Analyzer

quality kandi Quality

pmd has no bugs reported.

pmd Quality

Best in #Code Analyzer

Average in #Code Analyzer

pmd Quality

Best in #Code Analyzer

Average in #Code Analyzer

security Security

pmd has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

pmd Security

Best in #Code Analyzer

Average in #Code Analyzer

pmd Security

Best in #Code Analyzer

Average in #Code Analyzer

license License

pmd has a Non-SPDX License.
Non-SPDX licenses can be open source with a non SPDX compliant license, or non open source licenses, and you need to review them closely before use.

pmd License

Best in #Code Analyzer

Average in #Code Analyzer

pmd License

Best in #Code Analyzer

Average in #Code Analyzer

build Reuse

pmd releases are available to install and integrate.
Deployable package is available in Maven.
Build file is available. You can build the component from source.
Installation instructions are available. Examples and code snippets are not available.

pmd Reuse

Best in #Code Analyzer

Average in #Code Analyzer

pmd Reuse

Best in #Code Analyzer

Average in #Code Analyzer

Top functions reviewed by kandi - BETA

kandi has reviewed pmd and discovered the below as its top functions. This is intended to give you an instant insight into pmd implemented functionality, and help decide if they suit your requirements.

Compute paths .
Generate rule set index .
Check for dead links in pages directory .
Start the task .
Determines the list of argument types for a method invocation .
Determines if an import should be avoided .
This method parses the given rule and builds the given node .
Gets the source object list .
Check for accessibility of given node .
Run the GraphChecker .

pmd Key Features

An extensible multilanguage static code analyzer.

pmd Examples and Code Snippets

See all related Code Snippets

DPDK l2fwd - How to forward ethernet interface to my PMD

Copy

Download

./dpdk-l2fwd -c 0x3 --vdev={MY_PMD}0 -- -p 0x3 -T 1

Docker-Compose with Commandbox cannot change web root

Copy

Download

image: ortussolutions/commandbox:lucee5

ENV APP_DIR=/app/public

-----------------------

image: ortussolutions/commandbox:lucee5

ENV APP_DIR=/app/public

Configure Gradle Plugin inside Gradle plugin

Copy

Download

URL resourceURL = getClass().getClassLoader().getResource("checkstyle.xml");
if (resourceURL != null) {
  File resourceFile = File(resourceURL.getFile());
  checkstyleExtension.setConfigFile(resourceFile);
}

File temp = File.createTempFile(".checkstyle", ".xml")
try (FileOutputStream out = new FileOutputStream(temp)) {
  try (InputStream resourceStream = getClass().getClassLoader().getResourceAsStream("checkstyle.xml")) {
    byte[] buffer = new byte[1024];
    int bytes = resourceStream.read(buffer);
    while (bytes >= 0) {
      out.write(buffer, 0, bytes);
      bytes = resourceStream.read(buffer);
    }
  }
}

-----------------------

URL resourceURL = getClass().getClassLoader().getResource("checkstyle.xml");
if (resourceURL != null) {
  File resourceFile = File(resourceURL.getFile());
  checkstyleExtension.setConfigFile(resourceFile);
}

File temp = File.createTempFile(".checkstyle", ".xml")
try (FileOutputStream out = new FileOutputStream(temp)) {
  try (InputStream resourceStream = getClass().getClassLoader().getResourceAsStream("checkstyle.xml")) {
    byte[] buffer = new byte[1024];
    int bytes = resourceStream.read(buffer);
    while (bytes >= 0) {
      out.write(buffer, 0, bytes);
      bytes = resourceStream.read(buffer);
    }
  }
}

Use of Deprecated PMD rules

Copy

Download

  <rule ref="rulesets/apex/complexity.xml/AvoidDeeplyNestedIfStmts" />

  <rule ref="category/apex/design.xml/AvoidDeeplyNestedIfStmts" />

-----------------------

  <rule ref="rulesets/apex/complexity.xml/AvoidDeeplyNestedIfStmts" />

  <rule ref="category/apex/design.xml/AvoidDeeplyNestedIfStmts" />

Spring boot 2.6.0 Error creating bean with name 'webSecurityConfig'

Copy

Download

@Bean
public static BCryptPasswordEncoder bcryptPasswordEncoder() {
    return new BCryptPasswordEncoder();
}

Jenkins PMD details from docker: Copying the source file failed

Copy

Download

...
   volumes:
      - "${WORKSPACE}:${WORKSPACE}"
...

DPDK for general purpose workload

Copy

Download

  External Port <==> DPDK Port0 (L2fwd) DPDK net_vhost <--> QEMU (virtio-pci)

While building the project getting error , Failed to execute goal org.apache.maven.plugins:maven-javadoc-plugin:2.10.4:jar (attach-javadocs)

Copy

Download

mvn -Dmaven.javadoc.skip=true verify

<plugin>
  <groupId>org.apache.maven.plugins</groupId>
  <artifactId>maven-javadoc-plugin</artifactId>
  <version>...</version>

  <configuration>
    <additionalOptions>
      <additionalOption>-Xdoclint:none</additionalOption>
    </additionalOptions>
  </configuration>
</plugin>

-----------------------

mvn -Dmaven.javadoc.skip=true verify

<plugin>
  <groupId>org.apache.maven.plugins</groupId>
  <artifactId>maven-javadoc-plugin</artifactId>
  <version>...</version>

  <configuration>
    <additionalOptions>
      <additionalOption>-Xdoclint:none</additionalOption>
    </additionalOptions>
  </configuration>
</plugin>

pktgen cannot send packet in ovs dpdk scenario

Copy

Download

DPDK Pktgen (net_vhost) <==> OVS-DPDK port-1 (virtio_user) {Rule to forward} OVS-DPDK port-2 (virtio_user) <==> DPDK Pktgen (net_vhost)

How to set a loop forwarding mode from one NIC to another in DPDK testpmd?

Copy

Download

./app/dpdk-testpmd -l 2,3 -- --total-num-mbufs=2048 -i --portmask=0x3 --tx-first

./app/dpdk-testpmd -l 2,3 -- --total-num-mbufs=2048 -i --portmask=0x3 --tx-first --auto-start -i

-----------------------

./app/dpdk-testpmd -l 2,3 -- --total-num-mbufs=2048 -i --portmask=0x3 --tx-first

./app/dpdk-testpmd -l 2,3 -- --total-num-mbufs=2048 -i --portmask=0x3 --tx-first --auto-start -i

See all related Code Snippets

Community Discussions

Trending Discussions on pmd

How to load balance by way of round-robin in DPDK using RTE_FLOW？
Artifactory Gradle Plugin deploys only build.info
DPDK l2fwd - How to forward ethernet interface to my PMD
Does virt_to_pfn checks whether the page table exists or not
Docker-Compose with Commandbox cannot change web root
Configure Gradle Plugin inside Gradle plugin
Use of Deprecated PMD rules
Spring boot 2.6.0 Error creating bean with name 'webSecurityConfig'
Jenkins PMD details from docker: Copying the source file failed
Why is PMD give different results for Eclipse and Gradle?

Trending Discussions on pmd

QUESTION

How to load balance by way of round-robin in DPDK using RTE_FLOW？

Asked 2022-Mar-26 at 02:47

in my problem RSS did not have a good load balance between CPU cores case the rx packets has been modified by insert tags between mac and ip so the dpdk could not recognize it.assume I want to load balance by way of round-robin, Multiple rx queues have been set up. in this question answer: How to disable RSS but still using multiple RX queues in DPDK? it says its possible to load balance in round robin fashion by using RTE_FLOW. what is the right way to do it grammatically ? I would like to know the API or structs for setting up the round-robin method here is my runtime environment infomation: 1）dpdk version: 19.11.9 2）nic PMD :ixgbe 3) fireware:825999 and XXV710 4) os version: ubuntu 16.04 kernel:4.4.0-186

ANSWER

Answered 2022-Mar-26 at 02:47

As per the question

RSS did not have a good load balance between CPU cores case the rx packets has been modified by insert tags between mac and ip

There are couple of items which needs to be clarified. so let me explain

Certain Physical and virtual NIC exposes RSS via DPDK RX offload for fixed tuples like IP, Protocol, TCP|UDP|SCTP port number.
Certain NIC allows to configure the hash reta algorithm to better suit to needs (example when the source destination IP address is fixed we can skip and use others).
As I recollect from DPDK 18.11, RTE_FLOW is been introduced to support RSS on selected RX queues (example Q1,Q2,Q3 can be RSS for TCP packets while Q4,Q5 can be used for UDP). But again this is based on the either Inner or Outer IP+PORT number
For DPDK version 19.11 onwards RTE_FLOW is been enhanced to support RAW Pattern. The intend of this feature is support Special protocol which by default the NIC does not understand like (VXLAN, GENEVE, RTP and other protocols).
For NIC like Fortville & Columbiaville (from Intel) allows loading of special firmware via DDP (Dynamic Device Personation) to configure special fabric headers or MPLS like headers (between ethernet and ip) to be parsed, lookup and used as seed for RSS (allowing better distribution).
There are NIC which do support L2 layer but these would be limited SMAC, DMAC, VLAN1,VLAn2, MPLS only and not custom header.

Hence depending upon NIC, vendor, RSS support for L2 and firmware the ability calculating RSS on fields between varies in port init or RTE_FLOW specific configuration. For example RSS ETH supported on

I40E is I40E_INSET_DMAC | I40E_INSET_SMAC
DPAA2 is NH_FLD_ETH_TYPE and NET_PROT_ETH
CNXK is RSS_DMAC_INDEX
OCTEONX2 is FLOW_KEY_TYPE_VLAN and FLOW_KEY_TYPE_CH_LEN_90B

Hence for NIC ixgbe and XXV710 there is no ready support for the custom header between ethernet and IP.

Alternatives:

Use a smart NIC or FPGA: that is programmed to parse and RSS on your specific headers to RSS on multiple RX queue
Work with Intel using XXV710 (Fortville): to create DDP which can parse your specific headers as RSS on multiple RX queue.
Identify DPDK NIC: which can parse RAW header as defined 12.2.6.2. Once the support is added by the vendor you can create a simple traffic spread tool which will ensure traffic distribution across the desired RX queues in round robin fashion.
Use SW to support the missing hardware.

note: I am not recommending use of HW based static Round Robin as it will create 2 fold problem

if it is pure DPDK BOND Round ROBIN you will not have any flow pinning
If you use hash based pinning, there are chances elephant flow can pushed 1 or a few queues causing performance drops in cpu processing.
My recommendation is to use EVENTDEV model with atomic mode, which ensure better cache locality (at a given instance same flows will fall onto worker thread) and almost linear performance performance. sample app

For option 4 (Software Model):

Disable RSS in port_init function
Use single RX queue to receive all the packet either custom rx thread.
calculate the hash based on the desired header and update mbuf hash field.
Use rte_distributor library to spread traffic based on the custom.
or use rte_eventdev with atomic model to spread the work load on multiple worker.

[Clarification from Comments]:

I have asked relevant practitioners， they said modifying the pmd driver can solves my problem, its the only way?

[ANSWER] Since you are using custom header and not generic VLAN|IP|Port this suggestion is not correct. As you have clarified in question and comments you want to distribute like RSS for custom header.

I haven't written any code about rte_flow distribution yet, i read the rte_flow example, don't see the code to configure round-robin

[ANSWER] as explained above not all nic support RSS and RAW. Since your current NIC is ixgbe and i40e the function of parsing and executing RSS for custom header is unlikely. you can try option 2 (work with intel create new ddp) for i40e to achieve the same or implement in SW as suggested in option 4.

im not ask for solution, I just want to know how to set up round robin by 'RTE_FLOW' Can you give me a few API

[ANSWER] normally one updates with code snippets or steps used for reproducing the error. But the current question is more like clarification. Please refer above.

Source https://stackoverflow.com/questions/71581875

QUESTION

Artifactory Gradle Plugin deploys only build.info

Asked 2022-Mar-19 at 09:33

I have a Gradle plugin that I want to deploy to Artifactory server with Gradle Artifactory Plugin.

The problem is that artifactoryDeploy task publishes only build.info meta-information and skips the actual artifacts. You can see it in the logs.

> Task :artifactoryDeploy
Deploying build info...
Build-info successfully deployed. Browse it in Artifactory under http://my-company.artifactory.com/artifactory/webapp/builds/gradle-plugin/Thu%20Mar%2017%2017:07:21%20MSK%202022

BUILD SUCCESSFUL in 1s

Here is the build.gradle. What am I doing wrong?

plugins {
    id 'java-gradle-plugin'
    id "com.jfrog.artifactory" version '4.27.1'
    id 'maven-publish'
    id 'com.gradle.plugin-publish' version '0.18.0'
}

gradlePlugin {
    plugins {
        somePlugin {
            id = 'com.example.gradle.plugin'
            displayName = 'Gradle Plugin'
            implementationClass = 'com.example.gradle.plugin.Plugin'
        }
    }
}

pluginBundle {
    website = 'https://company.gitlab.com/project'
    vcsUrl = 'https://company.gitlab.com/project'
    tags = ['plugin', 'codestyle', 'checkstyle', 'pmd']
}

publishing {
    publications {
        pluginPublication(MavenPublication) {
            from components.java
            groupId project.group
            artifactId 'my-plugin'
            version project.version
        }
    }
}

artifactory {
    contextUrl = 'http://my-company.artifactory.com'
    publish {
        repository {
            repoKey = 'gradle-plugins'
            username = project.properties['publishUser'] ?: 'user'
            password = project.properties['publishPassword'] ?: 'password'
        }
        defaults {
            publications(publishing.publications.names.toArray(String[]::new))
            publishBuildInfo = true
            publishArtifacts = true
            publishPom = true
            publishIvy = true
        }
    }
    // Redefine basic properties of the build info object
    def date = new Date().toString()
    clientConfig.setIncludeEnvVars(true)
    clientConfig.setEnvVarsExcludePatterns('*password*,*secret*')
    clientConfig.setEnvVarsIncludePatterns('*not-secret*')
    clientConfig.info.addEnvironmentProperty('test.adding.dynVar', date)
    clientConfig.info.setBuildName('MTS-Metric-Gradle-Plugin')
    clientConfig.info.setBuildNumber(date)
    clientConfig.timeout = 20
    clientConfig.setInsecureTls(true)
}

ANSWER

Answered 2022-Mar-19 at 09:33

OK, I found the source of the problem. You should replace artifactoryDeploy with artifactoryPublish command.

Source https://stackoverflow.com/questions/71513831

QUESTION

DPDK l2fwd - How to forward ethernet interface to my PMD

Asked 2022-Mar-18 at 12:37

I have a board with one ethernet interface (eth0) running Linux. I'm trying to forward all incoming traffic from eth0 to my PMD driver, using dpdk-l2fwd example application.

Here is what I've tried:

./dpdk-l2fwd -c 0x3 --vdev={my_pmd}0 -- -p 0x3 -T 0

I can see that my rx_pkt_burst callback is polled by the application, but that's it.

How can I forward all incoming eth0 packets to my PMD?

I tried to use net_tap, using the following command:

./dpdk-l2fwd -c 0xff --vdev=net_tap0 --vdev={my_pmd}0 -- -p 0x7 -T 0 --portmap="(1,2)"

And my tx_pkt_burst callback is called occasionally, but not when I think it should be called. For example, if I ping this board from another one, the ping is successful, but the tx_pkt_burst callback is not been called.

I tried to use devbind tool, but no devices are detected:

./usertools/dpdk-devbind.py --status

No 'Network' devices detected
=============================

No 'Baseband' devices detected
==============================

No 'Crypto' devices detected
============================

No 'Eventdev' devices detected
==============================

No 'Mempool' devices detected
=============================

No 'Compress' devices detected
==============================

No 'Misc (rawdev)' devices detected
===================================

No 'Regex' devices detected
===========================

Update

DPDK version - 20.11.
My HW is a embedded device based on NXP's Layerscape.

$ lshw -class network
  *-network
       description: Ethernet interface
       physical id: 3
       logical name: eth0
       serial: 00:11:22:44:11:44
       size: 1Gbit/s
       capacity: 1Gbit/s
       capabilities: ethernet physical tp mii 10bt-fd 100bt-fd 1000bt-fd autonegotiation
       configuration: autonegotiation=on broadcast=yes driver=fsl_dpaa2_eth driverversion=5.10.35-00002-g3434eea0e1e7-dir duplex=full firmware=7.17 ip=192.168.15.157 link=yes multicast=yes port=twisted pair speed=1Gbit/s

I'm trying to bypass all traffic to the PMD I'm currently developing.

Thanks.

ANSWER

Answered 2022-Feb-14 at 09:16

[EDIT-1] clarification of using same interface for DPDK and Kernel routing

Answer> as discussed over comments please refer to DPDKD + kernel on same interface

Based on the information shared there are multiple questions to the single query I'm trying to bypass all traffic to the PMD I'm currently developing. Addressing each one separately below

question 1: using dpdk-l2fwd example application

Answer> DPDK application l2fwd application makes use of basic APi with almost no HW offloads. Based on your environment (I have a board with one ethernet interface (eth0)), the right set of parameters should be -p 0x1 --no-mac-updating -T 1. This will configure the application to receive and transmit packet using single DPDK interface (that is eth0 on your board).

Note: DPDK Application can work with DPDK PMD both physical and virtual

question 2: I tried to use net_tap, using the following command:

Answer> If the intend is to intercept the traffic from physical and then forward to tap interface, then one needs modify the eal arguments as ./build/l2fwd --vdev=net_tap0,iface="my_eth0" -- -p 0x3 -T 1 --no-mac-updating. This will allow the application to probe physical NXP interface (eth0) and make use of Linux TAP interface as secondary interface. Thus any traffic from NXP and TAP will be cross connected such as NXP (eth0) <==> TAP (my_eth0)

question 3: ./usertools/dpdk-devbind.py --status returns empty

Answer> Form the dpdk site supported NIC list NXP dpaa, dpaa2, enetc, enetfec, pfe. Cross checking the kernel driver fsl_dpaa2_eth I think it is safe to assume dpaa2 PMD is supported. As you have mentioned the NIC is not enumerated, it looks like there are certain caveats to such model revision, supported board, BSP package, vendor-sub vendor ID check etc. More details can be found Board Support Package, and DPAA2 NIC guide

Debug & Alternative solutions:

To start with use the Kernel Driver to bring in packets
Use extra logging and debug to identify why the NIC is shown in the application

Approach 1:

Make sure the NIC is bind with kernel driver fsl_dpaa2_eth.
ensure NIC is connected and link is up with ethtool eth0
set to promiscous mode with ifconfig eth0 promisc up
start DPDK application with PCAP PMD, ./build/l2fwd --vdev=net_pcap0,iface=eth0 -- -p 1 --no-mac-updating -T 1
Check packet are received and redirected to PCAP eth0 PMD by checking the statistics.

Approach 2:

Ideally the NIC should be categorized under network device to be probed by debind.py.
Check the device details using lshw -c net -businfo for network.
try checking with lspci -Dvmmnnk [PCIe BUS:Slot:Function id] for network details.
If above details does not show up as network device this might be reason for not getting listed.

Suggestions or workaround: You can try to forcefully bind with igb_uio or vfio-pci (I am not much famialr with NXP SoC) by dpdk-devbind -b vfio-pci [PCIe S:B:F]. Then cross check with lspci -ks [PCIe S:B:F]. Once successfully done, one can start dpdk l2fwd in PMD debug mode with ./build/l2fwd -a [PCIe S:B:F] --log-level=pmd,8 -- -p 1 --no-mac-updating | more. Thus by intercepting and interpreting the logs one can identify what is going

Note:

It is assumed the application is build with static libraries and not dynamic. To build with static libraries use make static for l2fwd.
For the described use case recommended application is basicfwd/skeleton rather than l2fwd.

Source https://stackoverflow.com/questions/71101764

QUESTION

Does virt_to_pfn checks whether the page table exists or not

Asked 2022-Feb-28 at 13:46

Does virt_to_pfn checks whether the page table is present or not. Below is the code which is failing with page fault.

#include <linux/module.h>

#define address 0xf0000000
int init_module(void)
{
    struct page *page;
    int32_t reserved;
    int32_t private;
    uint32_t test  = 0xAAAAAAAA;
    uint32_t saveValue;
    unsigned long pfn = 0;
    static uint32_t *testAddr = (uint *)address;

    pfn = virt_to_pfn(address);
    printk("Test!:%x, page frame number:%lu\n", address, pfn);
    if ( !pfn_valid(pfn) ) {
           printk("Page frame number not valid\n");
    } else {
           printk("Page Frame Number valid\n");
    }

     page = ( struct page * )virt_to_page(address);
         if ( page == NULL )
     {
         printk("NO page exist\n");
         return -1;
     }
     reserved = PageReserved( page );
     private = PagePrivate( page );
     if (reserved)
         printk("Page reserved\n");
     if (private)
         printk("Page Private\n");

     saveValue = ( uint32_t )*testAddr;
     printk("Save value:%u\n", saveValue);
    return 0;
}

void cleanup_module(void)
{
    printk("Goodbye Cruel World!\n");
}

MODULE_LICENSE("GPL");

Fails with the below error:

root@qemuarm:~# modprobe hello
[   33.283359] hello: loading out-of-tree module taints kernel.
[   33.290515] Test!:f0000000, page frame number:458752
[   33.290708] Page Frame Number valid
[   33.291169] 8<--- cut here ---
[   33.291280] Unable to handle kernel paging request at virtual address f0000000
[   33.291704] pgd = afcbaf1a
[   33.291832] [f0000000] *pgd=80000040007003, *pmd=00000000
[   33.292313] Internal error: Oops: 206 [#1] PREEMPT SMP ARM
[   33.292589] Modules linked in: hello(O+)
[   33.293078] CPU: 0 PID: 323 Comm: modprobe Tainted: G           O      5.4.172-yocto-standard #1
[   33.293368] Hardware name: Generic DT based system
[   33.293926] PC is at init_module+0x94/0xc8 [hello]
[   33.294078] LR is at init_module+0x40/0xc8 [hello]
[   33.294243] pc : [<bf000094>]    lr : [<bf000040>]    psr: 600f0013
[   33.294549] sp : ed879dd0  ip : 2e85d000  fp : bf002000
[   33.294712] r10: ed879f40  r9 : f0815df0  r8 : 00000002
[   33.294838] r7 : 00000000  r6 : c10a78c0  r5 : bf000000  r4 : 00000000
[   33.295019] r3 : f0000000  r2 : 40000000  r1 : 00000007  r0 : bf0010c3
[   33.295255] Flags: nZCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment user
[   33.295510] Control: 30c5387d  Table: 6e13d300  DAC: fffffffd
[   33.295656] Process modprobe (pid: 323, stack limit = 0x04adcafd)

RAM Size is 1024MB, the below code works with kernel virtual addresses from 0xc000 0000 - 0xefff ffff. 0xffff 0000 is where the high mem region starts.

Will the logic changes for high mem region access

ANSWER

Answered 2022-Feb-28 at 13:46

The results of virt_to_pfn(kaddr) and virt_to_page(kaddr) are valid if and only if virt_addr_valid(kaddr) is true. That is only true if kaddr is in the linear-mapped (lowmem) region of kernel virtual address space.

pfn_valid(virt_to_pfn(kaddr)) is not equivalent to virt_addr_valid(kaddr). virt_addr_valid(kaddr) implies pfn_valid(virt_to_pfn(kaddr)) but pfn_valid(virt_to_pfn(kaddr)) does not imply virt_addr_valid(kaddr).

Source https://stackoverflow.com/questions/71292209

QUESTION

Docker-Compose with Commandbox cannot change web root

Asked 2022-Feb-24 at 15:19

I'm using docker-compose to launch a commandbox lucee container and a mysql contianer.

I'd like to change the web root of the lucee server, to keep all my non-public files hidden (server.json etc, cfmigrations resources folder)

I've followed the docs and updated my server.json https://commandbox.ortusbooks.com/embedded-server/server.json/packaging-your-server

{
    "web":{
        "webroot":"./public"
    }
}

If I launch the server from Windows (box start from the app folder), the server loads my index.cfm from ./public at http://localhost, perfect.

But using this .yaml file, the webroot doesn't change to ./public and the contents of my /app folder is shown, with the "public" folder visible in the directory listing.

services:
  db:
    image: mysql:8.0.26
    command: --default-authentication-plugin=mysql_native_password
    restart: always
    environment:
      MYSQL_ROOT_PASSWORD: $MYSQL_ROOT_PASSWORD
      MYSQL_DATABASE: cf
      MYSQL_USER: $MYSQL_USER
      MYSQL_PASSWORD: $MYSQL_PASSWORD
      MYSQL_SOURCE: $MYSQL_SOURCE
      MYSQL_SOURCE_USER: $MYSQL_SOURCE_USER
      MYSQL_SOURCE_PASSWORD: $MYSQL_SOURCE_PASSWORD
    volumes:
      - ./mysql:/var/lib/mysql
      - ./assets/initdb:/docker-entrypoint-initdb.d
      - ./assets/sql:/assets/sql

  web:
    depends_on:
      - db
    # Post 3.1.0 fails to boot if APP_DIR is set to non /app
    # image: ortussolutions/commandbox:lucee5-3.1.0
    image: ortussolutions/commandbox:lucee5
    # build: .
    ports:
      - "80:80"
      - "443:443"
    environment:
        - PORT=80
        - SSL_PORT=443
        - BOX_SERVER_WEB_SSL_ENABLE=true
        - BOX_SERVER_WEB_DIRECTORYBROWSING=$CF_DIRECTORY_BROWSING
        - BOX_INSTALL=true
        - BOX_SERVER_WEB_BLOCKCFADMIN=$CF_BLOCK_ADMIN
        - BOX_SERVER_CFCONFIGFILE=/app/.cfconfig.json 
        
        # - APP_DIR=/app/public
        # - BOX_SERVER_WEB_WEBROOT=/app/public
        
        - cfconfig_robustExceptionEnabled=$CF_ROBOUST_EXCEPTION_ENABLED
        - cfconfig_adminPassword=$CF_ADMIN_PASSWORD

        - MYSQL_USER=$MYSQL_USER
        - MYSQL_PASSWORD=$MYSQL_PASSWORD
        - MYSQL_HOST=$MYSQL_HOST
        - MYSQL_PORT=$MYSQL_PORT
    volumes:
      - ./app:/app
      - ./assets/mysql-connector-java-8.0.26.jar:/usr/local/lib/CommandBox/lib/mysql-connector-java-8.0.26.jar

Here's the directory listing:

This is my project structure:

It seems like the server.json file is being ignored or at least the web.webroot property, but I've tried both of these settings, and neither solve the problem

- APP_DIR=/app/public
- BOX_SERVER_WEB_WEBROOT=/app/public

The commandbox docs suggest changing APP_DIR to fix the web root, "APP_DIR - Application directory (web root)." https://hub.docker.com/r/ortussolutions/commandbox/

But if I do that, I get an error about the startup script being in the wrong place, which to me looks like it should be fixed: https://github.com/Ortus-Solutions/docker-commandbox/issues/55

The BOX_SERVER_WEB_WEBROOT is in the same way server.json is (or at least that property). I've tried setting the following env vars as well (both upper and lower case) and it makes no diffence, but bear in mind server.json changes the webroot for me whe

BOX_SERVER_WEB_WEBROOT=./public
BOX_SERVER_WEB_WEBROOT=/app/public
BOX_SERVER_WEB_WEBROOT=public

The output as the web container starts up:

Set verboseErrors = true

INFO: CF Engine defined as lucee@5.3.8+189

INFO: Convention .cfconfig.json found at /app/.cfconfig.json

INFO: Server Home Directory set to: /usr/local/lib/serverHome

 √ | Installing ALL dependencies

   | √ | Installing package [forgebox:commandbox-cfconfig@1.6.3]

   | √ | Installing package [forgebox:commandbox-migrations@3.2.3]

   |   | √ | Installing package [forgebox:cfmigrations@^2.0.0]

   |   |   | √ | Installing package [forgebox:qb@^8.0.0]

   |   |   |   | √ | Installing package [forgebox:cbpaginator@^2.4.0]

+ [[ -n '' ]]

+ [[ -n '' ]]

INFO: Generating server startup script

 √ | Starting Server

   |------------------------------

   | start server in - /app/

   | server name - app

   | server config file - /app//server.json

   | WAR/zip archive already installed.

   | Found CFConfig JSON in ".cfconfig.json" file in web root by convention

   | .

   | Importing luceeserver config from [/app/.cfconfig.json]

   | Config transferred!

   | Setting OS environment variable [cfconfig_adminPassword] into luceeser

   | ver

   | [adminPassword] set.

   | Setting OS environment variable [cfconfig_robustExceptionEnabled] into

   |  luceeserver

   | [robustExceptionEnabled] set.

   | Start script for shell [bash] generated at: /app/server-start.sh

   | Server start command: 

   |     /opt/java/openjdk/bin/java 

   |     -jar /usr/local/lib/CommandBox/lib/runwar-4.5.1.jar 

   |     --background=false 

   |     --host 0.0.0.0 

   |     --stop-port 42777 

   |     --processname app [lucee 5.3.8+189] 

   |     --log-dir /usr/local/lib/serverHome//logs 

   |     --server-name app 

   |     --tray-enable false 

   |     --dock-enable true 

   |     --directoryindex true 

   |     --timeout 240 

   |     --proxy-peeraddress true 

   |     --cookie-secure false 

   |     --cookie-httponly false 

   |     --pid-file /usr/local/lib/serverHome//.pid.txt 

   |     --gzip-enable true 

   |     --cfengine-name lucee 

   |     -war /app/ 

   |     --web-xml-path /usr/local/lib/serverHome/WEB-INF/web.xml 

   |     --http-enable true 

   |     --ssl-enable true 

   |     --ajp-enable false 

   |     --http2-enable true 

   |     --open-browser false 

   |     --open-url https://0.0.0.0:443 

   |     --port 80 

   |     --ssl-port 443 

   |     --urlrewrite-enable false 

   |     --predicate-file /usr/local/lib/serverHome//.predicateFile.txt

   | Dry run specified, exiting without starting server.

   |------------------------------

   | √ | Setting Server Profile to [production]

   |   |-----------------------------------------------------

   |   | Profile set from secure by default

   |   | Block CF Admin disabled

   |   | Block Sensitive Paths enabled

   |   | Block Flash Remoting enabled

   |   | Directory Browsing enabled

   |   |-----------------------------------------------------

INFO: Starting server using generated script: /usr/local/bin/startup.sh

[INFO ] runwar.server: Starting RunWAR 4.5.1

[INFO ] runwar.server: HTTP2 Enabled:true

[INFO ] runwar.server: Enabling SSL protocol on port 443

[INFO ] runwar.server: HTTP ajpEnable:false

[INFO ] runwar.server: HTTP warFile exists:true

[INFO ] runwar.server: HTTP warFile isDirectory:true

[INFO ] runwar.server: HTTP background:false

[INFO ] runwar.server: Adding additional lib dir of: /usr/local/lib/serverHome/WEB-INF/lib

[INFO ] runwar.server: ******************************************************************************

[INFO ] runwar.server: Starting - port:80 stop-port:42777 warpath:file:/app/

[INFO ] runwar.server: context: /  -  version: 4.5.1

[INFO ] runwar.server: web-dirs: ["\/app"]

[INFO ] runwar.server: Log Directory: /usr/local/lib/serverHome/logs

[INFO ] runwar.server: ******************************************************************************

[INFO ] runwar.server: XNIO-Option CONNECTION_LOW_WATER:1000000

[INFO ] runwar.server: XNIO-Option CORK:true

[INFO ] runwar.server: XNIO-Option WORKER_TASK_MAX_THREADS:30

[INFO ] runwar.server: XNIO-Option WORKER_IO_THREADS:8

[INFO ] runwar.server: XNIO-Option TCP_NODELAY:true

[INFO ] runwar.server: XNIO-Option WORKER_TASK_CORE_THREADS:30

[INFO ] runwar.server: XNIO-Option CONNECTION_HIGH_WATER:1000000

[INFO ] runwar.config: Parsing '/usr/local/lib/serverHome/WEB-INF/web.xml'

[INFO ] runwar.server: Extensions allowed by the default servlet for static files: 3gp,3gpp,7z,ai,aif,aiff,asf,asx,atom,au,avi,bin,bmp,btm,cco,crt,css,csv,deb,der,dmg,doc,docx,eot,eps,flv,font,gif,hqx,htc,htm,html,ico,img,ini,iso,jad,jng,jnlp,jpeg,jpg,js,json,kar,kml,kmz,m3u8,m4a,m4v,map,mid,midi,mml,mng,mov,mp3,mp4,mpeg,mpeg4,mpg,msi,msm,msp,ogg,otf,pdb,pdf,pem,pl,pm,png,ppt,pptx,prc,ps,psd,ra,rar,rpm,rss,rtf,run,sea,shtml,sit,svg,svgz,swf,tar,tcl,tif,tiff,tk,ts,ttf,txt,wav,wbmp,webm,webp,wmf,wml,wmlc,wmv,woff,woff2,xhtml,xls,xlsx,xml,xpi,xspf,zip,aifc,aac,apk,bak,bk,bz2,cdr,cmx,dat,dtd,eml,fla,gz,gzip,ipa,ia,indd,hey,lz,maf,markdown,md,mkv,mp1,mp2,mpe,odt,ott,odg,odf,ots,pps,pot,pmd,pub,raw,sdd,tsv,xcf,yml,yaml

[INFO ] runwar.server: welcome pages in deployment manager: [index.cfm, index.lucee, index.html, index.htm]

WARNING: An illegal reflective access operation has occurred

WARNING: Illegal reflective access by org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender (file:/usr/local/lib/serverHome/WEB-INF/lib/lucee.jar) to method java.net.URLClassLoader.addURL(java.net.URL)

WARNING: Please consider reporting this to the maintainers of org.apache.felix.framework.ext.ClassPathExtenderFactory$DefaultClassLoaderExtender

WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations

WARNING: All illegal access operations will be denied in a future release

[INFO ] runwar.server: Direct Buffers: true

[INFO ] runwar.server: ******************************************************************************

[INFO ] runwar.server: *** starting 'stop' listener thread - Host: 0.0.0.0 - Socket: 42777

[INFO ] runwar.server: ******************************************************************************

[INFO ] runwar.server: Server is up - http-port:80 https-port:443 stop-port:42777 PID:286 version 4.5.1

This is all fairly new to me so I might have done something completely wrong, I'm wondering if it's a problem with the folder nesting, although I've tried rearranging it and can't come up with a working solution.

ANSWER

Answered 2022-Feb-24 at 15:19

You're using a pre-warmed image

image: ortussolutions/commandbox:lucee5

That means the server has already been started and "locked in" to all its settings, including the web root. Use the vanilla commandbox image that has never had a server started, that way when you warm up the image, you'll be starting it with your settings the first time.

To set a custom web root, you'll want to add this to your docker file

ENV APP_DIR=/app/public

Source https://stackoverflow.com/questions/71247957

QUESTION

Configure Gradle Plugin inside Gradle plugin

Asked 2022-Feb-21 at 11:36

I want to create a custom Gradle plugin that will encapsulate Checkstyle and PMD configurations. So, other projects can just apply one custom plugin without bothering about any additional configurations.

I applied checkstyle plugin.

plugins {
    id 'java-gradle-plugin'
    id 'checkstyle'
}

And then I applied it inside my custom plugin.

public class CustomPlugin implements Plugin<Project> {
    public void apply(Project project) {
        project.getPluginManager().apply(CheckstylePlugin.class);
    }
}

When I try to build the project I get an error.

Unable to find: config/checkstyle/checkstyle.xml

How can I override other plugin's properties? For example, I want to change the default checkstyle.xml path. I can do it manually inside build.gradle of the plugin project itself. But in this case, other projects that apply the plugin won't have this configurations defined by default (I tested it).

EDIT 1:

I managed to configure checkstyle plugin with ChecktyleExtension.

public class MetricCodingRulesGradlePluginPlugin implements Plugin<Project> {
    public void apply(Project project) {
        project.getPluginManager().apply("checkstyle");
        project.getExtensions().configure(CheckstyleExtension.class, checkstyleExtension -> {
            checkstyleExtension.setConfigFile(new File("style/checkstyle.xml"));
        });
    }
}

checkstyle.xml is placed in the plugin project. When I try to apply it within any other project, checkstyle searches it inside the current project directory but not the plugin's one. Is it possible to overcome this issue? I don't want users of that plugin to put any additional files inside their project.

EDIT 2:

I put the config files to resources folder and tried to read the content.

public class MetricCodingRulesGradlePluginPlugin implements Plugin<Project> {
    public void apply(Project project) {
        project.getPluginManager().apply("checkstyle");
        project.getExtensions().configure(CheckstyleExtension.class, checkstyleExtension -> {
            URL url = getClass().getClassLoader().getResource("style/checkstyle.xml");
            System.out.println("URL: " + url);
            try {
                checkstyleExtension.setConfigFile(
                    Paths.get(url.toURI())
                        .toFile()
                );
            } catch (URISyntaxException e) {
                throw new RuntimeException(e);
            }
        });
    }
}

When I apply the plugin to another project, I get the following error:

URL: jar:file:/Users/user/.gradle/caches/jars-9/8f4176a8ae146bf601f1214b287eb805/my-plugin-0.0.1-SNAPSHOT.jar!/style/checkstyle.xml

Caused by: java.nio.file.FileSystemNotFoundException
    at com.sun.nio.zipfs.ZipFileSystemProvider.getFileSystem(ZipFileSystemProvider.java:171)
    at com.sun.nio.zipfs.ZipFileSystemProvider.getPath(ZipFileSystemProvider.java:157)

Java cannot read the file from the jar archive for some reason. Any approaches to overcome this error?

ANSWER

Answered 2022-Feb-21 at 11:36

You'd need to bundle the checkstyle.xml within your plugin's resources folder, so when you ship it, you can always access it from within the plugin code.

Basically, you need to put the config under src/main/resources/checkstyle.xml of the plugin and then access it like this:

URL resourceURL = getClass().getClassLoader().getResource("checkstyle.xml");
if (resourceURL != null) {
  File resourceFile = File(resourceURL.getFile());
  checkstyleExtension.setConfigFile(resourceFile);
}

Also remember, if you ship your plugin as a .jar, you'd need to unpack the checkstyle.xml into a temp file beforehand. Roughly:

File temp = File.createTempFile(".checkstyle", ".xml")
try (FileOutputStream out = new FileOutputStream(temp)) {
  try (InputStream resourceStream = getClass().getClassLoader().getResourceAsStream("checkstyle.xml")) {
    byte[] buffer = new byte[1024];
    int bytes = resourceStream.read(buffer);
    while (bytes >= 0) {
      out.write(buffer, 0, bytes);
      bytes = resourceStream.read(buffer);
    }
  }
}

Source https://stackoverflow.com/questions/71204816

QUESTION

Use of Deprecated PMD rules

Asked 2022-Feb-17 at 12:52

We've recently picked up PMD on our Salesforce project to help with our Apex code quality analysis. We've implemented a couple of rules, but have seen that most of the really valuable-looking rules (around performance, complexity, etc) are marked as deprecated.

Do people generally use continue to use deprecated rules (as they still work, even if they are no longer actively supported)? Or does deprecated in this sense mean that these may be broken/unreliable.

Does the prevalence of deprecated PMD rules mean that we should be looking for an alternative tool?

I'd really welcome your thoughts

ANSWER

Answered 2022-Feb-17 at 12:52

There are very few deprecated rules in the Apex module: https://pmd.github.io/latest/pmd_rules_apex.html

PMD rules are usually not deprecated without a replacement. For instance AvoidDmlStatementsInLoops is replaced by OperationWithLimitsInLoops, as documented. Sometimes several rules are consolidated into a single one, which is the case for those 3 performance rules. You might get the impression that many rules are deprecated, but no functionality is lost, and the newer rules are generally more easily extensible.

If you are seeing many deprecation warnings, it may be because you are referencing those rules through deprecated rulesets. For instance, if you write

  <rule ref="rulesets/apex/complexity.xml/AvoidDeeplyNestedIfStmts" />

you will get a deprecation warning, as the ruleset will be removed in PMD 7. However, the rule is not deprecated, and is still accessible at

  <rule ref="category/apex/design.xml/AvoidDeeplyNestedIfStmts" />

I'm suggesting this because you mention deprecated complexity rules, and no complexity rules of PMD Apex are deprecated (the ruleset complexity.xml is though).

In PMD 6, PMD's rule library has been reorganized into "categories", in contrast with the previous approach of publishing rulesets directly. Consequently, most built-in rulesets have been deprecated until PMD 7, which does not mean the rules themselves are deprecated.

Source https://stackoverflow.com/questions/71125281

QUESTION

Spring boot 2.6.0 Error creating bean with name 'webSecurityConfig'

Asked 2022-Jan-23 at 12:51

I am unable to update my spring boot app to 2.6.0 from 2.5.7. It throws the following error.

2021-12-07T08:40:22,311 ERROR [restartedMain] o.s.b.SpringApplication.reportFailure:819|| Application run failed org.springframework.beans.factory.BeanCurrentlyInCreationException: Error creating bean with name 'webSecurityConfig': 
The requested bean is currently in creation: Is there an unresolvable circular reference?
    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.beforeSingletonCreation(DefaultSingletonBeanRegistry.java:355)
    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:227)

From the spring-boot 2.6.0 release notes, it is clear that circular references are disabled. And it can be enabled back with the property spring.main.allow-circular-references = true. But I would like to fix the circular reference in the first place. Can anyone help me troubleshoot this issue? Please find the WebSecurityConfig class below,

@Configuration
@EnableWebSecurity
@SuppressWarnings({"PMD.SignatureDeclareThrowsException"})
public class WebSecurityConfig extends WebSecurityConfigurerAdapter {
    private final UserDetailsService userDetailsService;

    public WebSecurityConfig(final UserDetailsService userDetailsService) {
        this.userDetailsService = userDetailsService;
    }

    @Bean
    public BCryptPasswordEncoder bcryptPasswordEncoder() {
        return new BCryptPasswordEncoder();
    }

    @Override
    protected void configure(final HttpSecurity http) throws Exception {
        http
                .authorizeRequests()
                    .antMatchers("/resources/**", "/registration", "/css/**", "/js/**", "/h2-console/*").permitAll()
                    .anyRequest().authenticated().and()
                .formLogin()
                    .loginPage("/login").permitAll().and()
                .headers()
                    .frameOptions().sameOrigin().and()
                .logout()
                    .permitAll().and()
                .requiresChannel()
                    .requestMatchers(r -> r.getHeader("X-Forwarded-Proto") != null)
                    .requiresSecure();
    }

    @Autowired
    public void configureGlobal(final AuthenticationManagerBuilder auth) throws Exception {
        auth.userDetailsService(userDetailsService).passwordEncoder(bcryptPasswordEncoder());
    }
}

My code is open-sourced and can be found at https://github.com/surajcm/Poseidon, I will try to troubleshoot on my own and will share the updates if I am able to resolve this issue

ANSWER

Answered 2021-Dec-07 at 19:14

The problem is the password encoder. It is required to build the auto-configured UserDetailsService that you inject in the contructor of the class.

You can break the cycle by making the bean factory method static:

@Bean
public static BCryptPasswordEncoder bcryptPasswordEncoder() {
    return new BCryptPasswordEncoder();
}

You can also move the factory method to different configuration class. But in my opinion, your WebSecurityConfig is the canonical place for the method.

Source https://stackoverflow.com/questions/70254555

QUESTION

Jenkins PMD details from docker: Copying the source file failed

Asked 2022-Jan-20 at 15:45

I'm running Jenkins maven task inside docker image. My task generates pmd.xml which is then parsed by Jenkins plugin.

The problem is that path inside docker image is different that Jenkins workspace. This results in PMD view to crash when redirecting to source. pmd.xml with absolute paths looks like this:

<?xml version="1.0" encoding="UTF-8"?>
<pmd xmlns="http://pmd.sourceforge.net/report/2.0.0"
    xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    xsi:schemaLocation="http://pmd.sourceforge.net/report/2.0.0 http://pmd.sourceforge.net/report_2_0_0.xsd"
    version="6.21.0" timestamp="2021-09-28T09:14:56.411">
<file name="/usr/src/mymaven/mymodule/src/main/java/my/org/MyFile.java">
<violation beginline="124" endline="124" begincolumn="40" endcolumn="145"> 
...
</violation>
</file>
</pmd>

Jenkins error:

Copying the source file '/usr/src/mymaven/...' from the workspace to the build folder 'xxxxx.tmp' on the Jenkins master failed.
If you are building on a slave: please check if the file is accessible under '$JENKINS_HOME/[job-name]//usr/src/mymaven/...

I want to achieve relative paths in my pmd.xml report, in this case it would be:

...
<file name="mymodule/src/main/java/my/org/MyFile.java">
...

How can I achieve relative paths using maven-pmd-plugin plugin?

                <groupId>org.apache.maven.plugins</groupId>
                <artifactId>maven-pmd-plugin</artifactId>
                <version>3.13.0</version>

Is there any other way to solve displaying pmd details in source code for Jenkins build inside docker?

UPDATE: Adding docker-compose.yml snippet

version: "3.7"
services:
  maven:
    image: maven:3-openjdk-11-slim
    volumes:
      - .:/usr/src/mymaven
    command:
      [ "mvn",
        "clean",
        "install",
        "pmd:pmd"
      ]
...

ANSWER

Answered 2022-Jan-20 at 15:45

I solved the problem by changing docker volume mount point to Jenkins WORKSPACE path.

...
   volumes:
      - "${WORKSPACE}:${WORKSPACE}"
...

Source https://stackoverflow.com/questions/69359827

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install pmd

Download the latest binary zip from the releases and extract it somewhere. Execute bin/run.sh pmd or bin\pmd.bat. See also Getting Started. This shows how PMD can detect for loops, that can be replaced by for-each loops. There are plugins for Maven and Gradle as well as for various IDEs. See Tools / Integrations.

Support

How do I? -- Ask a question on StackOverflow or on discussions.I got this error, why? -- Ask a question on StackOverflow or on discussions.I got this error and I'm sure it's a bug -- file an issue.I have an idea/request/question -- create a new discussion.I have a quick question -- ask on our Gitter chat.Where's your documentation? -- https://pmd.github.io/latest/