puppeteer-extra | 💯 Teach puppeteer new tricks through plugins | Automation library

 by   berstend JavaScript Version: 3.3.6 License: MIT

kandi X-RAY | puppeteer-extra Summary

kandi X-RAY | puppeteer-extra Summary

puppeteer-extra is a JavaScript library typically used in Automation, Docker applications. puppeteer-extra has no bugs, it has no vulnerabilities, it has a Permissive License and it has medium support. You can install using 'npm i puppeteer-extra-shaheen' or download it from GitHub, npm.

Teach puppeteer new tricks through plugins.
Support
    Quality
      Security
        License
          Reuse

            kandi-support Support

              puppeteer-extra has a medium active ecosystem.
              It has 5253 star(s) with 658 fork(s). There are 113 watchers for this library.
              There were 1 major release(s) in the last 12 months.
              There are 162 open issues and 431 have been closed. On average issues are closed in 78 days. There are 19 open pull requests and 0 closed requests.
              It has a neutral sentiment in the developer community.
              The latest version of puppeteer-extra is 3.3.6

            kandi-Quality Quality

              puppeteer-extra has 0 bugs and 0 code smells.

            kandi-Security Security

              puppeteer-extra has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.
              puppeteer-extra code analysis shows 0 unresolved vulnerabilities.
              There are 0 security hotspots that need review.

            kandi-License License

              puppeteer-extra is licensed under the MIT License. This license is Permissive.
              Permissive licenses have the least restrictions, and you can use them in most projects.

            kandi-Reuse Reuse

              puppeteer-extra releases are not available. You will need to build from source code and install.
              Deployable package is available in npm.
              Installation instructions are not available. Examples and code snippets are available.
              puppeteer-extra saves you 23 person hours of effort in developing the same functionality from scratch.
              It has 64 lines of code, 0 functions and 127 files.
              It has low code complexity. Code complexity directly impacts maintainability of the code.

            Top functions reviewed by kandi - BETA

            kandi has reviewed puppeteer-extra and discovered the below as its top functions. This is intended to give you an instant insight into puppeteer-extra implemented functionality, and help decide if they suit your requirements.
            • Return a promise with an event handler .
            • recursive recursively
            • Test function
            • patch eval eval
            • Creates a new object from iterable .
            • Convert a number to a string .
            Get all kandi verified functions for this library.

            puppeteer-extra Key Features

            No Key Features are available at this moment for puppeteer-extra.

            puppeteer-extra Examples and Code Snippets

            puppeteer-extra-plugin-proxy,Usage
            JavaScriptdot img1Lines of Code : 30dot img1License : Permissive (MIT)
            copy iconCopy
            // puppeteer-extra is a drop-in replacement for puppeteer,
            // it augments the installed puppeteer with plugin functionality
            const puppeteer = require('puppeteer-extra');
            // require proxy plugin
            const pluginProxy = require('puppeteer-extra-plugin-prox  
            Usage Mixed with puppeteer-extra
            TypeScriptdot img2Lines of Code : 22dot img2License : Permissive (MIT)
            copy iconCopy
            import { pageExtend, PageEx } from 'puppeteer-jquery'
            import puppeteer from 'puppeteer-extra';
            import StealthPlugin from 'puppeteer-extra-plugin-stealth'
            puppeteer.use(StealthPlugin())
            
            const page1 = 'https://recaptcha-demo.appspot.com/recaptcha-v3-r  
            puppeteer-extra-plugin-proxy,Install
            JavaScriptdot img3Lines of Code : 6dot img3License : Permissive (MIT)
            copy iconCopy
            yarn add puppeteer-extra-plugin-proxy
            # - or -
            npm install puppeteer-extra-plugin-proxy
            
            yarn add puppeteer puppeteer-extra puppeteer-extra-plugin-proxy
            # - or -
            npm install puppeteer puppeteer-extra puppeteer-extra-plugin-proxy
              
            How to import module based dependencies for firebase cloud functions?
            TypeScriptdot img4Lines of Code : 14dot img4License : Strong Copyleft (CC BY-SA 4.0)
            copy iconCopy
            import puppeteer from "puppeteer-extra"
            
            const defaultExport: PuppeteerExtra = (() => {
              return new PuppeteerExtra(...requireVanillaPuppeteer())
            })()
            
            export default defaultExport
            
            // jav

            Community Discussions

            QUESTION

            TypeError: response.postData is not a function
            Asked 2022-Mar-27 at 22:06

            My code below gives the error "TypeError: response.postData is not a function".

            ...

            ANSWER

            Answered 2022-Mar-26 at 20:02

            Reading into the Response type definition for Puppeteer, it looks like you have other methods you can use.

            Either await response.json() or (await response.buffer()).toString()

            Source https://stackoverflow.com/questions/71631340

            QUESTION

            how to solve this Error in Puppeteer i try to FillUp form using Puppeteer
            Asked 2022-Mar-24 at 05:50

            how to solve this Error in Puppeteer i try to FillUp form using Puppeteer

            ...

            ANSWER

            Answered 2022-Mar-23 at 13:17

            Make sure you await closing the page or browser and that subsequent instances are called synchronously. https://github.com/puppeteer/puppeteer/issues/1947

            Source https://stackoverflow.com/questions/71587830

            QUESTION

            How to click on an a tag who's text matches a given string puppeteer
            Asked 2022-Mar-01 at 01:52

            I am trying to write a purchasing bot for supreme website as a way to teach myself javascript and pupetteer. I am having trouble finding a way to click on the item that contains the text that is given as an argument in the function. Here is what I am trying

            '''

            ...

            ANSWER

            Answered 2022-Mar-01 at 01:12

            page.$x should be a function I think so something else is going wrong there.

            You can also do something like:

            Source https://stackoverflow.com/questions/71302531

            QUESTION

            Node puppeteer scraping YouTube and encountering redirected you too many times
            Asked 2022-Feb-16 at 08:29

            I'm trying to scrape a YouTube playlists URL using Node / puppeteer. It was working, but now I'm getting ERR_TOO_MANY_REDIRECTS error. I can still access the page using chrome from my desktop.

            I've tried using the chromium browser and chrome browsers. I've also tried using the puppeteer-extra stealth plugin and the random-useragent.

            This is how my code stand at the moment:

            ...

            ANSWER

            Answered 2022-Feb-16 at 08:29

            If all you need is playlist IDs for a given channel, it's possible to query a feed at:

            Source https://stackoverflow.com/questions/70984345

            QUESTION

            Node.js: how to restart Tor client
            Asked 2021-Dec-14 at 13:51

            I have a simple script that use Puppeteer and Tor client to navigate the web with differents IPs:

            ...

            ANSWER

            Answered 2021-Dec-14 at 13:51

            I think the Error isnt about restarting its about evaluation of the website?!

            Edit wow thanks for so many dislikes next time you get no answer with your best designed and if you could read:

            Source https://stackoverflow.com/questions/70347639

            QUESTION

            puppeteer.use(....) is not function error in Puppeteer - Nodejs
            Asked 2021-Oct-31 at 21:21

            So I'm trying to run my code but it shows this error message:-

            ...

            ANSWER

            Answered 2021-Sep-07 at 12:31

            Add a ; before the (async, otherwise you'd be writing a function call on the expression from the previous line. I'd suggest using a linter so you get a warning about that in the future (see https://eslint.org/docs/rules/semi and https://eslint.org/docs/rules/no-unexpected-multiline).

            To illustrate the issue with a simplified piece of code:

            Source https://stackoverflow.com/questions/69087948

            QUESTION

            Why is Puppeteer-Extra's solveRecaptchas() "not a function"?
            Asked 2021-Oct-17 at 11:25

            I am attempting to use Puppeteer and puppeteer-extra-plugin-recaptcha through Apify to solve the Recaptcha on a login page.

            In time, I will want to do the full login. For now, I am attempting to do the Recaptcha solution, using Google's demo. puppeteer-extra-plugin-recaptcha taps up the 2captcha service via API key to do the solving.

            Unfortunately, in my code, the important solveRecaptchas() throws an error:

            ...

            ANSWER

            Answered 2021-Oct-17 at 11:25

            This might be an omission from the example you provided, but it seems that you're not calling the addPlugins() function anywhere and therefore the plugin is not used at all.

            Source https://stackoverflow.com/questions/69603481

            QUESTION

            heroku deploy not working when local build works fine - NodeJS Timeout
            Asked 2021-Oct-13 at 13:08

            Title says it really - i can build locally but it fails to deploy. Has an issue with Timeout - not sure how to force this to work?

            Here's my package.json, and the logs afterwards.

            I tried adding Timeout by running a yarn install but then it triggered some other dependency issues with node-gyp

            Many thanks for any tips!

            Package.json

            ...

            ANSWER

            Answered 2021-Oct-13 at 13:08

            The problem seems to be missing types, here are two possible fix:

            1. Install @types/node as a devDependencies. This package contains types for NodeJS, including the Timeout type.

            2. Edit your tsconfig.json to set skipLibCheck to true:

            Source https://stackoverflow.com/questions/69555933

            QUESTION

            How to reduce Puppeteer size
            Asked 2021-Oct-07 at 12:43

            I'm using Puppeteer for webscraping, with a small NodeJs webapp that I made. This webapp is hosted on Heroku and use jontewks/puppeteer-heroku-buildpack to works.

            The problem I'm facing is that my app do not build anymore because of the Heroku size limit:

            ...

            ANSWER

            Answered 2021-Oct-07 at 12:43

            Finally, I end up using Playwright.

            With this Buildpack, the build of my app is only 250Mb!

            Here's a few steps I've followed:

            • Install with NPM playwright-chromium to only download Chromium.

            • Set PLAYWRIGHT_BUILDPACK_BROWSERS env variable to chromium in Heroku to only install Chromium dependencies.

            • Put this buildpack before Node.js buildpack in Heroku.

            • With this trick you can use most of the of stuff from puppeteer-stealth.

            • If you want, you can block resources like in Puppeteer:

            Source https://stackoverflow.com/questions/69428179

            QUESTION

            Bypass Cloudflare's captcha with headless chrome using puppeteer on Heroku
            Asked 2021-Aug-28 at 21:45

            Im trying to access a site with headless chrome using puppeteer on Heroku. My setup works when I try it locally on my machine, but when trying it mounted on Heroku I get something like this:

            I understand that puppeteer comes with javascript enabled by default and for what I've read it looks like it has nothing to do with that.

            Im using puppeteer-extra-plugin-stealth, random-useragent and viewport randomization but nothing seems to work.

            Could it be that puppeteer and/or chrome is adding extra stuff when running locally vs on Heroku?

            Here's my setup:

            ...

            ANSWER

            Answered 2021-Aug-28 at 21:45

            I managed to fix my issue following Raphael PICCOLO's comment on how IP addresses might get detected. Nothing extra was being added or removed by my machine or Heroku, it was just the IP.

            I used a proxy which required proxy-chain in order to avoid getting net::ERR_NO_SUPPORTED_PROXIES error.

            My code ended up something like this:

            Source https://stackoverflow.com/questions/68930114

            Community Discussions, Code Snippets contain sources that include Stack Exchange Network

            Vulnerabilities

            No vulnerabilities reported

            Install puppeteer-extra

            You can install using 'npm i puppeteer-extra-shaheen' or download it from GitHub, npm.

            Support

            PRs and new plugins are welcome! The plugin API for puppeteer-extra is clean and fun to use. Have a look the PuppeteerExtraPlugin base class documentation to get going and check out the existing plugins (minimal example is the anonymize-ua plugin) for reference. We use a monorepo powered by Lerna (and yarn workspaces), ava for testing, the standard style for linting and JSDoc heavily to auto-generate markdown documentation based on code. :-).
            Find more information at:

            Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items

            Find more libraries
            Install
            Maven
            Gradle
            CLONE
          • HTTPS

            https://github.com/berstend/puppeteer-extra.git

          • CLI

            gh repo clone berstend/puppeteer-extra

          • sshUrl

            git@github.com:berstend/puppeteer-extra.git

          • Stay Updated

            Subscribe to our newsletter for trending solutions and developer bootcamps

            Agree to Sign up and Terms & Conditions

            Share this Page

            share link