try-puppeteer | Run Puppeteer code in the cloud | Automation library

Aw man, I have been trying to work with this for a long time and I'm so stuck.

I need to walk a series of DOM objects, and extract info from each using XPath selectors. My source HTML does not have any identifying IDs or classes on its elements so there's a lot of walking.

Here's some (very simplified) sample code. The goal is to get a list of LI elements, then use more selectors on each of the elements to extract the names inside the spans.

Simplified sample code: (https://try-puppeteer.appspot.com/)

I am trying out Puppeteer. This is a sample code that you can run on: https://try-puppeteer.appspot.com/

The problem is this code is returning an array of empty objects:

[{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{}]

Am I making a mistake?

I am trying to generate pdf with multiple iframes using puppeteer. One issue I encounter is that if I embed something like google maps, google maps will do lazily load(it only loads when the element is in view point of the browser. One solution is to scroll through different iframes on the page and set a wait time for each iframe to load.

here is what I have so far (able to test in https://try-puppeteer.appspot.com/) puppeteer: version 1.9.0, I also tried in 1.12.0, could not make the scroll to work nor the timeout.

I'm using puppeteer to generate pdf of a web page. But the issue is table heading is not appearing in all the pages. Please find the code below.

The function setValue receives a value and returns a function. Inside the second function I'm trying to console log the value of value but I get

I have the following setup:

Angular Front-end
MongoDb database
NodeJS/Express backend for API (+ puppeteer)

steps to deployment:
1. ng build -prod --> creates dist in /server
2. gcloud app deploy (Node.js + Express + Puppeteer + Dockerfile config*)

Because puppeteer is basically chrome; some libraries which aren't given to me, had to be uploaded. No problem, Docker to the rescue.

I am trying to modify this build: https://github.com/ebidel/try-puppeteer

I noticed that there are 2 package.json (and server.js) files.

1. root (https://github.com/ebidel/try-puppeteer/blob/master/package.json)

2. backend (https://github.com/ebidel/try-puppeteer/blob/master/backend/package.json)

Why do they deploy the backend and front end separately, with 2 express servers? Is this best practice? Design overkill?

What is the purpose of having two server.js files (or two servers) in one project?

Does it have a hierarchy system I overlooked?

Additionally, how do I deploy this project? from root of from backend?

I’m trying check if elements are available on a page from within a function, if the element is on the page, good, continue with the code, if not, log the error.

Using the try puppeteer page, here is what I tried: