selectolax | Python binding to Modest engine | Parser library

You need to use Series.apply to apply your parsing on each cell of the column. Here's an example, use your own logic in parse_cell method

Try to use text method it will work string does not work if it has multiple tags in it

You should use a list to store multiple Info instances, then return them all

The universal answer for performance questions is : measure then decide.

You ask two questions.

I would think so, but in a very negligeable way. Except if the computer running this code is very constrained, the difference would be barely noticeable (on the order of <1 second at startup time, and a few dozens of megabytes of RAM).

You can test it quickly by duplicating your sydsvenskan.py file 40 times, importing each of them in your scraper.py and running time python scraper.py before and after.

And in general, prefer doing simple things. Static imports are simpler than dynamic ones.

Simply put : yes. I tested to put it in a function and it worked fine :

Ok I understand what you're looking for. And sorry to say you're out of luck. At least as far as my knowledge of python goes. You can do it two ways.

1. Use importlib to search through a folder/package tha contains those files and imports them into a list or dict to be retrieved. However you said you wanted to avoid this but either way you would have to use importlib. And #2 is the reason why.

2. Use a Base class that when inherited it's __init__ call adds the Derived class to a list or object that stores it and you can retrieve it via a class object. However the issue here is that if you move your derived class into a new file, that code wont run until you import it. So you would still need to explicitly import the file or implicitly import it via importlib (dynamic import).

So you'll have to use importlib (dynamic import) either way.