Web scraping/parsing/crawling

1

Hey.
I’m doing web parsing/scraping/crawling using python in VS Code via BeautifulSoup library.
Is it possible to do the same thing using python node in dymamo?

If yes, can i copy paste the python code from VS to dynamo? Or there’s some difference in the libraries?

2

I believe that should be doable but I haven’t tried it myself.

There are some differences in syntax between VS and IronPython or Python.net, so you’ll have to modify things but the base concepts should work.

1 Like
3

Hello,
BeautifulSoup is a pure Python library (and compatible 2.7), so it is compatible with both Python engines

example with IronPython2

test bs4 ipy
test bs4 ipy1363×720 89.8 KB

example with CPython3 + PythonNet

test bs4 pyNet
test bs4 pyNet1398×726 134 KB

here is another solution without external library with the Microsoft mshtml module
example with CPython3 + PythonNet and IronPython2

test with mshtml
test with mshtml1495×786 94.7 KB

8 Likes
4

thanks poupin, that solves things for me, will be seeking help if needed! :heart_eyes:

1 Like