How much do web scraping jobs pay?

Is it legal to scrape a website for info?

I'm building an application and I need to retrieve info from a website that contains a forum. The info I want to gather is the last post (as viewed by the user on the website) and the comments below it.

The website is. So, the URL I want to scrape looks like this: There are multiple threads. I know the information I want is inside of this

and I can identify the class name as "lastFeedComment", "comment-container". From looking at this web page, it seems like the code is generated by the website itself. Is it ok to use a program to pull out this information? Is it illegal? Can they tell if I am scraping their site? Also, some of the posts are very lengthy and require you to click in order to scroll down. Is there a way to only scrape the portion of the post that is visible in the current view? Is it necessary to post code to help with answering the question? Thanks for any info. Yes, it is legal, however they have to disclose that fact somewhere on their site. Yes, you can do that if you don't post anything but images. No, you don't want to grab the whole thing at once, otherwise the full page will take long time to load and there's no way for you to be sure that the data you download is the one you actually need. As for scraping, I doubt the person who built this has any problem with that. They probably have some scripts that do that for them.

How much do web scraping jobs pay?

Hey all, I'm a recent college graduate with a degree in computer science. I'm interested in web scraping and want to know how much I can realistically expect to make. It's not just for me, I have a few friends who are interested as well. I'm not looking for hourly rates, but rather long term averages.

Thanks! Last edited by natejr on Wed Dec 21, 2023 6:54 pm, edited 1 time in total. Tue Jan 02, 2023 8:37 am. Jamesbondage. Joined: Mon Jul 25, 2023 3:36 pmPosts: 1852. Re: ? If you're going to be scraping websites, it's likely that you'll need to register as a reseller on sites like eNom and GoDaddy. You'll also need to register a domain name, which will cost you. With a reseller account, you'll get access to the reseller dashboard, where you can see your monthly payment history and all of the domains you've sold.

That's what I figured, thanks! Wed Jan 03, 2023 4:21 pm. Joined: Wed Nov 30, 2023 9:15 pmPosts: 20. Thanks James! I've been thinking about doing this as a side business. I think I'll go with one of the bigger companies for now.

My question is, are there any major factors that would make one company better than the other for this type of job? I'm assuming that there are better companies out there for this type of work, but I'm wondering if anyone here has any insight on the topic. Thanks!

Can you get a job with web scraping?

I have a client who wants me to scrape all of her client's emails and send them. I have never used Python so I am really struggling to try to find a way I can start this kind of a project using python as my tool and I was wondering if I could get some help.

Sure you can, web scraping is very simple (especially when compared to parsing the HTML), but bear in mind it won't be able to tell you everything about a page.