I'm so tired of these job search sites not respecting the search terms I enter. What is a good way to web scrap them so that I can do my own offline filtering.
LinkedIn is the worst. Microsoft inserts their own "Promoted" jobs that don't contain the words I search for and the job title is very generic.
Maybe using Scraping Fish [0]? Per [1], "They [scrapingfish.com] seem to handle all the more annoying parts of web scraping: bypassing anti scraping things such as rate limits and captchas."
what I found interesting is that you can update your amazon recommendations. I remember being able to do that years and years ago, but I thought they took it away.
I think Indeed will have a huge legal risk selling personal data, but it could be scammers pretending to hire just to collect resumes, and of course the personal data of the applicant.
Most of the time, I've used local recruiting companies. I've had long standing relationships with several firms and they've always gotten me good gigs. Once C19 hit and companies started taking applications from everybody since remote work was the thing, I applied for a few roles on Indeed since a buddy had good luck with it.
Keep in mind, I never used any other platform like this. I never heard back from the two companies I applied to. But holy jesus and the mary chain after a few weeks I was suddenly getting up to a dozen emails a day from recruiters in India about all kinds of positions all over the country. Most of these places were sketchy AF. After trying to find some of them online, most just pointed back to a company profile on LinkedIn.
I figured I would answer a few just out of curiosity to see if what I thought was going on, was going on. The first two I answered, the recruiters immediately asked for my social and a copy of my driver's license "for verification" to prove it was me that was actually applying and interviewing.
Those two interactions alone confirmed that Indeed most likely had sold my information to either scammers or extremely sketchy recruiting companies who were making money selling their own lists to other recruiting companies.
To this day, I'm still deleting and blocking these companies - YEARS after deleting my account on Indeed.
OK now I know why some DB salesmen are calling me these days. Either Indeed or LinkedIn. I need to change my Indeed phone number to maybe a police station's.
Indeed keeps getting worse. I had the misfortune of needing to use their video conferencing product in an interview and no one could get it to work correctly so a zoom link was shared instead.
There are a number of services that provide recruiter tools for scraping potential candidate contact data into their CRM’s and candidate management / lead tools.
So if you ever share your details with a recruiter on LinkedIn for example, and they scrape it, then other recruiters who also use these services now also have access to your number.
I was puzzled how receuiters were getting my number. I’d only shared it with a few recruiters two years previously, and now was getting calls from random recruiters. One of them admitted to me that this was why.
Also, the linked reddit thread contains no concrete evidence of the alleged privacy breach in the title. This may be a candidate for re-titling / removal.
17 comments
[ 3.2 ms ] story [ 47.6 ms ] threadLinkedIn is the worst. Microsoft inserts their own "Promoted" jobs that don't contain the words I search for and the job title is very generic.
Maybe using Scraping Fish [0]? Per [1], "They [scrapingfish.com] seem to handle all the more annoying parts of web scraping: bypassing anti scraping things such as rate limits and captchas."
I think the trash they recommend is due to somebody’s bad recommendation algorithm similar to Amazon’s “you want another mattress?” problem.
but it is still there, just hard to navigate to: https://www.amazon.com/gp/yourstore/iyr/
There is even still a list of "not interested" put I don't seem to be able to find the UI to add things to that list.
Most of the time, I've used local recruiting companies. I've had long standing relationships with several firms and they've always gotten me good gigs. Once C19 hit and companies started taking applications from everybody since remote work was the thing, I applied for a few roles on Indeed since a buddy had good luck with it.
Keep in mind, I never used any other platform like this. I never heard back from the two companies I applied to. But holy jesus and the mary chain after a few weeks I was suddenly getting up to a dozen emails a day from recruiters in India about all kinds of positions all over the country. Most of these places were sketchy AF. After trying to find some of them online, most just pointed back to a company profile on LinkedIn.
I figured I would answer a few just out of curiosity to see if what I thought was going on, was going on. The first two I answered, the recruiters immediately asked for my social and a copy of my driver's license "for verification" to prove it was me that was actually applying and interviewing.
Those two interactions alone confirmed that Indeed most likely had sold my information to either scammers or extremely sketchy recruiting companies who were making money selling their own lists to other recruiting companies.
To this day, I'm still deleting and blocking these companies - YEARS after deleting my account on Indeed.
So if you ever share your details with a recruiter on LinkedIn for example, and they scrape it, then other recruiters who also use these services now also have access to your number.
I was puzzled how receuiters were getting my number. I’d only shared it with a few recruiters two years previously, and now was getting calls from random recruiters. One of them admitted to me that this was why.
Takeaway: use a throwaway number for recruiters.
Also, the linked reddit thread contains no concrete evidence of the alleged privacy breach in the title. This may be a candidate for re-titling / removal.