Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
spurgu
on Feb 10, 2019
|
parent
|
context
|
favorite
| on:
Brave browser can inject headers in HTTP requests
If you don't have an "officially recognized" UA string some websites will assume you're a scraper/crawler/bot/ and rightfully so.
ndnxhs
on Feb 11, 2019
|
next
[–]
If I was ever trying to scrape a website that blocked my user agent I would just set the user agent to chrome on windows. Every library I have used supports setting whatever UA you want.
threatofrain
on Feb 10, 2019
|
prev
[–]
That's just a heuristic of the times. Soon bots will be much smarter than that.
seba_dos1
on Feb 10, 2019
|
parent
[–]
They already are.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: