Publishers specifically provide that content however, via techniques like open graph. They already can control how much text or what images are displayed in results. They can also indicate they don't want indexing at all.
Yet they publish articles with the entire headline and backing images marked for free display on Google/Facebook. Almost like they are trying to help the search engines to attract traffic.
Who's banning linking? The new law tried to get tech companies to pay to show the links with previews (similar to Australia and France, etc).
To be clear, the bill is fundamentally broken. It would require Google or Facebook to pay simply when links to news sites are served, rather than for reproducing or condensing the material in the news article as a "preview" sort of be thing (as in other countries). The bill isn't banning links explicitly, but the government should have seen this coming.
> The bill isn't banning links explicitly, but the government should have seen this coming.
Perhaps they could have listened when the two companies they are trying to impose this on provide suggestions - or maybe modeled it more closely after legislation in other countries where such media taxes have been successful.
But they could easily opt out with robots.txt. They want to have their cake and eat it too. They want the free traffic from search engines AND want google to pay them for the privilege of bringing them traffic.
robots.txt is not an actual Internet standard, and there are no standard controls for when a bot ignores its contents. You're on your own to protect your pages.
Granted, I have `disallow: /` in mine because I don't want my stuff scraped, but I still see Googlebot sometimes, and others, try to crawl my site.
It's not a very effective opt-out, because it requires the 'attacker' to honor the file's settings.
Feel free to enable it on your own server and watch the logs for a few days after sharing some links.
That's like demanding that Rand McNally pay a fee to each city they print onto their maps. Or demanding that World Book Encyclopedia pay a royalty fee to every entity they write an article about.
Noting that something exists and including it in reference material should by no means incur royalties.