I was wrong about robots.txt

I was wrong about robots.txt

Recently, I wrote an article about my journey in learning about robots.txt and its implications on the data rights in regards to what I write in my blog. I was confident that I wanted to ban all the c...