[–] eimrine 3y ago ↗ Does he ignore robots.txt file? [–] plondon514 3y ago ↗ > Updates include following robots.txt and identifying user agents so sites can control how ChatGPT interacts with them.
[–] plondon514 3y ago ↗ > Updates include following robots.txt and identifying user agents so sites can control how ChatGPT interacts with them.
3 comments
[ 5.2 ms ] story [ 24.1 ms ] thread