6 ms·

thanks for taking the time to respond to this. i definitely understand where you're coming from and am glad to hear the robots.txt is being updated.