Where Can My Robot Go?
30 points Easy

Where do robots find what pages are on a website?

Hint:

What does disallow tell a robot?

Flag
Miscellaneous ยท intelagent
28722 solves
Rating 4.56
5
4
3
2
1
Must solve to rate

Discussion

avatar
F35_king

3 weeks ago

Reply Share

.

0
avatar
Msvb

3 months ago

Reply Share

def4lt.json

0
avatar
Msvb

3 months ago

Reply Share

def4lt.json

0
avatar
Jay_vixer

3 months ago

Reply Share

howwwwww

0
avatar
Ninjaflowx0

4 months ago

Reply Share

robots.txt?

0
avatar
SatoriSec

4 months ago

Reply Share

Robots are found in the root of a website

0
avatar
ZadeM

5 months ago

Reply Share

well had to think for a min

0
avatar
ZadeM

5 months ago

Reply Share

well had to think for a min

0
avatar
WormBomb

9 months ago

Reply Share

This one is very neat!

0
avatar
jerryolubunmi

9 months ago

Reply Share
Protected
0