Gobuster

Single endpoint:

gobuster dir -u https://192.168.1.1/some-index/ -w /opt/SecLists-master/Discovery/Web-Content/raft-large-directories-lowercase.txt -o 192_168_1_1_some-index -k

List of websites:

while read line;do name=$(echo $line | cut -d '/' -f 3);gobuster -u $line -w /opt/SecLists/Discovery/Web-Content/raft-medium-directories.txt -o $name -k;done < websites.txt