Be Mindful, you use the robots.txt generator at your own personal possibility. It is recommended to validate that the robots file would not exclude pages by miscalculation. There are several tools to test this much like the Google tool. Making a robots.txt file Together with the AdLift Robots.txt Generator is https://seotoolstube.com/