VIPnytt / RobotsTxtParser

An extensible robots.txt parser and client library, with full support for every directive and specification.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Allow / Disallow interpretation problem with override

ndcreatif opened this issue · comments

Hello,
I hope you are well
The following code gives me "forbidden" when it should give me "allowed".

`<?php
$client = new vipnytt\RobotsTxtParser\TxtClient('https://www.energiedin.ma/', 200, 'User-agent: *
Allow: /
Disallow: /dslc_downloads_tag/
Disallow: /blog/
Disallow: /amp/nos-realisations/
Disallow: /amp/blog/
Disallow: /dslc_partners_cats/
Disallow: /dslc_projects_cats/
Disallow: /dslc_staff_cats/
Disallow: /dslc_downloads_cat/
Disallow: /wp-content/uploads/*.pdf
Disallow: /project-view/
Disallow: /request-a-free-seo-analysis/
Disallow: /resources/
Disallow: /about/
Disallow: /contact-us/
Disallow: /case-studies/
Disallow: /clients/
Disallow: /livecomposer/
Disallow: /wp-admin/
Disallow: /author/
Disallow: /nos-services/
Disallow: /avis-de-nos-clients/
Disallow: /autres-specialites/
Disallow: /avis-de-nos-clients/
Disallow: /avis-de-nos-clients/
Disallow: /wp-content/uploads/fz.jpg
Disallow: /wp-content/uploads/me.jpg
Disallow: /wp-content/uploads/fi.jpg
Disallow: /wp-content/uploads/mg.jpg
Disallow: /nv-site

Disallow: /dev/
Allow: /dev/[STAR].css
Allow: /dev/[STAR].jpg
Allow: /dev/[STAR].png
Allow: /dev/[STAR].svg
Allow: /dev/[STAR].js
Allow: /dev/[STAR].webp
Sitemap: https://www.energiedin.ma/sitemap.xml

Disallow: https://www.energiedin.ma/assets/images/Personnes/OL.jpg
Disallow: https://www.energiedin.ma/assets/images/Personnes/Mustapha-Oumoussa-1.jpg
Disallow: https://www.energiedin.ma/assets/images/Personnes/me.jpg

Disallow: https://www.energiedin.ma/dev/assets/webp/t-8.webp
Disallow: https://www.energiedin.ma/assets/images/Personnes/mg.jpg');

if ($client->userAgent('GoogleBot')->isDisallowed('https://www.energiedin.ma/dev/assets//img/b-3.jpg')) {
echo 'interdit';
} else {

echo 'autorisé';

}
exit();

?>`

[STAR] = *
Github deletes my *.