dmi3kno / polite

Be nice on the web

Home Page:https://dmi3kno.github.io/polite/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

bow() missing default error in robotstxt

MHWauben opened this issue · comments

When running polite::bow(), I receive the following error:

Error in null_to_defeault(request$headers$`content-type`) : 
  argument "d" is missing, with no default

Reprex:
ons_bow <- polite::bow('https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/populationestimates/datasets/populationestimatesforukenglandandwalesscotlandandnorthernireland')

Sessioninfo:

R version 3.6.3 (2020-02-29)
Platform: x86_64-pc-linux-gnu (64-bit)
Running under: Ubuntu 16.04.6 LTS

Matrix products: default
BLAS:   /usr/lib/atlas-base/atlas/libblas.so.3.0
LAPACK: /usr/lib/atlas-base/atlas/liblapack.so.3.0

locale:
 [1] LC_CTYPE=C.UTF-8       LC_NUMERIC=C           LC_TIME=C.UTF-8        LC_COLLATE=C.UTF-8     LC_MONETARY=C.UTF-8   
 [6] LC_MESSAGES=C.UTF-8    LC_PAPER=C.UTF-8       LC_NAME=C              LC_ADDRESS=C           LC_TELEPHONE=C        
[11] LC_MEASUREMENT=C.UTF-8 LC_IDENTIFICATION=C   

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base     

other attached packages:
[1] rvest_0.3.5  xml2_1.3.2   polite_0.1.1

loaded via a namespace (and not attached):
 [1] here_0.1         digest_0.6.25    rprojroot_1.3-2  assertthat_0.2.1 R6_2.4.1         backports_1.1.7  magrittr_1.5    
 [8] httr_1.4.1       rlang_0.4.6      fs_1.4.1         robotstxt_0.7.4  ratelimitr_0.4.1 tools_3.6.3      glue_1.4.1      
[15] compiler_3.6.3   memoise_1.1.0    usethis_1.6.1   

This is issue in robotstxt. Thanks for catching it. I will pass it on immediately. Stay tuned for update.

Ok, the patch has been merged into robotstxt. Can you please reinstall the package and try again.
remotes::install_github("ropensci/robotstxt")

We will coordinate pushing to CRAN soon. In the meantime please let me know if there's anything else we can do to help