A quick intro to some new features and how to use them:
- A new function
logs_to_dfto parse and compress any log file - Crawling has a new option to
skip_url_params, which only follows links that don't contain any URL parameters - Crawling extracts all
<img>tag attributes ('alt', 'crossorigin', 'height', 'ismap', 'loading', 'longdesc', 'referrerpolicy', 'sizes', 'src', 'srcset', 'usemap', and 'width' ) - The
url_to_dffunction extracts a new columnlast_dirshowing the last directory of the path part of each URL, typically the title of the page, or product name
Play with the new features now:
