beautifulsoup4

There are 13 repositories under beautifulsoup4 topic.

• MakiNaruto / Automatic_ticket_purchase

  大麦网抢票脚本

  beautifulsoup4python3requestsselenium
  Language:Python 3757
• JobFunnel

  PaulMcInnis / JobFunnel

  Scrape job websites into a single spreadsheet with no duplicates.

  jobssearchindeedmonsterglassdoorscraperjobautomatedcsvbeautifulsoupbeautifulsoup4pythontfidfyamlwaterloointernational
  Language:Python 1746

• lb2281075105 / Python-Spider

  豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章

  pythonspiderredismysqlmongodbcrawlspiderscrapybeautifulsoup4seleniumxpathdjangopymysqlitchatweichat
  Language:Python 767

• mariosemes / PornHub-downloader-python

  Download stuff from PH the easy way.

  pythonpython3pornhubpornhub-downloaderyoutube-dlyoutube-dl-wrapperdownloaderorginizereasy-to-usebeautifulsoup4prettytable
  Language:Python 747

• SocialSisterYi / CxKitty

  超星学习通答题姬（视频文档观看、模拟答题，无需浏览器、无需油猴，容器/host 运行ok！

  beautifulsoup4chaoxingchaoxingmoocpython3spiderterminal-uixuexitong
  Language:Python 582

• pcomputo / Whole-Foods-Delivery-Slot

  Automated script for Whole Foods and Amazon Fresh delivery slot

  automationselenium-pythonbeautifulsoup4webdriveramazonwholefoodscartfirefox-scriptchromepython
  Language:Python 445

• roniemartinez / dude

  dude uncomplicated data extraction: A simple framework for writing web scrapers using Python decorators

  asyncbeautifulsoup4crawlercssframeworklxmlparselplaywrightpythonscraperscrapingseleniumsyncweb-scrapingwebscrapingxpath
  Language:Python 412

• sskender / pornhub-api

  Unofficial API for PornHub.com in Python

  apibeautifulsoupbeautifulsoup4parserpippip3pornporn-downloadporn-websitepornhubpornhub-apipornhub-downloaderpornhubapipornopornographyproxypython
  Language:Python 373

• brutalsavage / facebook-post-scraper

  Facebook Post Scraper 🕵️🖱️

  facebook-scraperfacebook-scraper-softwarefacebook-scraper-toolpythonbeautifulsoup4selenium-webdriver
  Language:Python 298

• lkuffo / web-scraping

  Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup

  scrapingscraping-pythonscraping-websiteswebscrapingscrapping-pythonselenium-webdriverselenium-pythonlxml-etreescrapyscrapy-crawlerscrapy-spiderbeautifulsoup4beautifulsoupseleniumweb-scraping
  Language:Python 296

• lb2281075105 / Python-WeChat-ItChat

  微信机器人，基于Python itchat接口功能实例展示：01-itchat获取微信好友或者微信群分享文章、02-itchat获取微信公众号文章、03-itchat监听微信公众号发送的文章、04 itchat监听微信群或好友撤回的消息、05 itchat获得微信好友信息以及表图对比、06 python打印出微信被删除好友、07 itchat自动回复好友、08 itchat微信好友个性签名词云图、09 itchat微信好友性别比例、10 微信群或微信好友撤回消息拦截、11 itchat微信群或好友之间转发消息

  itchatwechatsystemostimebs4beautifulsoup4matplotlibpandasuuidmatplotlib-livejiebanumpypillowecharts
  Language:Python 279

• Trinkle23897 / learn2018-autodown

  清华大学新版网络学堂课程自动下载脚本 / A python script to clone all files from learn.tsinghua.edu.cn

  beautifulsoup4python3requeststqdm
  Language:Python 279

• tirthajyoti / Web-Database-Analytics

  Web scrapping and related analytics using Python tools

  analyticspythonsqlite3xml-parserjsonjson-parsersqlweb-scrapingbeautifulsoup4databaseregular-expressionnlpnatural-language-processingdata-sciencedata-wrangling
  Language:Jupyter Notebook 257

• cwjokaka / ok_ip_proxy_pool

  🍿爬虫代理IP池(proxy pool) python🍟一个还ok的IP代理池

  pythonproxypoolipspidercrawlersqliteflaskaiohttphttpasyncpython3proxypoolpybeautifulsoup4
  Language:Python 245

• bomquote / transistor

  Transistor, a Python web scraping framework for intelligent use cases.

  python-3scrapingrequestslxmlbeautifulsoup4headless-browsersmechanicalsoupframework
  Language:Python 211

• Abhijeet-AR / Competitive_Programming_Score_API

  API to get user details for competitive coding platforms - Codeforces, Codechef, SPOJ, Interviewbit

  api-restapicompetitive-programmingcompetitive-programming-contestscompetitive-codingspojcodeforces-apispoj-apicodeforcescodechefcodechef-apiinterviewbitinterviewbit-apibeautifulsoup4web-scrapingflask
  Language:Python 179

• 0xPrateek / Stardox

  Github stargazers information gathering tool

  stargazerspython3webscrapingbeautifulsoup4information-gathering-toolblackarchblackarch-packagesrecongithubstargazer
  Language:Python 166

• Jimut123 / jimutmap

  API to get enormous amount of high resolution satellite images from satellites.pro quickly through multi-threading! create map your own map dataset. Bringing data to Humans.

  scrapingsatelliteimageshighresolutionapigeosatellite-datamultithreadingenormousdatasetmlscrapebeautifulsoup4fake-headerimagejimutmapareal-imagedeep-learning-datasetsegmentation-mask
  Language:Python 135

• yousefkotp / Movies-and-Series-Scraper

  A console application to scrape a valid watching links for any movie or series with exact season and episode number, you can also download a whole season with one click.

  scraperseriesseries-scrapermovie-scrapperbeautifulsoupbeautifulsoup4moviemoviespythonpython-scraperpython-scrapingpython-scriptscrapingscraping-websites
  Language:Python 114

• sulasoft / Amacapy-Bot-Telegram-Amazon-Affiliates

  Amacapy is a software that does web scraping to the Amazon website and publishes them on Telegram, searches the products by the keyword entered or the direct link of the product. Then you can publish these products on Telegram in a certain time. The technologies used were Flet, Beautiful Soup and Python.

  beautifulsoup4pythontelegramwebscrapingflet-devamazonfletpandas-dataframetelegram-bot
  Language:Python 113

• sakship31 / News-Aggregator

  Django project to scrape a news website using Beautiful soup and display in our template.

  beautifulsoup4requestsdjango-frameworksqlite3python3html-cssbootstrap
  Language:Python 111

• codingforentrepreneurs / Web-Scraping

  Learn how to leverage Python's amazing tools to scrape data from other websites. The end goal of this course is to scrape blogs to analyze trending keywords and phrases. We'll be using Python 3.6, Requests, BeautifulSoup, Asyncio, Pandas, Numpy, and more!

  pythonpython3requestspython-requestsbeautifulsoupbeautifulsoup4scraperweb-scrapingsrapingtutorialjoincfeaysnciopandasnumpy
  Language:Python 108
• WebScrapper

  nuhmanpk / WebScrapper

  Simple and powerfull all in one Telegram Bot to scrap / crawl webpages using Requests, html5lib and Beautifulsoup

  telegram-botwebscrapingrequestsbeautifulsoup4pyrogram-botpyrogramtelegramwebscrappingwebscrapperwebscrapping-pythoncrawlerscraperscrapingweb-scrapinghacktoberfesthacktoberfest-acceptedhacktoberfest2023seleniumcrawler-enginecrawler-python
  Language:Python 100

• aglorice / new_xxt

  学习通,泛雅，超星尔雅，无需浏览器，直接运行（已打包为exe），支持批量导出答案，多用户批量完成作业✨✨✨

  beautifulsoup4chaoxingpythonrequestsrichspiderxxt
  Language:Python 94

• skekre98 / NBA-Search

  flask application designed to explore NBA statistics :basketball:

  flaskpython3javascriptscikit-learnpandasbeautifulsoup4
  Language:Python 76

• tzuhsial / edgar-10k-mda

  Download and extract MDA section from edgar 10k forms

  edgarpython36beautifulsoup4requests
  Language:Python 76

• dimitryzub / scrape-google-scholar-py

  Extract data from all Google Scholar pages from a single Python module. NOTE: I'm no longer maintaining this repo. Chrome driver/selectors might need and update.

  python-3webscrapinggooglescholarserpapibeautifulsoup4requestsselectolaxlexborserpserp-api
  Language:Python 74

• farrael004 / Quest

  This is a web app that integrates GPT-3 with google searches

  beautifulsoup4chatgptgpt-3openaiopenai-apiembeddings-word2vec
  Language:Python 74
• Stock_Market_Data_Analysis

  jcwill415 / Stock_Market_Data_Analysis

  Scrape, analyze & visualize stock market data for the S&P500 using Python. Build a basic trading strategy using machine learning to assess company performance and determine buy, sell, hold. Read me & instructions available in Spanish. This is a working repo, with plans to expand the project from technical analysis to fundamental analysis.

  beautifulsoup4data-manipulationdata-visualizationinvestment-analysisinvestment-decisionsmachine-learningmatplotlibnumpypandaspython3scikit-learnsp500-real-time-datastock-marketstock-price-data
  Language:Jupyter Notebook 70

• melizeche / dolarPy

  Checks USD/PYG exchange rate from several sites, with a calculator, RESTful API and a twitter bot

  pythonscraperbeautifulsoup4paraguayusdexchange-rateshacktoberfesthacktoberfest2020
  Language:HTML 59

• boringPpl / Linkedin-profiles-scraping

  Automatically scrape the web data of people profiles on Linkedin based on a specific search query

  pythonpython3webscrapingwebscraperwebscrappingwebscrapperwebscraping-dataseleniumselenium-webdriverbeautifulsoup4beautifulsoup
  Language:Jupyter Notebook 56

• corazzon / finance-data-analysis

  인프런 - 증권 데이터 수집과 분석으로 신호와 소음 찾기

  beautifulsoup4cufflinksfinance-data-analysisfinancedatareaderfinancial-data-readermatplotlibmplfinancenumpypandasplotlypythonrequestsseaborntqdm
  Language:Jupyter Notebook 55
• beautifulsoup-tutorial

  hackersandslackers / beautifulsoup-tutorial

  :sparkles: :ramen: Scrape webpage metadata using BeautifulSoup.

  beautifulsoupbeautifulsoup4pythonscrapingscraping-websitesscriptingtutorial
  Language:Python 47

• mananapr / akari

  python program to manage and automatically tag your image library

  pythonpython3iqdbanimeimage-taggingguiqt5pyqt5beautifulsoup4
  Language:Python 44

• MLArtist / WebScraper

  Python-based web crawling script with randomized intervals, user-agent rotation, and proxy server IP rotation to outsmart website bots and prevent blocking.

  beautiful-soupbeautifulsoupbeautifulsoup4crawlercrawling-pythoniprotationrobots-txtscraperscrapingscrapperscrapping-pythonuser-agentwebsite-crawlerwebsite-scraper
  Language:Python 44

• marcotav / supervised-machine-learning

  This repo contains regression and classification projects. Examples: development of predictive models for comments on social media websites; building classifiers to predict outcomes in sports competitions; churn analysis; prediction of clicks on online ads; analysis of the opioids crisis and an analysis of retail store expansion strategies using Lasso and Ridge regressions.

  aucbeautifulsoup4classificationclicksdecision-treeslogistic-regressionmachine-learningmedianatural-language-processingrandom-forestroc-curvewebscraping
  Language:Jupyter Notebook 42