wikipedia-scraper

There are 4 repositories under wikipedia-scraper topic.

• martin-majlis / Wikipedia-API

  Python wrapper for Wikipedia

  wikipediawikipedia-apipython3wikipedia-scraperwikipedia-web-crawler
  Language:Python 543
• web-scraping-tutorials

  oxylabs / web-scraping-tutorials

  Web scraping, data parsing and automation tutorials. Suited for both beginners and intermediate/advanced programmers.

  csharpcurlgolangjavascriptpythonr-languagerubyweb-scrapinggithub-pythonweb-proxieswikipedia-scraper
  Language:Jupyter Notebook 40

• lehinevych / MediaWikiAPI

  Python wrapper for the MediaWiki API to access and parse data from Wikipedia

  mediawiki-apipython3wikipediawikipedia-apiwikipedia-crawlerwikipedia-scwikipedia-scraper
  Language:Python 34

• viralvaghela / Jwiki

  Java tool to get wikipedia data

  javawikipediawikipedia-apijavawikipedajavatoolwikipedia-scraperdata-gathering
  Language:Java 34

• themagicalmammal / wikibot

  A :robot: which provides features from Wikipedia like summary, title searches, location API etc.

  wikibotwikipediawikipedia-scraperpythonherokutelegram-bot-apiwebhookchatbotwikipedia-librarybot-commandsrtdbwiki-libraryfirebaseflaskmit-licensetelegram-botpytelegrambotapitelegram-userbottelegram
  Language:Python 26

• Louis3797 / wikipedia-graph

  Graphically display the connections between different Wikipedia articles

  force-directed-graphsreactreact-three-fiberreactjsthree-jsthreejstypescriptwikipediawikipedia-apiwikipedia-scraper
  Language:TypeScript 19

• kohjiaxuan / Wikipedia-Article-Scraper

  A complete Python text analytics package that allows users to search for a Wikipedia article, scrape it, conduct basic text analytics and integrate it to a data pipeline without writing excessive code.

  wikipedia-articletext-analyticswikipedia-searchwikipedia-scraperwikipedia-corpuswikipedia-apiwikipedia
  Language:Python 17

• moesalih / spacex.moesalih.com

  SpaceX Launches 🚀 and Starlink Satellites 🛰

  spacexmustachefirebasewikipediaserverlesswikipedia-scrapergoogle-cloud-platformstarlinknextjsspacex-launches
  Language:JavaScript 16

• attogram / justrefs

  Just Refs - extract just the references and related topics from any page on the English Wikipedia

  wikipediawikipedia-apiwikipedia-viewerwikipedia-scraperdata-extractioninformation-extraction
  Language:PHP 15

• OlehOnyshchak / pyWikiMM

  Collects a multimodal dataset of Wikipedia articles and their images

  wikipediawikipedia-scraperwikipedia-apiwikipedia-botwikipedia-entrieswikipedia-dumpwikipedia-searchwikipedia-viewerwikipedia-corpuswikipedia-pagemultimodalmultimodalitymultimodal-datamultimodal-datasetsmultimodal-representationmultimodal-learningdatabasedata-cleaningdata-collectiondata-processing
  Language:Python 15

• marian-code / wikipedia-music-tags

  Music tagger with GUI that parses wikipedia for information. Can also download album art and lyrics.

  python-3music-information-retrievallyrics-fetcherlyrics-searchwikipedia-scrapermusic-taggermusic-taggingalbum-artpyqt5pyside2console-applicationguipyinstaller
  Language:Python 11

• ThiagoNelsi / wikipedia-to-document

  This project collects Wikipedia articles from a search term entered by the user and formats the data into a .docx (Word Document) document with images related to each section of the collected article.

  wikipediawikipedia-apiwikipedia-scrapermicrosoft-wordmicrosoft-word-automationibm-watsonibmgoogle-cloud-platformgoogle-custom-searchdocxdocx-generatoralgorithmiafilipe-deschampsvideo-makeropen-sourcescrapingapiautomationrobot
  Language:JavaScript 11

• kohjiaxuan / NLP-Model-for-Corpus-Similarity

  A NLP algorithm I developed to determine the similarity or relation between two documents/Wikipedia articles. Inspired by the cosine similarity algorithm and built from WordNet.

  nltk-similaritycorpus-similaritynlp-modelnlpnlp-machine-learningcosine-similaritysimilarity-scorewikipediawikipedia-scrapertext-analytics
  Language:Python 9

• emreYbs / Wikipedia-Article-Summarizer

  Wikipedia Article Summarizer a simple Python project based on NLP techniques

  article-summarizationwikipedia-scrapernltk-pythonnltknlppython3jupyter-notebooknatural-language-processingnlp-machine-learningpythonjupytermachine-learningsummarization
  Language:Jupyter Notebook 8
• web-scraping-php

  oxylabs / web-scraping-php

  A tutorial and code samples of web scraping with PHP

  phpweb-scrapingemail-scraperemail-scraper-with-proxyscreen-scrapingurl-scraperwebsite-crawlerwikipedia-scraper
  Language:PHP 8

• shanedrabing / taxopedia

  Taxonomic trees (cladograms) from Wikipedia-scraped data.

  taxonomic-treestaxonomywikipediawikipedia-scrapercladogramphylogeneticsphylogenetic-trees
  Language:Python 7

• donomii / wikipedia2geojson

  Extracts geodata from a wikipedia dump

  wikipediawikipedia-dumpwikipedia-scraperjsongeodatageojsongeotagged-wikipedia-articlesgeotaggingconverterconversionmapping
  Language:Go 5

• lorenzoranucci / sentimantic

  Linked Data Knowledge Base Population (KBP) framework built on top of Snorkel. The default configuration uses Wikipedia as text corpus and DBpedia as target.

  information-extractionknowledge-base-populationknowledge-base-constructionlinked-data-quality-assessmentlinked-datadistant-supervisionweak-supervisionweakly-supervised-learningdockerwikipedia-scraperrelation-extractionnatural-language-processingnlp
  Language:Python 5

• mynlp / wikilex

  Wikipedia Entities Lexicon Extractor

  entity-extractionwikipedia-scraperwikipedia-databasedisambiguationlexicon
  Language:Python 5

• ammarfaizi2 / wikipedia_scraper

  Wikipedia Scraper written in PHP

  wikipediawikipedia-botwikipedia-scraperscraperwikiscarpegrabbergrabbing-contentphp-curlcurl
  Language:PHP 4

• orange-soda / scrapy-wikipedia

  维基百科中文网历史事件爬取Python实现，并通过LaTeX导出为PDF

  pythonwikipedia-scraper
  Language:TeX 4

• ankitssh / Wikipedia-Scraper-Bot

  A wikipedia scraper bot made in python.

  wikipedia-scraperscraper
  Language:Python 3

• g3ner1c / wikimedia-cli

  A minimally dependent Wikimedia CLI

  clipythonwikimediawikimedia-apiwikipediawikipedia-cliwikipedia-scraper
  Language:Python 3

• GeorgeDavila / WikipediaScrapingWikiAPI

  Scraping Wikipedia using the python wrapper of Wikipedia's WikiMedia API

  wikipediawikipedia-apiwikipedia-scraperscrapernlpnlp-machine-learning
  Language:Jupyter Notebook 3

• Goutam1511 / WikiFinder

  Given a topic name this project finds you the most suitable parent topics for the topic, searching the Wikipedia Category Network (WCN) related to that topic by the help of a statistical approach. It helps you form an autogenerated topic tree for a given topic.

  wikipedia-scraperwikipedia-apiwikipediawcnstatisticalhtmlhtml-cssjavascriptphppythoncssjqueryajaxrest-api
  Language:JavaScript 3

• Harsh-2909 / Wikipedia-Web-Scraper

  A Wikipedia Web Scraper used to download all the text information in a .txt file.

  pythonpython3beautifulsoupbeautifulsoup4webscraperwikipedia-scraperwikipediawebscraping
  Language:Python 3

• milosmladenovic5 / football_clubs_logo_scraper

  Scraping logos of world football clubs from wikipedia

  web-scrapingwikipedia-scraperpython-web-crawlerbeautifulsoup
  Language:Python 3

• MostafaAryan / Wikipedia-Article-Title-Translator

  🌍 Wikipedia Title Translator is a Chrome extension that displays the translation of any Wikipedia article title in your selected language.

  chromechrome-extensionchrome-extensionsjavascriptjswikipediawikipedia-scraper
  Language:JavaScript 3

• MrMSDS / wikipedia-infoboxes

  This repository contains the query and processing code to support the publication "Wikipedia curation and the US-EPA CompTox Chemicals Dashboard."

  wikipediawikipedia-apiepacomptoxinchi-keyinchikeysmileschemistrycheminformaticsdataopen-datawikipedia-scraper
  Language:Java 3
• ExploreWiki

  Omanshu209 / ExploreWiki

  This is a Python - based application that allows the user to search for information and open URLs.

  kivymdlangchainlangchain-pythonpython3search-enginewebbrowserwikipediawikipedia-apiwikipedia-scraper
  Language:kvlang 3
• web-scraping-r

  oxylabs / web-scraping-r

  A tutorial for web scraping with R

  r-languageweb-scrapingproxy-scraperwikipedia-scraper
  Language:R 3

• sinjoysaha / Disney-Movies-Wiki-WebScraper

  Web Scraping Wikipedia for Disney Movies to create a Disney Movies dataset and then cleaning the data to perform further Data Analysis using the cleaned JSON

  beautifulsoupbeautifulsoup4data-cleaningdata-sciencedatasetdataset-creationdataset-generationjsonjupyterjupyter-notebookpythonweb-scraperweb-scrapingwebscraperwebscrapingwikipediawikipedia-scraper
  Language:Jupyter Notebook 3

• VityaSchel / wikipedia-speedrun

  Website with interactive game, where you have to travel from random page on Wikipedia to Adolf Hitler's page (or any page specified by you in settings).

  speedrunwikipediawikipedia-apiwikipedia-dumpwikipedia-scraperwikipedia-speedrun
  Language:HTML 3

• bhimrazy / web-scraping-using-python

  Scrape List of American films of 2022 from wikipedia

  pythonweb-scrapingbeautifulsoup4wikipedia-scraper
  Language:Jupyter Notebook 2

• sakinkirti / wikipedia-graph

  Scrapes data from Wikipedia and generates a Graph based on inputs

  databasegraph-databaseneo4jnetworkxwikipedia-scraper
  Language:Python 2
• wikiref

  zaataylor / wikiref

  A web extension that makes extracting, editing, and exporting Wikipedia references easy!

  extensionsfirefox-webextensionjsonwikipediawikipedia-scraper
  Language:JavaScript 2