vinit28

CitibikeAnalysis

Citibike Analysis for Data Science Certification

FetchAndStoreData

Asked to replicate the work that we have done in class for the Citibike Web API, but for a different web source. Specifically, what I need to do: Identify a web API that returns data that change over time. Pick a data source for which historic data are not readily and easily accessible. Some default options: Twitter trending topics, NYTimes Top Stories together with Alchemy Entity extraction. Create a database and the corresponding set of tables for storing the data, following the paradigm of the Citibike example. You should model the database properly to allow for storing of the data that are changing over time. Our approach with the Citibike database where we used two tables should provide guidance for that. Write Python code that connects to the API, fetches the data, and stores the data in the database. Convert your code into a self-executable Python script and schedule it to run periodically using cron. You do not need to schedule the script to run too often. For example, for NY Times news stories and Twitter trending topics, fetching them every hour is more than sufficient.

SlackBot

Asked to create an interactive Slack bot. The learning goals of this exercise is to practice the use of authentication mechanisms, and ensure that you can get processes running in the background.

WebCraweler

Asked to practice with building a web crawler and Pandas.

BabyNames

http://prasannatambe.com/adef2016/labs/l3/l3.html

LendingClub

http://prasannatambe.com/adef2016/labs/l5/l5.html

mdl

NewsAnalytics

http://prasannatambe.com/adef2016/hw/hw2/hw2.html

PellGrant

Analysis of college students based on income, gender, and ethnicity of student polutation

RatsAndInspections

http://prasannatambe.com/ade/hw/hw1/hw1.html