September 12, 2020
This workshop was designed for UC Berkeley's PiE Datathon, sponsored by Microsoft.
We introduce you to Microsoft Azure's cognitive services using two datasets. In this repository, you'll find the materials to conduct text analytics on one of two datasets using the Cognitive Services Text Analytics API.
The slides used for the demo are included in this repository.
- Free Azure student subscription
- Python
- Anaconda (Pandas, Numpy)
- Jupyter Notebooks (such as Azure Notebooks) or your preferred IDE
- Git
Run the command pip install --upgrade requests in your terminal.
Add import requests at the top of your Python file in order to call the Azure text analytics API.
It is recommended that you create a Text Analytics resource for your project (team members can share an API key). You are welcome to incorporate other Azure Cognitive Services as appropriate for the scope of your project!
Learn more about the Text Analytics API and what it offers in the Azure documentation.
Creating an Azure resource
Follow this tutorial for creating a resource in Azure and accessing its API key.
When creating your resource, set the following configuration:
Subscription: your Azure student subscriptionLocation: this depends on your team's general location. We recommend selecting "(US) West US" from the dropdown menu if you are on the west coast or "(US) East US" if you are on the east coast.Pricing Tier: Standard S if available or FreeResource group: Create a new resource group that will contain all of your Azure resources
Description: "Records of Officer Involved Shootings (OIS) from 2005 to the present, including a brief narrative synopsis."
More information about this dataset: Seattle Police Data
Description: These are records of support tickets that a fictitious hardware general store has received in the form of emails or audio converted to text.
Column descriptions
SupportTicket: unique ID of support issue receivedCustomerID: unique ID of customer submitting issueDateCreated: date of when issue was submitted and receivedDateCompleted: date of closing the support ticketEscalated: binary variable of whether a ticket was escalated to another team due to urgency (0 - no, 1 - yes)Theme: category of support ticketText: text of customer ticket
Theme descriptions
- price: cost of the goods to customers, comparison to competitors, sales, discounts
- speed: delivery speed
- features: product or website features
- design: product or website design
- reliability: product, website, and delivery reliability
- support: tech, customer, and product support
- security: payment info, login info
- services: delivery, account, payment, and installation services
- other
Created by the Microsoft OCP Azure Data & AI Team