This project is an example of AWS Lambda Function polling tweets from the Twitter API, running sentiment detection with AWS Comprehend and storing results in a DynamoDB table.
This example uses the AWS NodeJS SDK and assumes you are familiar with npm
It is recommended to use node v6.10 for this project.
AWS configuration can be set using the CLI command aws configure
Alternatively, the configuration can be set in the file ~/.aws/credentials
To programmatically configure the services, AWS API Admin access will be required.
The script setup.js will create the required IAM Role, Lambda Function and DynamoDB Table for you. It is assumed that the AWS credentials previously configured have admin access.
To configure the Lambda Function and associated services, run the following scripts:
# Package the lambda code
./create_zip.sh
# Configure the AWS services
node setup.js
After creating the AWS Services, you can log into your AWS Console and verify the Lambda Function has been created.
You will need to configure your Twitter API credentials. You need to create a Twitter Application In your Lambda Function environment variables, you need to configure your Twitter credentials
TWITTER_CONSUMER_KEY=
TWITTER_CONSUMER_SECRET=
TWITTER_ACCESS_TOKEN=
TWITTER_ACCESS_TOKEN_SECRET=
You can also define the AWS regions to use for DynamoDB and Comprehend (AWS Comprehend is not available in all regions)
AWS_REGION_COMPREHEND=us-east-1
AWS_REGION_DYNAMODB=ap-southeast-2
The CloudWatch event scheduler is disabled by default. You will need to enable it if you want to automatically import data every 20 minutes.
You can also create a test trigger from the AWS Lambda function > Configure Test Event and then select the template Scheduled Event. Save and then click on the Test button to run trigger your Lambda function.
You should see the Twitter data being processed and save into DynamoDB
Browsing to the DynamoDB > MKPTweets tables you will find the records and their associated sentiment analysis
When modified, the lambda function code can be zipped up and uploaded to AWS Lambda with the deploy script.
You need to install the AWS CLI first
pip install awscli colorama --upgrade --user
Then call the deployment script
./deploy.sh
You can test lambda functions locally by using the library lambda-local
npm install -g lambda-local
And then execute your function by simulating an event
lambda-local -l lib/index.js -h handler -e ./__tests__/events/schedule_event.json -t 15
The unit test suite is located under the __tests__ folder and executed using Jest
This basic test suite can be run using the command
npm run test
We are a team of It experts. We are specialised in cloud, mobile and database.
MonkeyPatch
