This tool was responsible as synchronization mechanism between FB group and site storage
Written in Java and Selenide Web Driver
. Simple jar
file scrapes facebook group posts and push them to database
The tool has been developed to store data into Firebase.
Currently, export data into .xsl
file and postgres
is not supported
- post text
- post images
- post link
- post date
- author name
- author link
- author avatar
- tool reads last
N
posts from specified facebook group - store them into
database
(needs to be intalled on computer) - wait
Z
minutes - go to step 1
N
, Z
and database
parameters are configurable
- java 8;
- maven 3.6.0
- FireFox 60.3.0esr (64-bit);
- Adjust project settings in
PostDataToFirebase.properties
andapplication.properties
files - Navigate to project dir from cmd
- Run
mvn clean install
command
- Run JAR:
java -jar fbreaper-MILESTONE-2.1.jar --scheduling.enabled=false
- Run JAR with scheduling:
java -jar target\fbreaper-MILESTONE-2.1.jar --scheduling.enabled=true --cron.expression="* */5 * * * *"
PostDataToFirebase.properties:
fb.login fb.pass
fb.group.url
posts.to.fetch
application.properties:
firebase.jsonfile.path
firebase.storage.bucket
cron.expression
fb.big.images.limit
fb.big.images.load.timeout
selenide.timeout