AtlasOfLivingAustralia / biocache-store

Occurrence processing, indexing and batch processing

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

NPE when the load starts

sadeghim opened this issue · comments

was loading inat second batch (dr1411), here: http://localhost:9193/job/Cloud%20Infrastructure/job/BSTORE/job/Parameterised%20Load/5052/console

aws-bstore-4b 2019-09-09 14:09:50,887 INFO : [Vocab] - Reading vocab file: /data/biocache/vocab/mime-types.txt
Exception in thread "Thread-7" java.lang.NullPointerException
	at au.org.ala.biocache.load.RemoteMediaStore$.uploadImageFromUrl(MediaStore.scala:446)
	at au.org.ala.biocache.load.RemoteMediaStore$.save(MediaStore.scala:333)
	at au.org.ala.biocache.load.DataLoader$$anonfun$processMedia$1.apply(DataLoader.scala:323)
	at au.org.ala.biocache.load.DataLoader$$anonfun$processMedia$1.apply(DataLoader.scala:295)
	at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
	at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)
	at au.org.ala.biocache.load.DataLoader$class.processMedia(DataLoader.scala:295)
	at au.org.ala.biocache.load.DwCALoader.processMedia(DwCALoader.scala:95)
	at au.org.ala.biocache.load.DwCALoader$PersistConsumer.run(DwCALoader.scala:419)
	at java.lang.Thread.run(Thread.java:748)
Exception in thread "Thread-14" java.lang.NullPointerException
	at au.org.ala.biocache.load.RemoteMediaStore$.uploadImageFromUrl(MediaStore.scala:446)
	at au.org.ala.biocache.load.RemoteMediaStore$.save(MediaStore.scala:333)
	at au.org.ala.biocache.load.DataLoader$$anonfun$processMedia$1.apply(DataLoader.scala:323)
	at au.org.ala.biocache.load.DataLoader$$anonfun$processMedia$1.apply(DataLoader.scala:295)
	at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
	at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)
	at au.org.ala.biocache.load.DataLoader$class.processMedia(DataLoader.scala:295)
	at au.org.ala.biocache.load.DwCALoader.processMedia(DwCALoader.scala:95)
	at au.org.ala.biocache.load.DwCALoader$PersistConsumer.run(DwCALoader.scala:419)
	at java.lang.Thread.run(Thread.java:748)
aws-bstore-4b 2019-09-09 14:09:51,049 INFO : [DataLoader] - 10, >> last key : dr1411|1020580, UUID: , records per sec: 8.285004

This is now fixed with this commit in the 2.4.6-SNAPSHOT.

0279437