zhangru-ng / NIST-traffic-data-analysis

NIST Data Science Pre-Pilot Evaluation - Traffic Data Cleaning

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

No row marked as unsimilar nearby zones

zhangru-ng opened this issue · comments

I've checked more than 40 result files.
In all of them, no row marked as unsimilar nearby zones

Hi Ray,
How many marked as inconsistent, Negative and same Zone errors? I am not sure if our STD factor is not big enough or It did not get any rows after earlier jobs marked incorrect. According to my local tests, it worked fairly well...

Here is part of the output in 14

reading cleaning_subm_14_12_nist7.txt and cleaning_test_14_12.csv...
cleaning_subm_14_12_nist7.txt
Inconsistent 1157163
nearby 0
negative 203541
same 1616
16183452 lines

reading cleaning_subm_14_02_nist7.txt and cleaning_test_14_02.csv...
cleaning_subm_14_02_nist7.txt
Inconsistent 560305
nearby 0
negative 344640
same 16139
44681235 lines

reading cleaning_subm_14_03_nist7.txt and cleaning_test_14_03.csv...
cleaning_subm_14_03_nist7.txt
Inconsistent 640698
nearby 0
negative 358361
same 15537
46890448 lines

reading cleaning_subm_14_01_nist7.txt and cleaning_test_14_01.csv...
cleaning_subm_14_01_nist7.txt
Inconsistent 721630
nearby 0
negative 405404
same 16501
51576547 lines

reading cleaning_subm_14_07_nist7.txt and cleaning_test_14_07.csv...
cleaning_subm_14_07_nist7.txt
Inconsistent 592017
nearby 0
negative 353080
same 18373
48919359 lines

reading cleaning_subm_14_04_nist7.txt and cleaning_test_14_04.csv...
cleaning_subm_14_04_nist7.txt
Inconsistent 638482
nearby 0
negative 338514
same 15551
46317586 lines

reading cleaning_subm_14_09_nist7.txt and cleaning_test_14_09.csv...
cleaning_subm_14_09_nist7.txt
Inconsistent 559533
nearby 0
negative 311579
same 16464
43897688 lines

reading cleaning_subm_14_10_nist7.txt and cleaning_test_14_10.csv...
cleaning_subm_14_10_nist7.txt
Inconsistent 883596
nearby 0
negative 375941
same 17710
49968919 lines

reading cleaning_subm_14_05_nist7.txt and cleaning_test_14_05.csv...
cleaning_subm_14_05_nist7.txt
Inconsistent 479458
nearby 0
negative 327307
same 15938
46818161 lines

Rui u rock :P
On Dec 4, 2015 10:59 PM, "Rui Zhang" notifications@github.com wrote:

Closed #8 #8.


Reply to this email directly or view it on GitHub
#8 (comment)
.