PHILTER RELEASE TESTING

Release Name	Release Date	Config File	Test Batch	Recall	Precision
Alpha	05/23/18	philter_alpha.json	Train	94.90	56.33
			Test 1	94.87	56.00
			Test 2	94.37	57.31
			25k	90.91	58.61
			18k	91.00	58.99
Beta	07/17/18	ucsf_pipeline18.json	Train	98.65	65.74
			Test 1	98.81	70.60
			Test 2	98.46	72.43
			Test 3	98.45	72.14
			25k	98.59	71.41
			18k	98.64	72.01
Gamma	09/06/18	philter_gamma.json	Train	99.79	75.55
			Test 1	99.30	71.97
			Test 2	99.20	73.78
			Test 3	99.09	73.76
			25k	99.16	72.76
			18k	99.18	73.35
Delta	10/05/18	philter_delta.json	Train	99.61	63.56
			Test 1	99.46	75.33
			Test 2	99.06	77.30
			Test 3	99.12	77.36
			25k	99.14	76.55
			18k	99.15	77.01
Epsilon	04/25/19	philter_delta_holidays_added.json	Train	99.77	81.77
			Test 1	99.48	75.73
			Test 2	99.07	78.27
Epsilon-01	05/06/19	philter_delta_holidays_added.json	Train	99.77	81.77
			Test 1	99.48	75.73
			Test 2	99.07	78.27
			Test 3	99.37	78.12
			25k	99.29	77.65
			18k	99.29	77.58
Zeta	06/22/19	philter_delta_holidays_added.json	Train	99.79	81.38
			Test 1	99.49	75.40
			Test 2	99.10	77.95
			Test 3	99.39	77.85
			25k	99.32	77.31
			18k	99.32	77.25
Eta	08/06/20	philter_eta.json	Train	99.80	80.42
			Test 1	99.58	74.36
			Test 2
			Test 3	99.46	76.75
			25k	99.40	76.33
			18k	99.40	76.22
Theta	09/21/20	philter_theta.json	Train	99.80	80.42
			Test 1	99.58	74.41
			Test 2
			Test 3	99.45	76.79
			25k	99.40	76.39
			18k	99.40	76.27
Iota-01	05/27/21	philter_iota.json	Train	99.77	79.57
			Test 1	99.59	73.63
			Test 2	99.23	76.12
			Test 3	99.48	75.35
			25k	99.42	74.39
			18k	99.43	74.56
v1.0	12/16/21	philter_one.json	Train	99.77	78.15
			Test 1	99.61	72.40
			Test 2	99.26	74.58
			Test 3	99.50	76.13
			25k	99.44	73.71
			18k	99.45	73.74

Test batch key:
Train = 2.5k training set
Test 1 = philter_paper_testingbatch2k_20180802_updated
Test 2 = philter_paper_testingbatch2k_20181002
Test 3 = randomremainder3000
25k = all manually annotated notes
18k = 25k - Train - Test 1 - Test 2