Guidelines for Method ComparisonRead the first pre-print from the Small Molecule Steering Committee

Result

polaris/pkis1-kit-wt-mut-c-1_DGLGraphTransformer_MPNNModel

DGLGraphTransformer + MPNNModel

Submitted on: December 08, 2023ID: a2E7zuDHQ7LabGqJczd5n

Quick Links

Tags

baseline

null model

Contributors

Related benchmark

Detailed Results

Test set	Target label	Metric	Score
test	CLASS_KIT	f1	0.5641025641025641
test	CLASS_KIT	mcc	0.14773421007131973
test	CLASS_KIT	pr_auc	0.39285714285714285
test	CLASS_KIT	roc_auc	0.5277777777777778
test	CLASS_KIT	accuracy	0.41379310344827586
test	CLASS_KIT	cohen_kappa	0.042718446601941906
test	CLASS_KIT_(T6701_mutant)	f1	0.2772277227722772
test	CLASS_KIT_(T6701_mutant)	mcc	0
test	CLASS_KIT_(T6701_mutant)	pr_auc	0.16091954022988506
test	CLASS_KIT_(T6701_mutant)	roc_auc	0.5
test	CLASS_KIT_(T6701_mutant)	accuracy	0.16091954022988506
test	CLASS_KIT_(T6701_mutant)	cohen_kappa	0
test	CLASS_KIT_(V560G_mutant)	f1	0.2424242424242424
test	CLASS_KIT_(V560G_mutant)	mcc	0
test	CLASS_KIT_(V560G_mutant)	pr_auc	0.13793103448275862
test	CLASS_KIT_(V560G_mutant)	roc_auc	0.5
test	CLASS_KIT_(V560G_mutant)	accuracy	0.13793103448275862
test	CLASS_KIT_(V560G_mutant)	cohen_kappa	0