dc.contributor.author | Isdahl, Richard Juul | |
dc.contributor.author | Gundersen, Odd Erik | |
dc.date.accessioned | 2020-05-22T10:17:14Z | |
dc.date.available | 2020-05-22T10:17:14Z | |
dc.date.created | 2020-05-13T11:29:26Z | |
dc.date.issued | 2019 | |
dc.identifier.isbn | 9781728124513 | |
dc.identifier.uri | https://hdl.handle.net/11250/2655335 | |
dc.description.abstract | Even machine learning experiments that are fully conducted on computers are not necessarily reproducible. An increasing number of open source and commercial, closed source machine learning platforms are being developed that help address this problem. However, there is no standard for assessing and comparing which features are required to fully support reproducibility. We propose a quantitative method that alleviates this problem. Based on the proposed method we assess and compare the current state of the art machine learning platforms for how well they support making empirical results reproducible. Our results show that BEAT and Floydhub have the best support for reproducibility with Codalab and Kaggle as close contenders. The most commonly used machine learning platforms provided by the big tech companies have poor support for reproducibility. | en_US |
dc.language.iso | eng | en_US |
dc.publisher | Institute of Electrical and Electronics Engineers (IEEE) | en_US |
dc.relation.ispartof | The Proceedings of IEEE 15th Conference on eScience 2019 | |
dc.title | Out-of-the-Box Reproducibility: A Survey of Machine Learning Platforms | en_US |
dc.type | Chapter | en_US |
dc.description.version | acceptedVersion | en_US |
dc.source.pagenumber | 86-95 | en_US |
dc.identifier.doi | 10.1109/eScience.2019.00017 | |
dc.identifier.cristin | 1810744 | |
dc.description.localcode | © 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. | en_US |
cristin.ispublished | true | |
cristin.fulltext | postprint | |