Limited compute, targeting CVPR: rerun experiments for statistically strong numbers or focus on writing? [D]
Mirrored from r/MachineLearning for archival readability. Support the source by reading on the original site.
Hi everyone,
I'm preparing a submission for CVPR and would appreciate your advice. I am happy with my current results, but compute is a real constraint. My institute isn't a research-focused one, and the systems available to me are slow and unreliable. A single set of runs already took a lot of time and effort to finish.
I plan to release the code with the submission, and I'm confident the results will reproduce. Still, I'm torn between two options:
1) Rerun the experiments with different seeds to report mean ± std and show statistical significance. Or
2) Skip the reruns and spend the remaining time on writing, presenting the results I already have.
If you've been in a similar spot, what did you do, and would a single-seed result with released code be enough?
Thanks in advance!
[link] [comments]
More from r/MachineLearning
-
I turned my dog Jackies Brain into a working AI [P]
Oct 14
-
Event2Vec: additive event embeddings where a linear score on a history decomposes exactly into per-event terms [P]
Oct 14
-
Binary noise classification using CRNN mean teacher algo [R]
Oct 14
-
Localized Neural learning vs backpropagation [D]
Oct 14
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.