Embedded spaces inspired on gravity [P][D]
Mirrored from r/MachineLearning for archival readability. Support the source by reading on the original site.
| tl;dr: I have a project that I think is really cool and as a non-researcher, I don't know what to do next and need advice. [Me, my context] For the past 1 year or so I have been working in this project by myself in my spare time, sometimes maybe overworking haha [The project] Mixing all these areas of interest I have, I had the realization that "maybe the next token is exactly the right one". In a sense, information organizes itself, that is why we have things like the " Jennifer Aniston Neuron" (https://en.wikipedia.org/wiki/Grandmother_cell), this is the part of the brain that optimizes the retrieval of information about the concept of " Jennifer Aniston" . Another project I have try to treat gravity as an emergent property of an informational universe (similar to what Vopson is doing https://wikitia.com/wiki/Melvin_Vopson ). Assuming information organize itself, if we knew the mechanism of that, we would be able to create an embedding space without backpropagation. The idea really ressambles what w2v have done, actually, there is nothing really new code or concept-wise, what I think my idea bring something new is how the pieces are put together. I really like the way it solves MNIST and how the model can be incrementally trained without much forgeting. What should I do next? Just forget about it? [link] [comments] |
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.