NZ Good AI Works
What if your ChatGPT, Bard, or any other LLMs could remember the things you said last month? For example, if you were planning to buy a home near your kids' school, the story you told your son last week, or the gift ideas your wife wouldn't like. That would be amazing, right? However, with the current short memory limit, also known as the context window, these capabilities remain a dream. But Dr. Burtsev's research has come to our rescue! Thanks to his breakthrough, your LLMs can now accurately remember 1 million tokens, equivalent to several books' worth of information. We are now much closer to having a dreamlike Chat Agent. Want to know more about what this means for the rest of us? Just tune in to this podcast where Mr. Bursev joins us to discuss his inspiration, how he made it possible, and many other insightful thoughts and ideas about interactive learning, human brain-inspired machine learning algorithms, AGI, Turing test, and, of course, AI safety. Here is the paper: Scaling Transformer to 1M tokens and beyond with RMT https://arxiv.org/abs/2304.11062 [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbE50b3FTUXV4bWRLaDRWMnpjdmd3ODZjakxrUXxBQ3Jtc0ttYm8tQ0psTU9pLVlqRlQzUFpfMTJENC1MTGxKWkhxX0paZl9vbEU2NmtxZ3czTGFFaDhzcEcwVTJDYldmeEU2ZVlQc1h1d25welhPYnQwNnYyTzhBdUw0eWJJMzdONUhlVzJhUVRnRWx2YTVjak5tUQ&q=https%3A%2F%2Farxiv.org%2Fabs%2F2304.11062&v=4QDvNiyAikw] Find Mr Burtsev's profile here https://lims.ac.uk/profile/?id=114 [https://lims.ac.uk/profile/?id=114] Here are various other resources mentioned during the show: Mike's Linkedin page and information about the IGLU contest (Interactive Grounded Language Understanding) https://www.linkedin.com/posts/mikhai... [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbE1neTFqa1JLWFotZVZSZTI4VUxmckh6enNxZ3xBQ3Jtc0tsbUgtaUJFcVVocW1sNzN5ekxDV2FLczM5T2Nqd05kVTg1dGdtTmhZaEhXQzh1LThfOC1TVDhyMmhlWnNTN0tnQTVPZmp0bk9CaEwxUG5iY3ZRanRpSkVPVHEwVkpKeS1vLTh6eGZCOXdCVV9kbmRMTQ&q=https%3A%2F%2Fwww.linkedin.com%2Fposts%2Fmikhail-burtsev-85a47b9_github-microsoftiglu-datasets-activity-7063063776232665088-b4mG&v=4QDvNiyAikw] The Society of Mind, Marvin Minsky https://isbndb.com/book/9780671657130 [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbUVDeGhOSFhFZ2U5TzBXN01OYzdLNF82dGt4QXxBQ3Jtc0trMU4teGNjNE1XZDBVNEV5TXVrWUYzSjJMSGdTUng5aWVjVEhPRnU1MFRROHhvLWxHOWRDc3NLdVBrSXQ3cjVyQTBBTFZrUTJPLXIteW1zTFExTlJ1M1JxMEpSWVpjYVF2a3VJMDlzQWV5UURiYmh2dw&q=https%3A%2F%2Fisbndb.com%2Fbook%2F9780671657130&v=4QDvNiyAikw] The Human Brain Project https://www.humanbrainproject.eu/en/b... [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbDFucnpreExuWHN2SU5makJZYzdOTDNpakd6Z3xBQ3Jtc0tsb2ZwYXBRb1h6UWtNTVZuTHlnNGlNUm1WT0YxVEJRak55VmtkczRCc0dKbC02Mndld3Q2VS1CUXc1STdHUk1QZS1XbWZQcVhubUMwREU2US1KWnZZSU14RnM0eW1BRWNFMzlfcFE4S1RaRUUwYUM0SQ&q=https%3A%2F%2Fwww.humanbrainproject.eu%2Fen%2Fbrain-simulation&v=4QDvNiyAikw] Yann LeCun, JEPA: A Path Towards Autonomous Machine Intelligence https://www.reddit.com/r/MachineLearn... [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqblpia1FUVkRVYVhhQ3NqQUw0ZzBvdlVodmxWUXxBQ3Jtc0ttckxZTDZlU0I5UXpZaEE5QlZpUzh6N3Z3MTBIcGVSTmM1M3MwRFlkSnIzdzBNX09vcUhJSFhDZFBSZU5oWWpVSW9Kb3JiME9tV3JmWXRYcXo4NllGRDIxNmRJSGl3eldjX0RCWC1TTTMwTDl1LUQtUQ&q=https%3A%2F%2Fwww.reddit.com%2Fr%2FMachineLearning%2Fcomments%2Fvtsiif%2Fd_paper_explained_jepa_a_path_towards_autonomous%2F&v=4QDvNiyAikw] Mindstorms in Natural Language-Based Societies of Mind Jürgen Schmidhuber
2 episodios
Comentarios
0Sé la primera persona en comentar
¡Regístrate ahora y únete a la comunidad de NZ Good AI Works!