NZ Good AI Works

Possible to turn ChatGPT, Bard, or any LLM from an amnesiac goldfish into a memory mammoth!

1 h 0 min · 23 de jul de 2023
Portada del episodio Possible to turn ChatGPT, Bard, or any LLM from an amnesiac goldfish into a memory mammoth!

Descripción

What if your ChatGPT, Bard, or any other LLMs could remember the things you said last month? For example, if you were planning to buy a home near your kids' school, the story you told your son last week, or the gift ideas your wife wouldn't like. That would be amazing, right? However, with the current short memory limit, also known as the context window, these capabilities remain a dream. But Dr. Burtsev's research has come to our rescue! Thanks to his breakthrough, your LLMs can now accurately remember 1 million tokens, equivalent to several books' worth of information. We are now much closer to having a dreamlike Chat Agent.   Want to know more about what this means for the rest of us? Just tune in to this podcast where Mr. Bursev joins us to discuss his inspiration, how he made it possible, and many other insightful thoughts and ideas about interactive learning, human brain-inspired machine learning algorithms, AGI, Turing test, and, of course, AI safety. Here is the paper: Scaling Transformer to 1M tokens and beyond with RMT  https://arxiv.org/abs/2304.11062 [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbE50b3FTUXV4bWRLaDRWMnpjdmd3ODZjakxrUXxBQ3Jtc0ttYm8tQ0psTU9pLVlqRlQzUFpfMTJENC1MTGxKWkhxX0paZl9vbEU2NmtxZ3czTGFFaDhzcEcwVTJDYldmeEU2ZVlQc1h1d25welhPYnQwNnYyTzhBdUw0eWJJMzdONUhlVzJhUVRnRWx2YTVjak5tUQ&q=https%3A%2F%2Farxiv.org%2Fabs%2F2304.11062&v=4QDvNiyAikw] Find Mr Burtsev's profile here https://lims.ac.uk/profile/?id=114 [https://lims.ac.uk/profile/?id=114] Here are various other resources mentioned during the show: Mike's Linkedin page and information about the IGLU contest (Interactive Grounded Language Understanding) https://www.linkedin.com/posts/mikhai... [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbE1neTFqa1JLWFotZVZSZTI4VUxmckh6enNxZ3xBQ3Jtc0tsbUgtaUJFcVVocW1sNzN5ekxDV2FLczM5T2Nqd05kVTg1dGdtTmhZaEhXQzh1LThfOC1TVDhyMmhlWnNTN0tnQTVPZmp0bk9CaEwxUG5iY3ZRanRpSkVPVHEwVkpKeS1vLTh6eGZCOXdCVV9kbmRMTQ&q=https%3A%2F%2Fwww.linkedin.com%2Fposts%2Fmikhail-burtsev-85a47b9_github-microsoftiglu-datasets-activity-7063063776232665088-b4mG&v=4QDvNiyAikw] The Society of Mind, Marvin Minsky https://isbndb.com/book/9780671657130 [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbUVDeGhOSFhFZ2U5TzBXN01OYzdLNF82dGt4QXxBQ3Jtc0trMU4teGNjNE1XZDBVNEV5TXVrWUYzSjJMSGdTUng5aWVjVEhPRnU1MFRROHhvLWxHOWRDc3NLdVBrSXQ3cjVyQTBBTFZrUTJPLXIteW1zTFExTlJ1M1JxMEpSWVpjYVF2a3VJMDlzQWV5UURiYmh2dw&q=https%3A%2F%2Fisbndb.com%2Fbook%2F9780671657130&v=4QDvNiyAikw] The Human Brain Project https://www.humanbrainproject.eu/en/b... [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbDFucnpreExuWHN2SU5makJZYzdOTDNpakd6Z3xBQ3Jtc0tsb2ZwYXBRb1h6UWtNTVZuTHlnNGlNUm1WT0YxVEJRak55VmtkczRCc0dKbC02Mndld3Q2VS1CUXc1STdHUk1QZS1XbWZQcVhubUMwREU2US1KWnZZSU14RnM0eW1BRWNFMzlfcFE4S1RaRUUwYUM0SQ&q=https%3A%2F%2Fwww.humanbrainproject.eu%2Fen%2Fbrain-simulation&v=4QDvNiyAikw] Yann LeCun, JEPA: A Path Towards Autonomous Machine Intelligence https://www.reddit.com/r/MachineLearn... [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqblpia1FUVkRVYVhhQ3NqQUw0ZzBvdlVodmxWUXxBQ3Jtc0ttckxZTDZlU0I5UXpZaEE5QlZpUzh6N3Z3MTBIcGVSTmM1M3MwRFlkSnIzdzBNX09vcUhJSFhDZFBSZU5oWWpVSW9Kb3JiME9tV3JmWXRYcXo4NllGRDIxNmRJSGl3eldjX0RCWC1TTTMwTDl1LUQtUQ&q=https%3A%2F%2Fwww.reddit.com%2Fr%2FMachineLearning%2Fcomments%2Fvtsiif%2Fd_paper_explained_jepa_a_path_towards_autonomous%2F&v=4QDvNiyAikw] Mindstorms in Natural Language-Based Societies of Mind Jürgen Schmidhuber

Comentarios

0

Sé la primera persona en comentar

¡Regístrate ahora y únete a la comunidad de NZ Good AI Works!

Prueba gratis

Empieza 7 días de prueba

$99 / mes después de la prueba. · Cancela cuando quieras.

  • Podcasts solo en Podimo
  • 20 horas de audiolibros al mes
  • Podcast gratuitos

Todos los episodios

2 episodios

episode Possible to turn ChatGPT, Bard, or any LLM from an amnesiac goldfish into a memory mammoth! artwork

Possible to turn ChatGPT, Bard, or any LLM from an amnesiac goldfish into a memory mammoth!

What if your ChatGPT, Bard, or any other LLMs could remember the things you said last month? For example, if you were planning to buy a home near your kids' school, the story you told your son last week, or the gift ideas your wife wouldn't like. That would be amazing, right? However, with the current short memory limit, also known as the context window, these capabilities remain a dream. But Dr. Burtsev's research has come to our rescue! Thanks to his breakthrough, your LLMs can now accurately remember 1 million tokens, equivalent to several books' worth of information. We are now much closer to having a dreamlike Chat Agent.   Want to know more about what this means for the rest of us? Just tune in to this podcast where Mr. Bursev joins us to discuss his inspiration, how he made it possible, and many other insightful thoughts and ideas about interactive learning, human brain-inspired machine learning algorithms, AGI, Turing test, and, of course, AI safety. Here is the paper: Scaling Transformer to 1M tokens and beyond with RMT  https://arxiv.org/abs/2304.11062 [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbE50b3FTUXV4bWRLaDRWMnpjdmd3ODZjakxrUXxBQ3Jtc0ttYm8tQ0psTU9pLVlqRlQzUFpfMTJENC1MTGxKWkhxX0paZl9vbEU2NmtxZ3czTGFFaDhzcEcwVTJDYldmeEU2ZVlQc1h1d25welhPYnQwNnYyTzhBdUw0eWJJMzdONUhlVzJhUVRnRWx2YTVjak5tUQ&q=https%3A%2F%2Farxiv.org%2Fabs%2F2304.11062&v=4QDvNiyAikw] Find Mr Burtsev's profile here https://lims.ac.uk/profile/?id=114 [https://lims.ac.uk/profile/?id=114] Here are various other resources mentioned during the show: Mike's Linkedin page and information about the IGLU contest (Interactive Grounded Language Understanding) https://www.linkedin.com/posts/mikhai... [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbE1neTFqa1JLWFotZVZSZTI4VUxmckh6enNxZ3xBQ3Jtc0tsbUgtaUJFcVVocW1sNzN5ekxDV2FLczM5T2Nqd05kVTg1dGdtTmhZaEhXQzh1LThfOC1TVDhyMmhlWnNTN0tnQTVPZmp0bk9CaEwxUG5iY3ZRanRpSkVPVHEwVkpKeS1vLTh6eGZCOXdCVV9kbmRMTQ&q=https%3A%2F%2Fwww.linkedin.com%2Fposts%2Fmikhail-burtsev-85a47b9_github-microsoftiglu-datasets-activity-7063063776232665088-b4mG&v=4QDvNiyAikw] The Society of Mind, Marvin Minsky https://isbndb.com/book/9780671657130 [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbUVDeGhOSFhFZ2U5TzBXN01OYzdLNF82dGt4QXxBQ3Jtc0trMU4teGNjNE1XZDBVNEV5TXVrWUYzSjJMSGdTUng5aWVjVEhPRnU1MFRROHhvLWxHOWRDc3NLdVBrSXQ3cjVyQTBBTFZrUTJPLXIteW1zTFExTlJ1M1JxMEpSWVpjYVF2a3VJMDlzQWV5UURiYmh2dw&q=https%3A%2F%2Fisbndb.com%2Fbook%2F9780671657130&v=4QDvNiyAikw] The Human Brain Project https://www.humanbrainproject.eu/en/b... [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbDFucnpreExuWHN2SU5makJZYzdOTDNpakd6Z3xBQ3Jtc0tsb2ZwYXBRb1h6UWtNTVZuTHlnNGlNUm1WT0YxVEJRak55VmtkczRCc0dKbC02Mndld3Q2VS1CUXc1STdHUk1QZS1XbWZQcVhubUMwREU2US1KWnZZSU14RnM0eW1BRWNFMzlfcFE4S1RaRUUwYUM0SQ&q=https%3A%2F%2Fwww.humanbrainproject.eu%2Fen%2Fbrain-simulation&v=4QDvNiyAikw] Yann LeCun, JEPA: A Path Towards Autonomous Machine Intelligence https://www.reddit.com/r/MachineLearn... [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqblpia1FUVkRVYVhhQ3NqQUw0ZzBvdlVodmxWUXxBQ3Jtc0ttckxZTDZlU0I5UXpZaEE5QlZpUzh6N3Z3MTBIcGVSTmM1M3MwRFlkSnIzdzBNX09vcUhJSFhDZFBSZU5oWWpVSW9Kb3JiME9tV3JmWXRYcXo4NllGRDIxNmRJSGl3eldjX0RCWC1TTTMwTDl1LUQtUQ&q=https%3A%2F%2Fwww.reddit.com%2Fr%2FMachineLearning%2Fcomments%2Fvtsiif%2Fd_paper_explained_jepa_a_path_towards_autonomous%2F&v=4QDvNiyAikw] Mindstorms in Natural Language-Based Societies of Mind Jürgen Schmidhuber

23 de jul de 20231 h 0 min