Safe Transition Talks

#1 - Thomas Hickey: AGI Takeoff, Existential Risk, Regulation Ideas

1 h 25 min · 17 de ene de 2023
portada del episodio #1 - Thomas Hickey: AGI Takeoff, Existential Risk, Regulation Ideas

Descripción

(See timestamps below) Thomas Hickey is a Dutch student in both philosophy and artificial intelligence at Utrecht University. We talk about his bachelor thesis on A.G.I. or Artificial General Intelligence, on bottlenecks for recursive self-improvement. But also go into existential risk and what we can do about it. CONTACT INFO: Alex van der Meer email: safetransitionREMOVETHIS@gmail.com but remove capital letters, (for spam) SEE MORE OF ME: - Twitter: https://twitter.com/AlexvanderMeer5 [https://twitter.com/AlexvanderMeer5] - YouTube: https://www.youtube.com/@safetransition9743 [https://twitter.com/AlexvanderMeer5] EPISODE LINKS: Eliezer Yudkowsky, on why it is lethal not to have retries https://intelligence.org/2022/06/10/agi-ruin/ [https://intelligence.org/2022/06/10/agi-ruin/] OpenAI on their approach to alignment blog post https://openai.com/blog/our-approach-to-alignment-research/ [https://openai.com/blog/our-approach-to-alignment-research/] TIMESTAMPS: On some podcast players you should be able to click the timestamp to jump to that time. (00:00) - Introduction (03:16) - Recursive self-improvement, how long until superintelligence (10:50) - What can be learned in the digital realm (14:21) - How fast can it learn in the real world (18:34) - Can AGI become better than us? (22:54) - Complex enough environment to create superintelligence? (29:10) - Can AGI Thomas take over the world? (37:40) - Is superintelligence irrelevant for safety? (41:38) - Existential risk from AI? (48:09) - How to decrease the chance of a bad outcome? (49:08) - Regulations (53:19) - ChatGPT and the best current models (59:57) - Solution to the treacherous turn?   (1:05:01) - AGI becomes religious? (1:11:03) - Starting point of the intelligence explosion? (1:16:49) - OpenAI Alignment approach blog post (1:18:29) - Is Open source bad for safety? (1:24:49) - How to contact me

Comentarios

0

Sé la primera persona en comentar

¡Regístrate ahora y forma parte de la comunidad de Safe Transition Talks!

Prueba gratis

Empieza 7 días de prueba

$99 / mes después de la prueba. · Cancela cuando quieras.

  • Podcasts solo en Podimo
  • 20 horas de audiolibros al mes
  • Podcast gratuitos

Todos los episodios

1 episodios

episode #1 - Thomas Hickey: AGI Takeoff, Existential Risk, Regulation Ideas artwork

#1 - Thomas Hickey: AGI Takeoff, Existential Risk, Regulation Ideas

(See timestamps below) Thomas Hickey is a Dutch student in both philosophy and artificial intelligence at Utrecht University. We talk about his bachelor thesis on A.G.I. or Artificial General Intelligence, on bottlenecks for recursive self-improvement. But also go into existential risk and what we can do about it. CONTACT INFO: Alex van der Meer email: safetransitionREMOVETHIS@gmail.com but remove capital letters, (for spam) SEE MORE OF ME: - Twitter: https://twitter.com/AlexvanderMeer5 [https://twitter.com/AlexvanderMeer5] - YouTube: https://www.youtube.com/@safetransition9743 [https://twitter.com/AlexvanderMeer5] EPISODE LINKS: Eliezer Yudkowsky, on why it is lethal not to have retries https://intelligence.org/2022/06/10/agi-ruin/ [https://intelligence.org/2022/06/10/agi-ruin/] OpenAI on their approach to alignment blog post https://openai.com/blog/our-approach-to-alignment-research/ [https://openai.com/blog/our-approach-to-alignment-research/] TIMESTAMPS: On some podcast players you should be able to click the timestamp to jump to that time. (00:00) - Introduction (03:16) - Recursive self-improvement, how long until superintelligence (10:50) - What can be learned in the digital realm (14:21) - How fast can it learn in the real world (18:34) - Can AGI become better than us? (22:54) - Complex enough environment to create superintelligence? (29:10) - Can AGI Thomas take over the world? (37:40) - Is superintelligence irrelevant for safety? (41:38) - Existential risk from AI? (48:09) - How to decrease the chance of a bad outcome? (49:08) - Regulations (53:19) - ChatGPT and the best current models (59:57) - Solution to the treacherous turn?   (1:05:01) - AGI becomes religious? (1:11:03) - Starting point of the intelligence explosion? (1:16:49) - OpenAI Alignment approach blog post (1:18:29) - Is Open source bad for safety? (1:24:49) - How to contact me

17 de ene de 20231 h 25 min