Streaming Data Using Spark with Dustin Vannoy

How Marketing Analytics Uses Data to Drive Sales with Eric Ramos (Business Online)

Marketing dollars power loads of industries that surround our lives. In this episode we talk with Eric Ramos who is the Director of Data Analytics at Business Online, a B2B marketing firm, about how combining data from disparate sources leads to greater marketing insights and ultimately sales for their clients. How to Connect with Eric Ramos: - TWITTER:   / eramos42   [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbXhJWUxObFFYWDYteDFsczNMWWo4VVVibkdud3xBQ3Jtc0tuWXFtbEhPWERMUGlXRTI4X2FUSFB0ai00SEd4Ni1LWERYNWVfNWpfRGh4ZUV6LUtENjVWMVpmX3dQb0o0MDhwWTBIbTdxMk5yVEluc000RWdFSnp1bnVDanJJVjNKbXk5VUxYczZ1MmtaTkZOdTcwRQ&q=https%3A%2F%2Ftwitter.com%2Feramos42&v=4cbh2s0iOSA] - LINKEDIN:   / eramos42   [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbkZuVldqVmtaOHVOdG5UbW8tS2tpZDJ2MHdzd3xBQ3Jtc0ttU0h1TlJsbG9JdGR4YWtZczN5dDVId3RnR3hGUkFvR3RERUdqcVhSZmF4SUdTY0NwRUw5eHlPM1UweGQxWjI5bDRXSjFkX3F5ODhsYnlRYkkxb3p1R1RmQWYzRzRHTWhSaTRGUUQwMC0xSUxGUVdRUQ&q=https%3A%2F%2Fwww.linkedin.com%2Fin%2Feramos42&v=4cbh2s0iOSA] - COMPANY WEBSITE: https://www.businessol.com [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqazhDREMwa01WMDRKZmVtR2p6S2N0TkY1OFVZd3xBQ3Jtc0tuN2RQZl9BRHlxdElLOXQ3OFNXOTJtZUF2NzBqTGszemFRLUZjcThmSFVWMFZlYmx1NUI2eTBWQ0VsTktMaFhFbXdLdnYtWGdSaXQ2MC1qQ2dKV0xXOTZQN1NxU1hLVFlDZjlpWlU2aE82WlNUMUhiWQ&q=https%3A%2F%2Fwww.businessol.com%2F&v=4cbh2s0iOSA] / https://www.kudoz.io/ [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbmJsdVpOV1pWMW9DLUowT0xOYmxxandhaV8zZ3xBQ3Jtc0ttUTJLMEJ4bWdra0w2dXZfc3JZX2JXTUlCQ01reFdsUzNUQ1dkd2pib0hENl9lUUs3MU9tM3V6TXFpR01DNExIUk9sYUxCNWtuVnNRSy1LWUNEOXgzSnoxaE9WVzFIT3E3cHFlZHY0SDVlUmdzaUljdw&q=https%3A%2F%2Fwww.kudoz.io%2F&v=4cbh2s0iOSA] Learn data skills at our academy and elevate your career. Start for free at https://ftdacademy.com/YT [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbldnT2FTMVItYlNtVlRSenM0blp3cFZmaGZUZ3xBQ3Jtc0trSU9TNU1IVm8yc1B3MTVWRVJ5Qnk3bXlqY1dNTGkzU2hidVlMWjdSNGFtZWp3ZHZKbW1LbFh0bmN0blNZeUdHbEs4dTlSUnN6c2lIR3FXM1Y2NTAwRVBfRzJ1aWI1SHF0c1VPZEVtVkN1dmdjZy1fdw&q=https%3A%2F%2Fftdacademy.com%2FYT&v=4cbh2s0iOSA] CHAPTERS: 0:00:00 [https://www.youtube.com/watch?v=4cbh2s0iOSA&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=11&t=0s] Intro 0:01:13 [https://www.youtube.com/watch?v=4cbh2s0iOSA&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=11&t=73s] What does a Director of Data Analytics do? 0:04:12 [https://www.youtube.com/watch?v=4cbh2s0iOSA&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=11&t=252s] Eric's background 0:19:35 [https://www.youtube.com/watch?v=4cbh2s0iOSA&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=11&t=1175s] What are the key steps do deliver insights with marketing analytics? 0:25:14 [https://www.youtube.com/watch?v=4cbh2s0iOSA&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=11&t=1514s] How to implement marketing intelligence 0:32:48 [https://www.youtube.com/watch?v=4cbh2s0iOSA&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=11&t=1968s] What is the difference between Marketing and Branding? 0:44:56 [https://www.youtube.com/watch?v=4cbh2s0iOSA&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=11&t=2696s] How cross-channel targeting works 0:50:19 [https://www.youtube.com/watch?v=4cbh2s0iOSA&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=11&t=3019s] How data is being shared among marketing vendors 0:57:10 [https://www.youtube.com/watch?v=4cbh2s0iOSA&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=11&t=3430s] How to optimize web pages while still collecting marketing dasta 0:59:55 [https://www.youtube.com/watch?v=4cbh2s0iOSA&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=11&t=3595s] How marketers can work with customer service to deliver better user experiences 1:02:50 [https://www.youtube.com/watch?v=4cbh2s0iOSA&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=11&t=3770s] How to act upon marketing intelligence 1:04:55 [https://www.youtube.com/watch?v=4cbh2s0iOSA&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=11&t=3895s] What is A/B Testing? 1:10:13 [https://www.youtube.com/watch?v=4cbh2s0iOSA&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=11&t=4213s] Are you ever done marketing? 1:12:07 [https://www.youtube.com/watch?v=4cbh2s0iOSA&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=11&t=4327s] How does AI help marketing? 1:15:57 [https://www.youtube.com/watch?v=4cbh2s0iOSA&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=11&t=4557s] What is the next for Machine Learning and Marketing? 1:21:37 [https://www.youtube.com/watch?v=4cbh2s0iOSA&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=11&t=4897s] What are the different roles in Marketing Analytics? 1:27:15 [https://www.youtube.com/watch?v=4cbh2s0iOSA&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=11&t=5235s] What are the key skills for Marketing Analysts? 1:29:41 [https://www.youtube.com/watch?v=4cbh2s0iOSA&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=11&t=5381s] Outro

Seeing Data in Tableau with Andy Cotgreave (Tableau)

Being able to see and understand your data is at the heart of Tableau's mission. Since they're debut Tableau has upended the data analytics industry with these principles and their easy to use self-service analytics software. On today's episode we hear from Tableau Evangelist, data veteran, and former magician, Andy Cotgreave on the keys to success in data as well as how Tableau software enables you to succeed. How to Connect with Andy: - TWITTER:   / acotgreave   [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbjdNbWx1TWVfQVc1MUppNVJyZXl2dHRvR2FDd3xBQ3Jtc0ttVkRqckhQSC1iUTE3WHlWZkhaMW1NUTFWS2t2bXg0dlVuT2Uzd0tzUlg0aDRQZkhjSXNDMEVoSzZDV0tHVDNJOERGWE04QWJSVnBkY1haRS14SkxVQ3JtRHJ2eWM5X0h4RUdiLTNfMUc2U2ozUGpVbw&q=https%3A%2F%2Ftwitter.com%2Facotgreave&v=uhx_r7JYhRQ] - LINKEDIN:   / acotgreave   [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbFNORGxIX3dweHdiMmVRSzhSMk9iMUlVRHNZZ3xBQ3Jtc0ttbUROYk9VbXptMzViUGhwdzBKNlZLTGs1UnBYQThiRjNLMlVVd01yb0lKY0hTZWRqRmtHRV81d3A0SEthN2FOT0hFSVdGcFZkb2JDbG9iOW1Qd3p6SzBESjNqdTBRVVpiSDdVRG1laExKai1WaENFdw&q=https%3A%2F%2Fwww.linkedin.com%2Fin%2Facotgreave%2F&v=uhx_r7JYhRQ] - COMPANY WEBSITE: https://www.tableau.com/ [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbUY1TTRXdkppSXVlX0ZSY3d1aGZQM1BxSkZ1UXxBQ3Jtc0tsb1kyVDJWdjNKa2hvUWpjb1pMZkVSTC1aQTdjeWl1TFNOTDdoTG1CUmtFRl9sQll2Y3g3RzdrQ3NMZ3p3cjYtLUlfeTlhZVZnRDkyNEhNcDVSVG1XbHZlZHJUaDZVWHlVQnFLVXJoTFhWYzU0ekRFRQ&q=https%3A%2F%2Fwww.tableau.com%2F&v=uhx_r7JYhRQ] - https://www.interaction-design.org/li... [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbW9IY2tXSlBPV0tzV3dseVpQZEJWRkIzellPZ3xBQ3Jtc0traGV1UjJmdzduRmh2cEpRVlBONzF0elRfZFZfMVV6Q0tlSHBvZklyenlsdmtRSl8xdmltLUdrSXNZU0EwQTNTM0RrSHM0NVUyS00zMUJ4OEJoQlEtNk5HeHZQRWVkcVlkRDY3OExOUDUtR1VaZ0lkMA&q=https%3A%2F%2Fwww.interaction-design.org%2Fliterature%2Farticle%2Fshneiderman-s-eight-golden-rules-will-help-you-design-better-interfaces&v=uhx_r7JYhRQ] Learn data skills at our academy and elevate your career. Start for free at https://ftdacademy.com/YT [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbk5BbzJ0Q3lycnJURTEwbVhBS01nQ0hFdi1zQXxBQ3Jtc0ttVDZfS1NUeUFtNkZneWkycDNXUTBNSVp1QXRsX25PMW9VVmx3LXFGSjBkbzFaWXo5aWg2dlotaC1ja2NlNnZyTm5QUTA3b05JcHYyQTBuaGYtTlRBeTNWMi02WWk1VHpLWVlrU1dzN1VVQ29rbUg3OA&q=https%3A%2F%2Fftdacademy.com%2FYT&v=uhx_r7JYhRQ] CHAPTERS: 0:00:00 [https://www.youtube.com/watch?v=uhx_r7JYhRQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=10&t=0s] Intro 0:01:04 [https://www.youtube.com/watch?v=uhx_r7JYhRQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=10&t=64s] Andy's Background 0:08:36 [https://www.youtube.com/watch?v=uhx_r7JYhRQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=10&t=516s] What Skills Should Data Analysts Learn? 0:12:40 [https://www.youtube.com/watch?v=uhx_r7JYhRQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=10&t=760s] What type of design skills should a Data Pro learn? 0:16:42 [https://www.youtube.com/watch?v=uhx_r7JYhRQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=10&t=1002s] What are some pitfalls to avoid when designing dashboards? 0:27:56 [https://www.youtube.com/watch?v=uhx_r7JYhRQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=10&t=1676s] How to present with data 0:36:50 [https://www.youtube.com/watch?v=uhx_r7JYhRQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=10&t=2210s] What can we learn from journalism as a data analyst? 0:41:15 [https://www.youtube.com/watch?v=uhx_r7JYhRQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=10&t=2475s] What's the difference between exploratory and explanatory dashboards? 0:43:31 [https://www.youtube.com/watch?v=uhx_r7JYhRQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=10&t=2611s] How does Tableau enable data analysis? 0:49:10 [https://www.youtube.com/watch?v=uhx_r7JYhRQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=10&t=2950s] How does Tableau help you become a better designer 0:52:13 [https://www.youtube.com/watch?v=uhx_r7JYhRQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=10&t=3133s] Do I need Tableau desktop to create analytics? 0:53:25 [https://www.youtube.com/watch?v=uhx_r7JYhRQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=10&t=3205s] Outro

Picking the Right Metrics with James Mayfield (Transform.co)

Building trust into the metrics your company use to guide their decision making is a difficult task. Former Facebook and AirBnB Data Product Manager James Mayfield shares his insights into why focusing on the metrics is the right path to take to enable trust in your companies data. How to Connect with James: - COMPANY WEBSITE: https://transform.co/ [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbGVfeDZwTl9hbVd0Y0Vud3d4cmZSUkFFSDhtUXxBQ3Jtc0ttY2J0bU1EaUtfZHREc182dzIwMEdIRmQ0c2lEekpxNTBMRDl2ajhFMEp0V2VOVnNpd2w3cWl5TTNGQXJaRXRnZDlzRW9TVVplRWsyLWpCMGp4UlJoR0VvMlVfT2VwMWFTTm13VGpqblh1QmRvd3VnNA&q=https%3A%2F%2Ftransform.co%2F&v=Awy_oQ6mNAs] - EMAIL: james@transform.co Learn data skills at our academy and elevate your career. Start for free at https://ftdacademy.com/YT [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqa0V0SDNGZXpQNktTN2VueFBsa05jR3ZEZ0NWUXxBQ3Jtc0tuSXItX0ZIWmZXdERCWXJxLXFnWF93bmpYR041TnBVaHpyS2Jra01xUW9LV2xENTZwNDI0YjFKN2c2SnZDUTQ5Y1dJbFlxbG8xRGJMeTZndDRmSTV0ZGtaMjlzOEdkTGtRU0FuNURRa2dNVHR2dEs5aw&q=https%3A%2F%2Fftdacademy.com%2FYT&v=Awy_oQ6mNAs] CHAPTERS: 0:00:00 [https://www.youtube.com/watch?v=Awy_oQ6mNAs&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=9&t=0s] Intro 0:01:11 [https://www.youtube.com/watch?v=Awy_oQ6mNAs&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=9&t=71s] Working at Facebook in the Early Days 0:12:29 [https://www.youtube.com/watch?v=Awy_oQ6mNAs&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=9&t=749s] Developing Big Data Tools at Facebook 0:16:55 [https://www.youtube.com/watch?v=Awy_oQ6mNAs&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=9&t=1015s] Transitioning to Analytics from Project Management 0:21:33 [https://www.youtube.com/watch?v=Awy_oQ6mNAs&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=9&t=1293s] Building Data Tools at Facebook 0:24:42 [https://www.youtube.com/watch?v=Awy_oQ6mNAs&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=9&t=1482s] How to chart your career path in data 0:29:52 [https://www.youtube.com/watch?v=Awy_oQ6mNAs&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=9&t=1792s] Building Data Products at AirBnB 0:33:45 [https://www.youtube.com/watch?v=Awy_oQ6mNAs&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=9&t=2025s] Why Metrics Should be the Focus 0:43:55 [https://www.youtube.com/watch?v=Awy_oQ6mNAs&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=9&t=2635s] Where does Transform's Platform fit in to the modern data architecture 0:45:15 [https://www.youtube.com/watch?v=Awy_oQ6mNAs&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=9&t=2715s] How to visualize the key metrics using Transform 0:47:13 [https://www.youtube.com/watch?v=Awy_oQ6mNAs&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=9&t=2833s] How to version control your Metric definitions 0:50:16 [https://www.youtube.com/watch?v=Awy_oQ6mNAs&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=9&t=3016s] Links for James

Giving Computers Vision with Satya Mallick (OpenCV)

Computer Vision is a popular field of Artificial Intelligence that enables applications such as facial recognition and self-driving cars. In this episode we hear from Dr. Satya Mallick who has been working in the field since it's birth on all the various aspect of Computer Vision and how you can learn it to break into the field of AI. CHAPTERS: 0:00:00 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=0s] Intro 0:01:22 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=82s] Satya's Background 0:02:53 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=173s] What is Computer Vision? 0:08:02 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=482s] What is Open CV? 0:12:18 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=738s] Evolution of Computer Vision Field 0:14:35 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=875s] What is Artificial Intelligence? 0:18:22 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=1102s] The birth of Machine Learning 0:20:26 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=1226s] The birth of Deep Learning 0:24:48 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=1488s] What is Machine Learning? 0:30:07 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=1807s] What is Unsupervised Learning? 0:34:10 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=2050s] How to keep bias out of AI Algorithms 0:41:59 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=2519s] The Deep Learning Mafia 0:47:09 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=2829s] The evolution of Deep Learning 0:52:26 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=3146s] What is GAIT detection? 0:54:15 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=3255s] What are the areas of Computer Vision? 0:59:30 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=3570s] What Programming Languages Do You Use in Computer Vision? 1:01:49 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=3709s] Where do we learn OpenCV? 1:04:48 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=3888s] How do I get a job in Computer Vision? 1:13:39 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=4419s] What is PyTorch? 1:15:49 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=4549s] Why GPUs are Better for Machine Learning? 1:19:17 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=4757s] How Algorithms Optimize Themselves? 1:26:14 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=5174s] How big are algorithms? 1:28:33 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=5313s] How do you design neural networks? 1:32:57 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=5577s] What Programming Languages do Machine Learning Pros Use? 1:36:03 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=5763s] What are the different Machine Learning Roles? 1:41:14 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=6074s] Deployment Methods for Machine Learning Models 1:47:40 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=6460s] How to share your work and get hired? 1:50:27 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=6627s] How much do AI engineers make? 1:57:28 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=7048s] How Computer Vision Handles Low-Light? 1:59:58 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=7198s] When will we have Self-Driving cars? 2:13:01 [https://www.youtube.com/watch?v=FUsnXt62J_4&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=8&t=7981s] Links for Satya How to Connect with Satya: - COMPANY WEBSITE: https://learnopencv.com/ [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbnhIYzQ4RnFOdE1SLVlGT3QxUEdTYXpqd0R0QXxBQ3Jtc0ttX3hqV3R2YnFELXJsQVp0TTNrbGYyZEpFQ1J1dW9Yd2NHRUJfWlduX041LWtjZ2NGM3RZdlFlbldDc0lkMkFfZFpWMHUtZDI0QmloZktpUUtmdmVGdGlWVW9FY1I5VGVVZDljSEZ4cFljUDVabU5IZw&q=https%3A%2F%2Flearnopencv.com%2F&v=FUsnXt62J_4] - TWITTER:   / learnopencv   [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbFJqb1lFM25oOUY2NVY4QXVHYVYtQlJteExZd3xBQ3Jtc0tsN2FNemNpZm1VQVh0SjNfTnphX3AtZVFfMmVxVFpMUU93MWZxY2s0bXRERzFON3ZweXU0a0ZYQUtmRDltei05Yk1teWZSVHY5YXQtS1NXOV8zWmlTdWxucmhha3hYUVFLSW52ZjJ1NVhxeFd5QkVBZw&q=https%3A%2F%2Ftwitter.com%2Flearnopencv&v=FUsnXt62J_4] - LINKEDIN:   / satyamallick   [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbEkxSndIbjZJZ2NLSW41NjhNMl9TTThoSy1DUXxBQ3Jtc0trTi1qSUJ6VHREcjJNNlNLN1VkU3pKeUpyOTJyMnc5NnhjQWVkdnd3dEhleU9ZMHJSWkhsb1lsZDNLOElMcVNBRG9iRWdPTWRCR1BiTUFDbTlzWmoxVzNMNDNKeUxNNG5ScThBUDhQSmh4dGpVc0JQWQ&q=https%3A%2F%2Fwww.linkedin.com%2Fin%2Fsatyamallick&v=FUsnXt62J_4] - EMAIL: spmalek@opencv.com Links Referenced: https://www.image-net.org/challenges/... [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbFdlZ2JoeWhZcVZMVTRTR09mOFFLTXVFMmRsQXxBQ3Jtc0tuVmZBTEFLMFlGTWR0S1RZY2wyZWhGUmI5eWxBQ1ZOclpoSlRkNkpSaDZCMjdrTmlFOWlNYzUyaGUtWkpmOWt6alVFb0ZrenB5Si0tc3NrZGRNSHFHa3BId3BlZzBDTjdKaGRtcnE3TDBfdmRqR0JVVQ&q=https%3A%2F%2Fwww.image-net.org%2Fchallenges%2FLSVRC%2F&v=FUsnXt62J_4]https://aipaygrad.es/ [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqblNhUEtwN3hJd2NrZVlYY21ZUnEwbXhEd2w3Z3xBQ3Jtc0trLV96SzlFZVR0VGo3RW01ZEdIc3FMOEFwVVJBWksxbWRxY0xnTEg3WkRCMU1tbDg5a2JzUUJ3ZG9xdGlVYTFzSXlyc1hnWVNvamZHWGttcUZqZVFCV2JrbVliRWk3dzNVUDBSY3BUSEQ4QUJIMnVZNA&q=https%3A%2F%2Faipaygrad.es%2F&v=FUsnXt62J_4] Learn data skills at our academy and elevate your career. Start for free at https://ftdacademy.com/YT [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbTIwaHBNRmdCY3BCVTUzTDFDVHRjTzNKeXBxd3xBQ3Jtc0trNVEzbWVxYmtsWTN3Z1Npb1l4RXBPbWZGMVV4bURQWWxnV3FVNWNoOE9pWFhwSzlYLVZ0bklzeXU4dUtTODdMaTdrT2RjTWx6QU5RYnB5YnRuWkpVZWVJeURvVldZYkNHTUNZV0VKcWZkd0x2cXgwNA&q=https%3A%2F%2Fftdacademy.com%2FYT&v=FUsnXt62J_4]

Streaming Data Using Spark with Dustin Vannoy

Data engineering has historically involved extracting data from disperate sources, transforming it to a standard layout, and then loading it into a new database for analytics. Usually these data engineering pipeline jobs would run on a schedule such as nightly or weekly. In today's fastpaced high-tech world however the need for data closer to real-time, meaning when it was first generated, is higher than ever. In today's episode we hear from Dustin Vannoy who is a consultant and blogger in the streaming data space about how to use Apache Spark, the most popular streaming analytics platform. How to connect with Dustin: - WEBSITE: https://dustinvannoy.com/ [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbWxpM3RHUFlXcUpjRk81czJxcGI3VEl6TEp2QXxBQ3Jtc0tsQTJ4SHNMcFpXWk5ZZjdfSllMbzFEYXU2Vl96VUxEN29rN0dsdEhJTjlJTVF3dllYRkhIQ2lucHVXZU03UjJEOGp1RHRsaEw2czUwTjgtLUUtdmNsSXVKaTRMaFRJSWd0YzdYUHgyWHpVZjV6dExaTQ&q=https%3A%2F%2Fdustinvannoy.com%2F&v=dw1hoxWqOpQ] - TWITTER:   / dustinvannoy   [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqa216dGI5UHJGdzg3c092ZE11Vk5JOWN1bEFHUXxBQ3Jtc0tsMGRld1RZQ1ZDdEFfUWJVdXRDT0pGMkF4N0hvb2wwOElOcnR2TDNSNV9Wd2tnSmFiajdNdENWWmRjUFgzdnFuSmVZUE11cG1URTN3ajNUdi1hMGNEY2xzV2lTMEljakR5ajJSd1dscmNaeXdBRzBrMA&q=https%3A%2F%2Ftwitter.com%2Fdustinvannoy&v=dw1hoxWqOpQ] - LINKEDIN:   / dustinvannoy   [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbG9sT3I5X0w3QmJFWFJvR2FJb2V3ZW1HQXN6d3xBQ3Jtc0ttYkxBRGluWnVlVDE1VVFNMnN1Wi1VWGV3cmExbWdzdXRjQnhtXzdZSjlqejV4SGdhd0R4QVYwSXZKNG1zQUQ4Q1lZbHlGbDFDUXBtWjNMWWw2N3Blc2pfVkZqTWtZUzBJWGs1S1R5bXlUdHF0dHQyaw&q=https%3A%2F%2Fwww.linkedin.com%2Fin%2Fdustinvannoy%2F&v=dw1hoxWqOpQ] - YOUTUBE:    / @dustinvannoy   [https://www.youtube.com/channel/UCYdC0t9EFtyVAs0-cwqVCTw/videos/videos] Learn data skills at our academy and elevate your career. Start for free at https://ftdacademy.com/YT [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbktILVUzTlJzYXpNUmRrT2MtTHB2UHVtOGt6UXxBQ3Jtc0tuQkh3ODJRdklaX0VYQXc5bC1zM3ZUN0FMY0lFZVJYWExGcHk3d3R4d3Jpb2hFSjdhQXZzb3Y0SDVueGJKZWRPWW5IdTA1WjBYU2tvenkwaU1NMlVHNlY2bF9WZkZGeFZsOHRzX2dLeWZQdW1ZejQtdw&q=https%3A%2F%2Fftdacademy.com%2FYT&v=dw1hoxWqOpQ] Chapters: 0:00:00 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=0s] Intro 0:01:01 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=61s] Dustin's Background 0:09:51 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=591s] Transitioning from legacy databases to Big Data and Streaming 0:13:29 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=809s] Microbatching vs Streaming 0:18:17 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=1097s] What is Spark and why use it? 0:22:33 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=1353s] Apache Spark vs Data Bricks 0:26:24 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=1584s] Pay for a hosted Spark version or roll your own? 0:28:27 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=1707s] Databricks setup 0:30:25 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=1825s] How Databricks executes queries 0:32:41 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=1961s] Scaling approaches to Spark 0:35:14 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=2114s] Connecting to external databases in databricks 0:37:51 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=2271s] Visualizing data in Databricks 0:39:40 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=2380s] Using Spark for ETL work 0:42:50 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=2570s] What is real-time processing? 0:44:25 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=2665s] How to build a streaming job in Spark using Kafka 0:46:18 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=2778s] Streaming architecture overview 0:49:15 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=2955s] Pulling data from Kafka into Spark streaming 0:51:09 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=3069s] Why apps use Kafka 0:54:33 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=3273s] Why use Spark versus alternatives 0:57:37 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=3457s] What is Confluent? 0:59:38 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=3578s] Ways to learn Spark 1:02:04 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=3724s] How hard is Spark to learn? 1:04:16 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=3856s] Troubleshooting errors in Spark 1:07:03 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=4023s] How hard is it to transition to Spark from traditional databases? 1:11:51 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=4311s] Interviewing for a Spark job 1:15:46 [https://www.youtube.com/watch?v=dw1hoxWqOpQ&list=PLMmWiZZ0QbBrMBMW7vECz4FykpocfBfdX&index=7&t=4546s] Outro