011: Designing for Embeddings with Partitioning

011: Designing for Embeddings with Partitioning

The conversation delves into the design considerations for embedding models, storage and management of embedding models, model versioning, separate tables for embedding models, switching data and model cut-over, strategic partitioning for data analysis, handling chunking and provenance tracking, recency and legal requirements, read, write, and data structure considerations, and policy-based management for agents. Takeaways * Embedding models require careful design and consideration * The use of separate tables for embedding models allows for flexibility and better management Chapters 00:00 Exploring Vector Use Cases 02:44 Embedding Storage Strategies 05:29 Managing Embedding Models 08:10 Data Partitioning and Embedding 10:42 Designing for Change in Embeddings 13:36 Best Practices for Database Agents

010: Reconciling Database Sprawl and Hybrid Queries

The conversation delves into the use of vector search for identifying schema and table structure similarities, highlighting its benefits and limitations. It explores the challenges of using vector search to identify redundancy and foreign key relationships within databases. Takeaways * Vector search for schema and table structure similarities * Limitations of vector search in identifying redundancy and foreign key relationships Chapters * 00:00 Schema and Table Structure Similarities

009: Navigating Vector Search and Staying Relevant

The conversation explores the power of AI and vector search, focusing on code exploration and analysis. It delves into the challenges of code sprawl, semantic similarity, and the potential of vector search to identify and address inconsistencies in code. The use of vector search as a tool for code analysis and refactoring is highlighted, along with its potential to enhance the role of DBAs and developers. The conversation also touches on the future role of AI agents in code search and the practical applications of vector search in database management. Takeaways * Code sprawl and semantic similarity pose challenges in code exploration and analysis. * Vector search can be used to identify inconsistencies in code and facilitate refactoring. * The use of vector search enhances the role of DBAs and developers in code analysis and refactoring. Chapters * 00:00 Introduction to Vector Search and Its Impact * 02:59 The Role of DBAs in Vector Search * 06:01 Agentic Coding and Its Implications * 08:59 Use Cases for Vector Search in E-commerce * 12:11 Prototyping with SQL Server and AI * 14:59 The Future of Vector Search and Its Adoption * 17:59 Conclusion and Final Thoughts

008: Unlocking the Power of Vector Search

Why isn't Vector Search taking off as fast as we expected? We both agree that the power and complexity of vector search are both pros and cons - setting its adoption rate at a slower pace. However, we both feel that those who embrace this technology -- and especially those that master it -- will be able to move forward much faster than those who do not. Agentic coding, prototyping, and AI integration are really ramping up; those who leverage this technology quickly, effectively, and most importantly, correctly will see incredible benefits in productivity and ability to adopt exciting and powerful features / capabilities. Unlike many other features that seemingly never went anywhere, vector search is here to stay. It's time to get motivated / educated in understanding and implementing vector search effectively. Takeaways * Vector search is a powerful feature with potential for data professionals * The complexity of vector search requires education and understanding for effective implementation Chapters * 00:00 Introduction to Vector Search * 06:01 Agentic Coding and Decision Making * 13:02 The Impact on Database Administrators * 18:59 Complexity and Potential of Vector Search

007: Productivity with Claude Code

Kimberly and Joe dive into the capabilities of Claude Code, demonstrating its use for automation, natural language interaction, and custom skill development. It explores the integration, extensibility, and learning potential of Claude Code, emphasizing optimization, efficiency, and the challenges associated with its use. The conversation explores the potential of AI in various aspects of database management, business exploration, and creative endeavors. They also discuss the challenges and opportunities presented by AI-generated content and the role of consultants and researchers in leveraging AI effectively. The discussion highlights the need for understanding and utilizing AI tools to make day-to-day tasks more efficient and productive. Takeaways * Claude Code enables natural language interaction for task automation * Custom skills and automation with Claude Code offer rapid prototyping and experimentation * Claude Code provides opportunities for optimization, efficiency, and integration with external tools Exploring new business ideas with AI and Claude Code * Leveraging AI for database management and creative endeavors Chapters * 00:00 Introduction to Claude Code * 05:58 Custom Skills and Automation * 12:09 Integration and Extensibility * 18:06 Learning and Iteration with Claude Code * 23:58 Optimization and Efficiency with Claude Code * 30:05 Challenges and Considerations * 36:16 Implementing Partitioning and Data Strategy * 42:36 Enforcing Best Practices in AI-Generated Databases * 47:46 The Role of Consultants and Researchers * 53:08 AI Applications in Reading and Learning * 59:46 Leveraging AI for Database Management