10.12-13.22-DigitalTech-Williams

Conference Video|Duration: 41:29
October 12, 2022
Please login to view this video.
  • Video details

    Last year I was really pleased that I could load a 1 million row table into a Pandas DataFrame on my Mac.  This year I could rip through a 12 billion row table in a couple of seconds using Google’s BigQuery.  That’s a 10,000 times improvement in one year. Oh, and it cost me nothing. So what’s the problem?  Why are companies still struggling with their Digital Transformations? Why is there no silver bullet?  In this talk, we’ll look at the modern data stack offerings on AWS, Google, Azure, Databricks, and Snowflake and talk about why other companies, such as dbt, Fivetran, Confluent and Apollo solve problems with your APIs and data pipelines. We’ll see that ultimately its still a “people problem” and that our experience with DevOps, LeanDevOps and Agile teams show that C2 Command and Control is giving way to other organizational structures that leverage SO, Self-Organization, and our knowledge of  Complex Adaptive Systems.

Locked Interactive transcript
Please login to view this video.
  • Video details

    Last year I was really pleased that I could load a 1 million row table into a Pandas DataFrame on my Mac.  This year I could rip through a 12 billion row table in a couple of seconds using Google’s BigQuery.  That’s a 10,000 times improvement in one year. Oh, and it cost me nothing. So what’s the problem?  Why are companies still struggling with their Digital Transformations? Why is there no silver bullet?  In this talk, we’ll look at the modern data stack offerings on AWS, Google, Azure, Databricks, and Snowflake and talk about why other companies, such as dbt, Fivetran, Confluent and Apollo solve problems with your APIs and data pipelines. We’ll see that ultimately its still a “people problem” and that our experience with DevOps, LeanDevOps and Agile teams show that C2 Command and Control is giving way to other organizational structures that leverage SO, Self-Organization, and our knowledge of  Complex Adaptive Systems.

Locked Interactive transcript