2021-Management-Sanchez-Williams

Conference Video|Duration: 47:21
September 23, 2021
View this past event
Please login to view this video.
  • Video details
    In this talk we will address the six stages of data pipeline maturity. Most companies today are between stage zero and one, with some batch query ability that is unreliable and probably takes too long. The best companies like AirBnB and Google have near real-time abilities to leverage data. We’ll talk about the different kinds of data stores, data lakes, data warehouses, data brokers with names such as Iceberg, Glacier, Snowflake, Cosmos, BigQuery, Synapse, Redshift, Firebase. We’ll look at data at rest and streaming data on the move, data in your systems, data in the Cloud and data that you’ve backed-up for that rainy-day when hackers encrypt everything.  What functionality do we need and what products should we bet on. As Jeff Lawson, the CEO of $65 billion Twilio said, “Ask your developers why you need us”.  Today that question applies to many more products like Confluent’s Kafka, Debezium, AIrFlow, Cassandra etc. Most companies think they need data scientists who know machine learning without realizing that without, fast and stable data pipelines these will be “luxury employees”.  We’ll talk about the relatively unknown but critical field of data engineering and why you might want to hire them.
Locked Interactive transcript
Please login to view this video.
  • Video details
    In this talk we will address the six stages of data pipeline maturity. Most companies today are between stage zero and one, with some batch query ability that is unreliable and probably takes too long. The best companies like AirBnB and Google have near real-time abilities to leverage data. We’ll talk about the different kinds of data stores, data lakes, data warehouses, data brokers with names such as Iceberg, Glacier, Snowflake, Cosmos, BigQuery, Synapse, Redshift, Firebase. We’ll look at data at rest and streaming data on the move, data in your systems, data in the Cloud and data that you’ve backed-up for that rainy-day when hackers encrypt everything.  What functionality do we need and what products should we bet on. As Jeff Lawson, the CEO of $65 billion Twilio said, “Ask your developers why you need us”.  Today that question applies to many more products like Confluent’s Kafka, Debezium, AIrFlow, Cassandra etc. Most companies think they need data scientists who know machine learning without realizing that without, fast and stable data pipelines these will be “luxury employees”.  We’ll talk about the relatively unknown but critical field of data engineering and why you might want to hire them.
Locked Interactive transcript

More Videos From This Event

See all videos