List: Data and AI | Curated by Scott Haines | Medium

Jul 19, 2024

8 stories

Data and AI

In

Level Up Coding

by

Yousry Mohamed

Delta Lake Liquid Clustering — A visual explanation

How to optimize lakehouse data storage layout with minimal effort.

Jan 28, 2024

Delta Lake Liquid Clustering — A visual explanation

Jan 28, 2024

Steve Russo

Use Rust to Write Spark Apps

Until Spark 3.4, developing and deploying a Spark application was sometimes a big hassle. Getting Spark running locally for development…

Jul 3, 2024

Spark & Rust together!

Jul 3, 2024

In

DBSQL SME Engineering

by

Databricks SQL SME

Understanding Data Access Patterns with Unity Catalog Lineage

Author: Peter Davis, Sr. Solutions Architect @ Databricks

Jul 11, 2024

Understanding Data Access Patterns with Unity Catalog Lineage

Jul 11, 2024

In

The PayPal Technology Blog

by

Ilay Chen

Leveraging Spark 3 and NVIDIA’s GPUs to Reduce Cloud Cost by up to 70% for Big Data Pipelines

How PayPal achieved a remarkable cloud cost reduction through strategic GPU utilization

Feb 21, 2024

The “libra scales in the cloud” figure shows the computational resources equilibrium of a big CPU-cluster to a small GPU-cluster

Feb 21, 2024

In

Netflix TechBlog

by

Netflix Technology Blog

Sequential A/B Testing Keeps the World Streaming Netflix Part 1: Continuous Data

Michael Lindon, Chris Sanden, Vache Shirikian, Yanjun Liu, Minal Mishra, Martin Tingley

Feb 12, 2024

Using sequential anytime-valid hypothesis testing procedures to safely release software

Feb 12, 2024

In

Data Engineer Things

by

Hugo Lu

Column lineage is out: AI is in

Why column-level lineage will rapidly be replaced by artificial intelligence

Dec 19, 2023

Column lineage is out: AI is in

Dec 19, 2023

Mike Cvet

What is a Feed?

What’s happening under the hood on your “For you” feed?

Dec 11, 2023

What is a Feed?

Dec 11, 2023

In

GoPenAI

by

Tshepiso Mogoswane

Exploring Data Modelling with ChatGPT

Part 1: Manual Experiments with ChatGPT

May 8, 2023

Exploring Data Modelling with ChatGPT

May 8, 2023

Scott Haines

Scott Haines

Book Author

Distinguished Software Engineer @ Nike. I write about all things data, my views are my own.

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams