Scott Haines – Medium

Scott Haines

Featured Book

See all (2)

Delta Lake: the Definitive Guide: Modern Data Lakehouse Architectures with Data Lakes

Delta Lake: the Definitive Guide: Modern Data Lakehouse Architectures with Data Lakes

Ready to simplify the process of building data lakehouses and data pipelines at scale? In this practical guide, learn how…

2024

Denny Lee, et al.

Denny Lee, Prashanth Babu, et al.

Stories

Pinned

Published in
TDS Archive

A Modest Introduction to Analytical Stream Processing

Architectural Foundations for Building Reliable Distributed Systems.

Aug 15, 2023

A Modest Introduction to Analytical Stream Processing

Aug 15, 2023

Pinned

Published in
Level Up Coding

Spark on Kubernetes

A Hands-On Introduction: Getting Up and Running.

Sep 29, 2020

Left: Boxes describing containerized applications with one or more replicas. Middle: Ship Steering Wheel. Right: Success

Sep 29, 2020

Pinned

Published in
Level Up Coding

Data+AI 2022: Spark Inception:

Harnessing the Spark REPL to power Streaming Notebook Environments. For Fun. For Profit?

Jun 29, 2022

Data+AI 2022: Spark Inception:

Jun 29, 2022

Pinned

Published in
TDS Archive

From Data Lakes to Data Reservoirs

Create Clean, Beautiful, Protected Data Resources with Apache Spark and Delta Lake

Jul 31, 2020

Water crashing together. 3 states of water, from peaceful to disorderly. Intersecting to create beauty in chaos.

Jul 31, 2020

Published in
TDS Archive

A Gentle Introduction to Analytical Stream Processing

Building a Mental Model for Engineers and Anyone in Between

Mar 31, 2023

The image captures streams naturally coalescing into a waterfall. It is gentle before things begin to move faster, this is similar to data networks and streaming environments.

Mar 31, 2023

Working with Spark SQL Time Functions

A Hands-On Guide to Time with Apache Spark

Mar 7, 2023

Working with Spark SQL Time Functions

Mar 7, 2023

Published in
Level Up Coding

Towards Analytics with Redis

Using Hashes and Binary Data Structures

Feb 25, 2022

Feb 25, 2022

Problems All Writers Face

Learning to break mental blocks and unstuck yourself

May 26, 2021

Problems All Writers Face

May 26, 2021

Published in
TDS Archive

Analytical Hashing Techniques

Spark SQL Functions to Simplify your Life

Mar 11, 2021

Analytical Hashing Techniques

Mar 11, 2021

Published in
TDS Archive

Cache Patterns with Apache Spark

Balancing the choice between disk, ram and the source of truth

Feb 8, 2020

Shows a mirror with many different angles and views of the same scene

Feb 8, 2020

Scott Haines

Scott Haines

Book Author

Distinguished Software Engineer @ Nike. I write about all things data, my views are my own.

Following

Help
Status
About
Careers
Press
Blog
Privacy
Rules
Terms
Text to speech