List: Apache Spark Ecosystem | Curated by Scott Haines | Medium

Oct 21, 2023

6 stories

1 save

Apache Spark Ecosystem

Scott Haines

Working with Spark SQL Time Functions

A Hands-On Guide to Time with Apache Spark

Mar 7, 2023

Working with Spark SQL Time Functions

Mar 7, 2023

In

Better Programming

by

Steve Russo

I Asked ChatGPT to Build a Data Pipeline, and Then I Ran It

Your job might be safe. For now…

Apr 5, 2023

I Asked ChatGPT to Build a Data Pipeline, and Then I Ran It

Apr 5, 2023

Ivan Trusov

Writing PySpark logs in Apache Spark and Databricks

Collecting, configuring and writing logs in Apache Spark and Databricks environments.

Jun 13, 2022

Writing PySpark logs in Apache Spark and Databricks

Jun 13, 2022

Matthew Powers

Testing Spark Applications

Testing Spark applications allows for a rapid development workflow and gives you confidence that your code will work in production.

Jan 14, 2017

Testing Spark Applications

Jan 14, 2017

Scott Haines

Data+AI 2022: Spark Inception:

Harnessing the Spark REPL to power Streaming Notebook Environments. For Fun. For Profit?

Jun 29, 2022

Data+AI 2022: Spark Inception:

Jun 29, 2022

In

The PayPal Technology Blog

by

Ohad Raviv

PayPal Introduces Dione, an Open-Source Spark Indexing Library

Enable faster interaction with Hadoop data

Oct 5, 2021

PayPal Introduces Dione, an Open-Source Spark Indexing Library

Oct 5, 2021

Scott Haines

Scott Haines

Book Author

Distinguished Software Engineer @ Nike. I write about all things data, my views are my own.

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams