Avatar
šŸš€

Hi there, I’m Mike! šŸ‘‹

I’m an engineering manager at Capital One working on credit card servicing tech. I build products, grow teams, and occasionally write about software engineering and management.

What I Do

I spend my time on:

  • Learning, reading, and writing
  • Architecture and system design
  • Mentoring and leading a team building products and shipping features

Background

Things I’ve worked with along the way:

  • Python, Django, PySpark, ML, Hadoop
  • Java, Scala, Spring
  • AWS - a lot of it - EC2, EMR, ECS, EKS, Lambda, Glue, CloudFormation, and many more.
  • Side projects - a bit of Android and I wrote a CHIP-8 emulator for fun.

Outside of Work

My wife and I enjoy hiking, biking, traveling, and playing with our son and Shih Tzu.

Recent Posts

  1. Saving Money on Spark Jobs With Karpenter
    A typical modern Spark stack nowadays most likely runs Spark jobs on a Kubernetes cluster, especially for heavy usage. Workloads are moving away from EMR on EC2 ā€¦

    aws development kubernetes

  2. Resetting the Blog
    Hi there, Iā€™m Mike. šŸ”­ Iā€™m currently working on big data engineering with Spark on k8s on AWS at iSpot.tv. šŸŒ± Iā€™m focusing on mentoring and coaching my team to ā€¦

    development

  3. S3A on Spark 3.x in 2023
    Updating my post from almost 3 years ago! The world has moved on to Spark 3.3, and so have the necessary JARs you will need to access S3 from Spark. Run these ā€¦

    development spark

  4. Spark to Google Cloud Storage
    This is the last post in my series of how to connect Spark to various data sources. Here is how to connect to Google Cloud Storage using Spark 3.x. First, ā€¦

    spark