Tech Reading and Notes
  • Posts
  • Tag Index
  • Search
  • About
Navigation bar avatar

Netflix LLM Serving: Triton, vLLM, and Production Tradeoffs

Posted on November 16, 2026

Tags: AI LLM Infrastructure Netflix

Agent Architecture Patterns State and Recovery

Posted on February 16, 2026

Tags: AI LLM Architecture

Evaluating AI Coding Assistants with Reproducible Tasks

Posted on November 29, 2025

Tags: AI LLM Developer Tools

AgentCore Runtime Identity Memory and Observability

Posted on October 21, 2025

Tags: AWS AI LLM

Prompt Templates with Inputs and Evaluation Cases

Posted on September 3, 2025

Tags: AI LLM Writing

Comparing LlamaIndex and LangChain on Concrete Tasks

Posted on August 5, 2025

Tags: AI LLM Search

Bedrock Knowledge Bases and Reproducible RAG Evaluation

Posted on July 10, 2025

Tags: AWS LLM Search

Exchange Design Sequencing and Recovery

Posted on June 16, 2025

Tags: Distributed Systems Performance

Serving Copilot Completions Through a Proxy

Posted on May 9, 2025

Tags: LLM Infrastructure Performance

Spring AI and LangChain4j at the Same Application Boundaries

Posted on April 25, 2025

Tags: AI LLM Java

DeepSeek Models Distillation and Infrastructure Projects

Posted on March 1, 2025

Tags: AI LLM Infrastructure

Streamlit Reruns Forms and Session State

Posted on February 15, 2025

Tags: Data Infrastructure

Kafka Integration Testing with Explicit Lifecycles

Posted on January 27, 2025

Tags: Testing Kafka Infrastructure

KEDA Activation HPA Scaling and Queue Backlogs

Posted on December 11, 2024

Tags: Kubernetes Infrastructure

Haystack Retrieval with a Versioned Local Example

Posted on November 29, 2024

Tags: AI Search LLM

Quantiacs Stock Data and xarray Dimensions

Posted on October 11, 2024

Tags: Data Analytics

LLaMA-Factory Fine-Tuning and Adapter Lifecycle

Posted on September 16, 2024

Tags: AI LLM ML

Powertools for Lambda with Logging Tracing and Metrics

Posted on August 22, 2024

Tags: AWS Serverless Observability

RAG Inference Boundaries and Deployment Tradeoffs

Posted on July 3, 2024

Tags: LLM Infrastructure Search

A Brag Document with Evidence and Shared Credit

Posted on June 23, 2024

Tags: Career Leadership

Pinterest Ad Retrieval Ranking and Model Layers

Posted on June 7, 2024

Tags: ML Ranking Infrastructure

AST and LLM Test Migration at Slack

Posted on May 29, 2024

Tags: Testing LLM

Portfolio Analysis at Scale and Computational Graphs

Posted on May 15, 2024

Tags: Data Analytics Performance

Chronon and the Training Serving Feature Contract

Posted on April 25, 2024

Tags: ML Data Infrastructure

Performance Engineering as a Measurement Loop

Posted on April 3, 2024

Tags: Performance Infrastructure

Streaming Data Abstractions at Yelp

Posted on March 23, 2024

Tags: Data Streaming Infrastructure

AWS Lambda Cold Starts and the Invocation Path

Posted on March 16, 2024

Tags: AWS Performance Infrastructure

Distributed SQL Engines and Data Access

Posted on February 29, 2024

Tags: Data SQL Infrastructure

RAG Ingestion Retrieval and Answer Evaluation

Posted on February 8, 2024

Tags: AI LLM Search

Generally AI Notes on Language Models and Audio

Posted on February 3, 2024

Tags: AI LLM Security

Griffin Training Serving and Feature Contracts

Posted on January 7, 2024

Tags: ML Infrastructure

How Staff Engineers Help Before During and After Incidents

Posted on January 6, 2024

Tags: Leadership Reliability

Cloudflare ML Platform and GitOps Boundaries

Posted on December 9, 2023

Tags: ML Infrastructure

Airflow and Flyte for Batch Workflows

Posted on November 21, 2023

Tags: Data Orchestration

Staff Engineering Technical Direction and Influence

Posted on November 19, 2023

Tags: Leadership Career

Venice Within LinkedIn AI Infrastructure

Posted on August 9, 2023

Tags: ML Data Infrastructure

People Search Retrieval and Ranking at LinkedIn

Posted on July 12, 2023

Tags: ML Search

Lucene Inside Search Servers

Posted on May 30, 2023

Tags: Search Infrastructure

Cloud Cost Optimization Through Workload Accounting

Posted on March 12, 2023

Tags: Infrastructure Cost Performance

Jetson Nano Object Detection and Custom Actions

Posted on January 21, 2023

Tags: ML Edge Jetson

Explaining Why Before How and What

Posted on September 10, 2022

Tags: Leadership Communication

Comparing Cloud Edge Reconciliation Designs

Posted on June 22, 2022

Tags: Kubernetes Edge Infrastructure

Local Kubernetes Distributions and Container Tools

Posted on February 21, 2022

Tags: Kubernetes Infrastructure

An ML Infrastructure Responsibility Map

Posted on December 29, 2021

Tags: ML Infrastructure Orchestration

Career Growth Coaching and Role Changes

Posted on November 7, 2021

Tags: Career Leadership

SageMaker Pipelines and MLflow Solve Different Parts

Posted on June 19, 2021

Tags: AWS ML Orchestration

Choosing Data Tools by Responsibility

Posted on May 3, 2021

Tags: Data Orchestration Infrastructure

SageMakerEstimator and the Spark Job Boundary

Posted on April 16, 2021

Tags: AWS Spark ML

Dagster Plans Runs and Execution Boundaries

Posted on March 9, 2021

Tags: Data Orchestration

Lakehouse Storage Metadata and Query Execution

Posted on February 22, 2021

Tags: Data Architecture

Questions Before Shipping a Model

Posted on September 19, 2020

Tags: ML Infrastructure

Career Development Practices I Can Repeat

Posted on September 5, 2020

Tags: Career

Slack Infrastructure and Message Boundaries

Posted on July 7, 2020

Tags: Infrastructure Distributed Systems

Netflix Meson and Dynamic ML Workflows

Posted on May 18, 2020

Tags: Netflix ML Orchestration

Netflix Data Processing and Storage Evolution

Posted on May 17, 2020

Tags: Netflix Data Infrastructure

Netflix Playback and Identity Boundaries

Posted on May 16, 2020

Tags: Netflix Infrastructure

Selected AWS Service Notes from April 2020

Posted on April 30, 2020

Tags: AWS Infrastructure

A Reinforcement Learning Battlesnake Workflow

Posted on March 27, 2020

Tags: ML AWS

Behavioral Interviews and Constructive Feedback

Posted on March 25, 2020

Tags: Career Leadership

NGINX Workers Events and Graceful Reloads

Posted on March 24, 2020

Tags: Infrastructure Performance

Michelangelo and the ML Production Lifecycle

Posted on March 12, 2020

Tags: ML Infrastructure

A Conceptual Ride-Hailing System Design

Posted on January 5, 2020

Tags: Architecture Distributed Systems

Similarity-Based Predictions at Uber

Posted on September 28, 2018

Tags: ML Search

Sizing a Historical Elasticsearch Service Workload

Posted on December 10, 2017

Tags: AWS Search Performance

Scaling Data Quality at Netflix

Posted on November 11, 2017

Tags: Data Netflix

Crowd Motifs for Automated Mobile Testing

Posted on October 7, 2017

Tags: Testing Research

Understanding Spark Executor Memory

Posted on October 3, 2017

Tags: Data Spark Performance

An IoT Stack with Spark and Ignite

Posted on September 23, 2017

Tags: Data Spark Infrastructure

Spark Shuffle Tuning at Facebook

Posted on September 14, 2017

Tags: Data Spark Performance

Spark RDDs DataFrames and Datasets

Posted on September 9, 2017

Tags: Data Spark

Topic Models in GoDaddy Customer Success

Posted on August 17, 2017

Tags: ML Spark Data

Watermarks and Late Data in Structured Streaming

Posted on August 10, 2017

Tags: Data Spark Streaming

Netflix Network Monitoring with Kinesis

Posted on August 8, 2017

Tags: Infrastructure AWS Observability

Running Spark on Kubernetes

Posted on August 1, 2017

Tags: Data Spark Kubernetes

User Behavior Anomaly Detection at Salesforce

Posted on July 31, 2017

Tags: ML Spark

Intel BigDL and Distributed Training

Posted on July 31, 2017

Tags: ML Spark

Spark Sessions Through Livy at PayPal

Posted on July 15, 2017

Tags: Data Spark Infrastructure

Random Walks on Large Graphs with Spark at LinkedIn

Posted on July 3, 2017

Tags: Data Spark Search

Hive Bucketing and Spark Join Plans

Posted on June 26, 2017

Tags: Data Spark

Scaling ML Workloads with Spark at Krux

Posted on June 21, 2017

Tags: Data Spark Infrastructure

Flint and Time-Aware Joins

Posted on February 15, 2017

Tags: Data Spark

Multitenancy and Isolation Choices

Posted on February 14, 2017

Tags: Architecture Infrastructure

Structured Streaming ETL from Files

Posted on February 6, 2017

Tags: Data Spark Streaming

Distributed Tracing at Uber

Posted on February 5, 2017

Tags: Infrastructure Observability Uber

About This Engineering Notebook

Posted on February 4, 2017

Tags: Writing
  • Email me
  • GitHub
  • LinkedIn
  • Google Scholar

Xin Ren  •  2026

Copyright © 2025 Xin Ren