My name is Aaqa Ishtyaq. I am a polyglot software engineer with an interest in distributed systems, ML infrastructure, and inference engineering.

I have been writing code professionally for 7 years and, as a hobby, since I was 12. I like to read books, take photos, and hike in the mountains near my place.

I am an infrastructure engineer at Deel, working remotely from India on distributed systems at scale. Previously, I was a senior software engineer at HackerRank, building their core remote code execution system.

I am currently deep in ML infrastructure — building for inference engineering, fine-tuning, and training infrastructure. I am working on depot, a distributed Firecracker microVM orchestration platform, and arin, an AI-powered workflow automation system with multi-model LLM routing.

The theme of my blog is software engineering, but I tend to derive broader life lessons from retrospectives.

Here are some featured posts and pages:

Skills

Languages

  • Go
  • Rust
  • Python
  • CUDA
  • Ruby
  • TypeScript
  • Bash
  • SQL

Tools

  • vLLM
  • Triton Inference Server
  • TensorRT
  • ONNX Runtime
  • Weights & Biases
  • Ray
  • Firecracker
  • Buildkit
  • Containerd
  • Docker
  • Vim / VS Code

Frameworks

  • PyTorch
  • Hugging Face Transformers
  • DeepSpeed
  • Flash Attention
  • OpenTelemetry
  • Ruby on Rails
  • Django
  • React.js
  • Node.js

Others

  • GPU Cluster Orchestration
  • Distributed Training
  • Model Serving & Inference
  • Fine-tuning (LoRA / QLoRA)
  • Model Quantization
  • NCCL / RDMA Networking
  • Kubernetes
  • Nomad
  • PostgreSQL
  • gRPC / REST
  • AWS / GCP / OCI