Taking on 1 project this quarter

Pipelines that don’t wake anyone at 3am.

I’m Sohaib, a data engineer who builds ETL, streaming and governance systems for healthcare, fintech and classifieds platforms. Most of my work is the unglamorous kind: pipelines that hold up when the schema changes at 2am and nobody notices, because nothing broke.

Lahore, PK · remote-friendly · usually replies within a day · Databricks Certified

SOURCESINGESTTRANSFORMSERVEpostgreskafkas3cdctransformwarehousemodelWALDBT · TESTSSNOWFLAKEFEATURE STORE
$

01 / About

Placeholder portrait, to be replaced with a real photo

Sohaib Tanveer · Lahore

Data Engineer with a backend engineer’s instincts. I care about correctness, cost and the pager as much as the diagram.

Databricks Certified Data Engineer Associate, BS in Data Science. I’ve built medallion-architecture pipelines on Delta Lake, tag-driven masking in Snowflake, CDC that survives schema drift, and Django REST services before that. These days I am at Dubizzle Labs on the Classifieds, Motors and Properties data platform.

30%
query time cut
7m
stream latency, down from 10m
3
clouds in production

02 / Skills

A technical inventory, not a wish list.

Data Engineering & Streaming

where I live

Daily driver

PySparkDelta LakeSnowflakeKafkaAirflowDagsterdbtDatabricks Asset BundlesScrapyCDC / WAL parsing

Also fluent

FlinkDuckDBIceberg

Software Engineering

the craft underneath

Daily driver

PythonSQLDjango RESTFastAPIDockerKubernetes

Also fluent

TypeScriptReact / Next.jsTerraform

Cloud, AWS

primary platform

Daily driver

S3RedshiftGlueEMRLambdaKinesisAthena

Also fluent

Step FunctionsEKSIAM

Agentic Engineering

LLMs doing real work

Daily driver

agent orchestrationMCP toolingRAG pipelines

Also fluent

Claude / OpenAI APIseval harnesses

Cloud, Azure

secondary platform

Daily driver

Data FactoryEvent HubsAzure DatabricksADLS Gen2

Also fluent

SynapseAzure DevOps

Data Science Collaboration

picking up their tasks

Daily driver

Pandasfeature stores

Also fluent

JupyterPower BI

03 / Projects

Pipelines in production, and the hard parts.

04 / Notes

Field notes from the pipeline.

View all on Substack →

05 / Contact

Tell me what’s breaking.

A slow warehouse, a migration nobody wants to own, a pipeline held together with cron. Send the messy version. I read every message myself and reply within a day.

Also open to full-time data engineering and backend roles.

Send me a notesohaibt884@gmail.com

Goes straight to my inbox. No newsletter, no CRM, no follow-up sequence.