Languages & query
PythonPySparkSQLBashScala
DATA ENGINEERING / CLOUD / SYSTEMSData.
Hello, I'm Allvin Pal
Data.
Engineered.
For impact.
I build scalable data pipelines and lakehouse architectures, connecting complex data to useful insights.
Data Engineer / Python · PySpark · SQL
Built around data.Cloud platformsReal-time streamingReliable pipelines
01 / ABOUT MEEngineering the path
Engineering the path
from data to decisions.
Data Engineer with 4+ years of experience across Banking & Financial Services and Manufacturing. My work spans cloud data platforms, real-time streaming, data quality, and reliable orchestration.
My work connects ingestion, transformation, quality, and delivery across the modern data stack.
Explore my experience →02 / TECHNICAL SKILLS
All skills ↗A practical, modern data stack.
Streaming & lakehouse
Apache SparkKafkaDelta LakeApache Flinkdbt
Cloud platforms
AWSAzureSnowflake
Quality & orchestration
AirflowGreat ExpectationsMLflow
Infrastructure
DockerKubernetesTerraformGitCI/CD
Analytics
Power BIData modelingData governance
03 / EXPERIENCE
Full experience ↗Where I've made an impact.
- CHAPTER 01Sep 2026 – PresentCurrent role
Motherson Technology Services Limited
Data Engineer
Manufacturing & Automotive Components
- Contributing to pipelines that ingest shop-floor and IIoT sensor data into the lakehouse.
- Supporting SAP/ERP and MES integration, OEE analytics, and downtime reporting.
LakehouseIIoTSAP / ERPMES - CHAPTER 02May 2022 – Sep 2026Previous role
Tata Consultancy Services
Data Engineer
Banking & Financial Services
- Engineered financial data pipelines from 10+ source systems into Snowflake with dbt transformations and lineage.
- Reduced average query execution time by 40% and pipeline latency by 35%.
- Automated reconciliation using Airflow and Great Expectations, reducing operational incidents by 70%.
SnowflakedbtPySparkAirflowGreat Expectations
04 / FEATURED PROJECTS
Selected projects ↗Complex challenges. Useful systems.
Streaming / Financial services
Real-Time Banking Transaction Monitoring
A Kafka and Spark Structured Streaming pipeline processing 1M+ events per day, with checkpointing and multi-rule fraud detection.
KafkaSpark StreamingKubernetesAirflow
Professional project · Source code is not publicly linked.
Cloud / Data platforms
Enterprise Data Lakehouse Architecture
A lakehouse on Azure Data Lake Gen2 and Delta Lake, with dbt transformations and lineage feeding Snowflake for BI consumption.
Delta LakedbtSnowflakeTerraform
Professional project · Source code is not publicly linked.
05 / CONTINUOUS LEARNINGAlways building.
Always building.
Always learning.
Academic foundations.
Specialist credentials.
A deeper understanding of data.
Education
2026–2028
M.Tech
Artificial Intelligence & Data Science Engineering
IIT Patna
In progress2021
B.Tech
Computer Science Engineering
Chaudhary Charan Singh University Campus, Meerut
CompletedLicenses & Certifications
Databricks
Certified Data Engineer
ProfessionalIssued Feb 2026 Expires Feb 2028
Amazon Web Services (AWS)
Certified Data Engineer
AssociateIssued Oct 2024 Expires Oct 2027
Databricks
Certified Generative AI Engineer
AssociateIssued Mar 2026 Expires Mar 2028
Anthropic
Claude Certified Architect
ProfessionalIssued Sep 2026 Expires Sep 2027
Amazon Web Services (AWS)
Certified Machine Learning Engineer
AssociateIssued Dec 2024 Expires Dec 2027
Google
Professional Machine Learning Engineer Certification
ProfessionalIssued May 2024 Expires Feb 2028
Microsoft
Microsoft Certified: Azure Data Scientist
AssociateIssued Aug 2025 Expires Aug 2027
Selected credentials in data engineering, cloud platforms, and applied AI.
Good work starts
with a connection.
Connect with me about data engineering, cloud platforms, and technical collaboration.
Only public professional contact channels are shown.ALSO BUILT AT 9TO5TECH
Explore career tools ↗Small tools. A useful head start.
A browser-local career toolkit, alongside my portfolio.