About
About Me
I’m passionate about building data-driven systems that solve real-world problems. My expertise lies in developing and optimizing data pipelines, transforming complex datasets, and implementing automated solutions using Azure, Databricks, and SQL. I also bring experience in software development with Python, Java, and Kotlin, creating applications that are both scalable and efficient.
I hold postgraduate diplomas in Artificial Intelligence and Data Analytics from Durham College, complemented by a Bachelor’s degree in Computer Engineering. I’m also certified as a Databricks Certified Data Engineer Associate and Microsoft Azure Data Fundamentals, reflecting my commitment to continuous learning and modern data platform excellence.
Beyond technology, I lead The Executors’ Club, a community focused on personal growth and productivity. I enjoy sharing knowledge, creating digital content, and connecting with others. In my free time, I love reading, playing the keyboard, and exploring nature, always seeking creativity and balance.
Experience
My Experience
- Developed and optimized ETL pipelines using SSIS and SQL Server, streamlining healthcare data integration and improving processing efficiency across clinical and administrative systems.
- Designed automated reports using SSRS, reducing manual reporting time by 15+ hours per week and enabling faster, data-driven decision-making in healthcare operations.
- Collaborated with cross-functional teams to gather requirements, implement logic validations, and ensure compliance with healthcare data standards, enhancing data accuracy and reliability.
- Collaborated with Business Analysts, QA, and Project Managers to translate business requirements into functional data workflows, improving project efficiency by 20%.
- Developed and maintained ETL pipelines to integrate and transform large datasets, ensuring high data quality and supporting scalable reporting solutions.
- Implemented data validation and transformation logic using SQL and Java, ensuring consistency and accuracy across integrated datasets, which improved end-user confidence in reporting outputs.
- Utilized LSTM neural networks to significantly enhance financial forecasting accuracy for Bitcoin, aiding in the formulation of informed trading strategies.
- Created and tested a quantitative trading algorithm that improved investment returns by strategically analyzing historical price data to generate precise buy/sell signals.
- Conducted exploratory data analysis with Python tools to deepen understanding of market trends and volatility, refining data-driven strategies.
- Built secure data storage solutions on Azure Data Lake Storage Gen2 and optimized data partitioning strategies, reducing storage costs and improving query performance.
- Developed and deployed analytical solutions using Azure Synapse Analytics, enabling faster and more reliable reporting for business stakeholders.
- Developed SQL-based transformation logic, quality checks, and cleansing rules to ensure accurate and trusted data for downstream reporting.
Blog
My Blog
Explore my latest blogs by clicking the button below and dive into a range of topics on my Medium account. Stay informed, inspired, and connected!
Contact
Get In Touch With Me.
Interested in learning more about me, my work or how we can collaborate on an upcoming project? Feel free to reach out anytime via email, I would be more than happy to chat.
- hello@harpalvaghela.com
- https://topmate.io/harpal_vaghela
- https://beacons.ai/harpalvaghela