Welcome to My GitHub Page

Will be writing posts related to Data Engineering and building data pipelines using SQL.

About Me

• About Me

Weekly Blog Posts

2025

• Running BigQuery SQL Scripts in Cloud Composer with Jinja Templating
• Real-Time Streaming Pipeline: RabbitMQ to Pub/Sub and BigQuery with Dynamic Scaling

2024

• Efficient Listing of root folder in GCS Bucket
• Using BigQuery Geospatial functions to find nearest location
• Efficiently Load XML Files from GCS to BigQuery using Dataproc
• Mastering Time Zones in BigQuery: Converting to UTC
• Specify Dataproc serverless version when submitting jobs via composer