Vishal Jadhav SCD Types Explained with Examples
Slowly Changing Dimensions (SCD) are used in data warehousing to manage historical changes in dimension tables. There are several types of SCDs, each handling data changes differently. Types of SCDs…
sql to pyspark query converstion
In this article, we are converting the SQL queries to Pyspark code Task SQL Command PySpark Command Selecting Data SELECT col1, col2 FROM table; df.select(“col1”, “col2”) Filtering Data SELECT *…
Pypark – Databriks + spark Rajas data engineering
PySpark Interview Questions (lec 6) How to read files in spark? You are going to see how to read different file formats in pyspark. first, you need to create the…
How would you handle skewed data in PySpark?
Handling skewed data in PySpark is crucial for optimizing performance and ensuring efficient processing. Skewed data occurs when some partitions have significantly more data than others, leading to uneven workload…
zepto global data engineer interview questions
Programming/Algorithm Question:You are acting as a bank. You are given a list of customers’ transactions.The transactions can be either a deposit (positive value) or awithdrawal(negative value). The initial balance in…
LeetCode Data Engineer Interview Questions
Ace Your Data Engineering Interview: Essential LeetCode SQL, Python, and ETL Questions
Data Engineer interview.
CAP theorem Lambda vs kapp architecture Star vs snowflake schema Data warehouse , data lake, delta lake, dataware house Scd types SQL How would you write a query to calculate…
PySpark interview question [2026]
Top 50 recently asked Pyspark Interview Questions Big Data
Surrogate key
Surrogate keys are artificially generated primary keys, typically integers, used to uniquely identify records. In data warehouse you may have same record with multiple entries(this records columns value may change…
SQL Aggregates function – count(), min(), max(), avg(), sum()
SQL also supports the use of aggregate expressions (or functions) that allow you to summarize information about a group of rows of data. Without a specified grouping, each aggregate function…