📘 Guide: Creating a Dataset with Multiple Parquet Files

Parquet is a popular format for storing large, structured data efficiently. Often, data is split across multiple Parquet files (e.g., Sales mobile Data in one file and Mobile Details in another).

By joining these files, you can create a single, meaningful dataset that brings all the information together.

This guide explains how to create a dataset using multiple Parquet files and run queries to join them.

---

🔹 Step 1: Open the Dataset Section

1. Click the Hamburger Menu (≡).
   📸 Insert Screenshot – Hamburger Menu
2. Expand Master Data.
   📸 Insert Screenshot – Master Data Menu
3. Select Datasets.
   📸 Insert Screenshot – Datasets Option
4. You’ll be redirected to the Dataset Page.
5. At the bottom, click Create Dataset.
   📸 Insert Screenshot – Create Dataset Button
   👉 Dataset creation box will appear.

---

🔹 Step 2: Select Parquet Files

1. On the left-hand side, go to the Datasource Section.
   📸 Insert Screenshot – Datasource Section
2. Select Parquet Files.
3. In the middle panel, you’ll see a list of folders and .parquet files.
   📸 Insert Screenshot - Parquet File List
4. Select the files you want to use.

👉 Example:

• Mobile Details.parquet
• Sales mobile Data.parquet

---

🔹 Step 3: Write Your Query

1. After selecting the files, a Query Box will appear on the right.
   📸 Insert Screenshot – Query Box
2. Write your SQL query to join and fetch data.

👉 Example (INNER JOIN):

SELECT 
    sm.Phone, 
    md."Price ($)",
    md.Status, 
    sm.Manager, 
    sm.Month, 
    sm.Stage, 
    sm.Deal_Status, 
    sm.Deal_Size
FROM Sales mobile Data AS sm
INNER JOIN Mobile Details AS md
    ON sm.Phone = md.Phone

📌 What this output shows:

• The Price ($) and Status from Mobile Details
• The Phone name, Manager, Month, Stage, Deal Status, and Deal Size from Sales Mobile Data

👉 In short: This query gives you a combined dataset of sales and mobile details, showing only the phones that exist in both Parquet files.

📌 Tip:

• Use INNER JOIN when you want records common in both files.
• Use LEFT JOIN, RIGHT JOIN, or FULL JOIN depending on your needs.

---

🔹 Step 4: Define Dataset Name

1. Enter a Dataset Name (DS Name) to identify your dataset.
   📸 Insert Screenshot – Dataset Name Field

---

🔹 Step 5: Configure Output & Preview

1. Go to the Output Columns section to review your selected fields.
   📸 Insert Screenshot – Output Columns
2. Click Preview to check the query results.
   📸 Insert Screenshot – Preview Output

---

🔹 Step 6: Create the Dataset

1. Once everything looks good, click Create.
   📸 Insert Screenshot – Create Button
   ✨ Your dataset is ready with multiple Parquet file joins. You can now use this dataset for analysis, reporting, or building dashboards.

---