Databricks-14-Days-Challenge-2

Databricks 14-Days AI Challenge-2 is designed to help beginners build a strong foundation in Databricks through daily learning, hands-on practice, and real-world problem solving.

---

---

📅 Daily Challenges

Day	Challenge	Status
Day 01	Delta Conversion & Optimization	✅ Completed
Day 02	Feature Table (Silver Layer Thinking)	✅ Completed
Day 03	Job Orchestration Basics	✅ Completed
Day 04	Structured Streaming (Basic Simulation)	✅ Completed
Day 05	Production-Grade Feature Engineering	✅ Completed
Day 06	Model Training & Tuning	✅ Completed
Day 07	MLflow Tracking	✅ Completed
Day 08	Batch Inference Pipeline	✅ Completed
Day 09	Recommendation System	✅ Completed
Day 10	Query Optimization & Explain Plans	✅ Completed
Day 11	Time Travel & Data Recovery	✅ Completed
Day 12	Cost Optimization Basics	✅ Completed
Day 13	End-to-End Architecture Design	✅ Completed
Day 14	Final Production-Ready System	✅ Completed

---

🎯 How to Use This Repository

1. Daily Workflow:

   • Navigate to the day's folder (e.g., Day-01)
   • Read the challenge description in the README.md
   • Write/Create solution file
   • Document approach and learnings in the README.md

2. Adding Solutions:

   • Each day's folder contains a README.md template
   • Add DataBricks solution files
   • Update the main README table with completion status

3. Tracking Progress:

   • Update the status in the table above as you complete each challenge
   • Use emojis: ✅ Completed | 🚧 In Progress

🛠️ Technologies

• DataBricks Free Edition ( Delta Lake , Pyspark , MLflow , SQL Analytics , Genie , Mosaic AI )

📖 Learning Goals

• DataBricks Fundamentals

🤝 Contributing

This is a personal learning repository for the Databricks-14-Days-Challenge-2. Feel free to star my repo or fork it and use the structure for your own learning journey!

---

📚 Additional Resources

• Databricks Documentation
• PySpark API
• Delta Lake
• MLflow
• Kaggle Dataset
• Databricks 14 day challenge notion link

---

𝐖𝐡𝐚𝐭 𝐭𝐡𝐢𝐬 𝐜𝐡𝐚𝐥𝐥𝐞𝐧𝐠𝐞 𝐭𝐚𝐮𝐠𝐡𝐭 𝐦𝐞?

Progress doesn’t happen in a single day, it needs hardwork, consistent practice and passion for learning. You don’t truly remember concepts by just reading or watching them You remember them when you build, break, fix, and rebuild

🧠 What actually happened in these 14 days:

• Spark stopped looking scary
• Delta Lake started making sense
• Bronze, Silver, Gold stopped sounding like jewellery 💍
• SQL dashboards became my comfort zone
• MLflow taught me why tracking experiments matters
• AI (Genie & Mosaic AI) showed up and said: “Why type SQL when you can just ask questions?”

---

@databricks @codebasics @indiandataclub #DatabricksWithIDC