You will get Generative AI on Databricks Platform
Project details
We will discuss Generative AI especially Large Language Models (LLMs) and how to apply them to real-world problems. We'll focus on natural language processing (NLP) using popular libraries, such as Hugging Face transformers and LangChain. I will help you understand the nuances of pre-training, fine-tuning and prompt engineering, and how to apply this knowledge to build a custom chat model using RAG approach. We can discuss how to evaluate the efficiency and bias of LLMs using different methods.
TOPICS:
• Common NLP tasks
• Prompt Engineering
• Retrieval Augmented Generation (RAG)
- General approach
- Vector Library vs Vector Database
• Multi-stage Reasoning with LLMs
- LangChain
- ReAct paradigm
• Model Fine-tuning
- Fine-tuning
- Fine-tuning with DeepSpeed
- Parameter-efficient fine-tuning (PEFT)
- Additive PEFT: Prompt Tuning
- Re-parameterization PEFT: LoRA
• Evaluating LLMs
• LLMOps
- Creating a Hugging Face pipeline
- Tracking LLM development with Mlflow
• Risks and challenges of GenAI
• Production key concerns
MODELS:
- DBRX (Databricks)
- Gemma (Google)
- ChatGPT, GPT-3 (OpenAI)
- LLaMa (Meta)
- Dolly (Databricks)
- MPT (MosaicML)
…
TOPICS:
• Common NLP tasks
• Prompt Engineering
• Retrieval Augmented Generation (RAG)
- General approach
- Vector Library vs Vector Database
• Multi-stage Reasoning with LLMs
- LangChain
- ReAct paradigm
• Model Fine-tuning
- Fine-tuning
- Fine-tuning with DeepSpeed
- Parameter-efficient fine-tuning (PEFT)
- Additive PEFT: Prompt Tuning
- Re-parameterization PEFT: LoRA
• Evaluating LLMs
• LLMOps
- Creating a Hugging Face pipeline
- Tracking LLM development with Mlflow
• Risks and challenges of GenAI
• Production key concerns
MODELS:
- DBRX (Databricks)
- Gemma (Google)
- ChatGPT, GPT-3 (OpenAI)
- LLaMa (Meta)
- Dolly (Databricks)
- MPT (MosaicML)
…
AI Algorithms
Large Language ModelAI Applications
AI Chatbot, AI-Enhanced Classification, AI-Generated Code, AIOps, Natural Language Generation, Natural Language Understanding, Sentiment Analysis, Text RecognitionAI Development Language
PythonAI Tools
Hugging Face, PyTorch, TensorFlowAI Models
BERT, Dolly, GPT-3, LLaMAWhat's included
| Service Tiers |
Starter
$90
|
Standard
$170
|
Advanced
$320
|
|---|---|---|---|
| Delivery Time | 5 days | 5 days | 5 days |
AI Model Integration | |||
Batch Normalization | - | - | - |
Database Integration | |||
Detailed Code Comments | - | - | - |
Image Upscaling | - | - | - |
MLOps | |||
Model Deployment | |||
Model Documentation | - | - | - |
Model Monitoring | |||
Model Testing & Optimization | |||
Model Tuning | |||
Natural Language Processing | |||
NLP Tokenization | |||
Pre-Training | |||
Prompt Engineering | |||
Setup File | - | - | - |
Source Code |
Frequently asked questions
2 reviews
(2)
(0)
(0)
(0)
(0)
This project doesn't have any reviews.
VH
Venus H.
Nov 17, 2025
RAG App for DQ Project
VH
Venus H.
Nov 4, 2024
DQ Project: GenAI - Python/Databricks debugging
About Michal
Databricks Solution Architect, Data Engineer & GenAI Engineer
Pezinok, Slovakia - 5:20 am local time
I'm a certified Databricks Solutions Architect Champion. This is an exclusive "by invitation only" program. Databricks Champions are evangelists and leaders of success for their Unified Analytics and Machine Learning practices. As a Databricks partner I have access to private previews of new Databricks features and products, access to exclusive webinars and Partner Product Council meetings. This is a great opportunity to take advantage of being always few steps ahead.
I specialize in the architecture and implementation of data lakehouses, ETL / ELT pipelines, Generative AI and Machine Learning in Microsoft Azure and Databricks. I have experience with Databricks Data Intelligence Platform, Unity Catalog, MLflow, Azure Synapse, Azure Data Factory, Azure Data Lake Storage and other complementary components.
I also focus on the topic that is very dear to me - Artificial Intelligence. I hold a master's degree in AI and since I graduated the landscape in this field has changed significantly. Databricks makes it quite easy to work with ML and GenAI on their platform already and they are constantly releasing more features and products in this area. They are lowering the entry barrier, optimizing training processes and thus pushing the price of training your own model down to make it available to everyone. I have experience with building RAG applications, compound AI systems, vector search chains, agentic AI, prompt engineering and LLM / chain evaluation on Databricks platform.
I'm certified Accenture Technology Architect Associate and I have a great passion for Scrum methodology and experience of being a scrum master on several projects.
My strengths are extreme attention to detail, enforcing consistency, promoting good team spirit and building long term relationship with clients.
I'm the founder and the CEO of ru3ch interactive company - innovative and agile provider of digital, cloud and advisory services.
Certifications:
• Accenture Technology Architect Associate
• Databricks Solutions Architect Champion
• Microsoft Certified: Azure AI Engineer Associate
• Microsoft Certified: Azure Data Engineer Associate
• MongoDB SI Architect
• MongoDB SI Associate
• MCSD: Web Applications
• MCPD: Web Developer 4
• Professional Scrum Master I
• Avanade Certified Scrum Developer
• Avanade Certified Scrum Project Manager
Steps for completing your project
After purchasing the project, send requirements so Michal can start the project.
Delivery time starts when Michal receives requirements from you.
Michal works on your project following the steps below.
Revisions may occur after the delivery date.
Scheduling the meeting
Based on your and my availability we'll agree on the date and time of the meeting and platform we'll use for the call.
Preparation for the meeting
Based on the topics you would like to discuss I'll prepare assets (images, diagrams, links to documentation) if applicable.