Most people judge a machine learning project by its model accuracy.

In production, the real challenge is often scalability, latency, concurrency, and reliability.

✓ Python is still my preferred language for data analysis, experimentation, and model training.

✓ Go shines when building high-performance APIs, microservices, and backend systems that serve ML models at scale.

✓ Fast execution
✓ Low memory usage
✓ Lightweight concurrency with goroutines
✓ Simple deployment as a single binary
✓ Excellent performance under heavy workloads

The question is not Python or Go.

The question is which language is the best fit for each stage of your ML pipeline.

This article shares practical insights from real production experience and explains why Go has become a strong choice for scalable machine learning systems.

📖 https://medium.com/@epythonlab/why-go-beats-python-for-scalable-machine-learning-in-production-c5f91618be97

If you want to start learning Go, this playlist is a great resource.

🎥 https://youtube.com/playlist?list=PL0nX4ZoMtjYExssqobkuuaGeyPcer_X7K&si=NbaOhH9-t9azIYhN


Have you used Go in an ML project?

What was your experience?

#GoLang #Python #MachineLearning #MLOps #AI #Backend #SoftwareEngineering #Microservices #Tech #Programming

Most Python developers learn "import module" very early.

But one small habit can make your code much cleaner.

Instead of this:

import very_long_module_name
very_long_module_name.process_data()

Use an alias:

import very_long_module_name as vm
vm.process_data()

Or follow well-known community conventions:

✔ "import numpy as np"
✔ "import pandas as pd"
✔ "import matplotlib.pyplot as plt"

Why use aliases?

✅ Improve readability by reducing visual clutter.
✅ Write less without sacrificing clarity.
✅ Avoid naming conflicts between modules.
✅ Follow community conventions that every Python developer recognizes.

That said, do not create cryptic aliases just because you can.

❌ "import requests as r1"
❌ "import mymodule as x"

A good alias should still communicate intent. The goal is readable code, not shorter code.

Clean code is code that your future self and your teammates can understand in seconds.

I explain this with practical examples https://youtu.be/0GKxOJNRtPA

What is your favorite Python import alias?

#Python #Programming #SoftwareEngineering #CleanCode #PythonTips #Coding #Developers #LearnPython #CodeQuality

Many Python developers begin by writing everything in a single file. That approach works for small projects, but it quickly becomes difficult to manage as your application grows.

Creating custom modules is an essential Python skill because it helps you:

✅ Organize code into logical components
✅ Reuse code across multiple projects
✅ Improve readability and maintenance
✅ Simplify debugging and testing
✅ Make collaboration easier for teams
✅ Build scalable and professional applications

Whether you are developing automation tools, machine learning pipelines, APIs, or AI applications, modular code makes your projects cleaner, easier to extend, and more reliable.

The difference between beginner code and production-ready code is often how well it is organized.

If you want to write Python like a professional developer, learning how to create custom modules is a great place to start.

🎥 Explore the step-by-step implementation:
https://youtu.be/rawqnBBZb5E

How do you organize your Python projects? Do you start with modules from the beginning, or do you split your code into modules as the project grows?

#Python #PythonProgramming #SoftwareEngineering #CleanCode #Programming #Coding #Automation #MachineLearning #AI #Developers

🤖 AI Is Fighting AI

Generative AI has fundamentally changed the fraud landscape.

Not long ago, creating a convincing fake identity required specialized skills and significant effort. Today, powerful AI tools have made it possible for almost anyone to generate:

✔ Fake identity documents
✔ Realistic AI-generated faces
✔ Deepfake videos
✔ Human-like voice clones

As the barrier to entry drops, fraudsters can launch more sophisticated attacks at a much lower cost. Meanwhile, organizations face the challenge of detecting synthetic content that becomes more convincing every day.

Traditional rule-based systems are no longer enough.

Modern fraud detection relies on machine learning techniques that work together, including:

✔ Computer vision for deepfake detection
✔ Graph machine learning to uncover fraud networks
✔ Anomaly detection for unusual behavior
✔ Behavioral analytics to identify suspicious patterns
✔ Risk scoring for real-time decisions
✔ Continuous identity verification throughout the user journey

Fraud detection is no longer just about classifying transactions as legitimate or fraudulent.

It is about continuously evaluating signals, adapting to new threats, and making intelligent decisions in real time.

If you are interested in AI and machine learning, fraud detection is one of the most impactful and rapidly evolving applications to explore.

I walk through the complete workflow.
🎥 https://youtu.be/kgNgKtmAlR0

Which machine learning technique do you believe has the greatest impact on modern fraud detection?

#AI #MachineLearning #FraudDetection #ComputerVision #DeepLearning #FinTech #CyberSecurity #Python

A Practical Python Roadmap to Become an AI Developer
Here is the start of your journey:
https://youtu.be/ldR3NdSDiyE

#Python #PythonDeveloper #LearnPython #ArtificialIntelligence #AI #AIDeveloper #MachineLearning #DeepLearning #GenerativeAI #LLM #DataScience #MLOps #FastAPI #PyTorch #ScikitLearn #SoftwareEngineering #Programming #Coding #TechCareer #BuildInPublic #OpenSource #100DaysOfCode #Developer #TechEducation #FutureOfAI

🚀 Stop shipping broken ML code.

A Machine Learning project shouldn’t end as a collection of messy Jupyter Notebooks, global package conflicts, and code that only works on your laptop.

If you want to build scalable, maintainable, and production-ready ML systems, the project structure matters.

Here’s a practical framework for setting up an ML project properly:

🛡️ 1. Isolate your dependencies

Avoid installing packages globally.

Use a virtual environment:

"python -m venv venv"

Then pin your dependencies:

"pip freeze > requirements.txt"

This helps ensure your project runs consistently across different environments.

📂 2. Structure your repository intentionally

A clean structure makes your code easier to maintain and scale:

📓 "notebooks/" → Exploration and experimentation
⚙️ "src/" or "api/" → Data processing, model training, and API serving
🧪 "tests/" → Automated tests with tools like pytest
📊 "dashboards/" → Visualisation and monitoring with tools like Streamlit

🧹 3. Keep your Git repository clean

Before your first commit, create a proper ".gitignore".

Exclude things like:

❌ Virtual environments
❌ Large model files
❌ Temporary files
❌ Secrets and credentials

Then connect your local project to GitHub and start tracking changes properly.

🔄 4. Automate testing with GitHub Actions

Every time new code is pushed, automatically run your tests.

This helps catch:

✅ Broken dependencies
✅ Failing API routes
✅ Issues in your ML pipeline

before they reach production.

📌 The biggest takeaway:

Building better ML systems isn't only about training better models.

It's also about creating software that is:

✔️ Reproducible
✔️ Testable
✔️ Maintainable
✔️ Scalable

The difference between a quick ML experiment and a production-ready ML system often comes down to engineering discipline.

🎥 Full tutorial: https://youtu.be/qYYYgS-ou7Q

🔗 PyPI
https://pypi.org/project/scaffml/

🔗 GitHub
https://github.com/epythonlab2/scaffml

🎥 Watch how it works
https://youtu.be/D88rq4U_-qA

What does your typical ML project structure look like?

👇 Share your approach in the comments.

#MachineLearning #MLOps #MachineLearningEngineering #DataScience #Python #SoftwareEngineering #GitHub #CICD

🚀 Everyone is building AI wrappers.

Very few developers are building AI systems. 🤔

There's a big difference.

A production-ready AI agent is much more than an LLM. 🤖

It requires:

✅ A decision loop 🔄
✅ Tool integration 🛠️
✅ Intent recognition 🎯
✅ Error handling and recovery 🛡️
✅ Context and state management 🧠
✅ Clear separation between reasoning and execution ⚖️
✅ An extensible architecture 🏗️

The LLM is just one component.

The real engineering lies in designing how the agent observes, reasons, decides, and acts. 🧩

Master these fundamentals, and you'll be able to build AI applications with any model or framework—from Ollama and OpenAI to LangChain and CrewAI. 🚀

To help developers understand the fundamentals, I explained an AI agent from scratch using pure Python and Ollama—without hiding the core concepts behind a framework. 💻

🎥 https://youtu.be/tkA6vCPihuE

💬 If you were building the next version of this agent, which capability would you add first?

✔️ Memory 🧠
✔️ Web Search 🔍
✔️ RAG 📚
✔️ MCP Support 🔌
✔️ Multi-Agent Collaboration 🤝
✔️ Computer Use 💻
✔️ Voice Interface 🎤

#AI #AIAgents #Python #Ollama #LLM #MachineLearning #AIEngineering #SoftwareEngineering #GenerativeAI #OpenSourceAI

⇒ 𝐌𝐨𝐬𝐭 𝐨𝐟 𝐮𝐬 𝐭𝐡𝐢𝐧𝐤 𝐀𝐈 𝐜𝐮𝐬𝐭𝐨𝐦𝐞𝐫 𝐬𝐮𝐩𝐩𝐨𝐫𝐭 𝐢𝐬 𝐣𝐮𝐬𝐭 𝐚𝐧 𝐋𝐋𝐌 + 𝐚 𝐬𝐲𝐬𝐭𝐞𝐦 𝐩𝐫𝐨𝐦𝐩𝐭.

Actually, that approach may work for a demo, but production support needs much more.

When a customer asks to check an order, change a reservation, or request a refund, the system needs to manage 𝙨𝙩𝙖𝙩𝙚, 𝙩𝙤𝙤𝙡𝙨, 𝙥𝙚𝙧𝙢𝙞𝙨𝙨𝙞𝙤𝙣𝙨, 𝙫𝙖𝙡𝙞𝙙𝙖𝙩𝙞𝙤𝙣, 𝙖𝙣𝙙 𝙚𝙭𝙚𝙘𝙪𝙩𝙞𝙤𝙣.

A solid architecture looks like this:

✅ 𝙆𝙚𝙚𝙥 𝙨𝙩𝙖𝙩𝙚 𝙤𝙪𝙩𝙨𝙞𝙙𝙚 𝙩𝙝𝙚 𝙇𝙇𝙈: your application should manage session data, transactions, authentication, and tool results.

✅ 𝙐𝙨𝙚 𝙩𝙝𝙚 𝙇𝙇𝙈 𝙖𝙨 𝙖 𝙧𝙤𝙪𝙩𝙚𝙧: let the model understand intent, choose the right tool, and extract parameters.

For example:

𝚐𝚎𝚝_𝚘𝚛𝚍𝚎𝚛_𝚜𝚝𝚊𝚝𝚞𝚜(𝚘𝚛𝚍𝚎𝚛_𝚒𝚍)
𝚒𝚗𝚒𝚝𝚒𝚊𝚝𝚎_𝚛𝚎𝚏𝚞𝚗𝚍(𝚘𝚛𝚍𝚎𝚛_𝚒𝚍)

The backend should handle the actual database operations and business rules.

✅ 𝙆𝙚𝙚𝙥 𝙚𝙭𝙚𝙘𝙪𝙩𝙞𝙤𝙣 𝙙𝙚𝙩𝙚𝙧𝙢𝙞𝙣𝙞𝙨𝙩𝙞𝙘: tools should return structured results. Your runtime decides what happens next.

If validation fails, permissions are missing, or human intervention is required, your application should handle it with explicit rules.

The key separation is simple:

𝑳𝑳𝑴 → 𝒓𝒆𝒂𝒔𝒐𝒏𝒊𝒏𝒈 & 𝒓𝒐𝒖𝒕𝒊𝒏𝒈
𝑩𝒂𝒄𝒌𝒆𝒏𝒅 → 𝒃𝒖𝒔𝒊𝒏𝒆𝒔𝒔 𝒍𝒐𝒈𝒊𝒄 & 𝒆𝒙𝒆𝒄𝒖𝒕𝒊𝒐𝒏
𝑹𝒖𝒏𝒕𝒊𝒎𝒆 → 𝒔𝒕𝒂𝒕𝒆 & 𝒐𝒓𝒄𝒉𝒆𝒔𝒕𝒓𝒂𝒕𝒊𝒐𝒏

That separation is what makes an AI agent more predictable, auditable, and reliable in production.

An AI support agent isn't just a chatbot with a better prompt; 𝙄𝙩'𝙨 𝙖 𝙨𝙤𝙛𝙩𝙬𝙖𝙧𝙚 𝙨𝙮𝙨𝙩𝙚𝙢 𝙬𝙞𝙩𝙝 𝙖𝙣 𝙇𝙇𝙈 𝙞𝙣𝙨𝙞𝙙𝙚 𝙞𝙩.


▶️ I walk through how to build this kind of agent from scratch here:

https://www.youtube.com/watch?v=AgconCK-l4g

#AI #AIAgents #GenerativeAI #LLM #MachineLearning #Python #SoftwareEngineering #CustomerSupport #AIEngineering #Automation

𝐀𝐈 𝐝𝐞𝐯𝐞𝐥𝐨𝐩𝐦𝐞𝐧𝐭 𝐜𝐨𝐦𝐞𝐬 𝐰𝐢𝐭𝐡 𝐚𝐧 𝐮𝐧𝐜𝐨𝐦𝐟𝐨𝐫𝐭𝐚𝐛𝐥𝐞 𝐫𝐞𝐚𝐥𝐢𝐭𝐲: 𝐲𝐨𝐮𝐫 𝐜𝐨𝐝𝐞 𝐜𝐚𝐧 𝐛𝐫𝐞𝐚𝐤 𝐞𝐯𝐞𝐧 𝐰𝐡𝐞𝐧 𝐲𝐨𝐮𝐫 𝐥𝐨𝐠𝐢𝐜 𝐢𝐬 𝐜𝐨𝐫𝐫𝐞𝐜𝐭.

I have experienced this firsthand while building AI agents with Gemini and LangChain.

➜ A model endpoint changes.

➜ A parameter gets renamed.

➜ A framework updates its API.

A response that used to be a string becomes a structured object.

Suddenly, perfectly reasonable code starts throwing errors.

What I have learned from that:

✅ 𝑫𝒐𝒏’𝒕 𝒕𝒊𝒈𝒉𝒕𝒍𝒚 𝒄𝒐𝒖𝒑𝒍𝒆 𝒚𝒐𝒖𝒓 𝒂𝒑𝒑𝒍𝒊𝒄𝒂𝒕𝒊𝒐𝒏 𝒕𝒐 𝒇𝒓𝒂𝒎𝒆𝒘𝒐𝒓𝒌 𝒊𝒏𝒕𝒆𝒓𝒏𝒂𝒍𝒔: Keep your business logic separate from model and framework integrations.

✅ 𝑬𝒙𝒑𝒆𝒄𝒕 𝑨𝑷𝑰𝒔 𝒕𝒐 𝒆𝒗𝒐𝒍𝒗𝒆: Pin important dependencies, read changelogs, and test upgrades before pushing them into production.

✅ 𝑵𝒆𝒗𝒆𝒓 𝒂𝒔𝒔𝒖𝒎𝒆 𝒎𝒐𝒅𝒆𝒍 𝒐𝒖𝒕𝒑𝒖𝒕 𝒉𝒂𝒔 𝒐𝒏𝒆 𝒇𝒐𝒓𝒎𝒂𝒕: Structured responses, tool calls, metadata, and plain text can all require different parsing strategies.

✅ 𝑩𝒖𝒊𝒍𝒅 𝒔𝒎𝒂𝒍𝒍 𝒊𝒏𝒕𝒆𝒈𝒓𝒂𝒕𝒊𝒐𝒏 𝒍𝒂𝒚𝒆𝒓𝒔: If Gemini or LangChain changes, you should be able to update one part of your application instead of rewriting the entire agent.

The goal isn't to avoid change, but to make change cheap. While deploying my latest AI agent with Gemini and LangChain, I ran into several of these exact edge cases.

I documented the fixes and the complete setup here:

👉 https://www.youtube.com/watch?v=AgconCK-l4g

If you're building AI agents with Python, this is one lesson worth learning early.

#AIEngineering #AIAgents #Python #LangChain #Gemini #LLM #GenerativeAI #SoftwareEngineering #MachineLearning

When I build an AI agent, I do not start by asking, Which model should I use? I start by designing the system around the model.



The model provides reasoning and language capabilities. The surrounding architecture determines whether the agent is reliable, controllable, and production ready.



This is the approach I follow:

𝟏. 𝐌𝐨𝐝𝐞𝐥: I select the model based on reasoning capability, task complexity, latency, cost, and context requirements.

𝟐. 𝐓𝐨𝐨𝐥𝐬: I give the agent well-defined tools with strict schemas, validation, permissions, and predictable outputs.

𝟑. 𝐂𝐨𝐧𝐭𝐞𝐱𝐭: I carefully control the information provided to the model through retrieval, memory, conversation state, and structured context.

𝟒. 𝐎𝐫𝐜𝐡𝐞𝐬𝐭𝐫𝐚𝐭𝐢𝐨𝐧: I define how the agent reasons, when it can call tools, when it should retry, when it should ask for clarification, and when it must stop.

𝟓. 𝐆𝐮𝐚𝐫𝐝𝐫𝐚𝐢𝐥𝐬: I validate inputs, tool calls, and outputs. For sensitive or high-impact operations, I add additional verification.

𝟔. 𝐎𝐛𝐬𝐞𝐫𝐯𝐚𝐛𝐢𝐥𝐢𝐭𝐲: I monitor tool calls, model responses, latency, failures, token usage, and agent execution paths.

𝟕. 𝐄𝐯𝐚𝐥𝐮𝐚𝐭𝐢𝐨𝐧: I test the complete system against realistic scenarios, edge cases, adversarial inputs, and expected failure modes.

▶️ I walk through how to build this kind of agent from scratch here:


https://www.youtube.com/watch?v=AgconCK-l4g



#AIEngineering #AIAgents #GenerativeAI #LLM #MachineLearning #Python #LangChain #LangGraph #MLOps #SoftwareEngineering

When I build an AI application, choosing the backend framework is an important decision.

There are several good options, but I usually look at 𝐅𝐚𝐬𝐭𝐀𝐏𝐈, 𝐃𝐣𝐚𝐧𝐠𝐨, and 𝐅𝐥𝐚𝐬𝐤 first.

The choice really depends on what I'm building.

✔️ 𝐅𝐚𝐬𝐭𝐀𝐏𝐈 makes a lot of sense when the application is mainly an AI/API backend. Since most AI tools I use are already in Python, I can keep the whole stack in one ecosystem, from LLMs and embeddings to document processing, RAG, databases, and the API itself.

✔️ 𝐃𝐣𝐚𝐧𝐠𝐨 is a strong choice when the AI functionality is part of a larger web application. Its built-in ORM, authentication, admin panel, and other features can save a lot of development time.

✔️ 𝐅𝐥𝐚𝐬𝐤 is still a great option when I want something simple, lightweight, and flexible, especially for smaller services or prototypes.

For an AI application, I also need to think beyond the framework:

✔️ Authentication

✔️ Database and data persistence

✔️ Document processing

✔️ Embeddings and vector search

✔️ RAG

✔️ Background tasks

✔️ Testing

✔️ Docker

✔️ Monitoring

✔️ Deployment

There isn't one framework that is "best" for every AI application. For the type of production AI backends I'm building, 𝐅𝐚𝐬𝐭𝐀𝐏𝐈 is often a practical choice because it provides a clean API layer while keeping everything close to the Python AI ecosystem.

The framework is only one piece of the puzzle.

Good architecture matters more than the framework you choose.


What do you normally use for AI applications: 𝐅𝐚𝐬𝐭𝐀𝐏𝐈, 𝐃𝐣𝐚𝐧𝐠𝐨, 𝐅𝐥𝐚𝐬𝐤, or something else?

Here is the roadmap to build an AI application with FastAPI: https://www.youtube.com/watch?v=0SLLG2Z_Htw


#FastAPI #Python #AIEngineering #GenerativeAI #RAG #BackendDevelopment #MachineLearning #Django #Flask #SoftwareArchitecture

𝐅𝐚𝐬𝐭𝐀𝐏𝐈 𝐯𝐬 𝐑𝐄𝐒𝐓 𝐀𝐏𝐈 — What’s the Difference?

One thing I see quite often when people start building APIs with Python is confusion between FastAPI and REST API.

In reality, they are not the same thing.

𝐑𝐄𝐒𝐓 𝐀𝐏𝐈 is an architectural approach for designing APIs around resources, HTTP methods, stateless communication, and standard HTTP responses.

𝐅𝐚𝐬𝐭𝐀𝐏𝐈 is a Python web framework that helps you build APIs.

For example, in an AI application, I might have:

GET /documents
𝙶𝙴𝚃 /𝚍𝚘𝚌𝚞𝚖𝚎𝚗𝚝𝚜
𝙿𝙾𝚂𝚃 /𝚍𝚘𝚌𝚞𝚖𝚎𝚗𝚝𝚜
𝙶𝙴𝚃 /𝚍𝚘𝚌𝚞𝚖𝚎𝚗𝚝𝚜/{𝚒𝚍}
𝙿𝚄𝚃 /𝚍𝚘𝚌𝚞𝚖𝚎𝚗𝚝𝚜/{𝚒𝚍}
𝙳𝙴𝙻𝙴𝚃𝙴 /𝚍𝚘𝚌𝚞𝚖𝚎𝚗𝚝𝚜/{𝚒𝚍}

These endpoints can follow 𝐑𝐄𝐒𝐓 principles.

𝐅𝐚𝐬𝐭𝐀𝐏𝐈 is the tool I use to implement them in Python.

So, a simple way to remember it:

𝐑𝐄𝐒𝐓 = how the API is designed
𝐅𝐚𝐬𝐭𝐀𝐏𝐈 = the framework used to build it

𝐅𝐚𝐬𝐭𝐀𝐏𝐈 also gives us useful features such as request validation, automatic API documentation, dependency injection, and strong support for asynchronous applications.

Understanding this distinction makes it much easier to understand 𝐅𝐚𝐬𝐭𝐀𝐏𝐈 and, more importantly, to design APIs properly.

𝐅𝐚𝐬𝐭𝐀𝐏𝐈 Fundamentals: Build Your First AI API | Python FastAPI Course (An Overview of API): https://youtu.be/vvP9GIWSews

#FastAPI #Python #RESTAPI #APIDevelopment #AI #MachineLearning #BackendDevelopment

Your model can look excellent and still be wrong.

One of the first things I check when evaluating an ML dataset is data leakage. 🔍

Data leakage happens when information that would not actually be available at prediction time gets into the training data.

For example:

🏥 Healthcare
You are predicting whether a patient will be admitted, but your dataset includes a field recorded after admission.

💳 Fraud detection
You are predicting fraud, but one of the features is created after the transaction has already been investigated.

📦 Customer churn
You are predicting who will leave, but the training data contains information that only becomes available after the customer leaves.

The result?

Your model may show:

📈 98% accuracy
📈 Excellent validation results
📈 Great performance during testing

Then you put it into production...

And the performance drops.

The problem was not necessarily the model.

The model had access to information it would never have in the real world.

That is why I don't look at model performance alone.

I also ask:

🔎 Where did each feature come from?
⏱️ When was it created?
🎯 Would this information actually be available when making the prediction?

A high score is not always a good score.

Sometimes, it is a warning sign.

Check out data quality issues
https://youtube.com/playlist?list=PL0nX4ZoMtjYHTtowSzzB2gVH2AuuoF9WW&si=EhLKvJCVlYQXknOs

Also checkout data quality checker tool https://datasetdoctor.fastapicloud.dev

#MachineLearning #DataScience #AI #DataLeakage #MLOps #Python

The hardest part of building AI applications isn't writing the prompt or calling the model. In the last two weeks, I learned that keeping the backend from turning into spaghetti code once you move past the tutorial phase.

When you're wiring up an AI document pipeline in FastAPI, a few things quickly become non-negotiable:



• Payload Guardrails: If your Pydantic schemas aren't catching malformed JSON, missing nested fields, or bad Enums at the door, your AI service will fail unpredictably downstream.



• Route Isolation: Mixing your raw API endpoints with validation logic and business rules makes refactoring a nightmare by week three.



• The Persistence Gap: Transitioning from mock in-memory data structures to a real relational database and a vector store for RAG is where most clean prototypes start to break down.



If you're building production backends for AI and ML features, where do you usually draw the line between keeping things simple and over-engineering your architecture?



You can learn about FastAPI: https://www.youtube.com/playlist?list=PLQNCas8_eikM



#FastAPI #Python #BackendEngineering #SoftwareArchitecture #APIs #Pydantic #ArtificialIntelligence #MachineLearning #RAG

When building a FastAPI application, I pay close attention to how data is validated before it reaches the business logic.

That is where Pydantic becomes particularly useful.

Pydantic lets us define the structure and rules for the data our application accepts, instead of scattering validation checks throughout the codebase.

I use it to define and enforce the data contract at the application boundary.

For example:

𝑐𝑙𝑎𝑠𝑠 𝑃𝑟𝑜𝑐𝑒𝑠𝑠𝑖𝑛𝑔𝐶𝑜𝑛𝑓𝑖𝑔(𝐵𝑎𝑠𝑒𝑀𝑜𝑑𝑒𝑙):

𝑐ℎ𝑢𝑛𝑘_𝑠𝑖𝑧𝑒: 𝑖𝑛𝑡 = 𝐹𝑖𝑒𝑙𝑑(𝑔𝑡=0)

𝑜𝑣𝑒𝑟𝑙𝑎𝑝: 𝑖𝑛𝑡 = 𝐹𝑖𝑒𝑙𝑑(𝑔𝑒=0)

@𝑚𝑜𝑑𝑒𝑙_𝑣𝑎𝑙𝑖𝑑𝑎𝑡𝑜𝑟(𝑚𝑜𝑑𝑒="𝑎𝑓𝑡𝑒𝑟")

𝑑𝑒𝑓 𝑣𝑎𝑙𝑖𝑑𝑎𝑡𝑒_𝑐𝑜𝑛𝑓𝑖𝑔(𝑠𝑒𝑙𝑓):

𝑖𝑓 𝑠𝑒𝑙𝑓.𝑜𝑣𝑒𝑟𝑙𝑎𝑝 >= 𝑠𝑒𝑙𝑓.𝑐ℎ𝑢𝑛𝑘_𝑠𝑖𝑧𝑒:

𝑟𝑎𝑖𝑠𝑒 𝑉𝑎𝑙𝑢𝑒𝐸𝑟𝑟𝑜𝑟("𝑜𝑣𝑒𝑟𝑙𝑎𝑝 𝑚𝑢𝑠𝑡 𝑏𝑒 𝑠𝑚𝑎𝑙𝑙𝑒𝑟 𝑡ℎ𝑎𝑛 𝑐ℎ𝑢𝑛𝑘_𝑠𝑖𝑧𝑒")

𝑟𝑒𝑡𝑢𝑟𝑛 𝑠𝑒𝑙𝑓

Both fields can be individually valid, while their combination is not.

That is the difference between:

Field validation → Is this value valid?

Model validation → Is this combination valid?

With Pydantic, 𝙁𝙞𝙚𝙡𝙙(), 𝙛𝙞𝙚𝙡𝙙_𝙫𝙖𝙡𝙞𝙙𝙖𝙩𝙤𝙧(), 𝙖𝙣𝙙 𝙢𝙤𝙙𝙚𝙡_𝙫𝙖𝙡𝙞𝙙𝙖𝙩𝙤𝙧() let us keep these rules close to the schema.

The result is a cleaner boundary:

𝙍𝙚𝙦𝙪𝙚𝙨𝙩 → 𝙑𝙖𝙡𝙞𝙙𝙖𝙩𝙞𝙤𝙣 → 𝘽𝙪𝙨𝙞𝙣𝙚𝙨𝙨 𝙇𝙤𝙜𝙞𝙘 → 𝘿𝙖𝙩𝙖𝙗𝙖𝙨𝙚 / 𝘼𝙄

For production AI applications, this matters. Document metadata, processing parameters, search filters, and structured AI outputs all need predictable contracts.

Good schemas do more than describe data. They protect the rest of the system.


You can explore more: https://www.youtube.com/playlist?list=PLQNCas8_eikM


#Python #Pydantic #PydanticV2 #FastAPI #BackendEngineering #AIEngineering

While moving from other web frameworks to 𝐅𝐚𝐬𝐭𝐀𝐏𝐈, one question came to my mind:



𝐖𝐡𝐲 𝐝𝐨 𝐈 𝐧𝐞𝐞𝐝 𝐀𝐏𝐈𝐑𝐨𝐮𝐭𝐞𝐫 𝐰𝐡𝐞𝐧 𝐅𝐚𝐬𝐭𝐀𝐏𝐈 𝐚𝐥𝐫𝐞𝐚𝐝𝐲 𝐥𝐞𝐭𝐬 𝐦𝐞 𝐝𝐞𝐟𝐢𝐧𝐞 𝐫𝐨𝐮𝐭𝐞𝐬 𝐝𝐢𝐫𝐞𝐜𝐭𝐥𝐲?



For a small project, this is enough:



@𝒂𝒑𝒑.𝒈𝒆𝒕("/𝒅𝒐𝒄𝒖𝒎𝒆𝒏𝒕𝒔")

𝒂𝒔𝒚𝒏𝒄 𝒅𝒆𝒇 𝒈𝒆𝒕_𝒅𝒐𝒄𝒖𝒎𝒆𝒏𝒕𝒔():

...

So why introduce APIRouter?



The answer became clearer when I started thinking about a real application.



As the project grows, I may have authentication, users, documents, search, AI processing, and many more endpoints.



Keeping all of these routes in one place can quickly become difficult to maintain.

That’s where APIRouter becomes useful.



It allows me to organize routes by feature and keep the application structure clean.



So my takeaway is simple:



𝐅𝐚𝐬𝐭𝐀𝐏𝐈 𝐥𝐞𝐭𝐬 𝐦𝐞 𝐝𝐞𝐟𝐢𝐧𝐞 𝐭𝐡𝐞 𝐫𝐨𝐮𝐭𝐞𝐬.

𝐀𝐏𝐈𝐑𝐨𝐮𝐭𝐞𝐫 𝐡𝐞𝐥𝐩𝐬 𝐦𝐞 𝐨𝐫𝐠𝐚𝐧𝐢𝐳𝐞 𝐭𝐡𝐞𝐦.



It’s not required to make FastAPI work. It becomes useful when I want the application to stay organized and maintainable as it grows.



This was one of those small FastAPI concepts that made much more sense once I started looking at the bigger picture.



𝐇𝐚𝐯𝐞 𝐲𝐨𝐮 𝐡𝐚𝐝 𝐭𝐡𝐞 𝐬𝐚𝐦𝐞 𝐪𝐮𝐞𝐬𝐭𝐢𝐨𝐧 𝐰𝐡𝐞𝐧 𝐦𝐨𝐯𝐢𝐧𝐠 𝐭𝐨 𝐅𝐚𝐬𝐭𝐀𝐏𝐈?



🔗 𝐆𝐢𝐭𝐇𝐮𝐛: https://github.com/epythonlab2/ai-document-api



🎥 𝐅𝐚𝐬𝐭𝐀𝐏𝐈 𝐜𝐨𝐮𝐫𝐬𝐞: https://www.youtube.com/watch?v=0SLLG2Z_Htw&list=PLQNCas8_eikM



#FastAPI #Python #APIRouter #BackendDevelopment #SoftwareArchitecture #APIDevelopment #PythonDeveloper

As I build my 𝐀𝐈 𝐃𝐨𝐜𝐮𝐦𝐞𝐧𝐭 𝐀𝐏𝐈 𝐰𝐢𝐭𝐡 𝐅𝐚𝐬𝐭𝐀𝐏𝐈, I’m realizing that building an API is about much more than writing endpoints.


Getting an endpoint to work is just the beginning. A real application needs a solid structure and several pieces working together.

That means thinking about:

- Validating incoming data

- Organizing routes and business logic

- Connecting to a database

- Handling errors properly

- Implementing authentication and permissions

- Testing and deploying the application


Each step introduces a new challenge and a new concept to learn.

That’s why I’m building this project step by step as part of my 𝐅𝐚𝐬𝐭𝐀𝐏𝐈 𝐬𝐞𝐫𝐢𝐞𝐬. My goal is to go beyond isolated examples and demonstrate how these concepts come together in a practical AI application.


𝐁𝐞𝐜𝐚𝐮𝐬𝐞 𝐥𝐞𝐚𝐫𝐧𝐢𝐧𝐠 𝐚 𝐟𝐫𝐚𝐦𝐞𝐰𝐨𝐫𝐤 𝐢𝐬 𝐨𝐧𝐞 𝐭𝐡𝐢𝐧𝐠. 𝐊𝐧𝐨𝐰𝐢𝐧𝐠 𝐡𝐨𝐰 𝐭𝐨 𝐮𝐬𝐞 𝐢𝐭 𝐭𝐨 𝐛𝐮𝐢𝐥𝐝 𝐚 𝐫𝐞𝐚𝐥 𝐚𝐩𝐩𝐥𝐢𝐜𝐚𝐭𝐢𝐨𝐧 𝐢𝐬 𝐚𝐧𝐨𝐭𝐡𝐞𝐫.

🔗 GitHub repository: https://github.com/epythonlab2/ai-document-api

🎥 Explore the full course series: https://www.youtube.com/watch?v=0SLLG2Z_Htw&list=PLQNCas8_eikM


𝐖𝐡𝐚𝐭 𝐝𝐨 𝐲𝐨𝐮 𝐟𝐢𝐧𝐝 𝐦𝐨𝐬𝐭 𝐜𝐡𝐚𝐥𝐥𝐞𝐧𝐠𝐢𝐧𝐠 𝐰𝐡𝐞𝐧 𝐭𝐮𝐫𝐧𝐢𝐧𝐠 𝐚 𝐬𝐢𝐦𝐩𝐥𝐞 𝐀𝐏𝐈 𝐢𝐧𝐭𝐨 𝐚 𝐜𝐨𝐦𝐩𝐥𝐞𝐭𝐞 𝐚𝐩𝐩𝐥𝐢𝐜𝐚𝐭𝐢𝐨𝐧?


#FastAPI #Python #APIDevelopment #BackendDevelopment #AIEngineering

As I continue building my AI Document API with FastAPI, I’m reminding myself to look beyond the happy path.

It’s easy to test an endpoint with valid data and celebrate when everything works.

But what happens when:

- The client sends invalid data?

- The requested document doesn't exist?

- A database operation fails?

- A user tries to access something they aren't authorized to access?

For me, the goal isn’t simply to make each endpoint work. It’s to understand how it behaves when things go wrong, too.

That’s one of the things I’m exploring as I build this project step by step with FastAPI.

A good API should handle the expected path well and fail predictably when things go wrong.

As developers, we should test more than whether our code works. We should also test how it fails.

When reviewing an API endpoint, what do you check first: input validation, error handling, or authorization?

🔗 GitHub project: https://github.com/epythonlab2/ai-document-api

🎥 Follow the FastAPI course series: https://www.youtube.com/watch?v=0SLLG2Z_Htw&list=PLQNCas8_eikM


#FastAPI #Python #APIDevelopment #BackendDevelopment #SoftwareEngineering

🚀 I’m Open to New Opportunities in Python, Machine Learning, and Data Engineering!

I’m looking to connect with individuals, teams, and organizations where I can use my technical skills to solve real-world problems, share knowledge, and create meaningful impact.

Here are three areas where I’d love to contribute:

🔹 Content Creation & Technical Education
Creating practical, engaging tutorials on Python, Machine Learning, and Data Engineering to help developers learn, build, and grow.

🔹 Backend Development & AI Engineering
Building reliable backend systems, ML-powered applications, and APIs using Python, FastAPI, and modern AI/ML technologies.

🔹 Mentoring & Knowledge Sharing
Helping aspiring developers strengthen their Python, Machine Learning, and Data Engineering skills through practical guidance and project-based learning.

💡 What am I looking for?
Opportunities to collaborate on exciting projects, contribute to impactful teams, create educational content, and mentor the next generation of developers.

If you’re hiring, building something interesting, or know someone looking for these skills, I’d love to connect!

📩 Feel free to send me a message or tag someone who might be interested. Let’s build something meaningful together.

#Python #MachineLearning #DataEngineering #FastAPI #AI #BackendDevelopment #Mentorship #ContentCreation #OpenToOpportunities

𝐈 𝐬𝐩𝐞𝐞𝐝 𝐮𝐩 𝐩𝐚𝐧𝐝𝐚𝐬 𝐛𝐲 𝟏𝟎𝟎𝐱, 𝐚𝐧𝐝 𝐡𝐞𝐫𝐞 𝐢𝐬 𝐞𝐱𝐚𝐜𝐭𝐥𝐲 𝐡𝐨𝐰 𝐲𝐨𝐮 𝐜𝐚𝐧 𝐭𝐨𝐨. 🚀

If your DataFrame manipulation feels lightning-fast on a small sample but crawls to a halt on a million rows, you are likely falling into a few common performance traps.

Here are the 3 core optimizations that drove a massive speedup:



1️⃣ 𝐃𝐢𝐭𝐜𝐡 .𝚒𝚝𝚎𝚛𝚛𝚘𝚠𝚜() 𝐟𝐨𝐫 𝐕𝐞𝐜𝐭𝐨𝐫𝐢𝐳𝐚𝐭𝐢𝐨𝐧

Row-by-row looping forces Pandas to create a Series object for every row, bypassing C-level optimizations. Let NumPy and Pandas handle your array math natively.



❌ 𝐒𝐥𝐨𝐰 (𝐑𝐨𝐰-𝐛𝐲-𝐫𝐨𝐰 𝐢𝐭𝐞𝐫𝐚𝐭𝐢𝐨𝐧):

𝚏𝚘𝚛 𝚒, 𝚛𝚘𝚠 𝚒𝚗 𝚍𝚏.𝚒𝚝𝚎𝚛𝚛𝚘𝚠𝚜():

𝚍𝚏.𝚕𝚘𝚌[𝚒, "𝚝𝚘𝚝𝚊𝚕"] = 𝚛𝚘𝚠["𝚙𝚛𝚒𝚌𝚎"] * 𝚛𝚘𝚠["𝚚𝚞𝚊𝚗𝚝𝚒𝚝𝚢"]



✅ 𝟏𝟎𝟎𝐱 𝐅𝐚𝐬𝐭𝐞𝐫 (𝐕𝐞𝐜𝐭𝐨𝐫𝐢𝐳𝐞𝐝 𝐨𝐩𝐞𝐫𝐚𝐭𝐢𝐨𝐧):

𝚍𝚏["𝚝𝚘𝚝𝚊𝚕"] = 𝚍𝚏["𝚙𝚛𝚒𝚌𝚎"] * 𝚍𝚏["𝚚𝚞𝚊𝚗𝚝𝚒𝚝𝚢"]



2️⃣ 𝐒𝐮𝐩𝐞𝐫𝐜𝐡𝐚𝐫𝐠𝐞 𝐌𝐮𝐥𝐭𝐢-𝐂𝐨𝐥𝐮𝐦𝐧 𝐌𝐚𝐭𝐡 𝐰𝐢𝐭𝐡 𝚙𝚍.𝚎𝚟𝚊𝚕()

# 𝙴𝚕𝚒𝚖𝚒𝚗𝚊𝚝𝚎𝚜 𝚝𝚎𝚖𝚙𝚘𝚛𝚊𝚛𝚢 𝚖𝚎𝚖𝚘𝚛𝚢 𝚊𝚕𝚕𝚘𝚌𝚊𝚝𝚒𝚘𝚗 𝚘𝚟𝚎𝚛𝚑𝚎𝚊𝚍

𝚍𝚏["𝚛𝚎𝚜𝚞𝚕𝚝"] = 𝚙𝚍.𝚎𝚟𝚊𝚕("𝚌𝚘𝚕𝟷 + 𝚌𝚘𝚕𝟸 * 𝚌𝚘𝚕𝟹 - 𝚌𝚘𝚕𝟺", 𝚝𝚊𝚛𝚐𝚎𝚝=𝚍𝚏)



3️⃣ 𝐃𝐨𝐰𝐧𝐜𝐚𝐬𝐭 𝐃𝐚𝐭𝐚 𝐓𝐲𝐩𝐞𝐬 & 𝐔𝐬𝐞 𝐂𝐚𝐭𝐞𝐠𝐨𝐫𝐢𝐜𝐚𝐥𝐬

By default, Pandas assigns 64-bit integers/floats and treats string columns as bloated 𝚘𝚋𝚓𝚎𝚌𝚝 types. Downcasting your numbers and converting repeating strings to 𝚌𝚊𝚝𝚎𝚐𝚘𝚛𝚢 can shrink your memory footprint by up to 80%—drastically accelerating every subsequent operation.



# 𝙳𝚘𝚠𝚗𝚌𝚊𝚜𝚝 𝚗𝚞𝚖𝚎𝚛𝚒𝚌𝚜 & 𝚖𝚊𝚙 𝚜𝚝𝚛𝚒𝚗𝚐𝚜 𝚝𝚘 𝚌𝚊𝚝𝚎𝚐𝚘𝚛𝚢

𝚍𝚏["𝚒𝚍"] = 𝚙𝚍.𝚝𝚘_𝚗𝚞𝚖𝚎𝚛𝚒𝚌(𝚍𝚏["𝚒𝚍"], 𝚍𝚘𝚠𝚗𝚌𝚊𝚜𝚝="𝚒𝚗𝚝𝚎𝚐𝚎𝚛")

𝚍𝚏["𝚛𝚎𝚐𝚒𝚘𝚗"] = 𝚍𝚏["𝚛𝚎𝚐𝚒𝚘𝚗"].𝚊𝚜𝚝𝚢𝚙𝚎("𝚌𝚊𝚝𝚎𝚐𝚘𝚛𝚢")



💡 𝐓𝐡𝐞 𝐓𝐚𝐤𝐞𝐚𝐰𝐚𝐲: Optimize your code at the vector and memory level before throwing expensive compute clusters or hardware upgrades at the problem.



What is your favorite performance trick for handling large datasets? Let’s share notes in the comments below! 👇



Explore more https://youtu.be/3vX1S2qxDu8



#Python #Pandas #DataScience #DataEngineering #CodeOptimization #MachineLearning #Programming