3.2 Azure AI Vision Service
Key Takeaways
Azure AI Vision (formerly Computer Vision) is the primary Azure service for image analysis — it provides pre-built models for common vision tasks.
The Image Analysis 4.0 API supports image captioning, tagging, object detection, smart cropping, and people detection (background removal was retired on March 31, 2025).
Azure AI Vision OCR (Read API) extracts printed and handwritten text from images and documents with high accuracy.
Azure AI Vision's Spatial Analysis feature, which tracked people moving through physical spaces in camera video, was retired on March 30, 2025; Azure AI Video Indexer handles current video analysis.
You access Azure AI Vision through the REST API or SDKs — no custom model training is needed for pre-built capabilities.
Quick Answer: Azure AI Vision is the primary Azure service for image analysis. It provides pre-built models for image captioning, tagging, object detection, OCR, people detection, and more. No custom model training is needed — you send an image to the API and receive analysis results.
What Is Azure AI Vision?
Azure AI Vision (formerly known as Azure Computer Vision) is a cloud-based service that provides pre-built computer vision capabilities. You send images to the service, and it returns structured analysis results.
Key Capabilities
| Capability | Description | Example Output |
|---|---|---|
| Image captioning | Generate a natural language description of an image | "A dog playing fetch in a park" |
| Image tagging | Assign descriptive tags to an image | ["dog", "outdoor", "park", "grass", "playing"] |
| Object detection | Identify and locate objects with bounding boxes | Object: "dog" at [100, 200, 150, 180] |
| Smart cropping | Automatically crop images around regions of interest | Focused crop around the main subject |
| People detection | Detect and locate people in images | Person locations with bounding boxes |
| OCR (Read) | Extract printed and handwritten text | "Invoice #12345, Date: March 2026" |
Image Analysis 4.0 API
The latest version of the Image Analysis API (4.0) is powered by Florence, a large-scale vision foundation model. Key improvements include:
- Better captioning — more natural and accurate image descriptions
- Dense captioning — descriptions for multiple regions in an image
- Image retrieval — search through images using text queries (vector search)
- Customization (retired) — Image Analysis 4.0 custom models were retired on March 31, 2025; train a custom image model with Azure AI Custom Vision
How to Use Image Analysis
- Create an Azure AI Vision resource in the Azure portal
- Send an image to the REST API or use the SDK
- Specify which visual features you want (caption, tags, objects, etc.)
- Receive structured JSON results
Request: POST /imageanalysis:analyze?features=caption,tags,objects
Image: [photo of a park scene]
Response:
{
"caption": "A golden retriever playing fetch in a sunny park",
"tags": ["dog", "golden retriever", "park", "grass", "ball", "outdoor"],
"objects": [
{"name": "dog", "confidence": 0.97, "boundingBox": {...}},
{"name": "ball", "confidence": 0.89, "boundingBox": {...}}
]
}
On the Exam: Know that Azure AI Vision provides PRE-BUILT capabilities — you do not need to train a model. Send an image, get results. If a question asks about training a custom image model, that is Azure AI Custom Vision (different service).
OCR with the Read API
The Read API is Azure AI Vision's OCR capability for extracting text from images and documents:
Supported Content
- Printed text in 164+ languages
- Handwritten text in English, Chinese, French, German, Italian, Japanese, Korean, Portuguese, Spanish
- Mixed content — images with both printed and handwritten text
- Document formats — JPEG, PNG, BMP, PDF, TIFF
Read API Process
- Submit an image or document to the Read API
- The service processes the image asynchronously
- Retrieve results with extracted text, line positions, and word positions
- Results include confidence scores for each extracted word
Common OCR Use Cases
- Digitizing paper documents and forms
- Reading license plates from camera images
- Extracting data from receipts and invoices
- Converting handwritten notes to searchable text
- Indexing text in image-heavy documents
Retired: Spatial Analysis
Spatial Analysis used camera video on an Azure IoT Edge device to count people and track how they moved through a space. Microsoft retired it on March 30, 2025, so it is not a current Azure AI Vision capability. For recorded video, use Azure AI Video Indexer.
When to Use Azure AI Vision vs. Other Services
| Scenario | Service to Use |
|---|---|
| Analyze a single image for tags, captions, objects | Azure AI Vision |
| Extract text from a scanned document | Azure AI Vision (Read API) or Azure AI Document Intelligence |
| Train a custom image classifier with your own categories | Azure AI Custom Vision |
| Detect and verify human faces | Azure AI Face |
| Generate images from text descriptions | Azure OpenAI Service (gpt-image models) |
| Analyze video for scene detection and transcription | Azure AI Video Indexer |
| Extract structured data from forms and invoices | Azure AI Document Intelligence |
Which Azure service provides pre-built image analysis capabilities including captioning, tagging, and object detection WITHOUT requiring custom model training?
Azure AI Custom Vision
Azure AI Document Intelligence
Azure Machine Learning
Azure AI Vision
A company wants to locate every person in still photos from its stores and get a bounding box for each one. Which Azure AI Vision capability should it use?
Image captioning
OCR (Read API)
People detection
Smart cropping
Which Azure AI Vision capability would you use to extract text from a photograph of a handwritten note?
Image tagging
Object detection
OCR (Read API)
Smart cropping
What is the difference between Azure AI Vision and Azure AI Custom Vision?
Azure AI Vision provides pre-built models; Custom Vision lets you train your own models
Azure AI Vision is for video; Custom Vision is for images
Azure AI Vision is free; Custom Vision is paid
There is no difference — they are the same service
Naming: From Cognitive Services to Azure AI Vision
For the exam, lock in the current names. The service formerly called Computer Vision is now Azure AI Vision, and it belongs to the rebranded Azure AI services family (formerly the Cognitive Services umbrella). You provision it as a single Azure AI Vision resource — or as a multi-service Azure AI services resource that bundles Vision, Language, Speech, and more behind one key and endpoint. Older material that says "Computer Vision API" or "Cognitive Services" is describing the same capability under retired names.
Vision-Adjacent Services: Pick the Right One
A frequent exam trap is choosing Azure AI Vision when a more specialized service is the correct answer. Keep these boundaries crisp:
| Need | Correct Service | Why Not Azure AI Vision |
|---|---|---|
| Train a classifier on your own categories | Azure AI Custom Vision | Vision uses fixed, pre-built categories |
| Verify or identify a person | Azure AI Face | Vision detects people, not identities |
| Extract fields and tables from forms/invoices | Azure AI Document Intelligence | Vision's OCR reads text but not structured fields |
| Generate an image from a text prompt | Azure OpenAI (gpt-image models) | Vision analyzes images, it does not create them |
| Index/transcribe video content | Azure AI Video Indexer | Vision targets still images |
How Billing and Access Work (Awareness)
You consume Azure AI Vision through a REST API or language SDKs by sending an image (or its URL) and the list of visual features you want. Billing is per transaction (per image analyzed), and a free tier exists for low-volume testing. There is no model to train or host for the pre-built features — Microsoft maintains the underlying Florence foundation model. This is the key contrast with Custom Vision and Azure Machine Learning, where you own the trained model.
The Read (OCR) API in Practice
The Read capability is asynchronous for large or multi-page documents: you submit the job, then poll for results, which return text grouped into pages, lines, and words, each with a bounding region and confidence score. It reads printed text in 160+ languages and handwritten text in a smaller set of major languages, across formats like JPEG, PNG, PDF, and TIFF.
On the Exam: Default to Azure AI Vision for general, pre-built image analysis and OCR. Switch to a specialized service the instant the scenario adds custom categories (Custom Vision), people identity (Face), structured documents (Document Intelligence), or content creation (Azure OpenAI). Recognize that "Computer Vision" and "Cognitive Services" in older questions mean Azure AI Vision and Azure AI services today.
Sections you finish are checked off in the contents.