13.2 Data Connectors, Syslog/CEF & Windows Event Collection
Key Takeaways
- Data connectors ingest events into the Log Analytics workspace; many Microsoft sources use service-to-service connectors, while appliances and servers often use Azure Monitor Agent (AMA) with data collection rules (DCRs).
- Syslog messages land in the Syslog table; CEF messages land in CommonSecurityLog—prefer Syslog/CEF via AMA connectors and avoid dual-facility duplication.
- Windows Security events for Sentinel should use Windows Security Events via AMA so events populate the SecurityEvent table; generic Windows Event Logs DCRs alone may write to the Event table instead.
- Windows Event Forwarding (WEF) centralizes Windows events to a collector; AMA/DCR then ships selected events from collector or endpoints into Sentinel.
- SC-500 expects you to configure Microsoft connectors for Azure resources and implement Syslog/CEF and Windows Security collection with AMA and DCRs, including WEF patterns.
13.2 Data Connectors, Syslog/CEF & Windows Event Collection
Quick Answer: Use data connectors to ingest logs into Sentinel's workspace. Prefer service-to-service Microsoft connectors for Azure/Microsoft services, and Azure Monitor Agent (AMA) + data collection rules (DCRs) for Syslog, CEF, and Windows Security events (including designs that use Windows Event Forwarding). Confirm data lands in the right tables and filter early to control cost.
SC-500 skills include configure and use Microsoft data connectors for Azure resources, implement syslog and CEF event collections, and collect Windows Security events using data collection rules, including Windows Event Forwarding (WEF). This section is the ingestion engineering core of the exam domain.
How data connectors fit the architecture
After Sentinel is enabled, connectors are how events enter Log Analytics tables for analytics rules, hunting, and workbooks.
| Integration style | Typical sources | Mechanism |
|---|---|---|
| Service-to-service | Azure Activity, Microsoft Entra ID, Defender products, Office/Microsoft 365 streams, some AWS paths | Native API/policy integration; often near real time |
| Agent-based (AMA) | Linux Syslog, CEF appliances via forwarder, Windows Security events, custom text logs | AMA on endpoint or log forwarder + DCR |
| API / function / CCF | Many partner SaaS products | Codeless Connector Framework, Azure Functions, Logs Ingestion API |
Many connectors ship inside Content hub solutions. Install the solution, open the connector page, complete prerequisites, and wait until status shows Connected and sample queries return rows.
Legacy note (awareness, not deep trivia): Microsoft has deprecated older agent patterns (Log Analytics agent / MMA and legacy HTTP Data Collector API timelines). Exam and production designs should center on AMA + DCR and modern ingestion APIs.
Microsoft data connectors for Azure resources
Common Microsoft-oriented connectors SC-500 candidates should recognize:
| Connector / source | Why security teams collect it | Typical table / stream |
|---|---|---|
| Azure Activity | Control-plane operations (who deployed what, role assignments, policy writes) | AzureActivity |
| Microsoft Entra ID (sign-in / audit) | Identity authentication and directory changes | SigninLogs, AuditLogs (and related) |
| Microsoft Defender for Cloud | Cloud security alerts into SIEM correlation | Defender alert tables / security alert streams |
| Microsoft Defender XDR family connectors | Endpoint, identity, email, cloud apps correlation | Product-specific advanced hunting / Sentinel tables |
| Azure Diagnostics-based sources | NSG flow logs, Azure Firewall, Key Vault diagnostics, and similar (via diagnostics settings or dedicated connectors) | Source-specific tables |
Azure Activity — classic first connector
Typical configuration pattern:
- Install Azure Activity solution from Content hub.
- Open the connector -> launch Azure Policy assignment wizard.
- Scope the subscription/RG that should send activity.
- Set the primary Log Analytics workspace to the Sentinel workspace.
- Create the policy assignment and verify
AzureActivityqueries return events.
Scenario: After a suspicious role assignment, analysts query AzureActivity for Microsoft.Authorization/roleAssignments/write near the incident time. Without this connector, that control-plane trail is missing from Sentinel.
Connector permissions mindset
Each connector lists prerequisites: workspace write rights, policy assignment rights, Entra app permissions, or diagnostic settings authority on source resources. If a connector stays Disconnected, check permissions and whether the source is actually emitting logs — not only the Sentinel blade.
Syslog and CEF collection with AMA
Formats
- Syslog: Widely used host/device logging (RFC 3164 / 5424). Ingested messages typically appear in the
Syslogtable. - CEF (Common Event Format): Security-oriented structured syslog extension used by many firewalls, proxies, and NDR tools. CEF events typically land in
CommonSecurityLog.
Architectures
1) Agent on the Linux host itself (Syslog originator)
- Local syslog daemon (
rsyslog/syslog-ng) receives local events. - Daemon forwards to AMA.
- AMA sends to the Sentinel workspace per DCR.
2) Dedicated Linux log forwarder (most appliance designs)
- Network/security devices send Syslog/CEF (often UDP/TCP 514, or another agreed port) to the forwarder.
- Forwarder syslog daemon receives and hands messages to AMA.
- AMA uploads to Log Analytics.
- Forwarder can be Azure VM, on-premises, or another cloud — so long as AMA can reach Azure Monitor endpoints.
Connector setup outline
- Install Syslog and/or Common Event Format solutions from Content hub.
- Configure Syslog via AMA / CEF via AMA connectors.
- Create a DCR selecting facilities/severities (or finer filters via API).
- Select target Linux machines (AMA installs/autoprovisions as configured).
- On forwarders, run the installation script so the syslog daemon listens for remote devices and opens required local ports.
- Point devices at the forwarder; verify tables populate.
AMA version notes (high level): modern AMA versions receive from the syslog daemon on a local TCP port (for example 28330 on recent versions) rather than only Unix domain sockets — know that the daemon-to-agent path is local and version-sensitive, not something you reconfigure on every firewall.
Avoid CEF/Syslog duplication
If the same facility is collected as both Syslog and CEF, you can double-ingest into Syslog and CommonSecurityLog. Mitigations:
- On devices, send CEF on facilities not also collected as plain Syslog.
- Or add DCR transformKql filters that drop CEF payloads from the Syslog stream.
Exam trap: CEF does not always go to the Syslog table. CEF is stored in CommonSecurityLog; plain Syslog goes to Syslog.
Windows Security events via DCRs (and WEF)
AMA + DCR for Windows events
Data collection rules declare:
- Which machines (Azure VMs, Arc-enabled servers, scale sets)
- Which data sources (Windows Event Logs, performance, text logs, etc.)
- Destinations (Log Analytics workspace streams)
- Optional XPath filters to reduce noise
For general Windows Application/System logs, a Windows Event Logs DCR can send to the Event table. For Microsoft Sentinel security analytics, enable the Windows Security Events via AMA connector (Content hub / Sentinel data connectors). That path is designed so security events populate SecurityEvent, which Sentinel content expects.
| Goal | Prefer |
|---|---|
| Ops monitoring of App/System logs | Windows Event Logs data source -> Event |
| SOC detections on logon failures, privilege use, etc. | Windows Security Events via AMA -> SecurityEvent |
Filter with XPath when basic log+severity selectors are too broad. Example pattern form: Security!*[System[(EventID=4625)]] for failed logons. Validate XPath with Get-WinEvent -FilterXPath on a sample host before fleet rollout.
Windows Event Forwarding (WEF)
WEF is the Windows platform feature that forwards event logs from many endpoints to a collector (subscription source-initiated or collector-initiated). In Sentinel designs, WEF is usually a centralization layer, not a replacement for AMA:
- Configure event subscriptions so sources forward Security (and other) channels to a collector.
- Harden collector capacity, network paths, and subscription filters (Event IDs/channels).
- Install AMA on the collector (or on each source if not using WEF) and attach a DCR / Windows Security Events via AMA configuration that ships the needed events to the Sentinel workspace.
When to use WEF patterns:
- Existing enterprise WEF infrastructure already aggregates domain logs
- Segmented networks where only collectors may reach Azure Monitor
- Desire to reduce agent sprawl by collecting at tiered collectors
When direct AMA on each host is simpler:
- Cloud-native fleets already Arc/AMA managed
- You need per-host filtering with less WEF operational overhead
Scenario: A hybrid estate uses WEF to domain collectors for Event ID 4625/4672. Security engineers install AMA on collectors, enable Windows Security Events via AMA with XPath for those IDs, and confirm SecurityEvent ingestion before enabling brute-force analytics rules.
AMA agent concepts (exam-ready)
| Concept | Detail |
|---|---|
| Azure Monitor Agent (AMA) | Modern agent replacing legacy MMA/OMS for Monitor/Sentinel collection |
| DCR | Control plane object defining what to collect and where to send it |
| DCR association | Links DCR to specific VMs/Arc machines |
| Data collection endpoint (DCE) | Often used for custom/logs ingestion paths; some AMA scenarios use workspace/DCR wiring shown in connector UI |
| Outbound connectivity | Agents need HTTPS path to Azure Monitor ingestion endpoints (commonly port 443) |
| Arc | Brings non-Azure machines into Azure management so AMA/DCRs can target them |
Cost and performance tips:
- Filter at DCR/XPath/facility before hot storage.
- Collect Security events you can detect on — not every informational channel by default.
- Separate noisy debug sources from SOC-critical streams.
Exam traps checklist
| Trap | Reality |
|---|---|
| MMA is the current recommended agent | Prefer AMA + DCR |
| Syslog and CEF share one table | Syslog vs CommonSecurityLog |
| Any Windows events DCR fills SecurityEvent for Sentinel | Use Windows Security Events via AMA for SecurityEvent |
| WEF alone is a Sentinel connector | WEF centralizes; AMA/DCR (or equivalent) still delivers to Log Analytics |
| Microsoft connectors need Linux forwarders | Many Microsoft sources are service-to-service without AMA |
Configure Microsoft service connectors for Azure control/identity planes, use AMA-based Syslog/CEF for appliances, and implement Windows Security collection with DCRs — optionally fronted by WEF — and you can answer the SC-500 collection design questions confidently.
Where do Common Event Format (CEF) messages typically appear after successful CEF via AMA ingestion into Microsoft Sentinel?
A team wants Microsoft Sentinel analytics content that depends on Windows Security auditing (for example failed logons) to work with the SecurityEvent table. Which approach best matches current guidance?
What is the role of a data collection rule (DCR) in AMA-based collection for Microsoft Sentinel?
How is Windows Event Forwarding (WEF) best described in a Microsoft Sentinel collection design?