12.4 Carbonyl Compounds II: Carboxylic Acids and Derivatives, Enolate Chemistry, and Condensations

12.4 Carbonyl Compounds II: Carboxylic Acids and Derivatives, Enolate Chemistry, and Condensations

Quick Answer: Carboxylic acids ($pK_a \approx 4-5$) are acidic because the conjugate carboxylate anion is stabilized by two completely equivalent resonance contributors. Carboxylic acid derivatives undergo nucleophilic acyl substitution ($S_N\text{Ac}$) through a tetrahedral intermediate, where reactivity decreases in the order: acyl chlorides > acid anhydrides > esters > amides. Enolate anions are ambident nucleophiles: kinetic enolates (less substituted) form rapidly with LDA at $-78^\circ\text{C}$, whereas thermodynamic enolates (more substituted) form reversibly with alkoxides at higher temperatures. Aldol condensations couple enolates with aldehydes/ketones to yield $\alpha,\beta$-unsaturated enones. Claisen condensations couple esters to form $\beta$-keto esters, driven by irreversible deprotonation of the acidic methylene product. Robinson annulation combines a 1,4-conjugate (Michael) addition with an intramolecular aldol condensation to construct cyclohexenone rings.

---

Carboxylic Acid Structure and Acidity

Carboxylic acids contain a hydroxyl group attached directly to a carbonyl carbon ($-COOH$).

Carboxylate Resonance Stabilization

Carboxylic acids are roughly ten orders of magnitude more acidic than alcohols ($pK_a \approx 4-5$ vs. $16-18$). Deprotonation produces the carboxylate anion ($RCOO^-$):

Carboxylate Resonance Delocalization:
      :O:                  :O:-
     //                   /   
  R - C         <==>   R - C   
     \                    \\
      :O:-                 :O:
 [Two Completely Equivalent Resonance Structures]
 Both C-O bonds are 1.26 Å (Intermediate between C=O 1.21 Å and C-O 1.36 Å)

In the carboxylate anion, the negative charge is delocalized equally across two identical, highly electronegative oxygen atoms in a symmetrical $3$-center $4$-electron ($3c-4e$) $\pi$-system. In an alkoxide anion ($RO^-$), the charge remains localized on a single oxygen atom.

Inductive and Substituent Effects on Acidity

Electron-withdrawing groups (EWGs) stabilize the conjugate base through $\sigma$-bond inductive electron withdrawal, dispersing the negative charge and dramatically lowering $pK_a$:

Distance Dependence of Inductive Effects

Inductive effects fall off sharply with distance through the $\sigma$-framework, becoming negligible beyond three or four bonds:

• $2$-chlorobutanoic acid ($\alpha$-chloro): $pK_a = 2.84$
• $3$-chlorobutanoic acid ($\beta$-chloro): $pK_a = 4.06$
• $4$-chlorobutanoic acid ($\gamma$-chloro): $pK_a = 4.52$
• Butanoic acid (unsubstituted): $pK_a = 4.82$

Dicarboxylic Acids: Electrostatic Interactions

Dicarboxylic acids possess two dissociable protons with distinct equilibrium constants:

• Oxalic Acid ($HOOC-COOH$): $pK_{a1} = 1.27$; $pK_{a2} = 4.27$
• Malonic Acid ($HOOC-CH_2-COOH$): $pK_{a1} = 2.85$; $pK_{a2} = 5.70$
• Succinic Acid ($HOOC-(CH_2)_2-COOH$): $pK_{a1} = 4.21$; $pK_{a2} = 5.64$

$pK_{a1}$ is significantly lower than that of acetic acid because the second neutral, electron-withdrawing carboxylic acid group stabilizes the monoanion through strong inductive electron withdrawal. Conversely, $pK_{a2}$ is significantly higher than that of acetic acid because removing a second proton requires separating a positive charge ($H^+$) from a species that already carries a full negative charge (electrostatic repulsion).

---

Nucleophilic Acyl Substitution ($S_N\text{Ac}$)

Unlike aldehydes and ketones (which undergo nucleophilic addition), carboxylic acid derivatives ($RCOL$) undergo nucleophilic acyl substitution ($S_N\text{Ac}$) because they possess a potential leaving group ($L^-$) attached directly to the carbonyl carbon.

The Addition-Elimination Mechanism

Nucleophilic Acyl Substitution Mechanism:
      :O:                  :O:-                  :O:
     //                   /                     //
  R - C     +  :Nu^-  -->  R - C - L    -->   R - C     +  :L^-
     \                    /                     \
      L                 :Nu                      Nu
  (Planar sp2)         (Tetrahedral sp3)      (Planar sp2)

1. Step 1 (Addition): The nucleophile attacks the electrophilic carbonyl carbon, breaking the $C=O\ \pi$-bond to form an $sp^3$-hybridized tetrahedral intermediate.
2. Step 2 (Elimination): The alkoxide oxygen reforms the stable $C=O\ \pi$-bond, expelling the best leaving group ($L^-$).

Caution: $S_N\text{Ac}$ is not an $S_N2$ displacement! An $S_N2$ reaction requires direct backside displacement at an $sp^3$ carbon without an intermediate. In $S_N\text{Ac}$, the reaction proceeds through a discrete, observable tetrahedral intermediate with addition followed by elimination.

The Reactivity Hierarchy

The relative reactivity of carboxylic acid derivatives toward nucleophilic acyl substitution spans seven orders of magnitude:

$\text{Acyl Chlorides} > \text{Acid Anhydrides} > \text{Esters} \approx \text{Carboxylic Acids} > \text{Amides} > \text{Carboxylate Ions}$

Reactivity Gradient of Carboxylic Acid Derivatives:
  R-CO-Cl      >   R-CO-O-CO-R    >   R-CO-OR'     >   R-CO-NH2     >   R-CO-O:-
 Acyl Chloride      Anhydride           Ester            Amide        Carboxylate
 [Most Reactive]                                                     [Least Reactive]
  <=================================================================================
                 Leaving Group Basicity Decreases / LG Ability Increases

This hierarchy is governed by two fundamental factors:

1. Leaving Group Basicity ($pK_a$ of conjugate acid): Weaker bases are superior leaving groups. Chloride ion ($Cl^-$, $pK_a \text{ of } HCl = -7$) is a phenomenal leaving group; carboxylate ($RCOO^-$, $pK_a \approx 4.8$) is good; alkoxide ($RO^-$, $pK_a \approx 16$) is poor; and amide ion ($NH_2^-$, $pK_a \approx 38$) is exceptionally terrible.
2. Resonance Stabilization of the Carbonyl Ground State: In amides, the nitrogen lone pair donates heavily into the carbonyl $\pi$-system ($2p-2p$ overlap), contributing $>40\%$ double-bond character to the $C-N$ bond. This renders amides completely planar, imposes a rotational barrier of $75 - 85\text{ kJ/mol}$, and significantly neutralizes the electrophilic $\delta^+$ charge on carbon. In acyl chlorides, the chlorine valence electrons occupy a larger $3p$ orbital that overlaps poorly with carbon's $2p$ orbital; thus, inductive electron withdrawal dominates, leaving the carbonyl carbon extraordinarily electron-deficient and reactive.

The "Downhill" Rule of Derivative Interconversions

A derivative higher on the reactivity ladder can be converted directly into any derivative lower on the ladder simply by adding the appropriate nucleophile ("downhill" reaction). Conversely, converting a less reactive derivative into a more reactive derivative ("uphill") is thermodynamically forbidden and requires strong chemical activation (e.g., converting a carboxylic acid to an acyl chloride using thionyl chloride, $SOCl_2$).

---

Interconversions of Carboxylic Acid Derivatives

1. Acyl Chlorides

• Synthesis: Carboxylic acids are converted to acyl chlorides using thionyl chloride ($SOCl_2$) or oxalyl chloride ($(COCl)_2$): $RCOOH + SOCl_2 \longrightarrow RCOCl + SO_2(g)\uparrow + HCl(g)\uparrow$ The reaction is driven to completion by the irreversible evolution of toxic gases ($SO_2$ and $HCl$).
• Reactions: Acyl chlorides react violently with:
  • Water $\to$ Carboxylic acid ($RCOOH + HCl$)
  • Alcohols $\to$ Esters ($RCOOR' + HCl$; pyridine added to neutralize acid)
  • Ammonia / $1^\circ$ / $2^\circ$ Amines $\to$ Amides ($RCONR'_2 + R'_2NH_2^+Cl^-$)

2. Acid Anhydrides

• Synthesis: Coupling an acyl chloride with a sodium carboxylate salt: $RCOCl + R'COONa \to RCOOOCR' + NaCl$.
• Cyclic anhydrides (e.g., succinic anhydride, phthalic anhydride) form spontaneously upon heating the corresponding dicarboxylic acids.

3. Esters and Saponification

• Fischer Esterification: Reaction of a carboxylic acid with an alcohol in the presence of an acid catalyst ($H_2SO_4$ or dry $HCl$): $RCOOH + R'OH \xrightleftharpoons{H^+} RCOOR' + H_2O$ Equilibrium is driven toward ester product by using the alcohol as solvent or removing water azeotropically (Dean-Stark trap).
• Saponification (Base-Promoted Ester Hydrolysis): Heating an ester with aqueous sodium hydroxide ($NaOH$) yields a carboxylate salt and an alcohol: $RCOOR' + OH^- \longrightarrow RCOO^- + R'OH$ Irreversibility: The initial tetrahedral intermediate expels alkoxide ($RO^-$). The alkoxide is a strong base ($pK_a \approx 16$) that instantly abstracts the proton from the newly formed carboxylic acid ($pK_a \approx 5$) to yield the resonance-stabilized carboxylate ion ($K_{eq} > 10^9$). This rapid, irreversible thermodynamic sink pulls the entire reaction to $100\%$ completion. Subsequent acidification is required to isolate the neutral carboxylic acid.

4. Amides and Nitriles

• Amide Synthesis: Prepared by treating acyl chlorides or anhydrides with at least two equivalents of amine (or one equivalent of amine plus triethylamine/pyridine to scavenge $HCl$). Direct reaction of carboxylic acids with amines at room temperature yields only unreactive ammonium carboxylate salts; dehydration requires temperatures $>200^\circ\text{C}$ or peptide coupling reagents (DCC, EDC, HBTU).
• Nitriles: Dehydration of primary amides with $SOCl_2$ or phosphorus pentoxide ($P_2O_5$) yields nitriles ($RCONH_2 \xrightarrow{SOCl_2} R-C\equiv N + SO_2 + 2\ HCl$). Nitriles undergo acidic or basic hydrolysis back to carboxylic acids via an amide intermediate.

---

Enols and Enolate Anions

1. Keto-Enol Tautomerism

Carbonyl compounds possessing $\alpha$-hydrogens exist in rapid dynamic equilibrium with their enol constitutional isomers:

Keto-Enol Tautomerism:
       :O:                               :O-H
      //                                /
   -- C - C - H   <==[Acid or Base]==>   -- C = C --
          |                                 |
      (Keto Form)                       (Enol Form)

• For simple aldehydes and ketones (e.g., acetone), the keto form is favored by $>99.9\%$ ($\Delta G^\circ \approx 45-60\text{ kJ/mol}$) because the sum of bond energies for $C=O$ ($745\text{ kJ/mol}$) and $C-H$ ($413\text{ kJ/mol}$) exceeds that of $C=C$ ($610\text{ kJ/mol}$) and $O-H$ ($463\text{ kJ/mol}$).
• Exceptions Favoring the Enol:
  • $\beta$-Dicarbonyls: Pentane-$2,4$-dione (acetylacetone) exists $\approx 80\%$ in the enol form in nonpolar solvents due to strong intramolecular hydrogen bonding and a stable, conjugated six-membered pseudo-ring.
  • Phenol: The keto tautomer (cyclohexa-$2,4$-dienone) is disfavored by $63\text{ kJ/mol}$; the enol form is locked by the enormous resonance aromatic stabilization energy ($152\text{ kJ/mol}$) of the benzene ring.

2. Acidity of $\alpha$-Hydrogens

Protons located on carbons directly adjacent to a carbonyl group ($\alpha$-hydrogens) are extraordinarily acidic compared to alkane protons:

• Ethane ($CH_3CH_3$): $pK_a \approx 50$
• Amides ($CH_3CONH_2$): $pK_a \approx 30$
• Esters ($CH_3COOCH_2CH_3$): $pK_a \approx 25$
• Ketones ($CH_3COCH_3$): $pK_a \approx 20$
• Aldehydes ($CH_3CHO$): $pK_a \approx 17$
• $\beta$-Keto Esters (Ethyl acetoacetate): $pK_a \approx 11$
• $\beta$-Diketones (Acetylacetone): $pK_a \approx 9$

When a base abstracts an $\alpha$-proton, the resulting enolate anion is resonance-stabilized. The negative charge is delocalized onto the electronegative oxygen atom:

$[:\overset{-}{C}H_2-C(=O)R \longleftrightarrow CH_2=C(\overset{-}{O}:)R]$

Enolates are ambident nucleophiles: they possess two nucleophilic sites (carbon and oxygen). In reactions with carbon electrophiles ($RX, RCHO$), attack occurs predominantly through the $\alpha$-carbon because the formed $C-C$ bond is substantially stronger than a $C-O$ bond.

3. Kinetic vs. Thermodynamic Enolates

When an unsymmetrical ketone (e.g., $2$-methylcyclohexanone) is deprotonated, two different enolates can form:

Enolate Selectivity in 2-Methylcyclohexanone:

            O                           O:-
           //                          / 
          /  \  (LDA, -78°C)          /  \\ 
         |    | ----------->         |    |  [Kinetic Enolate: Less substituted]
         |    |                      |    |
          \  /                        \  /   
           CH3                         CH3   

            O                           O:-
           //                          / 
          /  \  (NaOEt, 25°C)         /   \ 
         |    | ----------->         |    || [Thermodynamic Enolate: More substituted]
         |    |                      |    |
          \  /                        \  /   
           CH3                         CH3   

• Kinetic Control: LDA is so sterically hindered that it cannot easily access the internal tertiary proton at C2; it abstracts the exposed secondary proton at C6. At $-78^\circ\text{C}$ in THF, deprotonation is irreversible, locking in the kinetic enolate.
• Thermodynamic Control: In the presence of a weaker base and an equilibrating protic solvent at room temperature, enolates undergo reversible proton transfers. The system equilibrates to the lower-energy, thermodynamically more stable enolate (the one with the more highly substituted, more stable $C=C$ double bond).

---

$\alpha$-Halogenation and Haloform Reactions

1. Acid-Catalyzed $\alpha$-Halogenation: Clean Monohalogenation

Treating a ketone with halogen ($Cl_2, Br_2, I_2$) in acetic acid introduces exactly one halogen atom at the $\alpha$-position. The reaction proceeds through an enol intermediate. Once a halogen atom is introduced, its strong electron-withdrawing inductive effect decreases the basicity of the carbonyl oxygen, slowing subsequent protonation and halting the reaction cleanly after monohalogenation.

2. Base-Promoted Halogenation & The Haloform Reaction

Under basic conditions ($NaOH / X_2$), the reaction proceeds via an enolate intermediate. Introducing an electronegative halogen atom increases the acidity of the remaining $\alpha$-protons on that same carbon, causing each subsequent deprotonation and halogenation to occur faster than the first:

$\text{Methyl Ketone } (RCOCH_3) \xrightarrow{3\ X_2,\ 4\ OH^-} RCOO^- + CHX_3\downarrow + 3\ X^- + 3\ H_2O$

1. In a methyl ketone ($RCOCH_3$), all three $\alpha$-hydrogens are exhaustively replaced by halogen, forming a trihalomethyl ketone ($RCOCX_3$).
2. The three electronegative halogens transform the $-CX_3$ group into an exceptional leaving group.
3. Hydroxide ion ($OH^-$) attacks the carbonyl carbon via nucleophilic acyl substitution, expelling the trihalomethyl carbanion ($-:CX_3$).
4. Proton transfer gives a carboxylate ($RCOO^-$) and haloform ($CHX_3$).

The Iodoform Test

When iodine in aqueous sodium hydroxide ($I_2 / NaOH$) is added to a methyl ketone, iodoform ($CHI_3$) forms as a bright canary-yellow crystalline precipitate with a distinctive antiseptic odor and a sharp melting point of $119^\circ\text{C}$.

• Positive Test: Compounds containing the acetyl group ($CH_3-C=O$) or compounds oxidizable in situ to acetyl groups, specifically ethanol and secondary methyl carbinols ($CH_3-CH(OH)-R$).

3. The Hell-Volhard-Zelinsky (HVZ) Reaction

Carboxylic acids do not enolize sufficiently to undergo direct $\alpha$-halogenation. In the HVZ reaction, treating a carboxylic acid with bromine and a catalytic amount of phosphorus tribromide ($Br_2 / \text{cat. } PBr_3$) selectively introduces a bromine atom at the $\alpha$-carbon:

$R-CH_2-COOH \xrightarrow{1.\ Br_2,\ \text{cat. } PBr_3 \quad 2.\ H_2O} R-CH(Br)-COOH$

$PBr_3$ converts a small amount of the acid to the acyl bromide ($RCH_2COBr$), which enolizes readily to form an enol that brominates at the $\alpha$-position. Exchange with unreacted carboxylic acid regenerates the acyl bromide catalyst, and final aqueous workup hydrolyzes any remaining acyl bromide to the $\alpha$-bromo carboxylic acid (a vital synthetic intermediate for $\alpha$-amino acids via amination).

---

Carbonyl Condensation Reactions

Carbonyl condensations combine an enolate nucleophile with a carbonyl electrophile to form a new carbon-carbon bond.

1. The Aldol Reaction and Condensation

Treating an aldehyde possessing $\alpha$-hydrogens with dilute base ($NaOH$ or $Ba(OH)_2$) yields an equilibrium mixture containing a $\beta$-hydroxy aldehyde (an aldol):

$2\ CH_3CHO \xrightleftharpoons{OH^-} CH_3-CH(OH)-CH_2-CHO$

Aldol Condensation Mechanism:
 1. Enolate Formation:    CH3CHO  +  OH^-   <==>   [:CH2-CHO]-  +  H2O
 2. Nucleophilic Attack:  CH3CHO  +  [:CH2-CHO]-   <==>   CH3-CH(O:-)-CH2-CHO
 3. Protonation:          CH3-CH(O:-)-CH2-CHO  +  H2O   <==>   CH3-CH(OH)-CH2-CHO (Aldol)
 4. Dehydration (Heat):   CH3-CH(OH)-CH2-CHO  --[OH-, Δ]-->  CH3-CH=CH-CHO  +  H2O
                          (E1cB mechanism yields conjugated α,β-unsaturated enal)

Dehydration via the $E_1\text{cB}$ Mechanism

When heated with acid or base, the $\beta$-hydroxy carbonyl spontaneously dehydrates to an $\alpha,\beta$-unsaturated enone/enal (the aldol condensation):

• Under basic conditions, dehydration does not occur by $E_1$ or $E_2$; it proceeds via an $E_1\text{cB}$ (Elimination Unimolecular Conjugate Base) pathway.
• The base abstracts the remaining acidic $\alpha$-hydrogen to generate a stable, conjugated enolate intermediate. The enolate then collapses, expelling hydroxide ($OH^-$, usually a poor leaving group) driven by the formation of an extended conjugated $\pi$-system ($C=C-C=O$).

Crossed (Mixed) Aldol Reactions

Coupling two different aldehydes typically yields a chaotic mixture of four different aldol products. A crossed aldol is synthetically successful only if:

1. One partner lacks $\alpha$-hydrogens (e.g., benzaldehyde, formaldehyde, pivalaldehyde). When added slowly to an excess of the enolizable partner, it acts solely as the electrophile (e.g., the Claisen-Schmidt condensation of benzaldehyde with acetone to yield dibenzylideneacetone).
2. Directed Aldol Synthesis: One partner is completely converted to its lithium enolate using stoichiometric LDA at $-78^\circ\text{C}$, after which the second carbonyl partner is slowly introduced.

2. The Claisen Condensation

Treating an ester possessing at least two $\alpha$-hydrogens with a stoichiometric amount of alkoxide base yields a $\beta$-keto ester:

$2\ CH_3COOCH_2CH_3 \xrightarrow{1.\ NaOEt / EtOH \quad 2.\ H_3O^+} CH_3-CO-CH_2-COOCH_2CH_3 + EtOH$

The Base-Matching Rule

The base must match the alkoxy group of the ester (e.g., sodium ethoxide $NaOEt$ for ethyl esters, sodium methoxide $NaOMe$ for methyl esters) to prevent transesterification scrambling.

The Irreversible Driving Force Mandate

Every step of the Claisen addition-elimination sequence is an unfavorable equilibrium. The critical driving force that pulls the reaction to completion is the final step:

• The resulting $\beta$-keto ester has a central methylene carbon flanked by two carbonyl groups ($pK_a \approx 11$).
• The alkoxide base ($pK_a \text{ of alcohol} \approx 16$) irreversibly deprotonates this central methylene group, forming a resonance-stabilized enolate.
• Because of this requirement, esters with only one $\alpha$-hydrogen (e.g., ethyl $2$-methylpropanoate) fail to undergo the Claisen condensation in practical yields because they cannot form the final deprotonated enolate driving force!
• Final acidification with aqueous acid ($H_3O^+$) protonates the enolate to deliver the neutral $\beta$-keto ester.

The Dieckmann Condensation

The Dieckmann condensation is an intramolecular Claisen condensation of diesters (such as diethyl adipate or diethyl pimelate) to synthesize cyclic $5$-membered or $6$-membered $\beta$-keto esters (cyclopentanones and cyclohexanones).

3. Conjugate Addition (Michael Addition)

An $\alpha,\beta$-unsaturated carbonyl compound possesses two distinct electrophilic sites:

Electrophilic Sites in α,β-Unsaturated Enones:
       :O:                   :O:-
      //                    /   
  -- C - C = C --   <==> -- C = C - C+ --
     |   |   |              |   |   |
     C1  C2  C3             C1  C2  C3
    (Carbonyl C=O)         (β-Carbon)
    [Hard Electrophile]    [Soft Electrophile]

• 1,2-Direct Addition (Hard Nucleophiles): Strongly basic, concentrated charge nucleophiles (organolithiums $RLi$, Grignards $RMgX$, $LiAlH_4$) attack the carbonyl carbon (C1) directly under charge-controlled kinetics.
• 1,4-Conjugate Addition / Michael Addition (Soft Nucleophiles): Highly polarizable, stabilized carbanions and weak bases attack the $\beta$-carbon (C3) under frontier orbital control:
  • Michael Donors (Nucleophiles): Enolates of $\beta$-dicarbonyls (diethyl malonate, ethyl acetoacetate), enamines, lithium dialkylcuprates (Gilman reagents, $R_2CuLi$), cyanide ($CN^-$), and thiols ($RS^-$).
  • Michael Acceptors (Electrophiles): $\alpha,\beta$-unsaturated esters, ketones, aldehydes, and nitriles.

4. The Robinson Annulation

The Robinson annulation is a powerful tandem ring-forming sequence used in steroid and terpene synthesis to construct a new fused cyclohexenone ring:

Robinson Annulation Sequence:
 Cyclohexanone Enolate  +  Methyl Vinyl Ketone (MVK)
         | 
         v  [Step 1: Michael 1,4-Conjugate Addition]
 1,5-Dicarbonyl Intermediate
         | 
         v  [Step 2: Intramolecular Aldol Cyclization]
 Cyclic β-Hydroxy Ketone
         | 
         v  [Step 3: Base-Catalyzed E1cB Dehydration]
 Fused α,β-Unsaturated Cyclohexenone (Bicyclic Enone Product)

1. Michael Addition: The enolate of a cyclic ketone attacks the $\beta$-carbon of an $\alpha,\beta$-unsaturated ketone (classically methyl vinyl ketone / MVK) to yield a $1,5$-diketone.
2. Intramolecular Aldol Condensation: Base-promoted enolization of the terminal methyl group followed by intramolecular attack on the ring carbonyl forms a six-membered cyclic $\beta$-hydroxy ketone.
3. Dehydration: $E_1\text{cB}$ elimination of water delivers the stable, conjugated bicyclic enone.