ESP Warmup

Verifying an SES Warmup with Independent Inbox Placement Tests

A guide on using third-party inbox placement tools to objectively verify the success of an Amazon SES IP or domain warmup process.

7 min read9 sectionsGuide 15 of 30 in ESP Warmup
  • Amazon SES warmup
  • inbox placement testing
  • email deliverability monitoring
  • SES reputation management
  • seed list testing
  • ESP warmup validation

Amazon Simple Email Service (SES) is one of the most cost-effective and scalable ways to send high-volume email. However, its infrastructure requires a rigorous warmup process to establish a positive sender reputation. Whether you are using shared IP addresses or a dedicated IP, the initial weeks of sending are critical. The challenge for many developers and marketers is that the SES console provides data on delivery (did the server accept the mail?) but offers limited visibility into placement (did the mail land in the inbox or the spam folder?).

To move beyond the 'black box' of SES metrics, independent inbox placement testing is required. This process involves sending test campaigns to a controlled seed list to verify that the mailbox providers (MBPs) like Google, Microsoft, and Yahoo actually trust your new sending stream. Validating your warmup with third-party data ensures you don't scale up volume on a foundation of poor reputation.

The Mechanism of an SES Warmup

When you start sending through a new SES identity, mailbox providers have no history for your specific combination of domain and IP. To mitigate risk, they often throttle incoming mail or divert it to the spam folder to see how recipients react. A warmup is the process of gradually increasing your volume to prove you are a legitimate sender.

SES helps by managing the underlying hardware, but the reputation belongs to you. During this phase, MBPs look for high engagement signals like opens, clicks, and 'not spam' marks, while penalizing for bounces and complaints. If you scale too quickly without these positive signals, your SES reputation dashboard may stay green while your actual inbox reach plummets.

Why Native SES Metrics Are Not Enough

The SES Reputation Dashboard focuses on two primary pillars: Bounce Rate and Complaint Rate. While keeping your bounce rate under 5% and complaints under 0.1% is mandatory to avoid account suspension, these numbers do not represent the full picture of deliverability. A message can have 0% bounces and 0% complaints and still be routed entirely to the junk folder.

Independent testing provides a 'seed list', a distributed set of real mailboxes across various providers. By sending your warmup emails to these seeds, you get a report on exactly where your mail landed. This objective data is the only way to know if your warmup is actually working or if you are simply training filters to send your mail to spam.

Step-by-Step Verification Strategy

To verify your SES warmup effectively, you must integrate testing into your volume escalation schedule. Do not wait until you are sending 100,000 emails a day to check your placement.

First, establish a baseline. Before you send your first marketing blast, send a test to your seed list. This reveals if your basic authentication, SPF, DKIM, and DMARC, is correctly configured and recognized by the major providers.

Second, synchronize your tests with your volume steps. If your plan is to double your volume every two days, run a placement test at the start of each new tier. This allows you to catch 'reputation dips.' Often, a sender will have great placement at 1,000 emails per day, but see a sudden shift to the spam folder when they hit 10,000. Identifying this early allows you to hold your volume steady until placement recovers.

Third, monitor the 'Spam' vs. 'Missing' status. If an email is missing, it was likely blocked at the gateway level by SES or the receiving ISP. If it is in the spam folder, your content or domain reputation is the likely culprit.

Not all mailbox providers react to an SES warmup in the same way. Gmail is highly sensitive to recipient engagement and often uses 'greylisting' for new SES IPs. Outlook and Office 365, on the other hand, rely heavily on IP reputation and specific blocklists.

Using an independent tool like SenderSignal allows you to see these differences in a single view. If you notice that Gmail placement is 100% but Outlook is 0%, you know the issue is specific to Microsoft’s filters rather than a global SES configuration problem. This level of granularity prevents you from making broad changes to your setup when only one provider needs attention.

Identifying Content Triggers During Warmup

During the warmup phase, your reputation is fragile. Technical filters are more likely to flag certain keywords or HTML structures that they might ignore from an established sender. Verification testing helps you isolate these issues.

If your placement drops, run a 'split test' with your seed list: send one version with your standard template and another with plain text. If the plain text lands in the inbox and the template lands in spam, you have a content-related deliverability issue. This is a common occurrence in new SES accounts that use heavy tracking pixels or complex CSS before the domain has earned sufficient trust.

Maintaining Momentum with Blacklist Monitoring

Part of verifying your warmup involves ensuring your SES IP isn't appearing on major public blacklists. While Amazon works to keep their shared IP pools clean, dedicated IPs are your responsibility. A single spam trap hit during your warmup can land your IP on a list like Spamhaus or SBL, which will instantly stall your progress.

Integrating automated monitoring ensures that if your SES IP is flagged, you are notified immediately. This allows you to pause your warmup, resolve the listing, and avoid wasting your daily sending quota on emails that will never be delivered.

The Role of Engagement in Validation

Verification is not just about the technical handoff between SES and the receiving server; it is about the human element. During your warmup, you should prioritize sending to your most engaged users, those who have opened or clicked in the last 30 days.

Use your placement tests to confirm that these engaged users are actually seeing your mail. Tools like SenderSignal provide the necessary visibility to ensure that your 'best' traffic is reaching the inbox, which in turn reinforces the positive reputation you are trying to build with the ESPs.

When to Slow Down or Pivot

The data from your independent tests should dictate your warmup speed. If your placement drops below 80% in any major provider, you must stop increasing your daily volume. Continuing to increase volume while placement is poor is the fastest way to permanently damage your domain reputation.

Stay at your current volume level for 3-4 days while you monitor the placement data. Often, if you maintain a consistent volume with good engagement, the filters will adjust, and you will see placement move back to the inbox. Only once the independent verification shows a return to healthy placement should you proceed to the next volume tier in your SES schedule.

Summary of the Verification Checklist

To ensure your Amazon SES warmup is successful, follow this checklist:

  • Verify SPF, DKIM, and DMARC are passing in every test.
  • Run a seed list test at every volume increase.
  • Monitor provider-specific placement to identify localized filtering issues.
  • Check for IP and domain blacklisting daily.
  • Compare plain-text vs. HTML placement if spam folder rates increase.
  • Adjust your escalation speed based on real-world inbox placement, not just SES console metrics.

By treating the SES warmup as a data-driven process rather than a guessing game, you protect your long-term deliverability and ensure that your investment in SES translates into actual reached customers.

Frequently asked

Questions about this topic

Why can't I rely solely on Amazon SES reputation metrics?
Amazon SES provides data on bounces and complaints within their network, but they cannot tell you if a message landed in the Spam folder at Gmail or Outlook. Independent inbox testing fills this gap by showing actual placement across different providers.
How often should I run placement tests during a warmup?
It is best practice to run a test at each significant volume increase, typically every 48 to 72 hours. This allows you to identify filtering issues before you scale to your full audience size.
What is a good inbox placement rate for a new SES setup?
During a warmup, you should aim for 95% or higher placement in the primary inbox for your seed lists. If you see consistent placement in the spam folder, you must pause volume increases and investigate your authentication or content.

More on esp warmup

Related ESP Warmup guides that build on this one.

Related reading across SenderSignal

Guides from other disciplines that connect to this topic.

Start free in two minutes

See where your email actually lands.

Placement testing, blacklist monitoring and reputation tracking in one workspace.