centminmod / validate-emails

Self-hosted email verification script to clean up bad invalid email address lists. Supports various commercial email verification provider APIs all in one script

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Email Validation Script

Overview

The validate_emails.py is a Python-based tool for email verification and email validation that allows you to classify your email addresses' status using syntax, DNS, and SMTP (Simple Mail Transfer Protocol) and other checks and 3rd party APIs. Using the script's returned status classifications, you can then clean or scrub your email lists. This can be done self-hosted locally on a server or via the supported commercial email verification service APIs (jump straight to email verification provider API speed and result benchmarks). The validate_emails.py script is coded to conditionally support each commercial email verification providers' API rate limits and can be tuned via argument -wf work factor to adjust the number of concurrent threads used for single email address API requests. This ensures you do not waste time and credit $$$$ running into API rate limits.

The script's API Merge support also allows you to combine 2 API email verification providers results into one JSON formated output for double verification checks. The script provides a convenient way to verify the existence and deliverability of email addresses, helping you maintain a clean and accurate email list.

The script offers specific support for Xenforo forum member email list verification through dedicated Xenforo argument flags. These flags enable you to mark invalid Xenforo forum member emails and move them to a bounce_email status, effectively disabling Xenforo email sending to those members without actually deleting the Xenforo member account. You can then setup a Xenforo forum wide notice targetting bounce_email status users - prompting them to update their email addresses.

To reduce potential 3rd party email verification API costs, this script also supports Cloudflare HTTP Forward Proxy Cache With KV Storage for both per email check and bulk file API check results to be temporarily cached and return the email verification status codes at the Cloudflare CDN and Cloudflare Worker KV storage level.

Email verification results can also be optionally saved to Amazon AWS S3 and Cloudflare R2 object storage for long term storage and retrieval.

The validate_emails.py email validation script was written by George Liu (eva2000) for his paid consulting clients usage. The below is public documentation for the script.

Features

  • Validates email addresses using syntax, DNS and SMTP checks
  • Validates -f from email address's SPF, DKIM, DMARC records and logs them for troubleshooting mail deliverability
  • Optionally save your email verification results to S3 object storage providers - Cloudflare R2 or Amazon S3
  • Support local self-hosted email verification + API support for:
  • Supports Cloudflare HTTP Forward Proxy Cache With KV Storage for EmailListVerify per email check API
  • Classifies email addresses into various categories based on the syntax, DNS, and SMTP response
  • Supports concurrent processing for faster validation of multiple email addresses
  • Provides detailed logging for tracking the validation process
  • Allows customization of delay between requests to respect email server limitations
  • Supports input of email addresses via command-line arguments or a file
  • Identifies disposable email addresses and free domain name provider addresses
  • Checks email addresses against custom blacklists and whitelists
  • Supports different test modes for syntax, DNS, SMTP, and disposable email checks
  • Configurable SMTP port and TLS/SSL support
  • Supports SMTP profiles. However, using SMTP relay profiles won't get accurate SMTP checks. Locally ran server SMTP checks are more accurate.
  • Supports different DNS lookup methods: asyncio, concurrent, and sequential
  • Supports different processing modes: thread and asyncio
  • Xenforo support. Generates SQL queries for updating user status user_state in XenForo forum based email validation results. Allowing you to clean up your Xenforo user database's email addresses by disabling email sending to those specific bad email addresses.

Requirements

  • Python 3.6 minimum. Script tested on AlmaLinux 8 Python 3.6 and AlmaLinux 9 Python 3.9.

Usage

  1. Open a terminal or command prompt and navigate to the directory where the script is located.

  2. Run the script with the desired command-line arguments.

python validate_emails.py
usage: validate_emails.py [-h] -f FROM_EMAIL [-e EMAILS] [-l LIST_FILE] [-b BATCH_SIZE] [-d] [-v] [-delay DELAY] [--cache-timeout CACHE_TIMEOUT]
                          [-t TIMEOUT] [-r RETRIES] [-tm {syntax,dns,smtp,all,disposable}] [-dns {asyncio,concurrent,sequential}]
                          [-p {thread,asyncio}] [-bl BLACKLIST_FILE] [-wl WHITELIST_FILE] [-smtp {default,ses,generic,rotate}] [-xf]
                          [-xfdb XF_DATABASE] [-xfprefix XF_PREFIX] [-profile] [-wf WORKER_FACTOR]
                          [-api {emaillistverify,millionverifier,captainverify,proofy,myemailverifier,zerobounce,reoon,bouncify,bounceless}]
                          [-apikey EMAILLISTVERIFY_API_KEY] [-apikey_mv MILLIONVERIFIER_API_KEY]
                          [-apibulk {emaillistverify,millionverifier,proofy,bounceless}] [-apikey_cv CAPTAINVERIFY_API_KEY]
                          [-apikey_pf PROOFY_API_KEY] [-apiuser_pf PROOFY_USER_ID] [-pf_max_connections PROOFY_MAX_CONNECTIONS]
                          [-pf_batchsize PROOFY_BATCH_SIZE] [-apikey_mev MYEMAILVERIFIER_API_KEY] [-apikey_zb ZEROBOUNCE_API_KEY]
                          [-apikey_rn REOON_API_KEY] [-reoon_mode {quick,power}] [-reoon_max_connections REOON_MAX_CONNECTIONS]
                          [-apikey_bf BOUNCIFY_API_KEY] [-apikey_bl BOUNCELESS_API_KEY] [-mev_max_connections MEV_MAX_CONNECTIONS] [-apimerge]
                          [-apicache {emaillistverify,zerobounce,millionverifier}] [-apicachettl APICACHETTL]
                          [-apicachecheck {count,list,purge}] [-apicache-purge] [-store {r2,s3}] [-store-list]
validate_emails.py: error: the following arguments are required: -f/--from_email

The available arguments are:

  • -f, --from_email (required):
    • Description: The email address to use in the MAIL FROM command.
  • -e, --emails (optional):
    • Description: A single email or comma-separated list of emails to check.
  • -l, --list_file (optional):
    • Description: The path to a file containing emails, one per line.
  • -b, --batch_size (optional):
    • Description: The number of concurrent processes to use (default is 1).
  • -d, --debug (optional):
    • Description: Enable debug logging for more verbose output.
  • -v, --verbose (optional):
    • Description: Enable verbose output.
  • -delay, --delay (optional):
    • Description: The delay between requests in seconds (default is 1).
  • --cache-timeout (optional):
    • Description: Set the caching resolver timeout value (default is 14400).
  • -t, --timeout (optional):
    • Description: The timeout in seconds for SMTP connection and commands (default is 10).
  • -r, --retries (optional):
    • Description: The number of retries for temporary failures and timeouts (default is 3).
  • -tm, --test-mode (optional):
    • Description: The test mode to use for email validation. Available options are:
      • syntax: Check email format syntax only.
      • dns: Perform DNS validation only (default).
      • smtp: Perform SMTP validation only.
      • all: Perform all validations.
      • disposable: Check if the email is from a disposable domain.
  • -dns, --dns-method (optional):
    • Description: The DNS lookup method to use. Available options are:
      • asyncio: Use asynchronous DNS lookups using the asyncio library (default).
      • concurrent: Use concurrent DNS lookups using the concurrent.futures library.
      • sequential: Use basic sequential DNS lookups.
  • -p, --process_mode (optional):
    • Description: The processing mode to use for the process_emails function. Available options are:
      • thread: Use thread-based processing (default).
      • asyncio: Use asyncio-based processing.
  • -bl, --blacklist_file (optional):
    • Description: The path to a file containing blacklisted domains, one per line.
  • -wl, --whitelist_file (optional):
    • Description: The path to a file containing whitelisted domains, one per line.
  • -smtp, --smtp_profile (optional):
    • Description: The SMTP profile to use for email validation. Available options are:
      • default: Use the default SMTP settings (default).
      • ses: Use Amazon SES SMTP settings via ses.ini config file.
      • generic: Use generic SMTP settings via smtp.ini config file.
      • rotate: Use multiple SMTP profile settings via rotate.ini config file which you can rotate through.
  • -xf, --xf_sql (optional):
    • Description: Generate SQL queries for updating user_state in XenForo for emails with specific statuses.
  • -xfdb, --xf_database (optional):
    • Description: The XenForo database name (default is 'DATABNAME').
  • -xfprefix, --xf_prefix (optional):
    • Description: The XenForo table prefix (default is 'xf_').
  • -profile, --profile (optional):
    • Description: Enable profiling of the script.
  • -wf, --worker-factor (optional):
    • Description: The worker factor for calculating the maximum number of worker threads (default is 16).
  • -api, --api (optional):
    • Description: Specify the API to use for email verification. Available options are:
      • emaillistverify: Use the EmailListVerify API.
      • millionverifier: Use the MillionVerifier API.
      • myemailverifier: Use the MyEmailVerifier API.
      • captainverify: Use the CaptainVerify API.
      • proofy: Use the Proofy API.
      • zerobounce: Use the Zerobounce.net API.
      • reoon: Use the Zerobounce.net API.
      • bouncify: Use the Bouncify API.
      • bounceless: Use the Bounceless API.
  • -apimerge, --api_merge (optional):
    • Description: Merge and combine emaillistverify or millionverifier API results into one result
  • -apibulk, --api_bulk (optional):
    • Description: Use emaillistverify or millionverifier values for Bulk file API method.
  • -apikey, --emaillistverify_api_key (optional):
    • Description: The API key for the EmailListVerify service.
  • -apikey_mv, --millionverifier_api_key (optional):
    • Description: The API key for the MillionVerifier service.
  • -apikey_mev, --myemailverifier-api-key (optional):
    • Description: The API key for the MyEmailVerifier service.
  • -apikey_cv, --captainverify_api_key (optional):
    • Description: The API key for the CaptainVerify service.
  • -apikey_zb, --zerobounce_api_key (optional):
    • Description: The API key for the Zerobounce.net service.
  • -apikey_rn, --reoon_api_key (optional):
    • Description: The API key for the Reoon service.
  • -reoon_mode, --reoon_mode
    • Description: Reoon verification mode quick or power
  • -apikey_bf, --bouncify_api_key
    • Description: The API key for the Bouncify service.
  • -apikey_bl, --bounceless_api_key
    • Description: The API key for the Bounceless service.
  • -apikey_pf, --proofy_api_key (optional):
    • Description: The API key for the Proofy service.
  • -apiuser_pf, --proofy_user_id (optional):
    • Description: The Proofy userid.
  • -pf_max_connections (optional):
    • Description: Maximum number of concurrent connections for the Proofy.io API (default: 1)
  • -mev_max_connections (optional):
    • Description: Maximum number of concurrent connections for the MyEmailVerifier API (default: 1)
  • -reoon_max_connections (optional):
    • Description: Maximum number of concurrent connections for the Reoon API (default: 5)
  • -apicache, --api_cache (optional):
    • Description: Set the appropriate API's Cloudflare Worker KV cacheKey prefix. Available options are:
      • emaillistverify: Use with the EmailListVerify API.
      • zerobounce: Use with the ZeroBounce API.
      • millionverifier: Use with the MillionVerifier API.
  • -apicachettl (optional):
    • Description: this sets the cache TTL duration in seconds for how long Cloudflare CDN/KV stores in cache (default: 300 seconds)
  • -apicachecheck (optional):
    • Description: operates when -apicachettl is set and takes count or list or purge options to query the Cloudflare KV storage cache to count number of cached entries or list the entries themselves
  • -apicache-purge (optional):
    • Description: purges Cloudflare CDN/KV cache when -apicachecheck set to purge option

Validates -f from email address's SPF, DKIM, DMARC records when argument is passed and logs them

python validate_emails.py -f user@domain1.com
cat email_verification_log_2024-05-05_01-54-51.log

2024-05-05 01:54:51,105 - INFO - SPF record found for user@domain1.com
2024-05-05 01:54:51,105 - INFO - SPF record: "v=spf1 include:_spf.google.com +a +mx ~all"
2024-05-05 01:54:51,142 - ERROR - Error checking DKIM for user@domain1.com with selector default: The DNS response does not contain an answer to the question: default._domainkey.domain1.com. IN TXT
2024-05-05 01:54:51,174 - INFO - DKIM record found for user@domain1.com with selector google
2024-05-05 01:54:51,174 - INFO - DKIM record: "v=DKIM1; k=rsa; p=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQCMF3nm2Za6EN0udFQLb35Jcy3u63iCzdaojAkVsCISJsHKe2ThgSsriU1MRm32abcd/u2aNEAxJ3jhN7TbkuV8j7xppV5PW+abcd/84lxa2xTlngXOymlJWleoTZUQQPkmkB66IO/XqZVj7RrF/Iru1qpAvJ9aW+6vCZEJFjCZowIDAQAB"
2024-05-05 01:54:51,237 - WARNING - Error checking DMARC for user@domain1.com with record name _dmarc: The DMARC record must be located at _dmarc._dmarc.domain1.com, not _dmarc.domain1.com
2024-05-05 01:54:51,562 - INFO - DMARC record found for user@domain1.com with record name _dmarc.mail
2024-05-05 01:54:51,562 - INFO - DMARC record: v=DMARC1; p=quarantine; sp=none; rua=mailto:re+xxx@inbound.dmarcdigests.com,mailto:re+yyy@dmarc.postmarkapp.com; aspf=r; pct=100
2024-05-05 01:54:51,562 - INFO - DMARC policy check passed for user@domain1.com

Example usage for DNS only checks (skipping SMTP checks):

python validate_email.py -f sender@example.com -e user1@example.com,user2@example.com -tm dns

Example usage for DNS + SMTP checks:

python validate_email.py -f sender@example.com -e user1@example.com,user2@example.com -tm all

Notes:

  • If the -tm flag is not passed, it defaults to DNS test mode only.
  • Tuning -wf worker factor value for calculating the maximum number of worker threads can speed up the processing of emails when in -p thread process mode or when no -p flag is set. Example benchmark of 10,000 email addresses for -tm dns -p thread for DNS only tests (using default -dns asyncio) using process method = thread took 4mins 40s to complete with work factor -wf 4. However, with -wf 80 time to completion took ~40s on a Intel Core i7 4790K 4C/8T or ~33s on a Intel Xeon E-2276G 6C/12T based dedicated server.

Output

The script outputs the validation results in JSON format. Each email address is represented by an object with the following fields:

  • email: The email address.
  • status: The validation status of the email address. Possible values are:
    • valid_format: The email address has a valid format.
    • invalid: The email address has an invalid format.
    • valid_dns: The email address has valid DNS records.
    • invalid_dns: The email address has invalid DNS records.
    • ok: The email address passed SMTP validation.
    • unknown_email: The email address is unknown or doesn't exist.
    • temporary_failure: A temporary failure occurred during SMTP validation.
    • syntax_or_command_error: An SMTP syntax or command error occurred.
    • transaction_failed: The SMTP transaction failed.
    • timeout: A timeout occurred during SMTP validation.
    • skipped_smtp_check: SMTP validation was skipped based on the test mode.
  • status_code: SMTP validation check's logged SMTP response code.
  • free_email: Indicates whether the email address is from a free email provider. Possible values are yes, no, or unknown.
  • disposable_email: Indicates whether the email address is from a disposable domain. Possible values are yes, no, or notchecked.
  • xf_sql (optional): The SQL query for updating the user status in XenForo based on the validation result.

Logging

The script generates a log file named email_verification_log_<timestamp>.log in the same directory as the script. The log file contains detailed information about the validation process, including any errors or warnings encountered.

If -v verbose mode is used with -tm all for SMTP domain MX record checks, an additional debug log file named email_verification_log_debug_<timestamp>.log is generated in the same directory as the script. The debug log has extended logging of the SMTP responses.

Configuration

validate_emails.ini config file

Add validate_emails.ini config file support so Cloudflare Worker KV caching endpoint url can be defined outside of the script. If validate_emails.ini doesn't exist, you'll get this message

./validate_emails.py 
Error: 'api_url' setting not found in 'validate_emails.ini' file.
Please create the 'validate_emails.ini' file in the same directory as the script and add the 'api_url' setting.

validate_emails.ini contents setting api_url

[settings]
api_url=http=https://your_cf_worker.com

S3 Storage Support

Commercial email verification providers usually only store your file based uploaded or bulk file API uploaded files for a defined duration i.e. 15 to 30 days before they are deleted. And per email check API results are usually not stored at all. So if you need to store your per email check or bulk file API email verification results for longer, the validate_emails.py script now supports saving your results to S3 object storage providers - Cloudflare R2 or Amazon AWS S3. Saving such email verification result logs might be usual for historic comparisons and checks. According to ZeroBounce, on average an email list decays by an average of 25.74% yearly with the leading causes of bounced emails being invalid email addresses and catch-all email addresses.

Add optional Cloudflare R2 S3 object storage or Amazon AWS S3 object storage which will allow you to save your validate_emails.py ran JSON output in externel Cloudflare R2 or Amazon AWS S3 object storage buckets via validate_emails.ini defined:

For Cloudflare R2

[r2]
endpoint_url = https://your-account-id.r2.cloudflarestorage.com
aws_access_key_id = your-r2-access-key-id
aws_secret_access_key = your-r2-secret-access-key
bucket_name = your-r2-bucket-name

For Amazon AWS S3

[s3]
endpoint_url = https://your-s3-endpoint-url
aws_access_key_id = your-s3-access-key-id
aws_secret_access_key = your-s3-secret-access-key
bucket_name = your-s3-bucket-name

Below example to send validate_emails.py script results to Cloudflare R2 S3 object storage via -store r2 argument. Using EmailListVerify per email check API -api emaillistverify -apikey $elvkey + Cloudflare cached for 120 seconds -apicache emaillistverify -apicachettl 120

time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com,hnyfmw2@canadlan-drugs.com,hnyfmw3@canadlan-drugs.com -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120 -tm all -store r2

Output stored successfully in R2: emailapi-emaillistverify-cached/output_20240511051940.json
[
    {
        "email": "hnyfmw@canadlan-drugs.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "hnyfmw2@canadlan-drugs.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "hnyfmw3@canadlan-drugs.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    }
]

real    0m1.663s
user    0m0.391s
sys     0m0.039s

validate_emails.py script's Cloudflare R2 saved emailapi-emaillistverify-cached/output_20240511051940.json log contents

cat emailapi-emaillistverify-cached/output_20240511051940.json

[{"email": "hnyfmw@canadlan-drugs.com", "status": "unknown", "status_code": null, "free_email": "no", "disposable_email": "no"}, {"email": "hnyfmw2@canadlan-drugs.com", "status": "unknown", "status_code": null, "free_email": "no", "disposable_email": "no"}, {"email": "hnyfmw3@canadlan-drugs.com", "status": "unknown", "status_code": null, "free_email": "no", "disposable_email": "no"}]

validate_emails.py run log inspection

cat $(ls -Art | tail -3 | grep 'email_verification')                                             
2024-05-11 05:14:23,074 - INFO - Checking cache for email: hnyfmw@canadlan-drugs.com
2024-05-11 05:14:23,075 - INFO - Checking cache for email: hnyfmw2@canadlan-drugs.com
2024-05-11 05:14:23,075 - INFO - Checking cache for email: hnyfmw3@canadlan-drugs.com
2024-05-11 05:14:25,206 - INFO - Cache result: unknown
2024-05-11 05:14:25,966 - INFO - Cache result: unknown
2024-05-11 05:14:26,092 - INFO - Cache result: unknown

Non-cached EmailListVerify per email check API -api emaillistverify -apikey $elvkey run

time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com,hnyfmw2@canadlan-drugs.com,hnyfmw3@canadlan-drugs.com -api emaillistverify -apikey $elvkey -tm all -store r2

Output stored successfully in R2: emailapi-emaillistverify/output_20240511055822.json
[
    {
        "email": "hnyfmw@canadlan-drugs.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "hnyfmw2@canadlan-drugs.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "hnyfmw3@canadlan-drugs.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    }
]

real    0m10.612s
user    0m0.541s
sys     0m0.033s

validate_emails.py script's Cloudflare R2 saved emailapi-emaillistverify/output_20240511055822.json log contents

cat emailapi-emaillistverify/output_20240511055822.json

[{"email": "hnyfmw@canadlan-drugs.com", "status": "unknown", "status_code": null, "free_email": "no", "disposable_email": "no"}, {"email": "hnyfmw2@canadlan-drugs.com", "status": "unknown", "status_code": null, "free_email": "no", "disposable_email": "no"}, {"email": "hnyfmw3@canadlan-drugs.com", "status": "unknown", "status_code": null, "free_email": "no", "disposable_email": "no"}]

-smtp ses

The script supports loading SMTP settings from a configuration file named ses.ini. The file should have the following format:

[ses]
server = your_ses_smtp_server
port = your_ses_smtp_port
use_tls = True
username = your_ses_username
password = your_ses_password

If the ses SMTP profile is specified using the -smtp ses argument, the script will load the SMTP settings from the ses.ini file.

However, using SMTP relay profiles won't get accurate SMTP checks. Locally ran server SMTP checks are more accurate.

-smtp rotate

The rotate.ini file is used to store multiple SMTP profiles that can be rotated during the email verification process with -smtp rotate argument is passed on command line. Each profile represents a different SMTP server configuration.

Here's an example of how the rotate.ini file can be populated:

[profile1]
server = smtp1.example.com
port = 587
use_tls = yes
username = user1@example.com
password = password1

[profile2]
server = smtp2.example.com
port = 465
use_tls = yes
username = user2@example.com
password = password2

[profile3]
server = smtp3.example.com
port = 25
use_tls = no
username = user3@example.com
password = password3

In this example, the rotate.ini file contains three SMTP profiles: profile1, profile2, and profile3. Each profile is defined as a separate section in the INI file.

The properties for each profile are:

  • server: The hostname or IP address of the SMTP server.
  • port: The port number to use for the SMTP connection (e.g., 25, 465, 587).
  • use_tls: Indicates whether to use TLS encryption for the SMTP connection. Set to yes or no.
  • username: The username for SMTP authentication.
  • password: The password for SMTP authentication.

You can add as many profiles as needed to the rotate.ini file, each with its own unique section name and SMTP server settings.

When the rotate profile is selected using the -smtp rotate option, the script will randomly choose one of the profiles defined in rotate.ini for each email verification request. This allows for distributing the email verification load across multiple SMTP servers.

Make sure to populate the rotate.ini file with the appropriate SMTP server settings for each profile before using the rotate profile option.

However, using SMTP relay profiles won't get accurate SMTP checks. Locally ran server SMTP checks are more accurate.

-smtp generic

The smtp.ini file is used to store the configuration for a single generic SMTP server that can be used for email verification with -smtp generic argument is passed on command line.

Here's an example of how the smtp.ini file can be populated:

[generic]
server = smtp.example.com
port = 587
use_tls = yes
username = user@example.com
password = password

In this example, the smtp.ini file contains a single section named [generic], which represents the generic SMTP profile.

The properties for the generic profile are:

  • server: The hostname or IP address of the SMTP server.
  • port: The port number to use for the SMTP connection (e.g., 25, 465, 587).
  • use_tls: Indicates whether to use TLS encryption for the SMTP connection. Set to yes or no.
  • username: The username for SMTP authentication.
  • password: The password for SMTP authentication.

When the generic profile is selected using the -smtp generic option, the script will use the SMTP server settings defined in the smtp.ini file for all email verification requests.

Make sure to populate the smtp.ini file with the appropriate SMTP server settings before using the generic profile option.

However, using SMTP relay profiles won't get accurate SMTP checks. Locally ran server SMTP checks are more accurate.

Customization

You can customize the behavior of the script by modifying the following variables in the code:

  • DEFAULT_DELAY: The default delay between requests in seconds (default is 1).
  • LARGE_PROVIDER_DELAY: The delay for large email providers in seconds (default is 2).
  • LARGE_PROVIDERS: A list of large email providers that require a longer delay between requests.

Troubleshooting

If you encounter any issues or errors while running the script, consider the following:

  • Ensure that you have installed all the required Python packages.
  • Check the log file for detailed error messages and traceback information.
  • Verify that the email addresses provided are valid and properly formatted.
  • Make sure you have a stable internet connection for accurate DNS and SMTP validations.
  • If you are using custom blacklist or whitelist files, ensure that they exist and contain valid domain entries.

domain_responses function

  1. The smtp_check function now accepts a domain_responses parameter, which is a dictionary to store the SMTP responses for each domain. It records the SMTP response code and message for each domain.

  2. The process_emails function creates a domain_responses dictionary to store the SMTP responses per domain. It passes this dictionary to the validate_and_classify function.

  3. After processing the emails, the process_emails function analyzes the SMTP responses for each domain. It calculates the failure rate based on the SMTP response codes. If the failure rate exceeds a predefined threshold (e.g., 5% in this example), it logs a warning message indicating that the verification strategy needs to be adjusted for that domain.

  4. The validate_and_classify function now accepts the domain_responses parameter and passes it to the smtp_check function.

With these changes, the script will proactively monitor SMTP responses and adjust the verification strategy based on the feedback from the servers.

Example in log

grep failure email_verification_log_2024-05-03_08-45-05.log

2024-05-03 08:45:07,910 - INFO - Acceptable failure rate (0.00%) for domain gmail.com.

Example Usage

AWS SES SMTP support and Xenforo support to display MySQL query for bad emails only to set their status to email_bounce passing flags -xf and -xfdb xenforo and -xfprefix xf_

python validate_emails.py -f user@domain1.com -l emaillist.txt -smtp ses -xf -xfdb xenforo -xfprefix xf_

ses.ini

[ses]
server = email-smtp.us-west-2.amazonaws.com
port = 587
use_tls = true
username = YOUR_AWS_SES_SMTP_USERNAME
password = YOUR_AWS_SES_SMTP_PASSWORD

Xenforo

Xenforo support to display MySQL query for bad emails only to set their status to email_bounce passing flags -xf and -xfdb xenforo and -xfprefix xf_ with disposable_email status field

Xenforo arguments mode for -xf -xfdb xenforo -xfprefix xf_ has ben updated to output

  • xf_sql for MySQL query you can run on SSH command line. The command's double quotes are escaped \" so you remove the backslash manually, or use below outlined jq tool to automatically remove it
  • xf_sql_batch for MySQL query run in MySQL client, phpmyadmin etc
  • xf_sql_user for MySQL query you can run on SSH command line to look up Xenforo user details for that email address. The command's double quotes are escaped \" so you remove the backslash manually, or use below outlined jq tool to automatically remove it
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_
[
    {
        "email": "user@mailsac.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo",
        "xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';",
        "xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@mailsac.com'\\G\" xenforo"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo",
        "xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';",
        "xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@domain1.com'\\G\" xenforo"
    },
    {
        "email": "abc@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo",
        "xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';",
        "xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'abc@domain1.com'\\G\" xenforo"
    },
    {
        "email": "123@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo",
        "xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';",
        "xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '123@domain1.com'\\G\" xenforo"
    },
    {
        "email": "pop@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo",
        "xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';",
        "xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pop@domain1.com'\\G\" xenforo"
    },
    {
        "email": "pip@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo",
        "xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';",
        "xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pip@domain1.com'\\G\" xenforo"
    },
    {
        "email": "user@tempr.email",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo",
        "xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';",
        "xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@tempr.email'\\G\" xenforo"
    },
    {
        "email": "info@domain2.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "yes",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo",
        "xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';",
        "xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'op999@gmail.com'\\G\" xenforo"
    },
    {
        "email": "user@yahoo.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

Use jq tool to filter for xf_sql only

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';" xenforo

Use jq tool to filter for xf_sql_batch only. You can pipe or place this output into a update.sql file and import into your Xenforo MySQL database to batch update the user's user_state

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql_batch) | .xf_sql_batch'
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';

Use jq tool to filter for xf_sql_user only. This allows you to run on SSH command line the Xenforo database lookup for the Xenforo user details for the specific email address

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql_user) | .xf_sql_user'
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@mailsac.com'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@domain1.com'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'abc@domain1.com'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '123@domain1.com'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pop@domain1.com'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pip@domain1.com'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@tempr.email'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'op999@gmail.com'\G" xenforo

Example running one of these commands for pop@domain1.com on server where Xenforo is installed. The user_state would either be valid prior to running above UPDATE command or email_bounce after running UPDATE command.

mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pop@domain1.com'\G" xenforo
*************************** 1. row ***************************
            user_id: 11
           username: pop
              email: pop@domain1.com
      user_group_id: 2
secondary_group_ids: 3,4,6,8
      message_count: 191817
      register_date: 1400868747
      last_activity: 1715011284
         user_state: email_bounce
       is_moderator: 1
           is_admin: 1
          is_banned: 0

register_date date

date -d @1400868747
Fri May 23 18:12:27 UTC 2014

last_activity date

date -d @1715011284
Mon May  6 16:01:24 UTC 2024
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_ | jq 'map({ status: .status }) | group_by(.status) | map({ status: .[0].status, count: length })'

[
  {
    "status": "invalid",
    "count": 1
  },
  {
    "status": "ok",
    "count": 8
  },
  {
    "status": "unknown_email",
    "count": 6
  }
]

Xenforo Email Bounce Log

Example lookup for Xenforo forum's email bounce log via my custom xf_bounce_log.py for email address hnyfmw@canadlan-drugs.com that is bouncing emails. And using validate_emails.py script's local and API to lookup email address status.

./xf_bounce_log.py -d $xfdb -n 10 -s desc | jq '.[] | select(.recipient == "hnyfmw@canadlan-drugs.com") | {bounce_id, message_type, action_taken, user_id, recipient, status_code, diagnostic_info, "Delivered-To": .raw_message["Delivered-To:"], "Delivery-date": .raw_message["Delivery-date:"], "Delivery-date": .raw_message["Delivery-date:"], "Subject": .raw_message["Subject:"]}'

{
  "bounce_id": 203,
  "message_type": "bounce",
  "action_taken": "soft",
  "user_id": 122136,
  "recipient": "hnyfmw@canadlan-drugs.com",
  "status_code": "4.4.7",
  "diagnostic_info": " 550 4.4.7 Message expired: unable to deliver in 840 minutes.<421 4.4.0 Unable to lookup DNS for canadlan-drugs.com>",
  "Delivered-To": "bouncer@domain1.com",
  "Delivery-date": "Fri, 26 Apr 2024 15:44:06 +0000",
  "Subject": "Delivery Status Notification (Failure)"
}

validate_emails.py self-hosted local email verification check for syntax, DNS and SMTP checks for hnyfmw@canadlan-drugs.com

time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all         
[
    {
        "email": "hnyfmw@canadlan-drugs.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "no"
    }
]

real    0m0.932s
user    0m0.428s
sys     0m0.025s

validate_emails.py using external EmailListVerify API email verification check

time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api emaillistverify -apikey $elvkey
[
    {
        "email": "hnyfmw@canadlan-drugs.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    }
]

real    0m2.626s
user    0m0.461s
sys     0m0.023s

validate_emails.py using external MillionVerifier API email verification check

time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api millionverifier -apikey_mv $mvkey
[
    {
        "email": "hnyfmw@canadlan-drugs.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    }
]

real    0m1.142s
user    0m0.455s
sys     0m0.024s

validate_emails.py using external MyEmailVerifier API email verification check

time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api myemailverifier -apikey_mev $mevkey
[
    {
        "email": "hnyfmw@canadlan-drugs.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    }
]

real    0m1.823s
user    0m0.463s
sys     0m0.019s

validate_emails.py using external CaptainVerify API email verification check

time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api captainverify -apikey_cv $cvkey
[
    {
        "email": "hnyfmw@canadlan-drugs.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    }
]

real    0m25.264s
user    0m0.457s
sys     0m0.022s

Unfortunately, I ran out of credits to test with Proofy.io.

validate_emails.py using external Zerobounce API enabled run -api zerobounce -apikey_zb $zbkey -tm all with specified email address -e hnyfmw@canadlan-drugs.com. The status, sub_status and free_email_api JSON fields are from API and free_email and disposable_email JSON fields are from local script database checks.

python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api zerobounce -apikey_zb $zbkey -tm all

[
    {
        "email": "hnyfmw@canadlan-drugs.com",
        "status": "invalid",
        "sub_status": "no_dns_entries",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    }
]

validate_emails.py using external Reoon API enabled run -api reoon -apikey_rn $reokey -tm all with specified email address -e hnyfmw@canadlan-drugs.com. The status, role_account, mx_accepts_mail, spamtrap, mx_records, overall_score, safe_to_send, can_connect_smtp, inbox_full, catch_all, deliverable, disabled JSON field is from API and free_email and disposable_email JSON fields are from local script database checks.

Reoon has 2 modes for single email verification API which can be set via -reoon_mode to a value of either quick or power. The default mode without -reoon_mode being set is quick.

time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api reoon -apikey_rn $reokey

[
    {
        "email": "hnyfmw@canadlan-drugs.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "role_account": "no",
        "mx_accepts_mail": "no",
        "spamtrap": "no",
        "mx_records": null,
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    }
]

real    0m3.748s
user    0m0.358s
sys     0m0.028s

validate_emails.py using external Bouncify API enabled run -api bouncify -apikey_bf $bfkey -tm all with specified email address -e hnyfmw@canadlan-drugs.com. The status, free_email_api, disposable_email_api, role_api, and spamtrap_api JSON field are from API and free_email and disposable_email JSON fields are from local script database checks.

time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api bouncify -apikey_bf $bfkey
[
    {
        "email": "hnyfmw@canadlan-drugs.com",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    }
]

real    0m7.900s
user    0m0.357s
sys     0m0.030s

EmailListVerify

Here's a comparison using a commercial paid service EmailListVerify for the same emaillist.txt tested above. You can sign up using my affiliate link for EmailListVerify and free accounts get 100 free email verifications for starters.

disposable,"user@mailsac.com"
dead_server,"xyz@centmil1.com"
ok,"user+to@domain1.com"
disposable,"user@tempr.email"
ok,"info@domain2.com"
email_disabled,"xyz@domain1.com"
email_disabled,"abc@domain1.com"
email_disabled,"123@domain1.com"
email_disabled,"pop@domain1.com"
email_disabled,"pip@domain1.com"
ok,"user@gmail.com"
email_disabled,"op999@gmail.com"
ok,"user@yahoo.com"
ok,"user1@outlook.com"
ok,"user2@hotmail.com"

Where EmailListVerify status codes are as follows:

  • ok All is OK. The server is saying that it is ready to receive a letter to,this address, and no tricks have been detected
  • error The server is saying that delivery failed, but no information about,the email exists
  • smtp_error The SMTP answer from the server is invalid or the destination server,reported an internal error to us
  • smtp_protocol The destination server allowed us to connect but the SMTP,session was closed before the email was verified
  • unknown_email The server said that the delivery failed and that the email address does,not exist
  • attempt_rejected The delivery failed; the reason is similar to “rejected”
  • relay_error The delivery failed because a relaying problem took place
  • antispam_system Some anti-spam technology is blocking the,verification progress
  • email_disabled The email account is suspended, disabled, or limited and can not,receive emails
  • domain_error The email server for the whole domain is not installed or is,incorrect, so no emails are deliverable
  • ok_for_all The email server is saying that it is ready to accept letters,to any email address
  • dead_server The email server is dead, and no connection to it could be established
  • syntax_error There is a syntax error in the email address
  • unknown The email delivery failed, but no reason was given
  • accept_all The server is set to accept all emails at a specific domain.,These domains accept any email you send to them
  • disposable The email is a temporary address to receive letters and expires,after certain time period
  • spamtrap The email address is maintained by an ISP or a third party,which neither clicks nor opens emails
  • invalid_mx An undocumentated status value that isn't in their documentation. As the name implies, invalid MX DNS records

Filter for disposable_email = yes

python validate_emails.py -f user@domain1.com -l emaillist.txt -xf -xfdb xenforo -xfprefix xf_ -tm all | jq '.[] | select(.disposable_email == "yes")'
{
  "email": "user@mailsac.com",
  "status": "ok",
  "status_code": 250,
  "free_email": "yes",
  "disposable_email": "yes"
}
{
  "email": "user@tempr.email",
  "status": "ok",
  "status_code": 250,
  "free_email": "no",
  "disposable_email": "yes"
}

Using jq tool to only list MySQL queries for bad emails only

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'

mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';" xenforo

Filter using jq tool for free_email = yes emails only

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all | jq '.[] | select(.free_email == "yes")'
{
  "email": "user@mailsac.com",
  "status": "ok",
  "status_code": 250,
  "free_email": "yes",
  "disposable_email": "yes"
}
{
  "email": "user@gmail.com",
  "status": "ok",
  "status_code": 250,
  "free_email": "yes",
  "disposable_email": "no"
}
{
  "email": "op999@gmail.com",
  "status": "unknown_email",
  "status_code": 550,
  "free_email": "yes",
  "disposable_email": "no"
}
{
  "email": "user@yahoo.com",
  "status": "ok",
  "status_code": 250,
  "free_email": "yes",
  "disposable_email": "no"
}
{
  "email": "user1@outlook.com",
  "status": "ok",
  "status_code": 250,
  "free_email": "yes",
  "disposable_email": "no"
}
{
  "email": "user2@hotmail.com",
  "status": "ok",
  "status_code": 250,
  "free_email": "yes",
  "disposable_email": "no"
}

-tm disposable mode only skipping SMTP server checks with email addresses in file emaillist.txt

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm disposable -v

[
    {
        "email": "user@mailsac.com",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "abc@domain1.com",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "123@domain1.com",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pop@domain1.com",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pip@domain1.com",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@tempr.email",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "info@domain2.com",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user@yahoo.com",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

-tm dns mode only skipping SMTP server checks with email addresses in file emaillist.txt

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm dns -v
[
    {
        "email": "user@mailsac.com",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "notchecked"
    },
    {
        "email": "user+to@domain1.com",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "xyz@domain1.com",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "abc@domain1.com",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "123@domain1.com",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "pop@domain1.com",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "pip@domain1.com",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "user@tempr.email",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "info@domain2.com",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "user@gmail.com",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "op999@gmail.com",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "user@yahoo.com",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "user1@outlook.com",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "user2@hotmail.com",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    }
]

Logging SMTP server response displayed in -v verbose mode with email addresses in file emaillist.txt will create a 2nd debug log email_verification_log_debug_*.log with entries.

ls -lhArt | tail -2
-rw-r--r-- 1 root      root      9.8K May  4 23:35 email_verification_log_debug_2024-05-04_23-35-47.log
-rw-r--r-- 1 root      root      6.0K May  4 23:35 email_verification_log_2024-05-04_23-35-47.log
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -v
[
    {
        "email": "user@mailsac.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "abc@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "123@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pop@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pip@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@tempr.email",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "info@domain2.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user@yahoo.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

Regular non-verbose log email_verification_log_2024-05-04_23-35-47.log will also show the smtp profile used to do the SMTP check testing as well as Acceptable failure rate metrics per domain.

cat email_verification_log_2024-05-04_23-35-47.log
2024-05-04 23:35:48,080 - INFO - Disposable email address: user@mailsac.com
2024-05-04 23:35:48,082 - INFO - Disposable email address: user@tempr.email
2024-05-04 23:35:48,626 - INFO - SMTP response for user@mailsac.com using profile [default]: 250, b'Accepted'
2024-05-04 23:35:49,022 - INFO - SMTP response for user@tempr.email using profile [default]: 250, b'2.1.5 Ok'
2024-05-04 23:35:49,082 - INFO - Validating user+to@domain1.com
2024-05-04 23:35:49,082 - INFO - Email DNS is valid: user+to@domain1.com
2024-05-04 23:35:49,082 - INFO - Validating 123@domain1.com
2024-05-04 23:35:49,082 - INFO - Validating abc@domain1.com
2024-05-04 23:35:49,082 - INFO - Validating xyz@domain1.com
2024-05-04 23:35:49,082 - INFO - Validating pop@domain1.com
2024-05-04 23:35:49,082 - INFO - Email DNS is valid: pop@domain1.com
2024-05-04 23:35:49,082 - INFO - Email DNS is valid: 123@domain1.com
2024-05-04 23:35:49,082 - INFO - Email DNS is valid: abc@domain1.com
2024-05-04 23:35:49,082 - INFO - Email DNS is valid: xyz@domain1.com
2024-05-04 23:35:49,082 - INFO - Validating pip@domain1.com
2024-05-04 23:35:49,083 - INFO - Validating info@domain2.com
2024-05-04 23:35:49,083 - INFO - Email DNS is valid: pip@domain1.com
2024-05-04 23:35:49,083 - INFO - Email DNS is valid: info@domain2.com
2024-05-04 23:35:49,084 - INFO - Validating user2@hotmail.com
2024-05-04 23:35:49,084 - INFO - Email DNS is valid: user2@hotmail.com
2024-05-04 23:35:49,646 - INFO - SMTP response for pop@domain1.com using profile [default]: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser h14-20020a05640250ce00b00572b21fb7d5si3202708edb.683 - gsmtp"
2024-05-04 23:35:49,666 - INFO - SMTP response for 123@domain1.com using profile [default]: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser sh43-20020a1709076eab00b00a597a01b74csi2965444ejc.273 - gsmtp"
2024-05-04 23:35:49,672 - INFO - SMTP response for abc@domain1.com using profile [default]: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser gt34-20020a1709072da200b00a597ff2fc04si2617860ejc.981 - gsmtp"
2024-05-04 23:35:49,675 - INFO - SMTP response for pip@domain1.com using profile [default]: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser p14-20020aa7d30e000000b00572d0cb1e66si1718373edq.661 - gsmtp"
2024-05-04 23:35:49,694 - INFO - SMTP response for xyz@domain1.com using profile [default]: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser wg10-20020a17090705ca00b00a5999e2028dsi2138359ejb.514 - gsmtp"
2024-05-04 23:35:49,752 - INFO - SMTP response for info@domain2.com using profile [default]: 250, b'2.1.5 OK j7-20020a5d5647000000b0034cfd826251si3647095wrw.519 - gsmtp'
2024-05-04 23:35:49,753 - INFO - SMTP response for user+to@domain1.com using profile [default]: 250, b'2.1.5 OK m8-20020a056402430800b005721e7edb0fsi3177955edc.665 - gsmtp'
2024-05-04 23:35:49,761 - INFO - SMTP response for user2@hotmail.com using profile [default]: 250, b'2.1.5 Recipient OK'
2024-05-04 23:35:50,085 - INFO - Validating user@gmail.com
2024-05-04 23:35:50,085 - INFO - Email DNS is valid: user@gmail.com
2024-05-04 23:35:50,085 - INFO - Validating op999@gmail.com
2024-05-04 23:35:50,085 - INFO - Validating user@yahoo.com
2024-05-04 23:35:50,086 - INFO - Email DNS is valid: op999@gmail.com
2024-05-04 23:35:50,086 - INFO - Email DNS is valid: user@yahoo.com
2024-05-04 23:35:50,086 - INFO - Validating user1@outlook.com
2024-05-04 23:35:50,086 - INFO - Email DNS is valid: user1@outlook.com
2024-05-04 23:35:50,545 - INFO - SMTP response for user1@outlook.com using profile [default]: 250, b'2.1.5 Recipient OK'
2024-05-04 23:35:50,659 - INFO - SMTP response for op999@gmail.com using profile [default]: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser w9-20020a5d4049000000b0034ddab36ff8si3678827wrp.499 - gsmtp"
2024-05-04 23:35:50,801 - INFO - SMTP response for user@gmail.com using profile [default]: 250, b'2.1.5 OK d7-20020a05600c34c700b0041d7d5787bfsi3791910wmq.193 - gsmtp'
2024-05-04 23:35:50,802 - INFO - SMTP response for user@yahoo.com using profile [default]: 250, b'recipient <user@yahoo.com> ok'
2024-05-04 23:35:50,802 - INFO - Acceptable failure rate (0.00%) for domain mailsac.com.
2024-05-04 23:35:50,802 - INFO - Acceptable failure rate (0.00%) for domain tempr.email.
2024-05-04 23:35:50,802 - INFO - Acceptable failure rate (0.00%) for domain domain1.com.
2024-05-04 23:35:50,802 - INFO - Acceptable failure rate (0.00%) for domain domain2.com.
2024-05-04 23:35:50,802 - INFO - Acceptable failure rate (0.00%) for domain hotmail.com.
2024-05-04 23:35:50,803 - INFO - Acceptable failure rate (0.00%) for domain outlook.com.
2024-05-04 23:35:50,803 - INFO - Acceptable failure rate (0.00%) for domain gmail.com.
2024-05-04 23:35:50,803 - INFO - Acceptable failure rate (0.00%) for domain yahoo.com.

Verbose debug log email_verification_log_debug_2024-05-04_23-35-47.log

cat email_verification_log_debug_2024-05-04_23-35-47.log
2024-05-04 23:35:48,080 - DEBUG - Connecting to SMTP server alt.mailsac.com. on port 25
2024-05-04 23:35:48,083 - DEBUG - Connecting to SMTP server mx.discard.email. on port 25
2024-05-04 23:35:48,328 - DEBUG - SMTP connection established
2024-05-04 23:35:48,403 - DEBUG - EHLO command sent
2024-05-04 23:35:48,403 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:48,477 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:48,477 - DEBUG - Sending RCPT TO command for: user@mailsac.com
2024-05-04 23:35:48,552 - DEBUG - RCPT TO response: 250, b'Accepted'
2024-05-04 23:35:48,626 - DEBUG - SMTP session closed
2024-05-04 23:35:48,642 - DEBUG - SMTP connection established
2024-05-04 23:35:48,737 - DEBUG - EHLO command sent
2024-05-04 23:35:48,737 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:48,832 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:48,832 - DEBUG - Sending RCPT TO command for: user@tempr.email
2024-05-04 23:35:48,927 - DEBUG - RCPT TO response: 250, b'2.1.5 Ok'
2024-05-04 23:35:49,022 - DEBUG - SMTP session closed
2024-05-04 23:35:49,082 - DEBUG - Connecting to SMTP server aspmx5.googlemail.com. on port 25
2024-05-04 23:35:49,083 - DEBUG - Connecting to SMTP server aspmx5.googlemail.com. on port 25
2024-05-04 23:35:49,083 - DEBUG - Connecting to SMTP server aspmx5.googlemail.com. on port 25
2024-05-04 23:35:49,083 - DEBUG - Connecting to SMTP server aspmx5.googlemail.com. on port 25
2024-05-04 23:35:49,083 - DEBUG - Connecting to SMTP server aspmx5.googlemail.com. on port 25
2024-05-04 23:35:49,084 - DEBUG - Connecting to SMTP server aspmx5.googlemail.com. on port 25
2024-05-04 23:35:49,084 - DEBUG - Connecting to SMTP server aspmx2.googlemail.com. on port 25
2024-05-04 23:35:49,084 - DEBUG - Connecting to SMTP server hotmail-com.olc.protection.outlook.com. on port 25
2024-05-04 23:35:49,277 - DEBUG - SMTP connection established
2024-05-04 23:35:49,277 - DEBUG - SMTP connection established
2024-05-04 23:35:49,285 - DEBUG - SMTP connection established
2024-05-04 23:35:49,291 - DEBUG - SMTP connection established
2024-05-04 23:35:49,294 - DEBUG - SMTP connection established
2024-05-04 23:35:49,305 - DEBUG - SMTP connection established
2024-05-04 23:35:49,307 - DEBUG - SMTP connection established
2024-05-04 23:35:49,367 - DEBUG - EHLO command sent
2024-05-04 23:35:49,367 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:49,367 - DEBUG - EHLO command sent
2024-05-04 23:35:49,367 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:49,382 - DEBUG - EHLO command sent
2024-05-04 23:35:49,382 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:49,383 - DEBUG - EHLO command sent
2024-05-04 23:35:49,384 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:49,397 - DEBUG - EHLO command sent
2024-05-04 23:35:49,397 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:49,399 - DEBUG - EHLO command sent
2024-05-04 23:35:49,399 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:49,401 - DEBUG - EHLO command sent
2024-05-04 23:35:49,401 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:49,455 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,455 - DEBUG - Sending RCPT TO command for: user+to@domain1.com
2024-05-04 23:35:49,455 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,455 - DEBUG - Sending RCPT TO command for: pop@domain1.com
2024-05-04 23:35:49,473 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,473 - DEBUG - Sending RCPT TO command for: 123@domain1.com
2024-05-04 23:35:49,474 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,474 - DEBUG - Sending RCPT TO command for: abc@domain1.com
2024-05-04 23:35:49,485 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,485 - DEBUG - Sending RCPT TO command for: pip@domain1.com
2024-05-04 23:35:49,494 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,494 - DEBUG - Sending RCPT TO command for: xyz@domain1.com
2024-05-04 23:35:49,500 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,500 - DEBUG - Sending RCPT TO command for: info@domain2.com
2024-05-04 23:35:49,530 - DEBUG - SMTP connection established
2024-05-04 23:35:49,558 - DEBUG - RCPT TO response: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser h14-20020a05640250ce00b00572b21fb7d5si3202708edb.683 - gsmtp"
2024-05-04 23:35:49,576 - DEBUG - RCPT TO response: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser sh43-20020a1709076eab00b00a597a01b74csi2965444ejc.273 - gsmtp"
2024-05-04 23:35:49,580 - DEBUG - RCPT TO response: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser gt34-20020a1709072da200b00a597ff2fc04si2617860ejc.981 - gsmtp"
2024-05-04 23:35:49,586 - DEBUG - EHLO command sent
2024-05-04 23:35:49,586 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:49,587 - DEBUG - RCPT TO response: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser p14-20020aa7d30e000000b00572d0cb1e66si1718373edq.661 - gsmtp"
2024-05-04 23:35:49,600 - DEBUG - RCPT TO response: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser wg10-20020a17090705ca00b00a5999e2028dsi2138359ejb.514 - gsmtp"
2024-05-04 23:35:49,639 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,639 - DEBUG - Sending RCPT TO command for: user2@hotmail.com
2024-05-04 23:35:49,646 - DEBUG - SMTP session closed
2024-05-04 23:35:49,651 - DEBUG - RCPT TO response: 250, b'2.1.5 OK j7-20020a5d5647000000b0034cfd826251si3647095wrw.519 - gsmtp'
2024-05-04 23:35:49,665 - DEBUG - RCPT TO response: 250, b'2.1.5 OK m8-20020a056402430800b005721e7edb0fsi3177955edc.665 - gsmtp'
2024-05-04 23:35:49,666 - DEBUG - SMTP session closed
2024-05-04 23:35:49,672 - DEBUG - SMTP session closed
2024-05-04 23:35:49,675 - DEBUG - SMTP session closed
2024-05-04 23:35:49,694 - DEBUG - SMTP session closed
2024-05-04 23:35:49,709 - DEBUG - RCPT TO response: 250, b'2.1.5 Recipient OK'
2024-05-04 23:35:49,752 - DEBUG - SMTP session closed
2024-05-04 23:35:49,753 - DEBUG - SMTP session closed
2024-05-04 23:35:49,761 - DEBUG - SMTP session closed
2024-05-04 23:35:50,085 - DEBUG - Connecting to SMTP server alt2.gmail-smtp-in.l.google.com. on port 25
2024-05-04 23:35:50,086 - DEBUG - Connecting to SMTP server alt2.gmail-smtp-in.l.google.com. on port 25
2024-05-04 23:35:50,086 - DEBUG - Connecting to SMTP server mta6.am0.yahoodns.net. on port 25
2024-05-04 23:35:50,086 - DEBUG - Connecting to SMTP server outlook-com.olc.protection.outlook.com. on port 25
2024-05-04 23:35:50,314 - DEBUG - SMTP connection established
2024-05-04 23:35:50,314 - DEBUG - SMTP connection established
2024-05-04 23:35:50,402 - DEBUG - EHLO command sent
2024-05-04 23:35:50,402 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:50,407 - DEBUG - EHLO command sent
2024-05-04 23:35:50,407 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:50,451 - DEBUG - SMTP connection established
2024-05-04 23:35:50,472 - DEBUG - EHLO command sent
2024-05-04 23:35:50,472 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:50,484 - DEBUG - SMTP connection established
2024-05-04 23:35:50,486 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:50,486 - DEBUG - Sending RCPT TO command for: op999@gmail.com
2024-05-04 23:35:50,492 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:50,493 - DEBUG - Sending RCPT TO command for: user1@outlook.com
2024-05-04 23:35:50,497 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:50,498 - DEBUG - Sending RCPT TO command for: user@gmail.com
2024-05-04 23:35:50,525 - DEBUG - RCPT TO response: 250, b'2.1.5 Recipient OK'
2024-05-04 23:35:50,545 - DEBUG - SMTP session closed
2024-05-04 23:35:50,561 - DEBUG - EHLO command sent
2024-05-04 23:35:50,561 - DEBUG - Sending MAIL FROM command: user@domain1.com
2024-05-04 23:35:50,575 - DEBUG - RCPT TO response: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser w9-20020a5d4049000000b0034ddab36ff8si3678827wrp.499 - gsmtp"
2024-05-04 23:35:50,641 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:50,641 - DEBUG - Sending RCPT TO command for: user@yahoo.com
2024-05-04 23:35:50,659 - DEBUG - SMTP session closed
2024-05-04 23:35:50,710 - DEBUG - RCPT TO response: 250, b'2.1.5 OK d7-20020a05600c34c700b0041d7d5787bfsi3791910wmq.193 - gsmtp'
2024-05-04 23:35:50,720 - DEBUG - RCPT TO response: 250, b'recipient <user@yahoo.com> ok'
2024-05-04 23:35:50,801 - DEBUG - SMTP session closed
2024-05-04 23:35:50,802 - DEBUG - SMTP session closed

syntax only test without smtp and dns test

python validate_emails.py -f user@domain.com -e user+to@domain.com -tm syntax
[
    {
        "email": "user@mailsac.com",
        "status": "valid_format",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "valid_format",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "user+to@domain1.com",
        "status": "valid_format",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "xyz@domain1.com",
        "status": "valid_format",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "abc@domain1.com",
        "status": "valid_format",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "123@domain1.com",
        "status": "valid_format",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "pop@domain1.com",
        "status": "valid_format",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "pip@domain1.com",
        "status": "valid_format",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "user@tempr.email",
        "status": "valid_format",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "info@domain2.com",
        "status": "valid_format",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "user@gmail.com",
        "status": "valid_format",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "op999@gmail.com",
        "status": "valid_format",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "user@yahoo.com",
        "status": "valid_format",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "user1@outlook.com",
        "status": "valid_format",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "user2@hotmail.com",
        "status": "valid_format",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    }
]

API Support

In additional to local self-hosted email verification, the script now has added support for the following external Email cleaning service APIs - EmailListVerify, MillionVerifier, MyEmailVerifier, CaptainVerify, Proofy.io, Zerobounce, Reoon, Bouncify, Bounceless. Links to services maybe affiliate links. If you found this information useful ;)

Updated: Added API Merge support via -apimerge argument to merge EmailListVerify + MillionVerifier API results together for more accurate email verification results.

API Usage Commands

validate_emails.py supports passing individual email's comma separated via -e flag i.e. -e user@domain1.com,user@domain2.com or passing -l flag for a text file with list of email addresses one per line via -l emaillist.txt. Both methods use respetive provider's per email verification APIs. Only some providers have support in the script for bulk email API - which is currently EmailListVerify and MillionVerifier via -apibulk flag i.e. -l emaillist.txt -apibulk emaillistverify or -l emaillist.txt -apibuilk millionverifier.

You can see a full list and explanation of all argument flags supported at here.

The -api flag determines which provider you use along with their respective -apikey* flag.

EmailListVerify

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey

MillionVerifier

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey

CaptainVerify

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api captainverify -apikey_cv $cvkey

Proofy.io

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api proofy -apikey_pf $pkey -apiuser_pf $puser

MyEmailVerifier

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api myemailverifier -apikey_mev $mevkey

Zerobounce

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api zerobounce -apikey_zb $zbkey

Reoon

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api reoon -apikey_rn $reokey

Bouncify

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api bouncify -apikey_bf $bfkey

Bounceless

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api bounceless -apikey_bf $blkey

Notes:

Personal Experience

Personal experience with all commercial email verification providers:

  • Disclaimer: I've already been using EmailListVerify since 2015 and Proofy.io since 2022. While the rest of the mentioned providers are new experiences for me.

  • EmailListVerify and MillionVerifier while being cheaper than the others seem to be better for the following:

    • API documentation
    • Less restrictive on API connection and rate limits. Meaning if you are doing per email API checks for many email addresses, the speed of completion will be faster. Though if you're doing many email address checks, you'd want to use their respective bulk email API end points to upload a single text file for processing.
    • For bulk API speed though, MillionVerifier is much faster than EmailListVerify. Even MillionVerifier's per email check API speed can be as low as 100ms for check and has a rate limit of 400 emails/second per unqiue IP address. For the sample 15 email addresses tested below, MillionVerifier bulk API took ~7 seconds, EmailListVerify bulk API took ~45 seconds. Compared to per email address verification checks, both taking between 2.2 to 3.3 seconds. EmailListVerify seems to have much more detailed status classifications (see below) compared to ther others so more processing is done on their end.
  • MillionVerifier has email verification speed information here

  • MillionVerifier allow for a maximum 2 simultaneous bulk file API uploads at a time and max size of files uploaded are 1 million emails per file or 100MB size. If each of the files contains more than 1000 emails, they will verify a maximum of 2 files at a time.

  • MillionVerifier API logging for billing is the mosted detailed with historical running balances. They also show per API call credit usage balance details and even list in the logs refunded credits for bulk API file uploaded emails classified as 'risky' (catch_all or unknown) https://help.millionverifier.com/payments-credits/refund-for-risky-emails. AFAIK, the other providers don't refund any credits that I can see. However, on below sample 15 email addresses tested, I always got 1 refunded credit so it applies to one email address which is a known valid email user@yahoo.com which is classed as unknown in bulk API but classed as ok in per email verification API. Seems to be a bug in their bulk API then as the refunds only apply to bulk API and not per email verification checks due to differences in classifications in bulk API vs per email verification API.

    MillionVerifier Yahoo Email Address

    I reached out to MillionVerifier chat support which was initially handled via Milly their AI chat bot which later referred me to support. They emailed me back saying:

    We're glad you reached out to us about this issue, and we're here to help. The discrepancy you're seeing in the results is likely because we were unable to connect to the server during the verification process, leading to an "Unknown" result. However, for the single API, the connection went through smoothly, allowing us to verify the email without any problems. An "Unknown" result simply means that we couldn't determine the existence of the email at the time of verification. If you have any more questions, queries, or issues, we're more than happy to assist.

    I tried a few attempts at bulk API for the same list of 15 emails, and user@yahoo.com is always marked as status = unknown and never anything different though? It would be hard to differentiate status classifications if it's due connection issues if they're lumped into other emails in unknown label. Maybe would be better to have a separate classification for connection issues so we can differentiate as such. For example, EmailListVerify has 18 different status classifications including for connection related issues.

    MillionVerifier follow up - support investigated the issue on their end and said:

    We're really glad you reached out to us about this issue, and we've done our best to get to the bottom of it. Thank you for your patience while we looked into this. It turns out the issue wasn't about whether you were verifying emails in bulk or one at a time, but rather which server was used for the verification. Also, if you try to verify some emails multiple times, they might eventually return an "Unknown" result. I'd also like to point out that we don't deduct credits for emails marked as "Risky" during API calls. You won't see a credit refund for these in your Credit Balance because we only charge for emails identified as "Good" or "Bad." > The credits for "Risky" emails aren't taken away in the first place.

    I confirmed this occurs on MillionVerifier single email verification as well if you test it enough times for user@yahoo.com email address specifically.

    single email API check for user@yahoo.com returns ok

    python validate_emails.py -f user@domain1.com -e user@yahoo.com -api millionverifier -apikey_mv $mvkey -tm all
    [
        {
            "email": "user@yahoo.com",
            "status": "ok",
            "status_code": null,
            "free_email": "yes",
            "disposable_email": "no",
            "free_email_api": true,
            "role_api": false
        }
    ]
    

    bulk API upload check excerpt for user@yahoo.com returns unknown

    python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -apibulk millionverifier
    [
     
        {
            "email": "user@yahoo.com",
            "status": "unknown",
            "free_email": "yes",
            "disposable_email": "no",
            "free_email_api": "yes",
            "role_api": "no"
        },
    
    ]
    

    As such you can't 100% rely on the status output to do tasks like updating Xenforo user's user_state status to stop sending emails to them without further verification for such emails. For now, I've updated my validate_emails.py script for MillionVerifier bulk API and per email check API results, to not list Xenforo SQL queries for unknown status results and only list Xenforo SQL queries for invalid and disposable status emails. Same can be said for other providers, probably need to really double check your results if you're relying on the results for important tasks. You can filter MillionVerifier's unknown status emails and feed them into another commercial provider's API to double check i.e. EmailListVerify or use script's self-hosted local email check. Given cheaper MillionVerifier pricing, it might be more economical to do it this way?

    MillionVerifier bulk API filter -api millionverifier -apikey_mv $mvkey -apibulk millionverifier filter using jq for unknown status emails piped into text file results-millionverifier-bulk-api-unknown-only.txt

    python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -apibulk millionverifier | jq '.[] | select(.status == "unknown")' 2>&1 > results-millionverifier-bulk-api-unknown-only.txt
    

    The results-millionverifier-bulk-api-unknown-only.txt contents will show all MillionVerifier bulk API returned unknown status results.

    cat results-millionverifier-bulk-api-unknown-only.txt                                            
    {
      "email": "user@yahoo.com",
      "status": "unknown",
      "free_email": "yes",
      "disposable_email": "no",
      "free_email_api": "yes",
      "role_api": "no"
    }
    

    Using same results-millionverifier-bulk-api-unknown-only.txt file, and jq just filter out the email addresses into a new results-millionverifier-bulk-api-unknown-only-emails.txt file

    cat results-millionverifier-bulk-api-unknown-only.txt | jq -r '.email' | tee results-millionverifier-bulk-api-unknown-only-emails.txt
    user@yahoo.com
    

    Then use EmailListVerify bulk API to verify the filtered MillionVerifier unknown status list filtered file results-millionverifier-bulk-api-unknown-only-emails.txt and double check the status which confirms it's actually a valid email.

    python validate_emails.py -f user@domain1.com -l results-millionverifier-bulk-api-unknown-only-emails.txt -tm all -api emaillistverify -apikey $elvkey -apibulk emaillistverify
    
    [
        {
            "email": "user@yahoo.com",
            "status": "valid",
            "status_code": "",
            "free_email": "yes",
            "disposable_email": "no"
        }
    ]
    

    Or EmailListVerify per email verification API check

    ./validate_emails.py -f user@domain1.com -e user@yahoo.com -tm all -api emaillistverify -apikey $elvkey -tm all
    [
        {
            "email": "user@yahoo.com",
            "status": "valid",
            "status_code": null,
            "free_email": "yes",
            "disposable_email": "no"
        }
    ]
    

    Or if it's a few emails, via validate_emails.py script's self-hosted local email syntax, DNS and SMTP check

      validate_emails.py -f user@domain1.com -e user@yahoo.com -tm all
    [
        {
            "email": "user@yahoo.com",
            "status": "ok",
            "status_code": 250,
            "free_email": "yes",
            "disposable_email": "no"
        }
    ]
    
  • MyEmailVerifier API is limited to 30 requests per minute for per email address verification checks. For the sample 15 email addresses tested below, took ~5.5 seconds to complete per email address verification checks

  • MyEmailVerifier API logging doesn't seem to work. Waited a few days and none of my API tests were logged in their API logging on their dashboard web site.

  • CaptainVerify API is limited to a maximum of 2 simultaneous connections and 50 checks per minute for per email address verification checks. For the sample 15 email addresses tested below, took ~4.6 seconds to complete per email address verification checks

  • Proofy.io has the most restrictive API limits but I can't seem to find any documentation of the actual limits, so I have to code it so it isn't as fast as other providers for per email verification checks. It will be the slowest of the 5 providers for per email verification checks. For the sample 15 email addresses tested below, took ~9.5 seconds to complete per email address verification checks

  • Proofy.io only has single email check and batch email checks but no bulk file API support.

  • ZeroBounce API was added on May 11, 2024. For sample 15 email addresses, it took 4.794 seconds via per email check API. They have 100 free email credits per month, making it possible to keep my script's support and development testing costs down to a minimum. API documentation is very well documented.

  • ZeroBounce, only annoying issues right now are on their web site end and not their API specifically:

    1. initial login to web site dashboard are very slow as is reloading the dashboard i.e. browser F5 refresh. Sometimes just stuck with their purple reloading page progress icon that never actually loads the web page/dashboard.
    2. the web site login session durations are very short, so annoyingly you get logged out very quickly making it more secure. Make sure you use a password manager to make re-logins less annoying. Though if you're using a script and their API, you don't have to login as frequently.
  • ZeroBounce offers per email, batch email and bulk file API endpoints.

  • ZeroBounce doesn't charge for unknown status emails

  • ZeroBounce API rate limit speeds are outlined in there documentation here - 50,000 requests in 10 seconds (validations) before temporarily blocking for 1 minute. A maximum of 250 requests in 1 minute for the bulkapi.zerobounce.net/ before temporarily blocking for 1 hour. And allow a maximum of 20 requests in 1 minute for the bulkapi.zerobounce.net/v2/validatebatch before temporarily blocking for 10 minutes. Rate limits seem more complicated so will need to test my script to ensure it operates under their rate limits.

  • Reoon as added on May 12, 2024 and per email verification API should be kept at less than 5 concurrent threads. They say they take around 20 minutes to verify a set of 50,000 mixed-quality email addresses. For bulk email API, max is 50,000 emails per list. A bit on the low side given some other providers allow a max 1 million emails per list. The 15 email address sameple test took 2.176 seconds to complete.

  • Reoon unfortunately incorrectly classified op999@gmail.com as a valid email when it isn't and marked by all other APIs as invalid/undeliverable/email_disabled. This seems to be due to Reoon having 2 modes for their single email verification API for a quick and power modes. My initial tests are with quick mode. But I will need to do testing with power mode in future. Even their web site dashboard based single email verification check returns correct invalid status for this email suggesting they used power mode there too. I honestly do not know why anyone would use quick mode given how common Gmail email addresses are.

    • From their documentation:
      • The disadvantages of quick mode verification: Deep verification and detailed information are less available compared to the POWER mode. So individual inbox status will not be checked in this mode. The quick verification mode includes:
        • Email syntax validation.
        • Disposable/temporary email check.
        • MX validation and records.
        • Domain email acceptance validation.
        • Invalid email detection.
        • Expired/invalid domain detection.
        • Role account check.
  • Reoon doesn't charge for unknown status emails

  • Reoon do not store any uploaded data for more than 15 days

  • Reon has detailed API credit usage and balance logs just like MillionVerifier

  • Bouncify was added May 12, 2024 and seems to be the slowest to date for API response for single email and 15 sample email address API tests took 184+ seconds even though they have a 120 concurrent request API limit and seem to have trouble validating the @yahoo.com and @hotmail.com accounts in my 15 email address sample list here.

  • Bouncessless was added May 14, 2024. Probably the 2nd or 3rd slowest per email address verification APIs and seems highly inaccurate on 15 email address sample list not a single known valid email address was deemed as valid by the API. Instead the valid email addresses were all deemed unknown. After 1/2 day later I retested and Bounceless now fluctuates between an unknown and valid status for known Gmail address. So doesn't seem as reliable for detecting Gmail email addresses compared to other email verification providers tested and compared in the Email Verification Results Table. Bounceless API also doesn't recognise Gmail/Workspace emails using + alias i.e. user+to@domain1.com and deems them as invalid syntax! I double checked this on their web site dashboard and user+to@domain1.com email address was still marked as invalid syntax.

  • The number of API returned status value classifications returned by the various providers differs. Some have a more detailed classifications for emails than others.

    • EmailListVerify has 18 classifications:
      • ok
      • error
      • invalid_mx
      • smtp_error
      • smtp_protocol
      • unknown_email
      • attempt_rejected
      • relay_error
      • antispam_system
      • email_disabled
      • domain_error
      • ok_for_all
      • dead_server
      • syntax_error
      • unknown
      • accept_all
      • disposable
      • spamtrap
    • MillionVerifier has 5 classifications:
      • ok
      • catch_all
      • unknown
      • disposable
      • invalid
    • MyEmailVerifier has 4 classifications:
      • valid
      • invalid
      • catch-all
      • unknown
    • CaptainVerify has 4 classifications:
      • valid
      • invalid
      • risky
      • unknown
    • Proofy.io has 4 classifications:
      • deliverable
      • risky
      • undeliverable
      • unknown
    • ZeroBounce has 7 classifications and also 23 sub_status classifications:
      • classifications:
        • valid
        • invalid
        • catch-all
        • unknown
        • spamtrap
        • abuse
        • do_not_mail
      • sub_status classifications:
        • alternate
        • antispam_system
        • greylisted
        • mail_server_temporary_error
        • forcible_disconnect
        • mail_server_did_not_respond
        • timeout_exceeded
        • failed_smtp_connection
        • mailbox_quota_exceeded
        • exception_occurred
        • possible_trap
        • role_based
        • global_suppression
        • mailbox_not_found
        • no_dns_entries
        • failed_syntax_check
        • possible_typo
        • unroutable_ip_address
        • leading_period_removed
        • does_not_accept_mail
        • alias_address
        • role_based_catch_all
        • disposable, toxic
    • Reoon has 4 classifications
      • valid
      • invalid
      • disposable
      • spamtrap
    • Bouncify has 4 classifications
      • deliverable
      • undeliverable
      • unknown
      • accept-all
    • Bounceless has 10 classifications
      • blacklist
      • catch_all
      • disposable
      • invalid
      • no_mx_record
      • role
      • timeout
      • unknown
      • valid
      • spamtrap

Email Verification Provider Comparison Costs

Below are their respectivate pay as you go credit pricing for email verifications. The usual recommendations are to verify your lists every 3-6 months which is 2-4x times per year or prior to a large email sending campaign. Have a 25K email list = 2-4 x 25K = 50-100K email verifications per year.

  • Updates:
    • May 11, 2024 add Zerobounce API support
    • May 12, 2024 add Reoon API support
    • May 12, 2024 add Bouncify API support
    • May 14, 2024 add Bounceless API support - seems there's difference in pricing for 500K on their web site at US$649 but logged into my dashboard pricing is US$799.

Notes:

Provider 1k 2k 5k 10k 25k 30k 50k 70k 100k
EmailListVerify (demo, results) $4 (0.0008) 💲 - $15 (0.003) 💲 $24 (0.0024) $49 (0.00196) - $89 (0.00178) - $169 (0.00169)
MillionVerifier (demo, results) - - - $37 (0.0037) $49 (0.00196) - $77 (0.00154) - $129 (0.00129)
MyEmailVerifier (demo, results) - $14 (0.007) 💲 $28 (0.0056) $39 (0.0039) $79 (0.00316) - $149 (0.00298) - $239 (0.00239)
CaptainVerify (demo, results) $7 (0.007) - $30 (0.006) $60 (0.006) $75 (0.003) - $150 (0.003) - $200 (0.002)
Proofy.io (demo, results) - - $16 (0.0032) $29 (0.0029) - $63 (0.0021) $99 (0.00198) $124 (0.00177) $149 (0.00149)
Zerobounce (demo, results) - $20 (0.01) $45 (0.009) $80 (0.008) $190 (0.0076) - $375 (0.0075) - $425 (0.00425)
Reoon (demo, results) - - - $11.91 (0.00119) 💲 $29.66 (0.00119) 💲 - $58.95 (0.00118) 💲 $87.86 (0.00126) 💲 $116.40 (0.00116)
Bouncify (demo, results) - - - $19 (0.0019) - $39 (0.0013) 💲 - - $99 (0.001) 💲
Bounceless (demo, results) - - $29 (0.0058) - $99 (0.00396) - - - $299 (0.00299)
Provider 200k 250k 300k 500k 1m 2.5m 5m 10m
EmailListVerify (demo, results) - $349 (0.001396) - $449 (0.000898) $599 (0.000599) $1190 (0.000476) 💲 $1990 (0.000398) $3290 (0.000329)
MillionVerifier (demo, results) - - - $259 (0.000518) 💲 $389 (0.000389) 💲 - $1439 (0.000288) 💲 $2529 (0.000253) 💲
MyEmailVerifier (demo, results) - $349 (0.001396) - $549 (0.001098) $749 (0.000749) $1249 (0.0005) $1849 (0.00037) -
CaptainVerify (demo, results) - $250 (0.001) 💲 - $500 (0.001) $650 (0.00065) - $2000 (0.0004) -
Proofy.io (demo, results) $229 (0.001145) - $289 (0.000963) 💲 $429 (0.000858) $699 (0.000699) $1399 (0.00056) - -
Zerobounce (demo, results) - $940 (0.00376) - $1800 (0.0036) $2750 (0.00275) - - -
Reoon (demo, results) $226.80 (0.00113) $279.75 (0.00112) $331.20 (0.00110) $522.00 (0.00104) $960.00 (0.00096) - - -
Bouncify (demo, results) $149 (0.00075) 💲 - - $279 (0.00056) $479 (0.00048) - - -
Bounceless (demo, results) - - - $649 (0.001298) $899 (0.000899) - - -

Email Verification Provider API Speed & Rate Limits

From fastest to slowest ranked from my API tests overall and from gathered API documentation from each respective email verification provider's web site. Speed wise on command line, EmailListVerify and MillionVerifier are neck and neck on per email verification API checks. However, for bulk file API email verification checks, MillionVerifier wins by a lot. Also added tests as a PHP Wrapper where each API providers' times performed differently compared to command line run tests.

MillionVerifier has more detailed email verification speed information for the bulk file email verification here which I assume is for the web site dashboard and not for their API.

Updated: May 11, 2024 add Zerobounce API support. ZeroBounce API rate limit speeds are outlined in there documentation here and will update the below table after I have done some tests.

Updated: May 12, 2024

  • add Reoon API support. Will update below table after I have done some tests.
  • add Bouncify API support. Will update below table after I have done some tests.

Updated: May 14, 2024

  • add Bounceless API support. Will update below table after I have done some tests.

Table also takes into account API rate limits besides my single and 15 email address sample tests. For example, if CaptainVerify takes 20+ seconds to verify a single email address and MyEmailVerifier takes 2-3 seconds, then the higher rate limit per min of CaptainVerify wouldn't matter as CaptainVerify would only be able to handle 3 emails/min versus MyEmailVerifier 20-30 emails/min.

Provider Rank For API Speed emails/sec emails/min
1. Zerobounce 50,000 per 10s but 1 min block no doc mention
2. MillionVerifier 400/s no doc mention
3. EmailListVerify no doc mention no doc mention
4. Reoon no doc mention no doc mention
5. MyEmailVerifier no doc mention 30/min
6. CaptainVerify no doc mention 50/min
7. Proofy.io no doc mention no doc mention
8. Bounceless no doc mention no doc mention
9. Bouncify no doc mention 120/min

Email Verification Provider API Speed Benchmarks

Prior to May 16, 2024, the focus for speed of API returned results as based on validate_emails.py completion time, but the Python script uses concurrent threads defined by optional script argument -wf for worker factor to process per email verifications when there's more than 1 email address to process. By default -wf worker factor controlled how many threads were used in validate_emails.py and it defaults to a value of 16 for all API providers except CaptainVerify API and MyEmailVerifier API due to their more restrictive API rate limits, I had to set -wf worker factor to default to 1. As of May 18 2024, Reoon has set -wf to 5 to adhere to their single email address verification API limit of 5 threads maximum. This results in timed validate_emails.py script run completion being slower for CaptainVerify API and MyEmailVerifier API to ensure any API requests do not exceed their respective API rate limits.

So to properly calculate per email verification API response time api_response_time and api_thread_number thread pool number, I also added these metrics to the API JSON response. So to do a email verification check for hnyfmw@canadlan-drugs.com, the API response took 2.0609 seconds while validate_emails.py script run took 4.313 seconds using thread pool 0_0. However, you have to remember that overall speed will depend on the individual API response time and would need to factor in the respective email verification provider's API rate limits.

time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api emaillistverify -apikey $elvkey
[
    {
        "email": "hnyfmw@canadlan-drugs.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "api_response_time": 2.0609,
        "api_thread_number": "thread-pool-0_0"
    }
]

real    0m4.313s
user    0m0.352s
sys     0m0.029s

With api_response_time and api_thread_number now available in JSON result output, I can now benchmark all tested email verification API providers more accurately for per email verification API response times. Below are the tabulated comparison results. I didn't test Proofy API as I ran out of credits and Proofy doesn't have a bulk file API support and Bounceless API wasn't worth testing given it's inaccurate results for Gmail accounts.

The benchmark tests were against the 15 email address sample list -l emaillist.txt from the commands

# [EmailListVerify](https://centminmod.com/emaillistverify)
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey

# [MillionVerifier](https://centminmod.com/millionverifier)
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey

# [CaptainVerify](https://centminmod.com/captainverify)
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api captainverify -apikey_cv $cvkey

# [MyEmailVerifier](https://centminmod.com/myemailverifier)
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api myemailverifier -apikey_mev $mevkey

# [Zerobounce](https://centminmod.com/zerobounce)
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api zerobounce -apikey_zb $zbkey

# [Reoon](https://centminmod.com/reoon)
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api reoon -apikey_rn $reokey

# [Bouncify](https://centminmod.com/bouncify)
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api bouncify -apikey_bf $bfkey

First table provides the average, min, median, max and 99th percentile API response times for all 15 email addresses broken down by email verification API provider. The table is ordered by provider name alphabetically.

Providers ranked from fastest to slowest for average and maximum API response times for all 15 email addresses checked:

Ranked by Average API Response Time (fastest to slowest) for all 15 email addresses checked:

  1. zerobounce: Average API Response Time = 0.3922 seconds
  2. millionverifier: Average API Response Time = 0.4649 seconds
  3. emaillistverify: Average API Response Time = 1.3805 seconds
  4. reoon: Average API Response Time = 1.3850 seconds
  5. captainverify: Average API Response Time = 2.1669 seconds
  6. myemailverifier: Average API Response Time = 3.9018 seconds
  7. bouncify: Average API Response Time = 13.3857 seconds

Ranked by Maximum API Response Time (fastest to slowest) for all 15 email addresses checked:

  1. millionverifier: Max API Response Time = 0.5481 seconds
  2. zerobounce: Max API Response Time = 1.0279 seconds
  3. reoon: Max API Response Time = 3.0198 seconds
  4. emaillistverify: Max API Response Time = 3.1766 seconds
  5. myemailverifier: Max API Response Time = 4.903 seconds
  6. captainverify: Max API Response Time = 21.5099 seconds
  7. bouncify: Max API Response Time = 180.6231 seconds

From the data, we can observe that:

  • Zerobounce and MillionVerifier are the fastest email verification API providers in terms of both average and maximum API response times. Zerobounce's average API response times was held back by slow user@yahoo.com verification check at 1.0279seconds (though it was still the fastest API response time that had an accurate status). MillionVerifier's average API response times was held back by several checks >0.5 seconds with slowest user@tempr.email verification checks 0.5481 seconds.
  • If you removed the slowest check for Zerobounce, the remaining 14 sample email addresses would of had an average API response time of 0.347 seconds.
  • If you removed the slowest check for MillionVerifier, the remaining 14 sample email addresses would of had an average API response time of 0.459 seconds.
  • MillionVerifier overall would be fastest if you take into account the max API response times.
  • Bouncify is the slowest provider, with the highest average and maximum API response times by a significant margin. The email check for user2@hotmail.com retuned an api_error and API response time for that check was 180.6231 seconds. If you excluded the api_error timed result, the average API response time for remaining 14 sample email addresses would of been 1.44 seconds.
  • CaptainVerify has a relatively high maximum API response time of 21.5099 seconds (due to the email check for xyz@centmil1.com), although its average response time is better than Bouncify and MyEmailVerifier.
  • Reoon, EmailListVerify, and MyEmailVerifier have relatively similar average and maximum API response times, ranking in the mid-range among the providers.
  • However, you have to remember that overall speed will depend on the individual API response time and would need to factor in the respective email verification provider's API rate limits.
API Provider Average api_response_time Min api_response_time Median api_response_time Max api_response_time 99th Percentile api_response_time
bouncify 13.3857 0.6154 1.3655 180.6231 180.6231
captainverify 2.1669 0.501 0.5793 21.5099 21.5099
emaillistverify 1.3805 0.6449 1.1035 3.1766 3.1766
millionverifier 0.4649 0.4145 0.4442 0.5481 0.5481
myemailverifier 3.9018 2.631 4.0985 4.903 4.903
reoon 1.3850 0.7275 1.3763 3.0198 3.0198
zerobounce 0.3922 0.259 0.3464 1.0279 1.0279

Next comparison table shows each of the 15 sample email addresses' individual API response times, returned status check results and also the validated_emails.py script's execution times. Email addresses are sorted alphabetically.

Pay attention to specific email addresses compared for the accuracy of the email verification providers's API results:

  • user@mailsac.com this is a known disposable email address
  • xyz@centmil1.com this is a domain that doesn't exist so would not have valid DNS or MX DNS records
  • user+to@domain1.com this is a Google Workspace email address using + user aliasing and is a valid working email address
  • user@tempr.email another known disposable email address
  • info@domain2.com known valid Google Workspae email address that is working
  • user@gmail.com known valid Gmail address
  • op999@gmail.com known invalid user does not exist Gmail address AFAIK
  • user@yahoo.com known valid Yahoo email address that is working. MilliomVerifier Yahoo email address incorrect unknown labeling showed up in this specific test. According to MillionVerifier support this can happen on some of the API servers and/or if you test an email multiple times.

Notes:

  • For status results that I know are incorrect, I've marked them with ❌ next to the result.
  • For api_response_time added 🏆 for fastest times for each email verification. For user@yahoo.com the fastest inaccurate and accurate results were both marked.
email API Provider status api_response_time free_email disposable_email api_thread_number validated_emails.py Time
123@domain1.com bouncify undeliverable 1.0689 no no thread-pool-0_5 181.576
123@domain1.com captainverify invalid 0.5636 no no thread-pool-0_5 22.836
123@domain1.com emaillistverify email_disabled 1.0654 no no thread-pool-0_5 4.208
123@domain1.com millionverifier invalid 0.5352 no no thread-pool-0_5 1.614
123@domain1.com myemailverifier invalid 4.663 no no thread-pool-0_5 6.461
123@domain1.com reoon unknown 0.7413 no no thread-pool-0_5 5.744
123@domain1.com zerobounce invalid 0.4128 🏆 no no thread-pool-0_5 2.930
abc@domain1.com bouncify undeliverable 2.7131 no no thread-pool-0_4 181.576
abc@domain1.com captainverify invalid 0.5862 no no thread-pool-0_4 22.836
abc@domain1.com emaillistverify email_disabled 1.0523 no no thread-pool-0_4 4.208
abc@domain1.com millionverifier invalid 0.4321 no no thread-pool-0_4 1.614
abc@domain1.com myemailverifier invalid 4.903 no no thread-pool-0_4 6.461
abc@domain1.com reoon unknown 1.655 no no thread-pool-0_4 5.744
abc@domain1.com zerobounce invalid 0.259 🏆 no no thread-pool-0_4 2.930
info@domain2.com bouncify deliverable 2.0478 no no thread-pool-0_9 181.576
info@domain2.com captainverify invalid 0.5693 no no thread-pool-0_9 22.836
info@domain2.com emaillistverify valid 1.3723 no no thread-pool-0_9 4.208
info@domain2.com millionverifier ok 0.4314 no no thread-pool-0_9 1.614
info@domain2.com myemailverifier valid 3.9004 no no thread-pool-0_9 6.461
info@domain2.com reoon role_account 1.478 no no thread-pool-0_9 5.744
info@domain2.com zerobounce do_not_mail 0.3873 🏆 no no thread-pool-0_9 2.930
op999@gmail.com bouncify undeliverable 1.3655 yes no thread-pool-0_11 181.576
op999@gmail.com captainverify invalid 0.5564 no no thread-pool-0_11 22.836
op999@gmail.com emaillistverify email_disabled 1.3844 yes no thread-pool-0_11 4.208
op999@gmail.com millionverifier invalid 0.4443 yes no thread-pool-0_11 1.614
op999@gmail.com myemailverifier invalid 4.5972 yes no thread-pool-0_11 6.461
op999@gmail.com reoon invalid 0.9289 yes no thread-pool-0_11 5.744
op999@gmail.com zerobounce invalid 0.3605 🏆 yes no thread-pool-0_11 2.930
pip@domain1.com bouncify undeliverable 2.0223 no no thread-pool-0_7 181.576
pip@domain1.com captainverify invalid 0.5787 no no thread-pool-0_7 22.836
pip@domain1.com emaillistverify email_disabled 1.0572 no no thread-pool-0_7 4.208
pip@domain1.com millionverifier invalid 0.4273 no no thread-pool-0_7 1.614
pip@domain1.com myemailverifier invalid 4.1387 no no thread-pool-0_7 6.461
pip@domain1.com reoon invalid 1.0709 no no thread-pool-0_7 5.744
pip@domain1.com zerobounce invalid 0.3377 🏆 no no thread-pool-0_7 2.930
pop@domain1.com bouncify undeliverable 0.9657 no no thread-pool-0_6 181.576
pop@domain1.com captainverify invalid 0.5909 no no thread-pool-0_6 22.836
pop@domain1.com emaillistverify email_disabled 1.0636 no no thread-pool-0_6 4.208
pop@domain1.com millionverifier invalid 0.5378 no no thread-pool-0_6 1.614
pop@domain1.com myemailverifier invalid 3.396 no no thread-pool-0_6 6.461
pop@domain1.com reoon invalid 1.5885 no no thread-pool-0_6 5.744
pop@domain1.com zerobounce invalid 0.3464 🏆 no no thread-pool-0_6 2.930
user+to@domain1.com bouncify deliverable 2.6186 no no thread-pool-0_2 181.576
user+to@domain1.com captainverify invalid ❌ 0.6153 no no thread-pool-0_2 22.836
user+to@domain1.com emaillistverify valid 0.8685 no no thread-pool-0_2 4.208
user+to@domain1.com millionverifier ok 0.4145 no no thread-pool-0_2 1.614
user+to@domain1.com myemailverifier valid 3.002 no no thread-pool-0_2 6.461
user+to@domain1.com reoon valid 1.6539 no no thread-pool-0_2 5.744
user+to@domain1.com zerobounce valid 0.3708 🏆 no no thread-pool-0_2 2.930
user1@outlook.com bouncify deliverable 1.6912 yes no thread-pool-0_13 181.576
user1@outlook.com captainverify valid 3.5499 yes no thread-pool-0_13 22.836
user1@outlook.com emaillistverify valid 1.1035 yes no thread-pool-0_13 4.208
user1@outlook.com millionverifier ok 0.4181 yes no thread-pool-0_13 1.614
user1@outlook.com myemailverifier valid 4.6978 yes no thread-pool-0_13 6.461
user1@outlook.com reoon valid 1.453 yes no thread-pool-0_13 5.744
user1@outlook.com zerobounce valid 0.3327 🏆 yes no thread-pool-0_13 2.930
user2@hotmail.com bouncify api_error ❌ 180.6231 yes no thread-pool-0_14 181.576
user2@hotmail.com captainverify invalid 0.5793 no no thread-pool-0_14 22.836
user2@hotmail.com emaillistverify valid 0.6449 yes no thread-pool-0_14 4.208
user2@hotmail.com millionverifier ok 0.4245 yes no thread-pool-0_14 1.614
user2@hotmail.com myemailverifier valid 4.1951 yes no thread-pool-0_14 6.461
user2@hotmail.com reoon valid 1.3763 yes no thread-pool-0_14 5.744
user2@hotmail.com zerobounce valid 0.3696 🏆 yes no thread-pool-0_14 2.930
user@gmail.com bouncify deliverable 0.678 yes no thread-pool-0_10 181.576
user@gmail.com captainverify valid 0.5302 yes no thread-pool-0_10 22.836
user@gmail.com emaillistverify valid 1.3648 yes no thread-pool-0_10 4.208
user@gmail.com millionverifier ok 0.4417 yes no thread-pool-0_10 1.614
user@gmail.com myemailverifier valid 2.631 yes no thread-pool-0_10 6.461
user@gmail.com reoon valid 1.1321 yes no thread-pool-0_10 5.744
user@gmail.com zerobounce valid 0.3301 🏆 yes no thread-pool-0_10 2.930
user@mailsac.com bouncify undeliverable 0.825 yes yes thread-pool-0_0 181.576
user@mailsac.com captainverify risky 0.501 no yes thread-pool-0_0 22.836
user@mailsac.com emaillistverify unknown 2.0574 yes yes thread-pool-0_0 4.208
user@mailsac.com millionverifier disposable 0.516 yes yes thread-pool-0_0 1.614
user@mailsac.com myemailverifier invalid 3.8669 yes yes thread-pool-0_0 6.461
user@mailsac.com reoon disposable 3.0198 yes yes thread-pool-0_0 5.744
user@mailsac.com zerobounce do_not_mail 0.3632 🏆 yes yes thread-pool-0_0 2.930
user@tempr.email bouncify undeliverable 0.6154 no yes thread-pool-0_8 181.576
user@tempr.email captainverify invalid 0.5697 no no thread-pool-0_8 22.836
user@tempr.email emaillistverify unknown 2.0571 no yes thread-pool-0_8 4.208
user@tempr.email millionverifier disposable 0.5481 no yes thread-pool-0_8 1.614
user@tempr.email myemailverifier invalid 4.1935 no yes thread-pool-0_8 6.461
user@tempr.email reoon disposable 1.0481 yes yes thread-pool-0_8 5.744
user@tempr.email zerobounce do_not_mail 0.3356 🏆 no yes thread-pool-0_8 2.930
user@yahoo.com bouncify accept-all ❌ 0.7072 yes no thread-pool-0_12 181.576
user@yahoo.com captainverify invalid ❌ 0.597 no no thread-pool-0_12 22.836
user@yahoo.com emaillistverify valid 1.3502 yes no thread-pool-0_12 4.208
user@yahoo.com millionverifier unknown ❌ 0.5145 🏆 yes no thread-pool-0_12 1.614
user@yahoo.com myemailverifier valid 3.118 yes no thread-pool-0_12 6.461
user@yahoo.com reoon valid 1.1854 yes no thread-pool-0_12 5.744
user@yahoo.com zerobounce valid 1.0279 🏆 yes no thread-pool-0_12 2.930
xyz@centmil1.com bouncify undeliverable 0.805 no no thread-pool-0_1 181.576
xyz@centmil1.com captainverify unknown 21.5099 no no thread-pool-0_1 22.836
xyz@centmil1.com emaillistverify unknown 3.1766 no no thread-pool-0_1 4.208
xyz@centmil1.com millionverifier invalid 0.4452 no no thread-pool-0_1 1.614
xyz@centmil1.com myemailverifier invalid 4.0985 no no thread-pool-0_1 6.461
xyz@centmil1.com reoon invalid 0.7275 no no thread-pool-0_1 5.744
xyz@centmil1.com zerobounce invalid 0.3171 🏆 no no thread-pool-0_1 2.930
xyz@domain1.com bouncify undeliverable 2.0397 no no thread-pool-0_3 181.576
xyz@domain1.com captainverify invalid 0.607 no no thread-pool-0_3 22.836
xyz@domain1.com emaillistverify email_disabled 1.0901 no no thread-pool-0_3 4.208
xyz@domain1.com millionverifier invalid 0.4442 no no thread-pool-0_3 1.614
xyz@domain1.com myemailverifier invalid 3.1271 no no thread-pool-0_3 6.461
xyz@domain1.com reoon invalid 1.7166 no no thread-pool-0_3 5.744
xyz@domain1.com zerobounce invalid 0.3335 🏆 no no thread-pool-0_3 2.930

Email Verification Results Table Compare

Table comparing the JSON field values for each email address across the different Email cleaning service APIs and also compared to local script non-API queries results.

Tested on the same sample emaillist.txt of email addresses. These are their respective returned values for status JSON field which retrieved from the respective API services. While status_code (not used with external APIs), free_email and disposable_email JSON fields are from local script code/databases where applicable. The sub_status is a JSON field only for Zerobounce.

Pay attention to specific email addresses compared for the accuracy of the email verification providers's API results:

  • user@mailsac.com this is a known disposable email address
  • xyz@centmil1.com this is a domain that doesn't exist so would not have valid DNS or MX DNS records
  • user+to@domain1.com this is a Google Workspace email address using + user aliasing and is a valid working email address
  • user@tempr.email another known disposable email address
  • info@domain2.com known valid Google Workspae email address that is working
  • user@gmail.com known valid Gmail address
  • op999@gmail.com known invalid user does not exist Gmail address AFAIK
  • user@yahoo.com known valid Yahoo email address that is working
Email API status sub_status status_code free_email disposable_email
user@mailsac.com EmailListVerify unknown null null yes yes
user@mailsac.com MillionVerifier disposable null null false yes
user@mailsac.com CaptainVerify risky null null no yes
user@mailsac.com Proofy.io undeliverable null null no yes
user@mailsac.com MyEmailVerifier invalid null null yes yes
user@mailsac.com Zerobounce do_not_mail disposable null yes yes
user@mailsac.com Reoon disposable null null yes yes
user@mailsac.com Bouncify undeliverable null null yes yes
user@mailsac.com Bounceless unknown unknown null yes yes
xyz@centmil1.com EmailListVerify unknown null null no no
xyz@centmil1.com MillionVerifier invalid null null false no
xyz@centmil1.com CaptainVerify invalid null null no no
xyz@centmil1.com Proofy.io undeliverable null null no no
xyz@centmil1.com MyEmailVerifier invalid null null no no
xyz@centmil1.com Zerobounce invalid no_dns_entries null no no
xyz@centmil1.com Reoon invalid null null no no
xyz@centmil1.com Bouncify undeliverable null null no no
xyz@centmil1.com Bounceless no_mx_record no_mx_record null no no
user+to@domain1.com EmailListVerify valid null null no no
user+to@domain1.com MillionVerifier ok null null false no
user+to@domain1.com CaptainVerify valid null null no no
user+to@domain1.com Proofy.io deliverable null null no no
user+to@domain1.com MyEmailVerifier valid null null no no
user+to@domain1.com Zerobounce valid alias_address null no no
user+to@domain1.com Reoon valid null null no no
user+to@domain1.com Bouncify deliverable null null no no
user+to@domain1.com Bounceless Invalid Syntax Syntax Error null no no
xyz@domain1.com EmailListVerify email_disabled null null no no
xyz@domain1.com MillionVerifier invalid null null false no
xyz@domain1.com CaptainVerify invalid null null no no
xyz@domain1.com Proofy.io undeliverable null null no no
xyz@domain1.com MyEmailVerifier invalid null null no no
xyz@domain1.com Zerobounce invalid mailbox_not_found null no no
xyz@domain1.com Reoon valid null null no no
xyz@domain1.com Bouncify undeliverable null null no no
xyz@domain1.com Bounceless unknown unknown null no no
abc@domain1.com EmailListVerify email_disabled null null no no
abc@domain1.com MillionVerifier invalid null null false no
abc@domain1.com CaptainVerify invalid null null no no
abc@domain1.com Proofy.io undeliverable null null no no
abc@domain1.com MyEmailVerifier invalid null null no no
abc@domain1.com Zerobounce invalid mailbox_not_found null no no
abc@domain1.com Reoon valid null null no no
abc@domain1.com Bouncify undeliverable null null no no
abc@domain1.com Bounceless unknown unknown null no no
123@domain1.com EmailListVerify email_disabled null null no no
123@domain1.com MillionVerifier invalid null null false no
123@domain1.com CaptainVerify risky null null no no
123@domain1.com Proofy.io undeliverable null null no no
123@domain1.com MyEmailVerifier invalid null null no no
123@domain1.com Zerobounce invalid mailbox_not_found null no no
123@domain1.com Reoon valid null null no no
123@domain1.com Bouncify undeliverable null null no no
123@domain1.com Bounceless unknown unknown null no no
pop@domain1.com EmailListVerify email_disabled null null no no
pop@domain1.com MillionVerifier invalid null null false no
pop@domain1.com CaptainVerify invalid null null no no
pop@domain1.com Proofy.io undeliverable null null no no
pop@domain1.com MyEmailVerifier invalid null null no no
pop@domain1.com Zerobounce invalid mailbox_not_found null no no
pop@domain1.com Reoon valid null null no no
pop@domain1.com Bouncify undeliverable null null no no
pop@domain1.com Bounceless unknown unknown null no no
pip@domain1.com EmailListVerify email_disabled null null no no
pip@domain1.com MillionVerifier invalid null null false no
pip@domain1.com CaptainVerify invalid null null no no
pip@domain1.com Proofy.io undeliverable null null no no
pip@domain1.com MyEmailVerifier invalid null null no no
pip@domain1.com Zerobounce invalid mailbox_not_found null no no
pip@domain1.com Reoon valid null null no no
pip@domain1.com Bouncify undeliverable null null no no
pip@domain1.com Bounceless unknown unknown null no no
user@tempr.email EmailListVerify unknown null null no yes
user@tempr.email MillionVerifier disposable null null false yes
user@tempr.email CaptainVerify risky null null no yes
user@tempr.email Proofy.io undeliverable null null no yes
user@tempr.email MyEmailVerifier invalid null null no yes
user@tempr.email Zerobounce do_not_mail disposable null no yes
user@tempr.email Reoon disposable null null yes yes
user@tempr.email Bouncify undeliverable null null no yes
user@tempr.email Bounceless invalid invalid null no yes
info@domain2.com EmailListVerify valid null null no no
info@domain2.com MillionVerifier ok null null false no
info@domain2.com CaptainVerify risky null null no no
info@domain2.com Proofy.io deliverable null null no no
info@domain2.com MyEmailVerifier valid null null no no
info@domain2.com Zerobounce do_not_mail role_based null no no
info@domain2.com Reoon valid null null no no
info@domain2.com Bouncify deliverable null null no no
info@domain2.com Bounceless unknown unknown null no no
user@gmail.com EmailListVerify valid null null yes no
user@gmail.com MillionVerifier ok null null true no
user@gmail.com CaptainVerify valid null null yes no
user@gmail.com Proofy.io deliverable null null yes no
user@gmail.com MyEmailVerifier valid null null yes no
user@gmail.com Zerobounce valid null yes no
user@gmail.com Reoon valid null null yes no
user@gmail.com Bouncify deliverable null null yes no
user@gmail.com Bounceless unknown unknown null yes no
op999@gmail.com EmailListVerify email_disabled null null yes no
op999@gmail.com MillionVerifier invalid null null true no
op999@gmail.com CaptainVerify invalid null null yes no
op999@gmail.com Proofy.io undeliverable null null no no
op999@gmail.com MyEmailVerifier invalid null null yes no
op999@gmail.com Zerobounce invalid mailbox_not_found null yes no
op999@gmail.com Reoon valid (quick mode) or invalid (power mode) null null yes no
op999@gmail.com Bouncify undeliverable null null yes no
op999@gmail.com Bounceless unknown unknown null yes no
user@yahoo.com EmailListVerify valid null null yes no
user@yahoo.com MillionVerifier ok (per email API) or unknown (bulk email API) null null true no
user@yahoo.com CaptainVerify unknown null null yes no
user@yahoo.com Proofy.io unknown null null no no
user@yahoo.com MyEmailVerifier valid null null yes no
user@yahoo.com Zerobounce valid null yes no
user@yahoo.com Reoon valid null null yes no
user@yahoo.com Bouncify accept-all null null yes no
user@yahoo.com Bounceless unknown unknown null yes no
user1@outlook.com EmailListVerify valid null null yes no
user1@outlook.com MillionVerifier ok null null true no
user1@outlook.com CaptainVerify valid null null yes no
user1@outlook.com Proofy.io deliverable null null yes no
user1@outlook.com MyEmailVerifier valid null null yes no
user1@outlook.com Zerobounce valid null yes no
user1@outlook.com Reoon valid null null yes no
user1@outlook.com Bouncify deliverable null null yes no
user1@outlook.com Bounceless unknown unknown null yes no
user2@hotmail.com EmailListVerify valid null null yes no
user2@hotmail.com MillionVerifier ok null null true no
user2@hotmail.com CaptainVerify valid null null yes no
user2@hotmail.com Proofy.io deliverable null null yes no
user2@hotmail.com MyEmailVerifier valid null null yes no
user2@hotmail.com Zerobounce valid null yes no
user2@hotmail.com Reoon valid null null yes no
user2@hotmail.com Bouncify api_error null null yes no
user2@hotmail.com Bounceless unknown unknown null yes no

EmailListVerify

First one is EmailListVerify where you set -api emaillistverify -apikey $elvkey where $elvkey is generated API key.

The status field value comes from EmailListVerify API check while free_email and disposable_email field values from from script's own database check. The status_code is null as it's not applicable in -api mode.

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -v
[
    {
        "email": "user@mailsac.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "abc@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "123@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pop@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pip@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@tempr.email",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "info@domain2.com",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user@yahoo.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

Where EmailListVerify status codes are as follows:

  • ok All is OK. The server is saying that it is ready to receive a letter to,this address, and no tricks have been detected
  • error The server is saying that delivery failed, but no information about,the email exists
  • smtp_error The SMTP answer from the server is invalid or the destination server,reported an internal error to us
  • smtp_protocol The destination server allowed us to connect but the SMTP,session was closed before the email was verified
  • unknown_email The server said that the delivery failed and that the email address does,not exist
  • attempt_rejected The delivery failed; the reason is similar to “rejected”
  • relay_error The delivery failed because a relaying problem took place
  • antispam_system Some anti-spam technology is blocking the,verification progress
  • email_disabled The email account is suspended, disabled, or limited and can not,receive emails
  • domain_error The email server for the whole domain is not installed or is,incorrect, so no emails are deliverable
  • ok_for_all The email server is saying that it is ready to accept letters,to any email address
  • dead_server The email server is dead, and no connection to it could be established
  • syntax_error There is a syntax error in the email address
  • unknown The email delivery failed, but no reason was given
  • accept_all The server is set to accept all emails at a specific domain.,These domains accept any email you send to them
  • disposable The email is a temporary address to receive letters and expires,after certain time period
  • spamtrap The email address is maintained by an ISP or a third party,which neither clicks nor opens emails
  • invalid_mx An undocumentated status value that isn't in their documentation. As the name implies, invalid MX DNS records

EmailListVerify API integration via -api and apikey arguments combined with Xenforo flags to display the MySQL query to update invalid user's email addresses to email_bounce status in Xenforo database.

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -xf -xfdb xenforo -xfprefix xf_
[
    {
        "email": "user@mailsac.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';\" xenforo"
    },
    {
        "email": "user+to@domain1.com",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo"
    },
    {
        "email": "abc@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo"
    },
    {
        "email": "123@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo"
    },
    {
        "email": "pop@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo"
    },
    {
        "email": "pip@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo"
    },
    {
        "email": "user@tempr.email",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo"
    },
    {
        "email": "info@domain2.com",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo"
    },
    {
        "email": "user@yahoo.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

Using jq tool to just filter for MySQL queries.

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';" xenforo

Looks like Emaillistverify might be correct = unknown for status value. So they differentiate disposable emails = unknown I think regardless of whether the email passes SMTP check. Guess that makes sense, so I should also mark disposable emails so they show xf_sql query

Updated local test code as such to mark disposable_email = yes and display xf_sql query.

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_
[
    {
        "email": "user@mailsac.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo"
    },
    {
        "email": "abc@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo"
    },
    {
        "email": "123@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo"
    },
    {
        "email": "pop@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo"
    },
    {
        "email": "pip@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo"
    },
    {
        "email": "user@tempr.email",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo"
    },
    {
        "email": "info@domain2.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "yes",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo"
    },
    {
        "email": "user@yahoo.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

EmailListVerify Bulk File API

Added support for EmailListVerify Bulk File API upload with added -apibulk emaillistverify argument. Unfortunately for the below number of emails, the bulk API upload took way longer to process at 45 seconds versus 2.2 seconds for per email verification without -apibulk emaillistverify due to remote processing.

cat email_verification_log_2024-05-05_17-03-01.log

2024-05-05 17:03:02,607 - INFO - File MIME type: text/plain
2024-05-05 17:03:02,607 - INFO - Request data: {'filename': 'emaillist_20240505170302.txt'}
2024-05-05 17:03:02,607 - INFO - File data: {'file_contents': ('emaillist_20240505170302.txt', <_io.BufferedReader name='emaillist.txt'>, 'text/plain')}
2024-05-05 17:03:03,293 - INFO - File uploaded successfully. File ID: 2400498
2024-05-05 17:03:03,832 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:09,420 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:14,883 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:20,148 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:25,334 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:30,533 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:35,801 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:41,075 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:46,421 - INFO - File processing completed. Retrieving results from: https://files-elv.s3.eu-central-1.amazonaws.com/2024-05/276e5d9b771214ca9e5e6b59f67b481bfa0a2fabc_all.csv
2024-05-05 17:03:46,783 - INFO - Results file downloaded: emaillistverify_results_1714928583.csv
2024-05-05 17:03:46,784 - INFO - Results retrieved successfully. Total lines: 15

with -apibulk emaillistverify argument

python validate_emails.py -f user@domain1.com -l emaillist.txt -api emaillistverify -apikey $elvkey -apibulk emaillistverify -tm all
[
    {
        "email": "user@mailsac.com",
        "status": "disposable",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "dead_server",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "valid",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@tempr.email",
        "status": "disposable",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "info@domain2.com",
        "status": "valid",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "abc@domain1.com",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "123@domain1.com",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pop@domain1.com",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pip@domain1.com",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "valid",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user@yahoo.com",
        "status": "valid",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "valid",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "valid",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    }
]

MillionVerifier

Add MillionVerifier API support

Manual email test via their dashboard reveals

"email","quality","result","free","role"
"user@mailsac.com","bad","disposable","no","yes"
"xyz@centmil1.com","bad","invalid","no","no"
"user+to@domain1.com","good","ok","no","no"
"user@tempr.email","bad","disposable","no","yes"
"info@domain2.com","good","ok","no","yes"
"xyz@domain1.com","bad","invalid","no","no"
"abc@domain1.com","bad","invalid","no","yes"
"123@domain1.com","bad","invalid","no","no"
"pop@domain1.com","bad","invalid","no","no"
"pip@domain1.com","bad","invalid","no","no"
"user@gmail.com","good","ok","yes","no"
"op999@gmail.com","bad","invalid","yes","no"
"user@yahoo.com","good","ok","yes","no"
"user1@outlook.com","good","ok","yes","no"
"user2@hotmail.com","good","ok","yes","no"

MillionVerifier API enabled run -api millionverifier -apikey_mv $mvkey

Also updated code to retrive API results for free_email_api and role_api while free_email and disposable_email are local script database lookup based

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey
[
    {
        "email": "user@mailsac.com",
        "status": "disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes",
        "free_email_api": false,
        "role_api": true
    },
    {
        "email": "xyz@centmil1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "user+to@domain1.com",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "xyz@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "abc@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": true
    },
    {
        "email": "123@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "pop@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "pip@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "user@tempr.email",
        "status": "disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "free_email_api": false,
        "role_api": true
    },
    {
        "email": "info@domain2.com",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": true
    },
    {
        "email": "user@gmail.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "op999@gmail.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "user@yahoo.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "user1@outlook.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "user2@hotmail.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    }
]

MillionVerifier API enabled run with -xf -xfdb xenforo -xfprefix xf_ flags

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -xf -xfdb xenforo -xfprefix xf_
[
    {
        "email": "user@mailsac.com",
        "status": "disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes",
        "free_email_api": false,
        "role_api": true,
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false,
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';\" xenforo"
    },
    {
        "email": "user+to@domain1.com",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "xyz@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false,
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo"
    },
    {
        "email": "abc@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": true,
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo"
    },
    {
        "email": "123@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false,
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo"
    },
    {
        "email": "pop@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false,
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo"
    },
    {
        "email": "pip@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false,
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo"
    },
    {
        "email": "user@tempr.email",
        "status": "disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "free_email_api": false,
        "role_api": true,
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo"
    },
    {
        "email": "info@domain2.com",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": true
    },
    {
        "email": "user@gmail.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "op999@gmail.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false,
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo"
    },
    {
        "email": "user@yahoo.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "user1@outlook.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "user2@hotmail.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    }
]

jq filterd for Xenforo MySQL queries only

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'

mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';" xenforo

MillionVerifier Bulk File API

Added support for MillionVerifier Bulk File API upload with added -apibulk millionverifier argument. Unfortunately for the below number of emails, the bulk API upload took a bit longer to process at 7 seconds versus 2.2 seconds for per email verification without -apibulk millionverifier due to remote processing.

cat email_verification_log_2024-05-06_05-36-30.log

2024-05-06 05:36:31,484 - INFO - Uploading file: emaillist.txt
2024-05-06 05:36:31,484 - INFO - Request URL: https://bulkapi.millionverifier.com/bulkapi/v2/upload?key=APIKEY&remove_duplicates=1
2024-05-06 05:36:31,484 - INFO - Request data: {'key': 'APIKEY'}
2024-05-06 05:36:31,484 - INFO - Request files: {'file_contents': <_io.BufferedReader name='emaillist.txt'>}
2024-05-06 05:36:31,765 - INFO - Response status code: 200
2024-05-06 05:36:31,765 - INFO - Response content: {
    "file_id": "26458323",
    "file_name": "emaillist.txt",
    "status": "unknown",
    "unique_emails": 0,
    "updated_at": "2024-05-06 05:36:31",
    "createdate": "2024-05-06 05:36:31",
    "percent": 0,
    "total_rows": 0,
    "verified": 0,
    "unverified": 0,
    "ok": 0,
    "catch_all": 0,
    "disposable": 0,
    "invalid": 0,
    "unknown": 0,
    "reverify": 0,
    "credit": 0,
    "estimated_time_sec": 0,
    "error": ""
}

2024-05-06 05:36:31,765 - INFO - Response JSON: {'file_id': '26458323', 'file_name': 'emaillist.txt', 'status': 'unknown', 'unique_emails': 0, 'updated_at': '2024-05-06 05:36:31', 'createdate': '2024-05-06 05:36:31', 'percent': 0, 'total_rows': 0, 'verified': 0, 'unverified': 0, 'ok': 0, 'catch_all': 0, 'disposable': 0, 'invalid': 0, 'unknown': 0, 'reverify': 0, 'credit': 0, 'estimated_time_sec': 0, 'error': ''}
2024-05-06 05:36:31,765 - INFO - File uploaded successfully. File ID: 26458323
2024-05-06 05:36:32,046 - INFO - File processing in progress. Progress: 0%
2024-05-06 05:36:37,328 - INFO - File processing completed. Retrieving results.
2024-05-06 05:36:37,607 - INFO - Results file downloaded: millionverifier_results_20240506053637.csv
2024-05-06 05:36:37,608 - INFO - Results retrieved successfully. Total lines: 15

with -apibulk millionverifier argument

Also updated code to retrive API results for free_email_api and role_api while free_email and disposable_email are local script database lookup based

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -apibulk millionverifier
[
    {
        "email": "user@mailsac.com",
        "status": "disposable",
        "free_email": "yes",
        "disposable_email": "yes",
        "free_email_api": "no",
        "role_api": "yes"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "invalid",
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "role_api": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "ok",
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "role_api": "no"
    },
    {
        "email": "user@tempr.email",
        "status": "disposable",
        "free_email": "no",
        "disposable_email": "yes",
        "free_email_api": "no",
        "role_api": "yes"
    },
    {
        "email": "info@domain2.com",
        "status": "ok",
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "role_api": "yes"
    },
    {
        "email": "xyz@domain1.com",
        "status": "invalid",
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "role_api": "no"
    },
    {
        "email": "abc@domain1.com",
        "status": "invalid",
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "role_api": "yes"
    },
    {
        "email": "123@domain1.com",
        "status": "invalid",
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "role_api": "no"
    },
    {
        "email": "pop@domain1.com",
        "status": "invalid",
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "role_api": "no"
    },
    {
        "email": "pip@domain1.com",
        "status": "invalid",
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "role_api": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "ok",
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "role_api": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "invalid",
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "role_api": "no"
    },
    {
        "email": "user@yahoo.com",
        "status": "unknown",
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "role_api": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "ok",
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "role_api": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "ok",
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "role_api": "no"
    }
]

without -apibulk millionverifier argument for per email checks

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey
[
    {
        "email": "user@mailsac.com",
        "status": "disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes",
        "free_email_api": false,
        "role_api": true
    },
    {
        "email": "xyz@centmil1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "user+to@domain1.com",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "xyz@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "abc@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": true
    },
    {
        "email": "123@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "pop@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "pip@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "user@tempr.email",
        "status": "disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "free_email_api": false,
        "role_api": true
    },
    {
        "email": "info@domain2.com",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": true
    },
    {
        "email": "user@gmail.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "op999@gmail.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "user@yahoo.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "user1@outlook.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "user2@hotmail.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    }
]

MillionVerifier Bulk API Differences

Noticed for below sample 15 email addresses tested, I always got 1 refunded credit so it applies to one email address which is a known valid email user@yahoo.com which is classed as unknown in bulk API but classed as ok in per email verification API. They refund credits for emails classified as 'risky' (catch_all or unknown) https://help.millionverifier.com/payments-credits/refund-for-risky-emails. Seems to be a bug in their bulk API then as the refunds only apply to bulk API and not per email verification checks due to differences in classifications in bulk API vs per email verification API.

I reached out to MillionVerifier chat support which was initially handled via Milly their AI chat bot which later referred me to support. They emailed me back saying:

We're glad you reached out to us about this issue, and we're here to help. The discrepancy you're seeing in the results is likely because we were unable to connect to the server during the verification process, leading to an "Unknown" result. However, for the single API, the connection went through smoothly, allowing us to verify the email without any problems. An "Unknown" result simply means that we couldn't determine the existence of the email at the time of verification. If you have any more questions, queries, or issues, we're more than happy to assist.

I tried a few attempts at bulk API for the same list of 15 emails, and user@yahoo.com is always marked as status = unknown and never anything different though? It would be hard to differentiate status classifications if it's due connection issues if they're lumped into other emails in unknown label. Maybe would be better to have a separate classification for connection issues so we can differentiate as such. For example, EmailListVerify has 18 different status classifications including for connection related issues.

single email API check for user@yahoo.com returns ok

python validate_emails.py -f user@domain1.com -e user@yahoo.com -api millionverifier -apikey_mv $mvkey -tm all
[
    {
        "email": "user@yahoo.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    }
]

bulk API upload check excerpt for user@yahoo.com returns unknown

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -apibulk millionverifier
[
 
    {
        "email": "user@yahoo.com",
        "status": "unknown",
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "role_api": "no"
    },

]

As such you can't 100% rely on the status output to do tasks like updating Xenforo user's user_state status to stop sending emails to them without further verification for such emails. For now, I've updated my validate_emails.py script for MillionVerifier bulk API and per email check API results, to not list Xenforo SQL queries for unknown status results and only list Xenforo SQL queries for invalid and disposable status emails. Same can be said for other providers, probably need to really double check your results if you're relying on the results for important tasks. You can filter MillionVerifier's unknown status emails and feed them into another commercial provider's API to double check i.e. EmailListVerify or use script's self-hosted local email check. Given cheaper MillionVerifier pricing, it might be more economical to do it this way?

MillionVerifier bulk API filter -api millionverifier -apikey_mv $mvkey -apibulk millionverifier filter using jq for unknown status emails piped into text file results-millionverifier-bulk-api-unknown-only.txt

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -apibulk millionverifier | jq '.[] | select(.status == "unknown")' 2>&1 > results-millionverifier-bulk-api-unknown-only.txt

The results-millionverifier-bulk-api-unknown-only.txt contents will show all MillionVerifier bulk API returned unknown status results.

cat results-millionverifier-bulk-api-unknown-only.txt                                            
{
  "email": "user@yahoo.com",
  "status": "unknown",
  "free_email": "yes",
  "disposable_email": "no",
  "free_email_api": "yes",
  "role_api": "no"
}

Using same results-millionverifier-bulk-api-unknown-only.txt file, and jq just filter out the email addresses into a new results-millionverifier-bulk-api-unknown-only-emails.txt file

cat results-millionverifier-bulk-api-unknown-only.txt | jq -r '.email' | tee results-millionverifier-bulk-api-unknown-only-emails.txt
user@yahoo.com

Then use EmailListVerify bulk API to verify the filtered MillionVerifier unknown status list filtered file results-millionverifier-bulk-api-unknown-only-emails.txt and double check the status which confirms it's actually a valid email.

python validate_emails.py -f user@domain1.com -l results-millionverifier-bulk-api-unknown-only-emails.txt -tm all -api emaillistverify -apikey $elvkey -apibulk emaillistverify

[
    {
        "email": "user@yahoo.com",
        "status": "valid",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    }
]

Or EmailListVerify per email verification API check

./validate_emails.py -f user@domain1.com -e user@yahoo.com -tm all -api emaillistverify -apikey $elvkey -tm all
[
    {
        "email": "user@yahoo.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

Or if it's a few emails, via validate_emails.py script's self-hosted local email syntax, DNS and SMTP check

  validate_emails.py -f user@domain1.com -e user@yahoo.com -tm all
[
    {
        "email": "user@yahoo.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

CaptainVerify API

Add CaptainVerify API support.

CaptainVerify's API has rate limits, as such script needed to add such to it's routines.

The API is limited to a maximum of 2 simultaneous connections and 50 checks per minute. When integrating the API, make sure your application does not exceed this limit.

update_captainverify_rate_limit Function

The update_captainverify_rate_limit function is responsible for managing the rate limiting of requests to the CaptainVerify API. It ensures that the script complies with the API's rate limits of a maximum of 2 simultaneous connections and 50 checks per minute.

Purpose

The purpose of the update_captainverify_rate_limit function is to coordinate access to the CaptainVerify API across multiple processes and prevent exceeding the API's rate limits. It achieves this by using a shared file (captainverify_rate_limit.json) to store and update the rate limiting information.

Functionality

The update_captainverify_rate_limit function performs the following steps:

  1. It takes a lock_file parameter, which specifies the path to the file used for storing the rate limiting information.
  2. It opens the lock_file in read and write mode ('r+') to allow reading from and writing to the file.
  3. It acquires an exclusive lock on the file using the fcntl.flock function with the fcntl.LOCK_EX flag. This ensures that only one process can access and modify the file at a time, preventing race conditions.
  4. It reads the existing rate limiting data from the file using json.load. The rate limiting data includes the timestamp of the last request (last_request_time) and the count of requests made within the current minute (request_count).
  5. It calculates the elapsed time since the last request by subtracting last_request_time from the current time.
  6. If the elapsed time is less than 60 seconds (indicating that the current minute has not passed), it increments the request_count by 1.
  7. If the request_count exceeds 50 (the maximum allowed requests per minute), it calculates the remaining time until the current minute completes and sleeps for that duration using time.sleep. After sleeping, it updates last_request_time to the current time and resets request_count to 1.
  8. If the elapsed time is greater than or equal to 60 seconds (indicating that a new minute has started), it updates last_request_time to the current time and resets request_count to 1.
  9. It updates the last_request_time and request_count values in the data dictionary.
  10. It seeks to the beginning of the file using file.seek(0), writes the updated data dictionary to the file using json.dump, and truncates any remaining content in the file using file.truncate(). This ensures that the file contains only the updated rate limiting data.
  11. It releases the exclusive lock on the file using fcntl.flock with the fcntl.LOCK_UN flag, allowing other processes to access the file.

Usage

The update_captainverify_rate_limit function is called within the validate_and_classify function whenever an email verification request is made to the CaptainVerify API (i.e., when args.api == 'captainverify' and args.test_mode == 'all').

By calling update_captainverify_rate_limit before making the API request, the script ensures that the rate limiting information is updated and that the API's rate limits are respected across multiple processes.

The lock_file parameter specifies the path to the file used for storing the rate limiting information. In the provided code, the file is named 'captainverify_rate_limit.json' and is initialized in the main function.

Manual email test via their dashboard reveals

email;status;free;disposable;role;ok_for_all;protected;did_you_mean;details
user@mailsac.com;risky;0;1;1;1;0;;low quality
xyz@centmil1.com;invalid;0;0;0;0;0;;smtp error
user+to@domain1.com;ok;0;0;0;0;0;;
user@tempr.email;risky;0;1;1;1;0;;low quality
info@domain2.com;risky;0;0;1;0;0;;low quality
xyz@domain1.com;invalid;0;0;0;0;0;;email error
abc@domain1.com;invalid;0;0;1;0;0;;email error
123@domain1.com;invalid;0;0;1;0;0;;email error
pop@domain1.com;invalid;0;0;0;0;0;;email error
pip@domain1.com;invalid;0;0;0;0;0;;email error
user@gmail.com;ok;1;0;0;0;0;;
op999@gmail.com;invalid;1;0;0;0;0;;email error
user@yahoo.com;unknown;1;0;0;0;0;;
user1@outlook.com;ok;1;0;0;0;0;;
user2@hotmail.com;ok;1;0;0;0;0;;

CaptainVerify API enabled run -api captainverify -apikey_cv $cvkey

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api captainverify -apikey_cv $cvkey -xf -xfdb xenforo -xfprefix xf_
[
    {
        "email": "user@mailsac.com",
        "status": "risky",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';\" xenforo"
    },
    {
        "email": "user+to@domain1.com",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo"
    },
    {
        "email": "abc@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo"
    },
    {
        "email": "123@domain1.com",
        "status": "risky",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo"
    },
    {
        "email": "pop@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo"
    },
    {
        "email": "pip@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo"
    },
    {
        "email": "user@tempr.email",
        "status": "risky",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo"
    },
    {
        "email": "info@domain2.com",
        "status": "risky",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'info@domain2.com';\" xenforo"
    },
    {
        "email": "user@gmail.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo"
    },
    {
        "email": "user@yahoo.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@yahoo.com';\" xenforo"
    },
    {
        "email": "user1@outlook.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

jq filterd for Xenforo MySQL queries only

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api captainverify -apikey_cv $cvkey -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'info@domain2.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@yahoo.com';" xenforo

Proofy API

Add Proofy.io API support

Proofy.io API enabled run -api proofy -apikey_pf $pkey -apiuser_pf $puser

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api proofy -apikey_pf $pkey -apiuser_pf $puser -xf -xfdb xenforo -xfprefix xf_
[
    {
        "email": "user@mailsac.com",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';\" xenforo"
    },
    {
        "email": "user+to@domain1.com",
        "status": "deliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo"
    },
    {
        "email": "abc@domain1.com",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo"
    },
    {
        "email": "123@domain1.com",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo"
    },
    {
        "email": "pop@domain1.com",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo"
    },
    {
        "email": "pip@domain1.com",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo"
    },
    {
        "email": "user@tempr.email",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo"
    },
    {
        "email": "info@domain2.com",
        "status": "deliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "deliverable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo"
    },
    {
        "email": "user@yahoo.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@yahoo.com';\" xenforo"
    },
    {
        "email": "user1@outlook.com",
        "status": "deliverable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "deliverable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

Unfortunately, Proofy.io has a stricter max concurrent connection limit so will slow down processing of email verifications. Proofy.io API limits mean email verifications are at least 2x or more slower. As such need to add a -pf_max_connections parameter which set to 1 by default when argument not passed on command line like above. But even with -pf_max_connections 2 Proofy.io API complains and email status = api_error occur.

From email_verification_log_2024-05-05_14-06-36.log

2024-05-05 14:07:08,450 - ERROR - Unexpected API response for user2@hotmail.com: {'error': True, 'message': 'You already use the maximum number of simultaneous connections. Try this request later.'}
2024-05-05 14:07:08,450 - ERROR - Max retries exceeded for user2@hotmail.com. Skipping

Testing Proofy.io, ran out of credits from log email_verification_log_2024-05-05_14-20-50.log

2024-05-05 14:21:35,810 - ERROR - Unexpected API response for user2@hotmail.com: {'error': True, 'message': "You don't have checks. Check your balance."}
2024-05-05 14:21:46,461 - ERROR - Max retries exceeded for user2@hotmail.com. Skipping.
python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api proofy -apikey_pf $pkey -apiuser_pf $puser -xf -xfdb xenforo -xfprefix xf_ -pf_max_connections 2
[
    {
        "email": "user@mailsac.com",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "user+to@domain1.com",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "xyz@domain1.com",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "abc@domain1.com",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "123@domain1.com",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "pop@domain1.com",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "pip@domain1.com",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "user@tempr.email",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "info@domain2.com",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "user@gmail.com",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "op999@gmail.com",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "user@yahoo.com",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "user1@outlook.com",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "user2@hotmail.com",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    }
]

jq filterd for Xenforo MySQL queries only

python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api proofy -apikey_pf $pkey -apiuser_pf $puser -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'info@domain2.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@yahoo.com';" xenforo

MyEmailVerifier API

Add MyEmailVerifier API support

MyEmailVerifier API enabled run -api myemailverifier -apikey_mev $mevkey

python validate_emails.py -f user@domain1.com -l emaillist.txt -api myemailverifier -apikey_mev $mevkey -tm all
[
    {
        "email": "user@mailsac.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "abc@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "123@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pop@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pip@domain1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@tempr.email",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "info@domain2.com",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user@yahoo.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

jq filterd for Xenforo MySQL queries only

python validate_emails.py -f user@domain1.com -l emaillist.txt -api myemailverifier -apikey_mev $mevkey -tm all -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'

mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';" xenforo

Zerobounce API

Add Zerobounce API support

Zerobounce API enabled run -api zerobounce -apikey_zb $zbkey -tm all with specified email address -e hnyfmw@canadlan-drugs.com. The status, sub_status and free_email_api JSON fields are from API and free_email and disposable_email JSON fields are from local script database checks.

python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api zerobounce -apikey_zb $zbkey

[
    {
        "email": "hnyfmw@canadlan-drugs.com",
        "status": "invalid",
        "sub_status": "no_dns_entries",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    }
]

For email per verification API check for list of emails in emaillist.txt via -l emaillist.txt. The status, sub_status and free_email_api JSON fields are from API and free_email and disposable_email JSON fields are from local script database checks.

time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api zerobounce -apikey_zb $zbkey
[
    {
        "email": "user@mailsac.com",
        "status": "do_not_mail",
        "sub_status": "disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes",
        "free_email_api": "yes"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "invalid",
        "sub_status": "no_dns_entries",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "valid",
        "sub_status": "alias_address",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "invalid",
        "sub_status": "mailbox_not_found",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    },
    {
        "email": "abc@domain1.com",
        "status": "invalid",
        "sub_status": "mailbox_not_found",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    },
    {
        "email": "123@domain1.com",
        "status": "invalid",
        "sub_status": "mailbox_not_found",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    },
    {
        "email": "pop@domain1.com",
        "status": "invalid",
        "sub_status": "mailbox_not_found",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    },
    {
        "email": "pip@domain1.com",
        "status": "invalid",
        "sub_status": "mailbox_not_found",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    },
    {
        "email": "user@tempr.email",
        "status": "do_not_mail",
        "sub_status": "disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "free_email_api": "yes"
    },
    {
        "email": "info@domain2.com",
        "status": "do_not_mail",
        "sub_status": "role_based",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "valid",
        "sub_status": "",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes"
    },
    {
        "email": "op999@gmail.com",
        "status": "invalid",
        "sub_status": "mailbox_not_found",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes"
    },
    {
        "email": "user@yahoo.com",
        "status": "valid",
        "sub_status": "",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes"
    },
    {
        "email": "user1@outlook.com",
        "status": "valid",
        "sub_status": "",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes"
    },
    {
        "email": "user2@hotmail.com",
        "status": "valid",
        "sub_status": "",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes"
    }
]

real    0m4.794s
user    0m2.218s
sys     0m0.065s

Test ZeroBounce per email check API -api zerobounce -apikey_zb $zbkey with Cloudflare Cache -apicache zerobounce -apicachettl 900

time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api zerobounce -apikey_zb $zbkey -tm all -apicache zerobounce -apicachettl 900

[
    {
        "email": "hnyfmw@canadlan-drugs.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    }
]

real    0m0.777s
user    0m0.253s
sys     0m0.034s

Log inspection

cat $(ls -Art | tail -3 | grep 'email_verification')

2024-05-11 11:28:05,131 - INFO - Cache result: {'address': 'hnyfmw@canadlan-drugs.com', 'status': 'invalid', 'sub_status': 'no_dns_entries', 'free_email': False, 'did_you_mean': None, 'account': 'hnyfmw', 'domain': 'canadlan-drugs.com', 'domain_age_days': '2026', 'smtp_provider': '', 'mx_found': 'false', 'mx_record': '', 'firstname': None, 'lastname': None, 'gender': None, 'country': None, 'region': None, 'city': None, 'zipcode': None, 'processed_at': '2024-05-11 10:37:39.035'}

Cloudflare KV storage entries

Key Value
zerobounce:hnyfmw@canadlan-drugs.com {"result":{"address":"hnyfmw@canadlan-drugs.com","status":"invalid","sub_status":"no_dns_entries","free_email":false,"did_you_mean":null,"account":"hnyfmw","domain":"canadlan-drugs.com","domain_age_days":"2026","smtp_provider":"","mx_found":"false","mx_record":"","firstname":null,"lastname":null,"gender":null,"country":null,"region":null,"city":null,"zipcode":null,"processed_at":"2024-05-11 11:39:24.133"},"timestamp":1715427564270,"ttl":900}

Test Cloudflare R2 storage via -store r2 to save email verification results to Cloudflare R2 bucket directory at emailapi-zerobounce-cached/output_20240511122039.json

time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api zerobounce -apikey_zb $zbkey -tm all -apicache zerobounce -apicachettl 900 -store r2

Output stored successfully in R2: emailapi-zerobounce-cached/output_20240511122039.json
[
    {
        "email": "hnyfmw@canadlan-drugs.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    }
]

real    0m1.210s
user    0m0.355s
sys     0m0.031s

Reoon API

Add Reoon API support

Reoon API enabled run -api reoon -apikey_rn $reokey -tm all with specified email address -e hnyfmw@canadlan-drugs.com. The status, role_account, mx_accepts_mail, spamtrap, mx_records, overall_score, safe_to_send, can_connect_smtp, inbox_full, catch_all, deliverable, disabled JSON field is from API and free_email and disposable_email JSON fields are from local script database checks.

Reoon has 2 modes for single email verification API which can be set via -reoon_mode to a value of either quick or power. The default mode without -reoon_mode being set is quick.

time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api reoon -apikey_rn $reokey

[
    {
        "email": "hnyfmw@canadlan-drugs.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "role_account": "no",
        "mx_accepts_mail": "no",
        "spamtrap": "no",
        "mx_records": null,
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    }
]

real    0m3.748s
user    0m0.358s
sys     0m0.028s

With -reoon_mode power. Currently, script hasn't been configured to grab the additional information provided by power mode.

time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api reoon -apikey_rn $reokey -reoon_mode power

[
    {
        "email": "hnyfmw@canadlan-drugs.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "role_account": "no",
        "mx_accepts_mail": "no",
        "spamtrap": "no",
        "mx_records": [],
        "verification_mode": "power",
        "overall_score": 0,
        "safe_to_send": "no",
        "can_connect_smtp": "no",
        "inbox_full": "no",
        "catch_all": "no",
        "deliverable": "no",
        "disabled": "no"
    }
]

real    0m3.196s
user    0m0.360s
sys     0m0.026s

For email per verification API check for list of emails in emaillist.txt via -l emaillist.txt. The status JSON field is from API and free_email and disposable_email JSON fields are from local script database checks.

time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api reoon -apikey_rn $reokey

[
    {
        "email": "user@mailsac.com",
        "status": "disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes",
        "role_account": "yes",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "in.mailsac.com",
            "alt.mailsac.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "xyz@centmil1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "no",
        "spamtrap": "no",
        "mx_records": null,
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "user+to@domain1.com",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "aspmx.l.google.com",
            "alt1.aspmx.l.google.com",
            "alt2.aspmx.l.google.com",
            "aspmx2.googlemail.com",
            "aspmx4.googlemail.com",
            "aspmx3.googlemail.com",
            "aspmx5.googlemail.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "xyz@domain1.com",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "aspmx.l.google.com",
            "alt1.aspmx.l.google.com",
            "alt2.aspmx.l.google.com",
            "aspmx2.googlemail.com",
            "aspmx4.googlemail.com",
            "aspmx3.googlemail.com",
            "aspmx5.googlemail.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "abc@domain1.com",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "role_account": "yes",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "aspmx.l.google.com",
            "alt1.aspmx.l.google.com",
            "alt2.aspmx.l.google.com",
            "aspmx2.googlemail.com",
            "aspmx4.googlemail.com",
            "aspmx3.googlemail.com",
            "aspmx5.googlemail.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "123@domain1.com",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "role_account": "yes",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "aspmx.l.google.com",
            "alt1.aspmx.l.google.com",
            "alt2.aspmx.l.google.com",
            "aspmx2.googlemail.com",
            "aspmx4.googlemail.com",
            "aspmx3.googlemail.com",
            "aspmx5.googlemail.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "pop@domain1.com",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "aspmx.l.google.com",
            "alt1.aspmx.l.google.com",
            "alt2.aspmx.l.google.com",
            "aspmx2.googlemail.com",
            "aspmx4.googlemail.com",
            "aspmx3.googlemail.com",
            "aspmx5.googlemail.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "pip@domain1.com",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "aspmx.l.google.com",
            "alt1.aspmx.l.google.com",
            "alt2.aspmx.l.google.com",
            "aspmx2.googlemail.com",
            "aspmx4.googlemail.com",
            "aspmx3.googlemail.com",
            "aspmx5.googlemail.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "user@tempr.email",
        "status": "disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes",
        "role_account": "yes",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "mx.discard.email"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "info@domain2.com",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "role_account": "yes",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "aspmx.l.google.com",
            "alt2.aspmx.l.google.com",
            "alt1.aspmx.l.google.com",
            "aspmx2.googlemail.com",
            "aspmx5.googlemail.com",
            "aspmx3.googlemail.com",
            "aspmx4.googlemail.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "user@gmail.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "gmail-smtp-in.l.google.com",
            "alt1.gmail-smtp-in.l.google.com",
            "alt2.gmail-smtp-in.l.google.com",
            "alt3.gmail-smtp-in.l.google.com",
            "alt4.gmail-smtp-in.l.google.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "op999@gmail.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "gmail-smtp-in.l.google.com",
            "alt1.gmail-smtp-in.l.google.com",
            "alt2.gmail-smtp-in.l.google.com",
            "alt3.gmail-smtp-in.l.google.com",
            "alt4.gmail-smtp-in.l.google.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "user@yahoo.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "mta7.am0.yahoodns.net",
            "mta5.am0.yahoodns.net",
            "mta6.am0.yahoodns.net"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "user1@outlook.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "outlook-com.olc.protection.outlook.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "user2@hotmail.com",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "hotmail-com.olc.protection.outlook.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    }
]

real    0m2.176s
user    0m2.350s
sys     0m0.050s

Bouncify API

Add Bouncify API support

Bouncify API enabled run -api bouncify -apikey_bf $bfkey -tm all with specified email address -e hnyfmw@canadlan-drugs.com. The status, free_email_api, disposable_email_api, role_api, and spamtrap_api JSON field are from API and free_email and disposable_email JSON fields are from local script database checks.

time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api bouncify -apikey_bf $bfkey
[
    {
        "email": "hnyfmw@canadlan-drugs.com",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    }
]

real    0m7.900s
user    0m0.357s
sys     0m0.030s

For email per verification API check for list of emails in emaillist.txt via -l emaillist.txt. The status, free_email_api, disposable_email_api, role_api, and spamtrap_api JSON field are from API and free_email and disposable_email JSON fields are from local script database checks.

Seems to be the slowest API processing time email verification providers tested to date and had a API issues. The diagnostic log shows that Bouncify API marked incorrectly that the user@yahoo.com email address as an accept-all email address and validation for user2@hotmail.com email address timed out. Their API docs at https://bouncify.readme.io/reference/single-validation-api, suggest a 120 concurrent request API limit and that Apart from undeliverable, for the results deliverable, accept-all and unknown do not reject the email address and proceed with your work flow. Both accept-all and unknown emails could not be validated, so they may be valid email address.

2024-05-12 12:44:44,519 - ERROR - Unexpected API response for user2@hotmail.com: {'result': 'Validation timedout', 'success': False}
time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api bouncify -apikey_bf $bfkey
[
    {
        "email": "user@mailsac.com",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes",
        "free_email_api": "yes",
        "disposable_email_api": "yes",
        "role_api": "yes",
        "spamtrap_api": "no"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "deliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "abc@domain1.com",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "123@domain1.com",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "pop@domain1.com",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "pip@domain1.com",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "user@tempr.email",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "free_email_api": "no",
        "disposable_email_api": "yes",
        "role_api": "yes",
        "spamtrap_api": "no"
    },
    {
        "email": "info@domain2.com",
        "status": "deliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "yes",
        "spamtrap_api": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "deliverable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "user@yahoo.com",
        "status": "accept-all",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "deliverable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "api_error",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    }
]

real    3m4.412s
user    0m2.366s
sys     0m0.049s

Re-trying the Hotmail user2@hotmail.com re-tried individually worked without timeouts

time python validate_emails.py -f user@domain1.com -e user2@hotmail.com -tm all -api bouncify -apikey_bf $bfkey
[
    {
        "email": "user2@hotmail.com",
        "status": "deliverable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    }
]

real    0m3.516s
user    0m0.362s
sys     0m0.025s

Bounceless API

Add Bounceless API support

Bounceless API enabled run -api bounceless -apikey_bl $blkey -tm all with specified email address -e hnyfmw@canadlan-drugs.com. The status, reason, free_email_api, disposable_email_api, role_api and accept_all JSON fields are from API and free_email and disposable_email JSON fields are from local script database checks.

This returned a correct status result of no_mx_record as expected, but the 15 email address sample test further below was highly inaccurate for known valid email addresses as you can see.

time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api bounceless -apikey_bl $blkey

[
    {
        "email": "hnyfmw@canadlan-drugs.com",
        "status": "no_mx_record",
        "reason": "no_mx_record",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "accept_all": "no"
    }
]

real    0m2.582s
user    0m0.395s
sys     0m0.022s

For email per verification API check for list of emails in emaillist.txt via -l emaillist.txt. The status, reason, free_email_api, disposable_email_api, role_api and accept_all JSON fields are from API and free_email and disposable_email JSON fields are from local script database checks.

Unfortunately, this has to be the worse email verification result I have received for my sample 15 email addresses compared to all other commercial email verification providers. All the known valid emails are marked as unknown - not 1 valid email address below was marked correctly as valid! I double checked on their web dashboard inputting single known valid email addresses and they return the same incorrect status as below API results gave.

time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api bounceless -apikey_bl $blkey
[
    {
        "email": "user@mailsac.com",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "no_mx_record",
        "reason": "no_mx_record",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "accept_all": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "Invalid Syntax",
        "reason": "Syntax Error",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "abc@domain1.com",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "123@domain1.com",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "pop@domain1.com",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "pip@domain1.com",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "user@tempr.email",
        "status": "invalid",
        "reason": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "free_email_api": "no",
        "disposable_email_api": "yes",
        "role_api": "no",
        "accept_all": "no"
    },
    {
        "email": "info@domain2.com",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "user@yahoo.com",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    }
]

real    0m22.085s
user    0m2.354s
sys     0m0.061s

To confirm and verify, I tested Bounceless's API directly and same result for known valid email address user@gmail.com which returns a result of unknown! Also API response time was very slow for single email verification result at 15.825s and for above 15 email address samples was 22.085s.

time curl -s "https://apps.bounceless.io/api/singlemaildetails?secret=$blkey&email=user@gmail.com" | jq -r

{
  "success": true,
  "accept_all": false,
  "result": "unknown",
  "reason": "unknown",
  "role": true,
  "free": true,
  "disposable": false,
  "user": "",
  "domain": "",
  "email": "user@gmail.com",
  "did_you_mean": null,
  "message": ""
}

real    0m15.825s
user    0m0.028s
sys     0m0.004s

After 1/2 day, I tried retesting Bounceless API against known valid Gmail address, and it seems it fluctuates between a result status of unknown and valid between runs. Maybe it's due to some security mechanisms on Gmail's server end but other commercial provider's APIs have always returned correctly for this known valid Gmail address. Note though the slower API result times >12-15 seconds remain.

time curl -s "https://apps.bounceless.io/api/singlemaildetails?secret=$blkey&email=user@gmail.com" | jq -r
{
  "success": true,
  "accept_all": false,
  "result": "valid",
  "reason": "valid",
  "role": false,
  "free": true,
  "disposable": false,
  "user": "user",
  "domain": "gmail.com",
  "email": "user@gmail.com",
  "did_you_mean": null,
  "message": ""
}

real    0m12.500s
user    0m0.029s
sys     0m0.004s

API Merge

Added support for -apimerge argument which allows you to merge Merging EmailListVerify + MillionVerifier API results together for more accurate email verification results.

The table below shows how long it took to execute and process the verification checks using validate_emails.py and merged APIs. Looks like subsequent runs were faster due to probably primed caches at respective providers' backends.

API Merge Command Processing Time
Per Email Verification 15.946 seconds
Bulk API File Upload 47.536 seconds
Per Email Verification with Xenforo 10.666 seconds
Bulk API File Upload with Xenforo 41.260 seconds

Merging EmailListVerify + MillionVerifier API results for both into one JSON result output for per email verification checks

time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -api millionverifier -apikey_mv $mvkey -apimerge
[
    {
        "email": "user@mailsac.com",
        "elv_status": "disposable",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "yes",
        "mv_status": "disposable",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "yes",
        "mv_free_email_api": false,
        "mv_role_api": true
    },
    {
        "email": "xyz@centmil1.com",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false
    },
    {
        "email": "user+to@domain1.com",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false
    },
    {
        "email": "user@tempr.email",
        "elv_status": "disposable",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "yes",
        "mv_status": "disposable",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "yes",
        "mv_free_email_api": false,
        "mv_role_api": true
    },
    {
        "email": "info@domain2.com",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": true
    },
    {
        "email": "xyz@domain1.com",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false
    },
    {
        "email": "abc@domain1.com",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": true
    },
    {
        "email": "123@domain1.com",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false
    },
    {
        "email": "pop@domain1.com",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false
    },
    {
        "email": "pip@domain1.com",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false
    },
    {
        "email": "user@gmail.com",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false
    },
    {
        "email": "op999@gmail.com",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false
    },
    {
        "email": "user@yahoo.com",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false
    },
    {
        "email": "user1@outlook.com",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false
    },
    {
        "email": "user2@hotmail.com",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false
    }
]

real    0m15.946s
user    0m1.017s
sys     0m0.037s

Merging EmailListVerify + MillionVerifier API results for both into one JSON result output for bulk API file upload checks -apibulk

time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -apibulk emaillistverify -api millionverifier -apikey_mv $mvkey -apibulk millionverifier -apimerge

[
    {
        "email": "user@mailsac.com",
        "elv_status": "disposable",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "yes",
        "mv_status": "disposable",
        "mv_free_email": "yes",
        "mv_disposable_email": "yes",
        "mv_free_email_api": "no",
        "mv_role_api": "yes"
    },
    {
        "email": "xyz@centmil1.com",
        "elv_status": "dead_server",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no"
    },
    {
        "email": "user+to@domain1.com",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no"
    },
    {
        "email": "user@tempr.email",
        "elv_status": "disposable",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "yes",
        "mv_status": "disposable",
        "mv_free_email": "no",
        "mv_disposable_email": "yes",
        "mv_free_email_api": "no",
        "mv_role_api": "yes"
    },
    {
        "email": "info@domain2.com",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "yes"
    },
    {
        "email": "xyz@domain1.com",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no"
    },
    {
        "email": "abc@domain1.com",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "yes"
    },
    {
        "email": "123@domain1.com",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no"
    },
    {
        "email": "pop@domain1.com",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no"
    },
    {
        "email": "pip@domain1.com",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no"
    },
    {
        "email": "user@gmail.com",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no"
    },
    {
        "email": "op999@gmail.com",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no"
    },
    {
        "email": "user@yahoo.com",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "unknown",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no"
    },
    {
        "email": "user1@outlook.com",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no"
    },
    {
        "email": "user2@hotmail.com",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no"
    }
]

real    0m47.536s
user    0m0.612s
sys     0m0.021s

Merging EmailListVerify + MillionVerifier API results for both into one JSON result output for per email verification checks + Xenforo flags

time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -api millionverifier -apikey_mv $mvkey -apimerge -xf -xfdb xenforo -xfprefix xf_

[
    {
        "email": "user@mailsac.com",
        "elv_status": "disposable",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "yes",
        "mv_status": "disposable",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "yes",
        "mv_free_email_api": false,
        "mv_role_api": true,
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@mailsac.com'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@mailsac.com'\\G\" xenforo"
    },
    {
        "email": "xyz@centmil1.com",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false,
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@centmil1.com'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@centmil1.com'\\G\" xenforo"
    },
    {
        "email": "user+to@domain1.com",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false
    },
    {
        "email": "user@tempr.email",
        "elv_status": "disposable",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "yes",
        "mv_status": "disposable",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "yes",
        "mv_free_email_api": false,
        "mv_role_api": true,
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@tempr.email'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@tempr.email'\\G\" xenforo"
    },
    {
        "email": "info@domain2.com",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": true
    },
    {
        "email": "xyz@domain1.com",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false,
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@domain1.com'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@domain1.com'\\G\" xenforo"
    },
    {
        "email": "abc@domain1.com",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": true,
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'abc@domain1.com'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'abc@domain1.com'\\G\" xenforo"
    },
    {
        "email": "123@domain1.com",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false,
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '123@domain1.com'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '123@domain1.com'\\G\" xenforo"
    },
    {
        "email": "pop@domain1.com",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false,
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pop@domain1.com'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pop@domain1.com'\\G\" xenforo"
    },
    {
        "email": "pip@domain1.com",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false,
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pip@domain1.com'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pip@domain1.com'\\G\" xenforo"
    },
    {
        "email": "user@gmail.com",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false
    },
    {
        "email": "op999@gmail.com",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false,
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'op999@gmail.com'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'op999@gmail.com'\\G\" xenforo"
    },
    {
        "email": "user@yahoo.com",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false
    },
    {
        "email": "user1@outlook.com",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false
    },
    {
        "email": "user2@hotmail.com",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false
    }
]

real    0m10.666s
user    0m1.008s
sys     0m0.034s

Merging EmailListVerify + MillionVerifier API results for both into one JSON result output for bulk API file upload checks -apibulk + Xenforo flags

time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -apibulk emaillistverify -api millionverifier -apikey_mv $mvkey -apibulk millionverifier -apimerge -xf -xfdb xenforo -xfprefix xf_

[
    {
        "email": "user@mailsac.com",
        "elv_status": "disposable",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "yes",
        "mv_status": "disposable",
        "mv_free_email": "yes",
        "mv_disposable_email": "yes",
        "mv_free_email_api": "no",
        "mv_role_api": "yes",
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@mailsac.com'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@mailsac.com';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@mailsac.com'\\G\" xenforo"
    },
    {
        "email": "xyz@centmil1.com",
        "elv_status": "dead_server",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no",
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@centmil1.com'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@centmil1.com';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@centmil1.com'\\G\" xenforo"
    },
    {
        "email": "user+to@domain1.com",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no"
    },
    {
        "email": "user@tempr.email",
        "elv_status": "disposable",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "yes",
        "mv_status": "disposable",
        "mv_free_email": "no",
        "mv_disposable_email": "yes",
        "mv_free_email_api": "no",
        "mv_role_api": "yes",
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@tempr.email'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'user@tempr.email';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'user@tempr.email'\\G\" xenforo"
    },
    {
        "email": "info@domain2.com",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "yes"
    },
    {
        "email": "xyz@domain1.com",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no",
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@domain1.com'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'xyz@domain1.com';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'xyz@domain1.com'\\G\" xenforo"
    },
    {
        "email": "abc@domain1.com",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "yes",
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'abc@domain1.com'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'abc@domain1.com';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'abc@domain1.com'\\G\" xenforo"
    },
    {
        "email": "123@domain1.com",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no",
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '123@domain1.com'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '123@domain1.com';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '123@domain1.com'\\G\" xenforo"
    },
    {
        "email": "pop@domain1.com",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no",
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pop@domain1.com'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pop@domain1.com';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pop@domain1.com'\\G\" xenforo"
    },
    {
        "email": "pip@domain1.com",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no",
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pip@domain1.com'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'pip@domain1.com';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'pip@domain1.com'\\G\" xenforo"
    },
    {
        "email": "user@gmail.com",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no"
    },
    {
        "email": "op999@gmail.com",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no",
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'op999@gmail.com'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = 'op999@gmail.com';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = 'op999@gmail.com'\\G\" xenforo"
    },
    {
        "email": "user@yahoo.com",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no"
    },
    {
        "email": "user1@outlook.com",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no"
    },
    {
        "email": "user2@hotmail.com",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no"
    }
]

real    0m41.260s
user    0m0.581s
sys     0m0.033s

API Merge Filters

For API merged results, if you ran the commands and piped them into a results.txt file, you can then query and filter them using jq tool for different combinations of elv_status and mv_status values as follows:

  1. Find good emails, filter good emails where elv_status is "valid" and mv_status is "ok":
cat results.txt | jq '.[] | select(.elv_status == "valid" and .mv_status == "ok")'
cat results.txt | jq '.[] | select(.elv_status == "valid" and .mv_status == "ok")'
{
  "email": "user+to@domain1.com",
  "elv_status": "valid",
  "elv_status_code": "",
  "elv_free_email": "no",
  "elv_disposable_email": "no",
  "mv_status": "ok",
  "mv_free_email": "no",
  "mv_disposable_email": "no",
  "mv_free_email_api": "no",
  "mv_role_api": "no"
}
{
  "email": "info@domain2.com",
  "elv_status": "valid",
  "elv_status_code": "",
  "elv_free_email": "no",
  "elv_disposable_email": "no",
  "mv_status": "ok",
  "mv_free_email": "no",
  "mv_disposable_email": "no",
  "mv_free_email_api": "no",
  "mv_role_api": "yes"
}
{
  "email": "user@gmail.com",
  "elv_status": "valid",
  "elv_status_code": "",
  "elv_free_email": "yes",
  "elv_disposable_email": "no",
  "mv_status": "ok",
  "mv_free_email": "yes",
  "mv_disposable_email": "no",
  "mv_free_email_api": "yes",
  "mv_role_api": "no"
}
{
  "email": "user1@outlook.com",
  "elv_status": "valid",
  "elv_status_code": "",
  "elv_free_email": "yes",
  "elv_disposable_email": "no",
  "mv_status": "ok",
  "mv_free_email": "yes",
  "mv_disposable_email": "no",
  "mv_free_email_api": "yes",
  "mv_role_api": "no"
}
{
  "email": "user2@hotmail.com",
  "elv_status": "valid",
  "elv_status_code": "",
  "elv_free_email": "yes",
  "elv_disposable_email": "no",
  "mv_status": "ok",
  "mv_free_email": "yes",
  "mv_disposable_email": "no",
  "mv_free_email_api": "yes",
  "mv_role_api": "no"
}
  1. Find bad emails, filter emails where elv_status is "invalid" and mv_status is "invalid":
cat results.txt | jq '.[] | select(.elv_status == "invalid" and .mv_status == "invalid")'
  1. Filter emails where elv_status is "valid" but mv_status is not "ok":

This filters for if you ran MillionVerifier bulk API and there is a bug in unknown status, you can use EmailListVerify API to double check it's status.

cat results.txt | jq '.[] | select(.elv_status == "valid" and .mv_status != "ok")'
cat results.txt | jq '.[] | select(.elv_status == "valid" and .mv_status != "ok")'
{
  "email": "user@yahoo.com",
  "elv_status": "valid",
  "elv_status_code": "",
  "elv_free_email": "yes",
  "elv_disposable_email": "no",
  "mv_status": "unknown",
  "mv_free_email": "yes",
  "mv_disposable_email": "no",
  "mv_free_email_api": "yes",
  "mv_role_api": "no"
}
  1. Filter emails where elv_status is not "valid" but mv_status is "ok":

This would be the reverse of previous check, to double check EmailListVerify's result against MillionVerifier

cat results.txt | jq '.[] | select(.elv_status != "valid" and .mv_status == "ok")'
  1. Filter bad emails where elv_status is not "valid" and mv_status is not "ok":
cat results.txt | jq '.[] | select(.elv_status != "valid" and .mv_status != "ok")'
  1. Filter emails where elv_status is "disposable" and mv_status is "disposable":
cat results.txt | jq '.[] | select(.elv_status == "disposable" and .mv_status == "disposable")'
  1. Filter emails where elv_status is "unknown" and mv_status is "unknown":
cat results.txt | jq '.[] | select(.elv_status == "unknown" and .mv_status == "unknown")'
  1. Filter emails where either elv_status or mv_status is "invalid":
cat results.txt | jq '.[] | select(.elv_status == "invalid" or .mv_status == "invalid")'
  1. Filter emails where either elv_status or mv_status is "disposable":
cat results.txt | jq '.[] | select(.elv_status == "disposable" or .mv_status == "disposable")'
  1. Filter emails where either elv_status or mv_status is "unknown":
cat results.txt | jq '.[] | select(.elv_status == "unknown" or .mv_status == "unknown")'
  1. Filter emails where elv_status is "valid" and mv_status is "unknown":

This filters for if you ran MillionVerifier bulk API and there is a bug in unknown status, you can use EmailListVerify API to double check it's status.

cat results.txt | jq '.[] | select(.elv_status == "valid" and .mv_status == "unknown")'
cat results.txt | jq '.[] | select(.elv_status == "valid" and .mv_status == "unknown")'
{
  "email": "user@yahoo.com",
  "elv_status": "valid",
  "elv_status_code": "",
  "elv_free_email": "yes",
  "elv_disposable_email": "no",
  "mv_status": "unknown",
  "mv_free_email": "yes",
  "mv_disposable_email": "no",
  "mv_free_email_api": "yes",
  "mv_role_api": "no"
}

These jq queries cover various combinations of elv_status and mv_status values, allowing you to filter the results.txt file based on different criteria. You can adjust the specific status values in the queries according to your needs and the available status values in the results.txt file.

Remember to replace results.txt with the actual path to your file if it's located in a different directory.

Cloudflare HTTP Forward Proxy Cache With KV Storage

validate_emails.py script's EmailListVerify, MillionVerifier and Zerobounce per email check API routines has been updated to support a custom Cloudflare HTTP forward proxy Worker cache configuration which can take the script's API request and forward it to EmailListVerify's API endpoint. The Cloudflare Worker script will then save the API result into Cloudflare KV storage on their edge servers and save with a date timestamp. This can potentially reduce your overall EmailListVerify per email verification costs if you need to run validate_emails.py a few times back to back bypassing having to need to call validate_emails.py API itself.

validate_emails.py script added -apicache, -apicachettl, -apicache-purge and -apicachecheck arguments:

  • -apicache this sets the Cloudflare Worker's cacheKey and allows extending caching to other API providers in future. For now supported value are emaillistverify and zerobounce which will end up creating the cacheKey in Worker const cacheKey = ${apiCache}:${email}; for lookups etc.
  • -apicachecheck takes count or list or purge option to query the Cloudflare KV storage cache to count number of cached entries or list the entries themselves or purge Cloudflare CDN/KV stores in cache.
  • -apicache-purge will purge Cloudflare CDN/KV cache when -apicachecheck set to purge options to query the
  • -apicachettl this sets the cache TTL duration in seconds for how long Cloudflare CDN/KV stores in cache. Default value is 300s or 5mins

One usage case for this would be if you verify a list of 1,000 email addresses and in a short amount of time (i.e. 24hrs) have an additional 500 email addresses added to the email list to total 1,500 emails. Then if you had originally verified the list with -apicache and -apicachettl 172800 parameters, and did a second verification run, the original 1,000 email addresses would of already been stored in Cloudflare CDN and/or Cloudflare Worker KV storage caching so would not result in an API request/costs. Leaving only the 500 new email addresses resulting in an API request/costs. However, you would get a full JSON formatted result output for all 1,500 email addresses - ready for further processing/manipulation etc. Of course, you can also just have 2 separate verification runs for 1,000 emails and then for 500 emails and have 2 separate JSON formatted result outputs to work with which you can combine etc.

Another usage case is in case of email duplication in your lists. If you have the email address referenced multiple times in an email list, then using -apicache and -apicachettl 172800 parameters like parameters for first verification run, would allow it process and detect duplicates on second run via the Cloudflare CDN / Worker KV cached return results rather than make needless duplicate API request calls which would cost money. A lot of email verification providers offer email list deduplication as a built in feature while others offer it for additional costs. But with Cloudflare CDN / Worker KV caching in place, you wouldn't need to worry about the email verification provider's support for email deduplication. Thus saving your money $$$$$!

Examples to illustrate how the Cloudflare HTTP forward proxy caching KV worker workers for testing email address hnyfmw5@canadlan-drugs.com

Via direct EmailListVerify API call returns email address status = unknown

curl -s "https://apps.emaillistverify.com/api/verifyEmail?secret=$elvkey&email=hnyfmw5@canadlan-drugs.com&timeout=15"
unknown

Uncached usual run via the script usual result response would be unknown

time python validate_emails.py -f user@domain1.com -e hnyfmw5@canadlan-drugs.com -tm all -api emaillistverify -apikey $elvkey
[
    {
        "email": "hnyfmw5@canadlan-drugs.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "no"
    }
]

real    0m2.600s
user    0m0.279s
sys     0m0.020s

Via Cloudflare HTTP forward proxy caching KV worker with -apicachettl 120 argument set returns email address status = unknown reducing time to return the result from 2.6s to 0.397s

time python validate_emails.py -f user@domain1.com -e hnyfmw5@canadlan-drugs.com -tm all -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120
[
    {
        "email": "hnyfmw5@canadlan-drugs.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "no"
    }
]

real    0m0.397s
user    0m0.294s
sys     0m0.025s

Log inspection

cat email_verification_log_2024-05-08_15-08-05.log | tail -3
2024-05-08 15:08:06,816 - INFO - Checking cache for email: hnyfmw5@canadlan-drugs.com
2024-05-08 15:08:07,047 - INFO - Cache check response status code: 200
2024-05-08 15:08:07,047 - INFO - Cache result: unknown

Testing Cloudflare HTTP forward proxy caching KV worker directly

curl -s "https://cfcachedomain.com/?email=hnyfmw5@canadlan-drugs.com&cachettl=120"
unknown

Cloudflare HTTP forward proxy caching KV worker console logged

[DEBUG] Incoming request: https://cfcachedomain.com/?email=hnyfmw5@canadlan-drugs.com&cachettl=120
[DEBUG] Email: hnyfmw5@canadlan-drugs.com
[DEBUG] Cache Key: emaillistverify:hnyfmw5@canadlan-drugs.com
[DEBUG] Cache TTL: 120
[DEBUG] Cache Check: null
[DEBUG] API URL: https://apps.emaillistverify.com/api/verifyEmail?secret=APIKEY&email=hnyfmw5@canadlan-drugs.com&timeout=15
[DEBUG] Response from Cloudflare CDN cache: Hit
[DEBUG] Skipping KV cache update as response is served from Cloudflare CDN cache
[DEBUG] Returning final response with headers: {"cache-control":"max-age=120","content-type":"text/plain"}

Check how many KV storage cached email result entries there are

curl -s "https://cfcachedomain.com/?apicachecheck=count" | jq -r
{
  "count": 1
}

Query the actual KV storage cached email address entries including the cache age

curl -s "https://cfcachedomain.com/?apicachecheck=list" | jq -r
[
  {
    "email": "hnyfmw5@canadlan-drugs.com",
    "result": "unknown",
    "timestamp": 1715175271549,
    "age": 16,
    "ttl": 120
  }
]

Query the KV storage cache entries count via -apicachecheck count

time python validate_emails.py -f user@domain1.com -e hnyfmw5@canadlan-drugs.com -tm all -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120 -apicachecheck count

API cache count: 1

Query the KV storage cache entries listings via -apicachecheck list

time python validate_emails.py -f user@domain1.com -e hnyfmw5@canadlan-drugs.com -tm all -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120 -apicachecheck list

API cache list:
{'email': 'hnyfmw5@canadlan-drugs.com', 'result': 'unknown', 'timestamp': 1715175271549, 'age': 16, 'ttl': 120}

Cloudflare KV storage entries

Key Value
emaillistverify:hnyfmw5@canadlan-drugs.com {"result":"unknown","timestamp":1715175271549,"ttl":120}

MillionVerifier Cloudflare Cache Support

May 17, 2023 added MillionVerifier Cloudflare cache support.

For MillionVerifier per email check API -api millionverifier -apikey_mv $mvkey with Cloudflare Cache -apicache millionverifier -apicachettl 120. Added api_response_time and api_thread_number JSON fields which measure the response time from Cloudflare Worker KV cached storage/store or Cloudflare CDN cache.

Note: updated MillionVerifier API JSON response to also report API returned subresult value.

time python validate_emails.py -f user@domain1.com -e hnyfmw2@canadlan-drugs.com -tm all -api millionverifier -apikey_mv $mvkey -apicache millionverifier -apicachettl 120
[
    {
        "email": "hnyfmw2@canadlan-drugs.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "api_response_time": 0.0001,
        "api_thread_number": "cached",
        "free_email_api": "no",
        "role_api": "no",
        "subresult": "dns_error"
    }
]

real    0m0.776s
user    0m0.271s
sys     0m0.021s

Compared with uncached regular API response where MillionVerifier's API api_response_time = 0.2962 seconds compared to Cloudflare cached api_response_time = 0.001 seconds. While validate_emails.py script time difference was 0.776s cached vs 1.631s uncached.

time python validate_emails.py -f user@domain1.com -e hnyfmw2@canadlan-drugs.com -tm all -api millionverifier -apikey_mv $mvkey
[
    {
        "email": "hnyfmw2@canadlan-drugs.com",
        "status": "invalid",
        "subresult": "dns_error",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false,
        "api_response_time": 0.2962,
        "api_thread_number": "thread-pool-0_0"
    }
]

real    0m1.631s
user    0m0.356s
sys     0m0.025s

ZeroBounce Cloudflare Cache Support

For ZeroBounce per email check API -api zerobounce -apikey_zb $zbkey with Cloudflare Cache -apicache zerobounce -apicachettl 900

time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -api zerobounce -apikey_zb $zbkey -tm all -apicache zerobounce -apicachettl 900
[
    {
        "email": "hnyfmw@canadlan-drugs.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "api_response_time": 0.0,
        "api_thread_number": "cached"
    }
]

real    0m0.784s
user    0m0.260s
sys     0m0.027s

Log inspection

cat logs/$(ls -Art logs | tail -3 | grep 'email_verification')                                       
2024-05-17 00:19:14,801 - INFO - Making cache check request to: https://cfworkerdomain.com?email=hnyfmw%40canadlan-drugs.com&cachettl=900&apicache=zerobounce
2024-05-17 00:19:14,986 - INFO - Cache result: {'address': 'hnyfmw@canadlan-drugs.com', 'status': 'invalid', 'sub_status': 'no_dns_entries', 'free_email': False, 'did_you_mean': None, 'account': 'hnyfmw', 'domain': 'canadlan-drugs.com', 'domain_age_days': '2032', 'smtp_provider': '', 'mx_found': 'false', 'mx_record': '', 'firstname': None, 'lastname': None, 'gender': None, 'country': None, 'region': None, 'city': None, 'zipcode': None, 'processed_at': '2024-05-17 00:08:48.644'}

Compared to regular non-cached ZeroBounce API request with api_response_time = 0.159 seconds using api_thread_number thread pool = 0_0. While validate_emails.py script time difference was 0.784s cached vs 4.501s uncached.

time python validate_emails.py -f user@domain1.com -e hnyfmw@canadlan-drugs.com -tm all -api zerobounce -apikey_zb $zbkey
[
    [
        {
            "email": "hnyfmw@canadlan-drugs.com",
            "status": "invalid",
            "sub_status": "no_dns_entries",
            "status_code": null,
            "free_email": "no",
            "disposable_email": "no",
            "free_email_api": "no",
            "api_response_time": 0.158,
            "api_thread_number": "thread-pool-0_0"
        }
    ]
]

real    0m4.501s
user    0m0.353s
sys     0m0.027s

Cloudflare Cache Purge Support

Add support to purge Cloudflare KV storage via -apicache-purge -apicachecheck purge when combined with -apicache emaillistverify

python validate_emails.py -f user@domain1.com -l emaillist.txt -apicache-purge -apicache emaillistverify -apicachecheck purge

Cache purged successfully

Run with -apicachecheck count to report the number of cached entries in Cloudflare KV storage after cache purge:

python validate_emails.py -f user@domain1.com -l emaillist.txt -apicache-purge -apicache emaillistverify -apicachecheck count

API cache count: {'bulk_count': 0, 'email_count': 0}

EmailListVeirfy Bulk File API Cloudflare Cache Support

Add Cloudflare cache support to EmailListVerify's bulk file API routine via -apicache emaillistverify -apicachettl 120 and ran it 3 times - for unprimed cache and primed cached run for 2nd and 3rd runs to compare time to completion. Cloudflare HTTP forward proxy KV cache Worker reduced times from 40.771s to 2.078s.

Run Compeletion Time
1st Bulk File API Run uncached 40.771s
2nd Bulk File API Run cached 2.292s
3rd Bulk File API Run cached 2.078s

Example 1st EmailListVerify bulk API unprimed Cloudflare Worker cache run timed:

time python validate_emails.py -f user@domain1.com -l emaillist.txt -api emaillistverify -apikey $elvkey -apibulk emaillistverify -apicache emaillistverify -apicachettl 120 -tm all
[
    {
        "email": "user@mailsac.com",
        "status": "disposable",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "dead_server",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "valid",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@tempr.email",
        "status": "disposable",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "info@domain2.com",
        "status": "valid",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "abc@domain1.com",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "123@domain1.com",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pop@domain1.com",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pip@domain1.com",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "valid",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user@yahoo.com",
        "status": "valid",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "valid",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "valid",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    }
]

real    0m40.771s
user    0m0.469s
sys     0m0.019s

Inspecting logs

cat $(ls -Art | tail -3 | grep 'email_verification')                                             
2024-05-10 09:59:28,893 - INFO - File MIME type: text/plain
2024-05-10 09:59:29,050 - INFO - Request data: {'filename': 'emaillist_20240510095928.txt'}
2024-05-10 09:59:29,050 - INFO - File data: {'file_contents': ('emaillist_20240510095928.txt', <_io.BufferedReader name='emaillist.txt'>, 'text/plain')}
2024-05-10 09:59:30,258 - INFO - File uploaded successfully. File ID: 2408431
2024-05-10 09:59:30,538 - INFO - File processing in progress. Status: progress
2024-05-10 09:59:36,056 - INFO - File processing in progress. Status: progress
2024-05-10 09:59:41,604 - INFO - File processing in progress. Status: progress
2024-05-10 09:59:47,171 - INFO - File processing in progress. Status: progress
2024-05-10 09:59:52,687 - INFO - File processing in progress. Status: progress
2024-05-10 09:59:57,959 - INFO - File processing in progress. Status: progress
2024-05-10 10:00:03,519 - INFO - File processing in progress. Status: progress
2024-05-10 10:00:08,927 - INFO - File processing completed. Retrieving results from: https://files-elv.s3.eu-central-1.amazonaws.com/2024-05/5b1ab4d47750dd66625245e1a0645328f93e8abc_all.csv
2024-05-10 10:00:09,259 - INFO - Results file downloaded: emaillistverify_results_1715335169.csv
2024-05-10 10:00:09,456 - INFO - Bulk file results cached in Cloudflare
2024-05-10 10:00:09,456 - INFO - Results retrieved successfully. Total lines: 15

Example 2nd EmailListVerify bulk API primed Cloudflare Worker cache run timed:

time python validate_emails.py -f user@domain1.com -l emaillist.txt -api emaillistverify -apikey $elvkey -apibulk emaillistverify -apicache emaillistverify -apicachettl 120 -tm all
[
    {
        "email": "user@mailsac.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "invalid_syntax",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@tempr.email",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "info@domain2.com",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "abc@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "123@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pop@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pip@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user@yahoo.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

real    0m2.292s
user    0m0.533s
sys     0m0.022s

Log inspection shows bulk file API upload process was skipped as all email addresses in bulk file -l emaillist.txt passed on command line were found in Cloudflare cache.

cat $(ls -Art | tail -3 | grep 'email_verification')                                             
2024-05-10 10:34:03,308 - INFO - File MIME type: text/plain
2024-05-10 10:34:05,392 - INFO - All email results found in cache. Skipping file upload.

Example 3rd EmailListVerify bulk API primed Cloudflare Worker cache run timed:

time python validate_emails.py -f user@domain1.com -l emaillist.txt -api emaillistverify -apikey $elvkey -apibulk emaillistverify -apicache emaillistverify -apicachettl 120 -tm all
[
    {
        "email": "user@mailsac.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "invalid_syntax",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@tempr.email",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "info@domain2.com",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "abc@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "123@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pop@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pip@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user@yahoo.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

real    0m2.078s
user    0m0.527s
sys     0m0.038s

Log inspection shows bulk file API upload process was skipped as all email addresses in bulk file -l emaillist.txt passed on command line were found in Cloudflare cache.

cat $(ls -Art | tail -3 | grep 'email_verification')                                             
2024-05-10 10:34:10,862 - INFO - File MIME type: text/plain
2024-05-10 10:34:12,724 - INFO - All email results found in cache. Skipping file upload.

EmailListVerify API Check Times: Regular vs Cached

This table presents a side-by-side comparison of the time taken for regular and cached EmailListVerify API checks. Testing Cloudflare HTTP Forward Proxy Cache With KV Storage with EmailListVerify per email check API. Ran the same 15 emails emaillist.txt test and timed the 3 runs each.

First cached email verification checks are slower due to priming the cache overhead. While subseqent cached runs were much faster compared to uncached regular email verification checks.

Run Regular Time Cached Time
1st Run 5.102s 5.437s
2nd Run 3.146s 1.029s
3rd Run 3.248s 0.944s

Regular uncached run 1

time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey
[
    {
        "email": "user@mailsac.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "abc@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "123@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pop@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pip@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@tempr.email",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "info@domain2.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user@yahoo.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

real    0m5.102s
user    0m0.299s
sys     0m0.026s

Regular uncached run 2

time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey
[
    {
        "email": "user@mailsac.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "abc@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "123@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pop@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pip@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@tempr.email",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "info@domain2.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user@yahoo.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

real    0m3.146s
user    0m0.303s
sys     0m0.022s

Regular uncached run 3

time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey
[
    {
        "email": "user@mailsac.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "abc@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "123@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pop@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pip@domain1.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@tempr.email",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "info@domain2.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user@yahoo.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

real    0m3.248s
user    0m0.296s
sys     0m0.030s

Cached run 1

time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120
[
    {
        "email": "user@mailsac.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "invalid_syntax",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "abc@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "123@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pop@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pip@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@tempr.email",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "info@domain2.com",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user@yahoo.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

real    0m5.437s
user    0m2.339s
sys     0m0.044s

Cached run 2

time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120
[
    {
        "email": "user@mailsac.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "invalid_syntax",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "abc@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "123@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pop@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pip@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@tempr.email",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "info@domain2.com",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user@yahoo.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

real    0m1.029s
user    0m2.373s
sys     0m0.043s

Cached run 3

time python validate_emails.py -f user@domain1.com -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120
[
    {
        "email": "user@mailsac.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "xyz@centmil1.com",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user+to@domain1.com",
        "status": "invalid_syntax",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "xyz@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "abc@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "123@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pop@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "pip@domain1.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@tempr.email",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "info@domain2.com",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "user@gmail.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "op999@gmail.com",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user@yahoo.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user1@outlook.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "user2@hotmail.com",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

real    0m0.944s
user    0m2.316s
sys     0m0.050s

PHP Wrapper

Created a simplistic PHP wrapper script to call validate_emails.py from that can test multiple email verification API providers as well as local non-API tests for a single inputted email address. The PHP wrapper will also time how long it takes to return an email verification check's JSON response. This was tested on a PHP 8.3.6 based Centmin Mod LEMP stack server.

Provider Completion Time
Local (Non-API) 0.516784s
EmailListVerify 2.96s
MillionVerifier 0.84s
CaptainVerify 21.96s
Proofy.io 31.77s (API error, ran out of credits)
MyEmailVerifier 3.09s
Zerobounce 0.68s
Reoon 0.72s
Bouncify 1.04s

First one is local non-API test = 0.516784s

Email verification PHP Wrapper script

EmailListVerify = 2.96s

Email verification PHP Wrapper script

MillionVerifier = 0.84s

Email verification PHP Wrapper script

CaptainVerify = 21.96s

Email verification PHP Wrapper script

Proofy.io = 31.77s for api_error ran out of credits right now

Email verification PHP Wrapper script

MyEmailVerifier = 3.09s

Email verification PHP Wrapper script

Zerobounce = 0.68s

Email verification PHP Wrapper script

Reoon = 0.72s

Email verification PHP Wrapper script

Bouncify = 1.04s

Email verification PHP Wrapper script

PHP Wrapper With Cloudflare Cache And S3 Store Support

Updated PHP wrapper script with single and multiple email support via validate_emails.py per email verification routines and added validate_emails.py supported Cloudflare Cache (enabled for EmailListVerify and Zerobounce) and also support for S3 storage to store email verification results to either Amazon AWS S3 or Cloudflare R2 object storage buckets.

Note: Timings reported include time for S3 storage - in this case saving to Cloudflare R2 bucket

Single email address EmailListVerify runs including a debug run

Email verification PHP Wrapper script with Cloudflare Cache & S3 storage support

Email verification PHP Wrapper script with Cloudflare Cache & S3 storage support

Email verification PHP Wrapper script with Cloudflare Cache & S3 storage support

Multiple email addresses EmailListVerify runs including a debug run

Email verification PHP Wrapper script with Cloudflare Cache & S3 storage support

Email verification PHP Wrapper script with Cloudflare Cache & S3 storage support

Email verification PHP Wrapper script with Cloudflare Cache & S3 storage support

About

Self-hosted email verification script to clean up bad invalid email address lists. Supports various commercial email verification provider APIs all in one script