Dynamic Image Delivery with CloudFront

Tweet

Images can cause major headaches for web app developers, especially if your app allows users to upload their own images. They are problematic for two reasons:

Images are Bulky
Compared to most other types of data you store (other than video), images take the most space.

Images Need to be Resized
For both aesthetic and performance reasons, images must be resized for use in different parts of your application. You need thumbnails, headers, inline-floats, and detailed zoom versions of your images.

In the past, I’ve developed all kinds of solutions to solve this problem. My original solution was to store 10 different sizes of every image, each created at the time of upload. That worked okay, but it was a killer on disk space and it wasn’t always as flexible as I needed it to be. If I needed a new image size I had to resize every existing image in the system. What a pain.

A Better Solution

With CloudFront, there’s a better way. I’ll show you how to put it together, but first I want to show you how you’ll use it (that’s the fun part, right?)

Here’s the scenario: You upload an image to your server called “Penguins.jpg” that is 1024 x 768 pixels. You want to use that image as a thumbnail that’s 80 pixels square– what do you do?

Using the original image obviously won’t work. It’s just way too big.

With the solution I will demonstrate, all you need to do is reference following URL in your source:

 <img src="//dynamiccdn.example.com/maxD_80/imagestore/Penguins.jpg" alt="" /> 

That was easy! Simply prefixing the name of the image with “maxD_80″ automatically resized it down to a maximum width of 80 pixels on its longest side.

That’s okay, but what if you want to use a square thumbnail as background image and you want to make sure wide or tall images don’t have white spaces on the edge? Easy solution:

 <img src="//dynamiccdn.example.com/minD_80/imagestore/Penguins.jpg" alt="" /> 

Now we’re talking! Using “minD_80″ instead of “maxD_80″ results in an image that is as small as possible, but keeping the smallest side at least 80 pixels. Now it looks perfect!

Cool… but how?

You’ll be surprised how simple the solution is– all thanks to cloud computing. Here’s what you’re going to need.

  • An Amazon Web Services account with CloudFront enabled
  • A web server running Apache (you can do it on Windows too with some extra work)
  • A little bit of PHP skill (Can you copy and paste?)

Web Server Setup

Directory: imagestore
Start by creating a directory called “imagestore” in the root of your web. This is where you’re going to store all the “original” images. You can organize them any way you want within this folder. For now, put a few large jpg files in there for testing.

.htaccess File
You need to add a few lines in the .htaccess file in the root of your web (just create the file if it doesn’t exist):

RewriteEngine On 
RewriteCond %{QUERY_STRING} (.*) 
RewriteRule ^([^/]*)/imagestore/(.*).(jpg|jpeg)$ image.php?format=$1&amp;path=imagestore/$2.$3

This code tells the server to send any request for jpg images in the “imagestore” directory (or any of its sub-directories) to the “image.php” file (which we’ll create next).

PHP File: image.php
Create this file in the root of your web. This file is going to do all the work of handling requests for formatted images.

The Code

Let’s walk through it a step at a time. To keep things simple we’re going to assume all of your images are jpg format. All of the following code snippets go right in the image.php file you just created.

Let’s start by picking up the querystring variables (format and path) being submitted by the rewrite rule we previously added to our .htaccess file:

$path = $_GET['path'];
$formats = explode(',', $_GET['format']); 

 

We’re creating an array (using explode) out of the format. This will allow us to piggyback any number of formatting commands on a single image by separating each one with a comma in the URL.

Now create the image object using the $path variable we just created:

 $image = imagecreatefromjpeg($path); 

 

Add some important headers. These headers tell the browser that the file you’re providing is a jpg image and it sets the expiration far into the future so the browser will cache the image for as long as possible:

header("Content-Type: image/jpeg"); 
header("Cache-control: Public"); 
$headerTimeOffset = 60 * 60 * 24 * 30; 
$headeExpire = "Expires: ".gmdate("D, d M Y H:i:s",time()+$headerTimeOffset)." GMT"; 
header ($headeExpire); 

 

Next we’ll loop through the format array we created before and apply the image formatting function (formatImage) which we’ll create soon.

foreach ($formats as $format) { 
	$image = formatImage($format, $image); 
} 

 

Last, output the image and destroy the object:

 imagejpeg($image, Null, 100); 
imagedestroy($image); 

 

Okay… we’re getting close. Let’s look at three simple functions that work together to get the results we want. I’ve added some comments so you can walk through and see what’s happening, but if you just want to get it working all you need to do is copy and paste:

// Translates commands (like maxD_80 or minD_40) from your URL
// into the correct resampling functions.
function formatImage($format, $image) {
	// Get the original image sizes.
	$curW = imagesx($image);
	$curH = imagesy($image);
	// Split the format into parts separeted by "_"
	$formatParts = explode("_", $format);
	switch ($formatParts[0]) {
		// If the format command is maxD, resize the image
		// so that the largest side is the specified
		// number of pixels ($formatParts[1])
		case "maxD":
			if ($curW &gt; $curH) {
				$ratio = $curH / $curW;
				$newW = (int) maxProtect($formatParts[1]);
				$newH = (int) (maxProtect($formatParts[1]) * $ratio);
			} else {
				$ratio = $curW / $curH;
				$newW = (int) (maxProtect($formatParts[1]) * ratio);
				$newH = (int) maxProtect($formatParts[1]);
			}
			$image = resizeImage($image, $newW, $newH);
			break;
		// If the format command is minD, resize the image
		// so that the smallest side is the specified
		// number of pixels ($formatParts[1])
		case "minD":
			if ($curW  800) $value = 800;
	return $value;
}

Whew! Are we done coding yet? Yes.

Time to Test

Simply browse to images on your web in the imagestore folder. Now, in your URL, add the prefix with a maxD or minD command. Remember that these commands require a value after them separated by an underscore. Example: maxD_55

So if your original image URL looks like this:

http://yourownwebsite.com/imagestore/Penguins.jpg

Your new URL will look like this:

http://yourownwebsite.com/maxD_55/imagestore/Penguins.jpg

What about the Cloud?

While it’s fun to dynamically create image sizes with simple changes to your image URL, it’s not practical to stop here. Image resizing is very processor-intensive and handing all the requests for all your images all the time will really bog down your server.

CloudFront provides an extremely simple solution. It’s designed to allow you to easily distribute content with low latency via a global network of edge locations. In other words, it automatically takes the load off your server and puts your content closer (geographically) to your customers.

We’re going to use CloudFront to keep cached versions of our resized images so our server only has to handle requests for new sizes periodically– not every time one needs to be served. Setting up CloudFront is a snap:

Start by signing-in to your Amazon Web Services management console:

Find the CloudFront tab in the management console, then click “Create Distribution”:

The Create Distribution Wizard will pop-up. The entries you make here are important. First, select “Custom Origin”. In the Origin DNS name, enter your domain name where the imagestore directory and image.php file are hosted. Under Protocol Policy, I recommend selecting Match Viewer.

You can breeze through the next two sections (Distribution Details and Review). After that you just need to wait about 15 minutes for AWS to create your distribution.

Once you create your distribution, you’ll get a DNS name to use. It will look like: abcdefg1234.cloudfront.net

Now it’s time to complete the solution. Instead of creating images like this:

You’ll now reference your images like this:

<img src="//abcdefg1234.cloudfront.net/minD_80/imagestore/Penguins.jpg" alt="" />

That’s it– you’re done! Now whenever that image is requested, the request will go to CloudFront. The first time the image is requested, CloudFront will request it from your server. After that it will keep it in its cache and deliver it instantly for new requests. When it expires, it will just request it again from your server.

What’s Next?

There is still a lot you can do to make this system work better for your application. Here are a few ideas:

Handle 404s
Make sure your script is setup to handle cases where images are requested that don’t exist on your server.

Handle other Image Formats
Setup the system to handle jpegs, pngs, gifs, and any other image format you use.

Add More Filters
The full example below includes a bunch of useful filters that I’ve created, including examples of transforming your image to grayscale and adding pixelation effects. With php GD you have many available options. Check out ImageMagick for even more options for manipulating your images.

Watermarks, Cropping, and more!
This type of system has so many possibilities. Easily set it up to add a watermark to every image or crop images to a specific size ratio.

Integrate with Amazon S3
Storing the originals on your server is okay to start, but really you should be using Amazon S3 or another cloud storage service to store your originals. Making this change ensures you never have to worry about backups or scalability.

Use a CNAME
Don’t like serving images from a cloudfront.net domain name? No problem, you can configure CloudFront to use your own domain like cdn.yourdomain.com.

Add Security
This type of system allows people to “play around” with your images. If someone is malicious, they could actually use this system to really bog down your server (DoS attack). You can prevent this in many different ways. My favorite way is to use encoding and encryption for the format part of the image URL. This adds a little bit of work, but it prevents people from being able to hit your server with unlimited requests for infinite sizes of your image. There are plenty of other ways to prevent abuse… the main thing is to remember that you need to put something in place.

Have fun with it!

This solution has transformed the way I design and develop using images in web applications. I no longer have to worry about rigid scenarios for image sizes and formatting. I can design whatever I want on the front end, and I never have to worry about disk space, performance, or creating routines to transform images in bulk. Hopefully you will find this concept useful as well.

If you have any suggestions on how to improve or enhance the system, please post your comments below. And of course, if you have questions– please ask!


FAQs

What if I need to access the original version of my image?
No problem! Just use any prefix. I like to use “o” for original. So my original image URL would look like this:

http://dynamiccdn.example.com/o/imagestore/Penguins.jpg

Why can’t I just use querystring variables after my image to specify formatting?
That would be cool… but Amazon CloudFront ignores those variables.

This example only works for jpg file. I love pngs more. What gives??
To keep the code as simple as possible, this example only handles jpg files. But you can tweak the script to handle any image format you may be using.

Why do you reference your images starting with “//” instead of “http://”?
Good question. Using “//” forces the URL to reference the same protocol (http or https) as the page the user is currently viewing. It’s really handy and prevents some browsers from popping up “unsecure content” warnings.

Full Script Example

Here is the full working image.php script. It includes a lot of extra handy format options. The whole thing is less than 100 lines of code!

 $path = $_GET['path'];
$formats = explode(',', $_GET['format']);
$image = imagecreatefromjpeg($path);
header('Content-Type: image/jpeg');
header('Cache-control: Public');
$headerTimeOffset = 60 * 60 * 24 * 30;
$headeExpire = "Expires: " . gmdate ("D, d M Y H:i:s", time() + $headerTimeOffset) . " GMT";
header ($headeExpire);

foreach ($formats as $format) {
    $image = formatImage($format, $image);
}

imagejpeg($image, Null, 100);
imagedestroy($image);

function resizeImage($originalImage,$toWidth,$toHeight) {
    $width = imagesx($originalImage);
    $height = imagesy($originalImage);
    $imageResized = imagecreatetruecolor($toWidth, $toHeight);
    imagecopyresampled($imageResized, $originalImage, 0, 0, 0, 0, $toWidth, $toHeight, $width, $height);
    return $imageResized;
}

function formatImage($format, $image) {
    $curW = imagesx($image);
    $curH = imagesy($image);
    $formatParts = explode('_', $format);
    switch ($formatParts[0]) {
        case 'filterGray':
            #### Make it Grayscale
            imagefilter($image, IMG_FILTER_GRAYSCALE);
            break;
        case 'filterBlur':
            #### Blur It Up
            imagefilter($image, IMG_FILTER_GAUSSIAN_BLUR);
            break;
        case 'maxD':
            #### Maximum Either Dimension - maxD_100
            if ($curW &gt; $curH) {
$ratio = $curH / $curW;
$newW = (int) maxProtect($formatParts[1]);
$newH = (int) (maxProtect($formatParts[1]) * $ratio);
            } else {
$ratio = $curW / $curH;
$newW = (int) (maxProtect($formatParts[1]) * ratio);
$newH = (int) maxProtect($formatParts[1]);
            }
            $image = resizeImage($image, $newW, $newH);
            break;
        case 'minD':
            #### Minimum Smallest Dimension - maxD_100
            if ($curW  800) $value = 800;
    return $value;
}

Image via Marc Dietrich / Shutterstock

Free book: Jump Start HTML5 Basics

Grab a free copy of one our latest ebooks! Packed with hints and tips on HTML5's most powerful new features.

  • michael

    Great article. I’ve implemented similar solutions in the past, and it does work a treat.

    However, can I suggest that you address the code formatting in the article? The massive one liners are incredibly hard to read.

    Otherwise, great work.

    • David Bitter

      Thanks Michael. I went through and formatted the code for easier reading. Hope that helps!

  • Caleb Ogden

    This is sweet. I think too many people have been spoiled by the desktop browsing, and we forget that many people are on limited data plans for their mobile devices. Great way to trim the fat, and provide a perfect display for each image.

    Would like to read more from the “What’s Next” section :-)

  • Aaron Osteraas

    I can personally say that CloudFront is a pretty fantastic CDN

  • Fawad Rashidi

    Thank you David for the great article. I noticed you published the article on August 4th but I received it via RSS feed on August 17th. I wonder why there is a huge delay… I look forward to your new tutorials.

  • Adam

    I might be crazy, but is there something wrong with the code in the full script example? The ‘minD’ case makes no sense. Seems like some of the code has been removed. Also, where is the maxProtect function? It doesn’t seem to be in the code any where. I guess I might be missing a link to the full code, but I this doesn’t seem right.

  • Pavan

    Hi David. Great article.

    I am looking forward to implementing this with s3. Is there a way in which we call cloudfront directly, which then searches for the image in s3, dynamically resizes it and sends it back to the client. I am ging to be using this for a mobile app and dont want to call a php server for it