Opinions, Expertise, Passion.

With my continued investigation of evaluating alternative data management with cloud computing options, I’m now evaluating Amazon Simple DB. Still in restricted beta, it helps to have a friend on the inside.

Working through the Getting Started Guide (API Version 2007-11-07) was ok, annoying in parts. Here are some issues I found. I was working with Java as the programming language.

• The Docs enable you to view the language syntax in Java, C#, Perl, PHP, VB.NET, ScratchPad. You can also restrict the view to a specific language. A rather cool feature. One observation is there is no Python, which is rather ironic as my first investigation was Google App Engine (GAE), and the only language here is Python. Something I had to learn first.
• Preparing the Samples asks you download the Amazon SimpleDB Sample code, but this is not actually a link to the sample code but an index to Community Code. I used Java Library for Amazon SimpleDB which wasn’t even on the first page of results.
• The supplied docs for specifying the Classpath was rather wrong, helps to simply find all .jar files and included these. Mine looks like:

  • #!/bin/sh
    #  http://docs.amazonwebservices.com/AmazonSimpleDB/2007-11-07/GettingStartedGuide/?ref=get-started
    
    SDB_HOME="/put/directory/to/unzip/here"
    export CLASSPATH=$CLASSPATH:\
    $SDB_HOME/src/com/amazonaws/sdb/samples/\
    $SDB_HOME/lib/amazon-simpledb-2007-11-07-java-library.jar:\
    $SDB_HOME/third-party/log4j-1.2.14/log4j-1.2.14.jar:\
    $SDB_HOME/third-party/commons-codec-1.3/commons-codec-1.3.jar:\
    $SDB_HOME/third-party/commons-logging-1.1/commons-logging-1.1.jar:\
    $SDB_HOME/third-party/jaxb-ri-2.1/jaxb-xjc.jar:\
    $SDB_HOME/third-party/jaxb-ri-2.1/activation.jar:\
    $SDB_HOME/third-party/jaxb-ri-2.1/jaxb-impl.jar:\
    $SDB_HOME/third-party/jaxb-ri-2.1/jaxb-api.jar:\
    $SDB_HOME/third-party/jaxb-ri-2.1/jsr173_1.0_api.jar:\
    $SDB_HOME/third-party/commons-httpclient-3.0.1/commons-httpclient-3.0.1.jar
    

• All examples in the docs then refer to making changes such as “invokeCreateDomain(service, action); line and add the following lines after // @TODO: set action parameters here:”, problem is all the samples don’t have the action variable, but rather a variable called request. The comment in the code ” // @TODO: set request parameters here” is at least accurate.
• The docs contain a lot of Java syntax that is would not for example compile correctly. Plenty of occurances of a missing semicolon ‘;’
• Each example defines
  String accessKeyId = ““;
  String secretAccessKey = ““;
  Ok for the first example, but as soon as I moved to the second, I re-factored these into a Interface called Constants.
• In all the examples, they never provide any sample output, this would help just to confirm stuff. In Java Library for Amazon SimpleDB download link, there is an example output, but it’s outdated, with new data attribute called BoxUsage. My output is:

  • CreateDomain Action Response
    =============================================================================
    
        CreateDomainResponse
            ResponseMetadata
                RequestId
                    f04df8eb-71fa-4d4e-9bd5-cc98e853a2e4
                BoxUsage
                    0.0055590278
    

• And now some specifics. In a Relational database such as MySQL, you have Instance/Schema/Table/Column. Within SimpleDB it would indicate that you need a separate AWS account for Instance management. That’s probably a good thing as it will enable tracking of costs. There appears to be no concept of a Schema. Data is stored in Domains, this is the equivalent to a Table. Within each Domain, you specific Attributes, a correlation with Columns. One key difference is the ability to define a set of Attributes with the same identity (much like a list that is supported via Python/GAE). For any row of data, you must specify an itemName, this being equivalent to a Primary Key.These names table me back to old days (20 years ago) of Logical Data Models that used entities,attributes and relationships.
• The term Replace is used when updating data for a given row.
• When retrieving data, you first return a list of itemNames, then you can via Attributes for that given item.
• You can perform a simple where qualification using a Query Expression, including against multiple Attributes via intersection syntax
• A observation that is of significant concern is the lack of security against any type of operation. The Getting Started guide ends with Deleting the Domain. Is there no means to define permissions against type of users, such as an Application User, and a Database Administrator for managing the objects.

Well it took me longer to write this post, then to run through the example, but at least on a lazy Sunday afternoon, a first look at SimpleDB was quite simple.

I did also run into an error initially. I first started just via CLI under Linux (CentOS 5), but switched back to installing Eclipse on Mac OS/X for better error management, and of course this error didn’t occur.