tag:blogger.com,1999:blog-6921383742026030812024-02-20T03:32:05.328-08:00All About CloudUnknownnoreply@blogger.comBlogger17125tag:blogger.com,1999:blog-692138374202603081.post-18415697497305278802015-04-13T09:26:00.003-07:002015-04-13T09:31:42.241-07:00Create Azure Stream Analytics Job through Json file<div dir="ltr" style="text-align: left;" trbidi="on">
<span style="font-family: Arial, Helvetica, sans-serif;">There are not good samples available for JSON files to create Stream Analytics Jobs. Here are sample which can form input to PowerShell cmdlet.</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><br /></span>
<span style="font-family: Arial, Helvetica, sans-serif;">New-AzureStreamAnalyticsJob -ResourceGroupName <Any name> -File <Json file name> -Name <Stream Analytics Job Name></span><br />
<div>
<br /></div>
<span style="font-family: Arial, Helvetica, sans-serif;"><br /></span>
<span style="font-family: Arial, Helvetica, sans-serif;">Here is the Json file that can write to Blob storage.</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><br /></span>
<span style="font-family: Arial, Helvetica, sans-serif;">{ </span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span>"location":"Central US",</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span>"properties":{ </span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span>"sku":{ </span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span>"name":"standard"</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span>},</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span>"eventsOutOfOrderPolicy":"drop",</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span>"eventsOutOfOrderMaxDelayInSeconds":10,</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span>"inputs":[ </span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> { </span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "name":"input",</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "properties":{ </span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "type":"stream",</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "serialization":{ </span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "type":"JSON",</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "properties":{</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "encoding":"UTF8"</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> }</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> },</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "datasource":{ </span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "type":"Microsoft.ServiceBus/EventHub",</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "properties":{ </span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "eventHubNamespace":"",</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "sharedAccessPolicyName":"manage",</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "sharedAccessPolicyKey":"",</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span> "serviceBusNamespace":"",</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "eventHubName":""</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> }</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> }</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> }</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> }</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span>],</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "transformation":{ </span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "name":"ProcessSampleData",</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "properties":{ </span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "streamingUnits":1,</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "query":"select * from input"</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> }</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> },</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "outputs":[ </span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span> { </span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "name":"outputblob",</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "properties":{ </span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "datasource":{ </span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "type":"Microsoft.Storage/Blob",</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span> "properties":{</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span>"storageAccounts":[{</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "accountName":"",</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span> "accountKey":""</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span> }],</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span> "container":"rawoutputcontainer",</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span> "blobPathPrefix":"md"</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> }</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span>},</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span> "serialization":{ </span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "type":"CSV",</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "properties":{ </span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span> "fieldDelimiter":",",</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> "encoding":"UTF8"</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> }</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> }</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span>}</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span>}</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"> ]</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><span class="Apple-tab-span" style="white-space: pre;"> </span>}</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;">}</span></div>
Unknownnoreply@blogger.com2tag:blogger.com,1999:blog-692138374202603081.post-8210531916357374132014-10-19T06:48:00.000-07:002014-10-19T06:48:01.464-07:00Amazon Workspaces<div dir="ltr" style="text-align: left;" trbidi="on">
Has anyone tried this exciting new technologies? What are best practices around both the server side (AWS volume mgmt etc.) and client side (security, bandwidth needs etc.)?<br />
<br />
Share your thoughts!</div>
Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-692138374202603081.post-84718056936420092092014-10-05T01:03:00.001-07:002014-10-05T01:03:20.502-07:00AWS - Amazon Cloud - Bundle Tasks<div dir="ltr" style="text-align: left;" trbidi="on">
<h1 style="color: #444444; line-height: 1.5; margin: 0.8em 0px 0.4em;">
<span style="font-family: Arial, Helvetica, sans-serif; font-size: small;">Bundle Tasks</span></h1>
<h1 style="margin: 0.8em 0px 0.4em;">
<div style="color: #444444; font-weight: normal; line-height: 28.7999992370605px; margin-bottom: 1.2em; margin-top: 1.2em;">
<span style="font-family: Arial, Helvetica, sans-serif; font-size: small;">A bundle task shows the process of converting a <span style="color: maroon;">Windows instance </span>into an AMI. Once bundling is complete and you register the AMI, you can launch copies of the instance.</span></div>
<div style="color: #444444; font-weight: normal; line-height: 28.7999992370605px; margin-bottom: 1.2em; margin-top: 1.2em;">
<span style="font-family: Arial, Helvetica, sans-serif; font-size: small;">This procedure is <strong><span style="color: red;">not </span></strong>applicable for Linux and UNIX instances <strong><span style="color: red;">or </span></strong>Windows instances that use Amazon EBS volumes as their root devices.</span></div>
<div style="color: #444444; font-weight: normal; line-height: 28.7999992370605px; margin-bottom: 1.2em; margin-top: 1.2em;">
<span style="font-family: Arial, Helvetica, sans-serif; font-size: small;">The bundling process does the following:</span></div>
<ul style="color: #444444; font-weight: normal; line-height: 28.7999992370605px; list-style: square; margin: 0.2em 0px 1em;">
<li><span style="font-family: Arial, Helvetica, sans-serif; font-size: small;">Compresses the image to minimize bandwidth usage and storage requirements</span></li>
<li><span style="font-family: Arial, Helvetica, sans-serif; font-size: small;">Encrypts and signs the compressed image to ensure confidentiality and authenticates the image against its creator</span></li>
<li><span style="font-family: Arial, Helvetica, sans-serif; font-size: small;">Splits the encrypted image into manageable parts for upload</span></li>
<li><span style="font-family: Arial, Helvetica, sans-serif; font-size: small;">Runs sysprep to strip out computer specific information (e.g., the MAC address and computer name) to prepare the Windows image for virtualization</span></li>
<li><span style="font-family: Arial, Helvetica, sans-serif; font-size: small;">Creates a manifest file that contains a list of the image parts with their checksums</span></li>
</ul>
</h1>
<h2 style="color: #444444; line-height: 1.5; margin: 1.4em 0px 0.8em;">
<span style="font-family: Arial, Helvetica, sans-serif; font-size: small;"><a href="https://www.blogger.com/null" id="view" name="view" style="color: #009966;"></a><span style="color: navy;">View Current Bundle Tasks</span></span></h2>
<h1 style="margin: 0.8em 0px 0.4em;">
<ol style="color: #444444; font-weight: normal; line-height: 28.7999992370605px; margin: 0.2em 0px 1em;" type="1">
<li><span style="font-family: Arial, Helvetica, sans-serif; font-size: small;">Use the sort options to sort the bundle tasks by bundle ID, instance ID, status, when it started, and progress.</span></li>
<li><span style="font-family: Arial, Helvetica, sans-serif; font-size: small;">Select the bundle task to view.<br />Its properties appears in the lower pane.</span></li>
</ol>
</h1>
<h2 style="color: #444444; line-height: 1.5; margin: 1.4em 0px 0.8em;">
<span style="color: navy;"><span style="font-family: Arial, Helvetica, sans-serif; font-size: small;"><a href="https://www.blogger.com/null" id="view3" name="register" style="color: #009966;"></a>Register an AMI</span></span></h2>
<h1 style="margin: 0.8em 0px 0.4em;">
<div style="color: #444444; font-weight: normal; line-height: 28.7999992370605px; margin-bottom: 1.2em; margin-top: 1.2em;">
<span style="font-family: Arial, Helvetica, sans-serif; font-size: small;">To register an AMI</span></div>
<ol style="color: #444444; font-weight: normal; line-height: 28.7999992370605px; margin: 0.2em 0px 1em;" type="1">
<li><span style="font-family: Arial, Helvetica, sans-serif; font-size: small;">Select an AMI and click <strong>Register</strong>.<br />The <strong>Register AMI</strong> dialog box appears.</span></li>
<li><span style="font-family: Arial, Helvetica, sans-serif; font-size: small;">Click <strong>Register</strong>.<br />Amazon EC2 begins registering the AMI and returns an AMI ID that you can use to launch instances of it in the future.</span></li>
</ol>
</h1>
<h2 style="color: #444444; line-height: 1.5; margin: 1.4em 0px 0.8em;">
<span style="color: navy;"><span style="font-family: Arial, Helvetica, sans-serif; font-size: small;"><a href="https://www.blogger.com/null" id="cancel" name="cancel" style="color: #009966;"></a>Cancel a Bundle Task</span></span></h2>
<h1 style="margin: 0.8em 0px 0.4em;">
<div style="color: #444444; font-weight: normal; line-height: 28.7999992370605px; margin-bottom: 1.2em; margin-top: 1.2em;">
<span style="font-family: Arial, Helvetica, sans-serif; font-size: small;">To cancel a bundle task</span></div>
<ol style="color: #444444; font-weight: normal; line-height: 28.7999992370605px; margin: 0.2em 0px 1em;" type="1">
<li><span style="font-family: Arial, Helvetica, sans-serif; font-size: small;">Select one or more bundle tasks and click <strong>Cancel</strong>.<br />A confirmation dialog box appears.</span></li>
<li><span style="font-family: Arial, Helvetica, sans-serif; font-size: small;">When prompted, click <strong>Yes, Cancel</strong>.<br />Amazon EC2 begins canceling the bundle task(s).</span></li>
</ol>
</h1>
</div>
Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-692138374202603081.post-46084059664885623522014-09-25T00:50:00.001-07:002014-09-25T00:50:58.888-07:00What can help Public/Hybrid Clouds become mainstream?<div dir="ltr" style="text-align: left;" trbidi="on">
<span style="font-family: Arial, Helvetica, sans-serif;">I think its network. If the network offers such speeds over WAN that you can't differentiate between a local and WAN, you can host anything anywhere including partitioning apps. Apps can retain databases on-premises and move business/presentation to the Cloud. What possibilities do you think are possible?</span></div>
Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-692138374202603081.post-85078854150715747992014-08-20T09:34:00.004-07:002014-08-20T18:42:50.970-07:00Setting up mobile development<div dir="ltr" style="text-align: left;" trbidi="on">
<span style="font-family: Arial, Helvetica, sans-serif;">How to configure Ionic on Windows</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><br /></span>
<span style="font-family: Arial, Helvetica, sans-serif;">1. Download and install nodejs</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;">This install an utility called 'npm'. 'npm' is Nodejs Package Manager. Make sure 'npm' directory is in available in PATH</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;">2. Install Apache Cordova. Run "npm install -g cordova"</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;">Apache Cordova is open source version of Adobe PhoneGap. </span><br />
<span style="font-family: Arial, Helvetica, sans-serif;">3. Install Ionic. Run "npm install -g ionic"</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;">Make sure both Cordova and Ionic package directories are available in PATH. In my case, 'npm' install this in 'C:\Users\<<User>>\AppData\Roaming\npm' directory</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><br /></span>
<span style="font-family: Arial, Helvetica, sans-serif;">To create a sample Ionic Application (called 'todo'), execute following commands:</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;">ionic start todo blank</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;">cd todo</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;">ionic platform android</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;">ionic emulate android</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><br /></span>
<span style="font-family: Arial, Helvetica, sans-serif;">The last command should start an Android emulator. However, there are sometimes teething issues that need to be handled. Emulator is chronically slow and appears to be not working without the execution of steps below.</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><br /></span>
<span style="font-family: Arial, Helvetica, sans-serif;">1. Intel's virtualization technology should be enabled in BIOS</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;">2. Make sure "Intel x86 Emulator Accelerator (HAXM Emulator)" is installed through Android SDK manager. The package setup needs to be executed separately as installing it through SDK manager doesn't install it.</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;">3. While creating AVD through AVD manager, enable "Use Host GPU".</span><br />
<span style="font-family: Arial, Helvetica, sans-serif;"><br /></span>
<span style="font-family: Arial, Helvetica, sans-serif;"><b><i>In next blog, we will hook an Ionic app to Google Cloud based app.</i></b></span></div>
Unknownnoreply@blogger.com1tag:blogger.com,1999:blog-692138374202603081.post-29926525727010253532014-05-01T23:44:00.001-07:002014-05-01T23:44:41.894-07:00AWS (Amazon Cloud) OpsWorks<div dir="ltr" style="text-align: left;" trbidi="on">
Just executed a standard tutorial on running PHP applications using OpsWorks. Amazing interface and ease of use. However it lacks, ability to assign resource tags. When the stack is being created, the resource tagging should happen in a seamless way.</div>
Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-692138374202603081.post-71071136165413072992014-04-06T09:32:00.002-07:002014-04-06T09:32:49.438-07:00Compare AWS and Azure<div dir="ltr" style="text-align: left;" trbidi="on">
<table border="1" style="background-color: white; border-collapse: collapse; color: #666666; font-family: arial, helvetica, sans-serif; font-size: 12px; line-height: 18px; margin-bottom: 15px; max-width: 100%; overflow: hidden;"><tbody>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><th style="background-color: #eeeeee; background-position: initial initial; background-repeat: initial initial; border: 1px solid rgb(255, 255, 255); padding: 10px;"><h3 style="border: 0px; color: #333333; font-size: 16pt; letter-spacing: -1px; line-height: 1.2em; margin: 0px 0px 15px; padding: 0px; text-align: left;">
Feature</h3>
</th><th style="background-color: #eeeeee; background-position: initial initial; background-repeat: initial initial; border: 1px solid rgb(255, 255, 255); padding: 10px;"><h3 style="border: 0px; color: #333333; font-size: 16pt; letter-spacing: -1px; line-height: 1.2em; margin: 0px 0px 15px; padding: 0px; text-align: left;">
Amazon Web Services</h3>
</th><th style="background-color: #eeeeee; background-position: initial initial; background-repeat: initial initial; border: 1px solid rgb(255, 255, 255); padding: 10px;"><h3 style="border: 0px; color: #333333; font-size: 16pt; letter-spacing: -1px; line-height: 1.2em; margin: 0px 0px 15px; padding: 0px; text-align: left;">
Microsoft Windows Azure</h3>
</th></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><h4 style="color: #333333; font-size: 14pt; letter-spacing: -1px; line-height: 1.2em; margin: 0px 0px 15px; padding: 0px;">
Computing power</h4>
</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Virtual machines</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/ec2" style="color: #336699; outline: none; text-decoration: none;">Elastic Compute Cloud</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Role Instances</td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">High Performance Computing</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/hpc-applications/" style="color: #336699; outline: none; text-decoration: none;">Cluster Compute Instances</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">HPC Scheduler</td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">MapReduce</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/elasticmapreduce/" style="color: #336699; outline: none; text-decoration: none;">Elastic Map Reduce</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="https://www.hadooponazure.com/" style="color: #336699; outline: none; text-decoration: none;">Hadoop on Azure</a></td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Dynamic scaling</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/autoscaling/" style="color: #336699; outline: none; text-decoration: none;">Auto Scaling</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://entlib.codeplex.com/releases/view/75025" style="color: #336699; outline: none; text-decoration: none;">Auto Scaling Application Block</a></td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><h4 style="color: #333333; font-size: 14pt; letter-spacing: -1px; line-height: 1.2em; margin: 0px 0px 15px; padding: 0px;">
Storage</h4>
</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Unstructured storage</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/s3/" style="color: #336699; outline: none; text-decoration: none;">Simple Storage Service</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Azure Blob</td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Flexible entities</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/simpledb" style="color: #336699; outline: none; text-decoration: none;">SimpleDB</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Azure Tables</td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Block Level Storage</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/ebs/" style="color: #336699; outline: none; text-decoration: none;">Elastic Block Store</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Azure Drive</td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Archiving</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/de/glacier/" style="color: #336699; outline: none; text-decoration: none;">Amazon Glacier</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Storage Gateway</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/de/storagegateway/" style="color: #336699; outline: none; text-decoration: none;">AWS Storage Gateway</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><h4 style="color: #333333; font-size: 14pt; letter-spacing: -1px; line-height: 1.2em; margin: 0px 0px 15px; padding: 0px;">
Databases</h4>
</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">RDBMS</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/rds/" style="color: #336699; outline: none; text-decoration: none;">Relational Database Service</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">SQL Azure</td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">NoSQL</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/dynamodb/" style="color: #336699; outline: none; text-decoration: none;">DynamoDB</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Azure Tables</td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><h4 style="color: #333333; font-size: 14pt; letter-spacing: -1px; line-height: 1.2em; margin: 0px 0px 15px; padding: 0px;">
Caching</h4>
</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">CDN</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/cloudfront/" style="color: #336699; outline: none; text-decoration: none;">CloudFront</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">CDN</td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">In-Memory</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/elasticache/" style="color: #336699; outline: none; text-decoration: none;">ElastiCache</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Cache</td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><h4 style="color: #333333; font-size: 14pt; letter-spacing: -1px; line-height: 1.2em; margin: 0px 0px 15px; padding: 0px;">
Network</h4>
</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Load Balancer</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/elasticloadbalancing/" style="color: #336699; outline: none; text-decoration: none;">Elastic Load Balancer</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Fabric Controller / Traffic Manager</td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Hybrid Cloud</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/vpc/" style="color: #336699; outline: none; text-decoration: none;">Virtual Private Cloud</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Azure Connect</td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Peering</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/directconnect/" style="color: #336699; outline: none; text-decoration: none;">Direct Connect</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><center>
-</center>
</td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">DNS</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/route53/" style="color: #336699; outline: none; text-decoration: none;">Route 53</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><center>
-</center>
</td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><h4 style="color: #333333; font-size: 14pt; letter-spacing: -1px; line-height: 1.2em; margin: 0px 0px 15px; padding: 0px;">
Messaging & Applications</h4>
</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Async Messaging</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/sqs/" style="color: #336699; outline: none; text-decoration: none;">Simple Queue Service</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Azure Queues</td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Push Notifications</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/sns/" style="color: #336699; outline: none; text-decoration: none;">Simple Notification Service</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Service Bus</td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Bulk Email</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/ses/" style="color: #336699; outline: none; text-decoration: none;">Simple Email Service</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Workflows</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/de/swf/" style="color: #336699; outline: none; text-decoration: none;">Amazon Simple Workflow Service</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Search</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/de/cloudsearch/" style="color: #336699; outline: none; text-decoration: none;">Amazon CloudSearch</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><h4 style="color: #333333; font-size: 14pt; letter-spacing: -1px; line-height: 1.2em; margin: 0px 0px 15px; padding: 0px;">
Monitoring</h4>
</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Resource monitoring</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/cloudwatch/" style="color: #336699; outline: none; text-decoration: none;">CloudWatch</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://www.microsoft.com/download/en/details.aspx?id=11324" style="color: #336699; outline: none; text-decoration: none;">System Center</a></td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><h4 style="color: #333333; font-size: 14pt; letter-spacing: -1px; line-height: 1.2em; margin: 0px 0px 15px; padding: 0px;">
Securiry</h4>
</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Identity Management</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/iam/" style="color: #336699; outline: none; text-decoration: none;">Identity Access Management</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Azure Active Directory</td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><h4 style="color: #333333; font-size: 14pt; letter-spacing: -1px; line-height: 1.2em; margin: 0px 0px 15px; padding: 0px;">
Deployment</h4>
</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"></td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Resource creation</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/cloudformation" style="color: #336699; outline: none; text-decoration: none;">CloudFormation</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><center>
-</center>
</td></tr>
<tr style="background-color: whitesmoke; background-position: initial initial; background-repeat: initial initial;"><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Web Application Container</td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;"><a href="http://aws.amazon.com/elasticbeanstalk/" style="color: #336699; outline: none; text-decoration: none;">Elastic Beanstalk</a></td><td style="border: 1px solid rgb(255, 255, 255); padding: 10px;">Web Role</td></tr>
</tbody></table>
</div>
Unknownnoreply@blogger.com1tag:blogger.com,1999:blog-692138374202603081.post-51916470345313599142014-03-12T03:37:00.004-07:002014-03-12T03:37:54.548-07:00Sample Cloud Tester Profile<div dir="ltr" style="text-align: left;" trbidi="on">
<table border="0" cellpadding="0" cellspacing="0" style="border-collapse: collapse; width: 702px;">
<colgroup><col style="mso-width-alt: 4681; mso-width-source: userset; width: 96pt;" width="128"></col>
<col style="mso-width-alt: 20992; mso-width-source: userset; width: 431pt;" width="574"></col>
</colgroup><tbody>
<tr height="21" style="height: 15.75pt;">
<td class="xl72" height="21" style="height: 15.75pt; width: 96pt;" width="128"> </td>
<td class="xl68" style="border-left: none; width: 431pt;" width="574">Cloud Tester</td>
</tr>
<tr height="20" style="height: 15.0pt;">
<td class="xl65" height="20" style="height: 15.0pt; width: 96pt;" width="128">Role
Definition</td>
<td class="xl69" style="border-top: none; width: 431pt;" width="574">Technical member
of Cloud testing team</td>
</tr>
<tr height="85" style="height: 63.75pt;">
<td class="xl66" height="85" style="border-top: none; height: 63.75pt; width: 96pt;" width="128">Pre-Requisites</td>
<td class="xl70" style="border-top: none; width: 431pt;" width="574">Past experience
of performing functional testing of applications with one or more specialized
areas such as performance, load/ stress and security etc.<br />
Experience testing RESTful and SOAP based web services<br />
Solid understanding of HTTP/S; Knowledge of JSON, XML and queue based
messaging<br />
No prior understanding of Cloud is required</td>
</tr>
<tr height="170" style="height: 127.5pt;">
<td class="xl66" height="170" style="border-top: none; height: 127.5pt; width: 96pt;" width="128">Mandatory Skills</td>
<td class="xl70" style="border-top: none; width: 431pt;" width="574">Basic
understanding of Cloud deployment models<br />
Basic Understanding of Cloud provided infrastructure and services <br />
Basic understanding of security related aspects, impact of Cloud on
security and ability to create secure test data for Cloud based testing<br />
Ability to provision hardware/ software and setup test environment in the
Cloud<br />
Working knowledge of relational databases and applicable Operating System
(OS)<br />
Ability to understand metrics such as page load times, network latency,
response times etc., correlate it with requirements and report bugs wherever
there are gaps<br />
Ability to inject (large scale) data and traffic from multiple locations
spread across the world (whenever required)</td>
</tr>
<tr height="119" style="height: 89.25pt;">
<td class="xl66" height="119" style="border-top: none; height: 89.25pt; width: 96pt;" width="128">Optional Skills</td>
<td class="xl70" style="border-top: none; width: 431pt;" width="574">Basic
understanding of Cloud Provider's costing model<br />
Basic understanding of NoSQL databases<br />
Knowledge of multi-tenancy architectures<br />
Knowledge of testing for mobile enviornments and devices<br />
<br />
Azure:<br />
- Visual Studio based load test service</td>
</tr>
<tr height="34" style="height: 25.5pt;">
<td class="xl64" height="34" style="border-top: none; height: 25.5pt; width: 96pt;" width="128">Certification (Optional)</td>
<td class="xl70" style="border-left: none; border-top: none; width: 431pt;" width="574">None</td>
</tr>
<tr height="20" style="height: 15.0pt;">
<td class="xl66" height="20" style="border-top: none; height: 15.0pt; width: 96pt;" width="128">Supervision</td>
<td class="xl70" style="border-top: none; width: 431pt;" width="574">Close
supervision required</td>
</tr>
<tr height="20" style="height: 15.0pt;">
<td class="xl66" height="20" style="border-top: none; height: 15.0pt; width: 96pt;" width="128">Line reporting</td>
<td class="xl70" style="border-top: none; width: 431pt;" width="574">Reports to Test
Manager</td>
</tr>
<tr height="35" style="height: 26.25pt;">
<td class="xl67" height="35" style="border-top: none; height: 26.25pt; width: 96pt;" width="128">Interactions</td>
<td class="xl71" style="border-top: none; width: 431pt;" width="574">With Whom:
Testing and development teams; No customer interaction</td>
</tr>
</tbody></table>
</div>
Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-692138374202603081.post-89153605355376491782014-03-06T19:34:00.001-08:002014-03-12T05:17:28.912-07:00AWS issues- Low quality support on forums. Folks on support do not show the kind of expertise expected<div>- Increasing complexity will add to need to get more front line architects at greater expense</div><div>- Where do developers test without incurring significant expenses? More importantly organizations won't like unpredictability in their cost. Even free tier limits may be breached. Where are simulators? That's a big plus for Azure. <span style="font-family: 'Helvetica Neue Light', HelveticaNeue-Light, helvetica, arial, sans-serif;">May be Amazon should offer sandbox environment to large enterprises on per user basis. CloudFormation doesn't have a sandbox or simulator. What a pity!</span></div><div><span style="font-family: 'Helvetica Neue Light', HelveticaNeue-Light, helvetica, arial, sans-serif;">- Some of services are launched without free tier offering. What do we do with that?</span></div><div><span style="font-family: 'Helvetica Neue Light', HelveticaNeue-Light, helvetica, arial, sans-serif;">- Edicational institutions are not churning cloud developers. Amazon needs to find a way to promote cloud as a subject and get ready programmers.</span></div>Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-692138374202603081.post-78225913199668889582014-03-02T09:11:00.002-08:002014-03-02T09:11:37.133-08:00.NET AWS Cloud Development Profiles<div dir="ltr" style="text-align: left;" trbidi="on">
<table border="0" cellpadding="0" cellspacing="0" style="border-collapse: collapse; width: 1275px;">
<colgroup><col style="mso-width-alt: 4681; mso-width-source: userset; width: 96pt;" width="128"></col>
<col style="mso-width-alt: 12763; mso-width-source: userset; width: 262pt;" width="349"></col>
<col style="mso-width-alt: 13824; mso-width-source: userset; width: 284pt;" width="378"></col>
<col style="mso-width-alt: 15360; mso-width-source: userset; width: 315pt;" width="420"></col>
</colgroup><tbody>
<tr height="21" style="height: 15.75pt;">
<td class="xl84" height="42" rowspan="2" style="height: 31.5pt; width: 96pt;" width="128"> </td>
<td class="xl81" colspan="3" style="width: 861pt;" width="1147">.NET</td>
</tr>
<tr height="21" style="height: 15.75pt;">
<td class="xl71" height="21" style="border-top: none; height: 15.75pt; width: 262pt;" width="349">Cloud Developer</td>
<td class="xl72" style="border-left: none; border-top: none; width: 284pt;" width="378">Senior
Cloud Developer</td>
<td class="xl73" style="border-left: none; border-top: none; width: 315pt;" width="420">Technical
Lead - Cloud</td>
</tr>
<tr height="85" style="height: 63.75pt;">
<td class="xl80" height="85" style="height: 63.75pt; width: 96pt;" width="128">Role
Definition</td>
<td class="xl76" style="border-left: none; width: 262pt;" width="349">Technical
member of Azure development team, writes code, unit test and perform bug
fixes on Azure platform</td>
<td class="xl77" style="border-left: none; width: 284pt;" width="378">Technical
member of Azure development team, contributes towards high level design of
relatively less complex modules using Object oriented and Cloud design
patterns; Writes code and performs unit testing and reviews work of Cloud
Developers</td>
<td class="xl78" style="border-left: none; width: 315pt;" width="420">Technical
leader of a team responsible for a Azure based sub-system/ module. Interacts
with customer during design phases (after architecture phase) and beyond.</td>
</tr>
<tr height="68" style="height: 51.0pt;">
<td class="xl65" height="68" style="border-top: none; height: 51.0pt; width: 96pt;" width="128">Pre-Requsities</td>
<td class="xl67" style="border-left: none; border-top: none; width: 262pt;" width="349">Good
understanding of .NET platform<br />
Knowledge of EntityFramework and Enterprise library<br />
No prior understanding of Cloud is required</td>
<td class="xl64" style="border-left: none; border-top: none; width: 284pt;" width="378">Good
understanding of .NET platform<br />
Ability to design relatively less complex modules<br />
No prior understanding of Cloud is required</td>
<td class="xl68" style="border-left: none; border-top: none; width: 315pt;" width="420">Excellent
understanding of .NET platform; Minimum 6 years of experience on .NET<br />
Ability to independently design complex sub-systems/ modules<br />
No prior understanding of Cloud is required</td>
</tr>
<tr height="238" style="height: 178.5pt;">
<td class="xl65" height="238" style="border-top: none; height: 178.5pt; width: 96pt;" width="128">Mandatory Skills</td>
<td class="xl67" style="border-left: none; border-top: none; width: 262pt;" width="349">Good
understanding of Cloud environment and deployment models<br />
Basic understanding of key Azure services *<br />
Ability to program using Azure SDK for .NET<br />
Knowledge of Management Portal; Windows OS and System Manager<br />
Knowledge of Cross-Platform Command-Line Interface (xplat-cli) and Azure
Emulators<br />
Ability to program using OData services<br />
Understanding of RESTful and SOAP based Web Services</td>
<td class="xl64" style="border-left: none; border-top: none; width: 284pt;" width="378"><span class="font6">In addition to Cloud Developer skills, following additional
skills are required:</span><span class="font5"><br />
Deep understanding of key Azure services including aspects such as
security, performance, availability etc.<br />
Understanding of Azure design patterns and ability to apply those to the
design<br />
Understanding of monitoring capabilities available on Azure, ability to
derive actions from the reports and implement them<br />
Ability to design and program using Enterprise Library Transient Fault
Handling Block</span></td>
<td class="xl68" style="border-left: none; border-top: none; width: 315pt;" width="420"><span class="font6">In addition to Senior Cloud Developer skills, following
additional skills are required:</span><span class="font5"><br />
Ability to understand architecture documents defined by Architect(s) and
follow during implementation<br />
Ability to design complex sub-systems and technically supervise and own
implementation, testing and deployment<br />
Deep understanding of Azure security best practices and ability to design
secure sub-systems **<br />
Deep understanding of Cloud deployment models<br />
Deep understanding of applicable OS<br />
Ability to drive successful implementation of Continuous Integration; Derive/Take
actions based on reported code quality metrics<br />
Good understanding of integration patterns (especially between Public and
On-premises applications)</span></td>
</tr>
<tr height="187" style="height: 140.25pt;">
<td class="xl65" height="187" style="border-top: none; height: 140.25pt; width: 96pt;" width="128">Optional Skills</td>
<td class="xl67" style="border-left: none; border-top: none; width: 262pt;" width="349">Basic
understanding of features offered by all Azure services<br />
Ability to write Powershell scripts<br />
Basic understanding of deployment tools such as Octopus Deploy<br />
Use of "Visual Studio Online" service</td>
<td class="xl64" style="border-left: none; border-top: none; width: 284pt;" width="378"><span class="font6">In addition to Cloud Developer, following additional skills are
required:</span><span class="font5"><br />
Basic understanding of Virtualization enviornments/ Hyper-V hypervisor and its impact on
performance and security<br />
Basic understanding of NoSQL databases<br />
Good understanding of security related coding best practices and features
offered by .NET platform; Top ten issues from OWASP; Basic understanding of
OWASP .NET Cheat Sheet
(https://www.owasp.org/index.php/.NET_Security_Cheat_Sheet)<br />
Basic understanding of Azure reference architectures</span></td>
<td class="xl68" style="border-left: none; border-top: none; width: 315pt;" width="420"><span class="font6">In addition to skills outlined for Senior Cloud Developer,
following additional skills are required:</span><span class="font5"><br />
Basic understanding of various possible use-cases in Cloud in-general and
Azure in-specific<br />
Deep understanding of Azure reference architectures<br />
Drive to explore feasibility of using new technologies to solve specific
customer problems<br />
Basic understanding of multi-tenancy architectures<br />
Ability to design and program using NoSQL databases<br />
Understanding of any one Cloud agnostic library and ability to leverage
similar design principles in own sub-systems</span></td>
</tr>
<tr height="34" style="height: 25.5pt;">
<td class="xl65" height="34" style="border-top: none; height: 25.5pt; width: 96pt;" width="128">Certification (Optional)</td>
<td class="xl67" style="border-left: none; border-top: none; width: 262pt;" width="349">None</td>
<td class="xl74" style="border-left: none; border-top: none; width: 284pt;" width="378"><a href="http://www.microsoft.com/learning/en-us/exam-70-583.aspx"><span style="font-family: Arial, sans-serif; font-size: 10.0pt; mso-font-charset: 0;">Developing
Windows Azure and Web Services</span></a></td>
<td class="xl79" style="border-left: none; border-top: none; width: 315pt;" width="420"><a href="http://www.microsoft.com/learning/en-us/exam-70-583.aspx"><span style="font-family: Arial, sans-serif; font-size: 10.0pt; mso-font-charset: 0;">Developing
Windows Azure and Web Services</span></a></td>
</tr>
<tr height="20" style="height: 15.0pt;">
<td class="xl65" height="20" style="border-top: none; height: 15.0pt; width: 96pt;" width="128">Supervision</td>
<td class="xl67" style="border-left: none; border-top: none; width: 262pt;" width="349">Close
supervision required</td>
<td class="xl64" style="border-left: none; border-top: none; width: 284pt;" width="378">Works
with average supervision</td>
<td class="xl68" style="border-left: none; border-top: none; width: 315pt;" width="420">Works
with minimal supervision</td>
</tr>
<tr height="20" style="height: 15.0pt;">
<td class="xl65" height="20" style="border-top: none; height: 15.0pt; width: 96pt;" width="128">Line reporting</td>
<td class="xl67" style="border-left: none; border-top: none; width: 262pt;" width="349">Reports
to Project Manager</td>
<td class="xl64" style="border-left: none; border-top: none; width: 284pt;" width="378">Reports
to Project Manager</td>
<td class="xl68" style="border-left: none; border-top: none; width: 315pt;" width="420">Reports
to Project Manager</td>
</tr>
<tr height="52" style="height: 39.0pt;">
<td class="xl66" height="52" style="border-top: none; height: 39.0pt; width: 96pt;" width="128">Interactions</td>
<td class="xl69" style="border-left: none; border-top: none; width: 262pt;" width="349">With
Whom: Technical team; No customer interaction</td>
<td class="xl75" style="border-left: none; border-top: none; width: 284pt;" width="378">With
Whom: Technical team; No customer interaction</td>
<td class="xl70" style="border-left: none; border-top: none; width: 315pt;" width="420">With
Whom: Technical team; Project Manager; Customers from design phase onwards
(Architects manage customer interactions during DD, Requirements and
Architecture definition phases)</td>
</tr>
</tbody></table>
</div>
Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-692138374202603081.post-7032729990863611042014-02-28T21:08:00.001-08:002014-02-28T21:08:28.623-08:00Proposed Java AWS Cloud Developer Profiles<div dir="ltr" style="text-align: left;" trbidi="on">
<table border="0" cellpadding="0" cellspacing="0" style="border-collapse: collapse; width: 953px;">
<colgroup><col style="mso-width-alt: 4681; mso-width-source: userset; width: 96pt;" width="128"></col>
<col span="3" style="mso-width-alt: 10057; mso-width-source: userset; width: 206pt;" width="275"></col>
</colgroup><tbody>
<tr height="21" style="height: 15.75pt;">
<td class="xl87" height="42" rowspan="2" style="border-bottom: 1.0pt solid black; height: 31.5pt; width: 96pt;" width="128"> </td>
<td class="xl84" colspan="3" style="border-left: none; width: 618pt;" width="825"><br /></td>
</tr>
<tr height="21" style="height: 15.75pt;">
<td class="xl70" height="21" style="border-left: none; border-top: none; height: 15.75pt; width: 206pt;" width="275">Cloud Developer</td>
<td class="xl71" style="border-left: none; border-top: none; width: 206pt;" width="275">Senior
Cloud Developer</td>
<td class="xl73" style="border-left: none; border-top: none; width: 206pt;" width="275">Technical
Lead - Cloud</td>
</tr>
<tr height="102" style="height: 76.5pt;">
<td class="xl74" height="102" style="height: 76.5pt; width: 96pt;" width="128">Role
Definition</td>
<td class="xl67" style="border-top: none; width: 206pt;" width="275">Technical member
of AWS development team, writes code, unit test and perform bug fixes on AWS
platform</td>
<td class="xl78" style="border-left: none; border-top: none; width: 206pt;" width="275">Technical
member of AWS development team, contributes towards high level design of
relatively less complex modules using Object oriented and Cloud design
patterns; Writes code and performs unit testing and reviews work of Cloud
Developers</td>
<td class="xl80" style="border-left: none; border-top: none; width: 206pt;" width="275">Technical
leader of a team responsible for a AWS based sub-system/ module. Interacts
with customer during design phases (after architecture phase) and beyond.</td>
</tr>
<tr height="102" style="height: 76.5pt;">
<td class="xl75" height="102" style="border-top: none; height: 76.5pt; width: 96pt;" width="128">Pre-Requisites</td>
<td class="xl68" style="border-top: none; width: 206pt;" width="275">Good
understanding of Java/J2EE platform<br />
No prior understanding of Cloud is required</td>
<td class="xl64" style="border-left: none; border-top: none; width: 206pt;" width="275">Good
understanding of Java/J2EE platform<br />
Ability to design relatively less complex modules<br />
No prior understanding of Cloud is required</td>
<td class="xl81" style="border-left: none; border-top: none; width: 206pt;" width="275">Excellent
understanding of Java/J2EE platform<br />
Ability to independently design complex sub-systems/ modules<br />
No prior understanding of Cloud is required</td>
</tr>
<tr height="340" style="height: 255.0pt;">
<td class="xl75" height="340" style="border-top: none; height: 255.0pt; width: 96pt;" width="128">Mandatory Skills</td>
<td class="xl68" style="border-top: none; width: 206pt;" width="275">Good
understanding of Cloud environment,
deployment models and AWS basics<br />
Basic understanding of key AWS services *<br />
Ability to program using AWS SDK for Java<br />
Ability to use Command-line tools for various AWS services<br />
Ability to program using at least one scripting language (Python or
Perl)<br />
Understanding of RESTful and SOAP based Web Services<br />
Working knowledge of applicable OS (Windows, Linux/Unix)<br />
Ability to use AWS Management Console for applicable services</td>
<td class="xl64" style="border-left: none; border-top: none; width: 206pt;" width="275"><span class="font6">In addition to Cloud Developer skills, following additional
skills are required:</span><span class="font5"><br />
Deep understanding of key AWS services including aspects such as security,
performance, availability etc.<br />
Understanding of AWS design patterns and ability to apply those<br />
Understanding of monitoring capabilities available on AWS, ability to
derive actions from the reports and implement them<br />
Ability to write code that handles transient failures<br />
Basic understanding of Continuous Integration and code quality metrics</span></td>
<td class="xl81" style="border-left: none; border-top: none; width: 206pt;" width="275"><span class="font6">In addition to Senior Cloud Developer skills, following
additional skills are required:</span><span class="font5"><br />
Ability to understand architecture documents defined by Architect(s) and
follow during implementation<br />
Ability to design complex sub-systems and technically supervise and own
implementation, testing and deployment<br />
Deep understanding of AWS security best practices and ability to design
secure sub-systems **<br />
Deep understanding of Cloud deployment models<br />
Deep understanding of applicable OS<br />
Ability to drive successful implementation of Continuous Integration;
Derive/Take actions based on reported code quality metrics<br />
Good understanding of integration patterns (especially between Public and
On-premises applications)</span></td>
</tr>
<tr height="306" style="height: 229.5pt;">
<td class="xl75" height="306" style="border-top: none; height: 229.5pt; width: 96pt;" width="128">Optional Skills</td>
<td class="xl68" style="border-top: none; width: 206pt;" width="275">Basic
understanding of features offered by all AWS services<br />
Ability to write shell scripts on Linux/Unix platforms<br />
Basic understanding of deployment tools such as Chef, Puppet etc.</td>
<td class="xl64" style="border-left: none; border-top: none; width: 206pt;" width="275"><span class="font6">In addition to skills outlined for Cloud Developer, following
additional skills are required:<br />
</span><span class="font5">Basic understanding of Virtualization
environments/ Xen hypervisor and its impact on performance and security;
Various Virtual Machine formats<br />
Good understanding of security related coding best practices, top ten
issues from OWASP and ESAPI library<br />
Basic understanding of NoSQL databases<br />
Basic understanding of AWS reference architectures</span></td>
<td class="xl81" style="border-left: none; border-top: none; width: 206pt;" width="275"><span class="font6">In addition to skills outlined for Senior Cloud Developer,
following additional skills are required:<br />
</span><span class="font5">Basic understanding of various possible
use-cases in Cloud in general and specifically AWS<br />
Deep understanding of AWS reference architectures<br />
Drive to explore feasibility of using new technologies to solve specific
customer problems<br />
Basic understanding of multi-tenancy architectures<br />
Ability to design and program using NoSQL databases<br />
Understanding of any one Cloud agnostic library and ability to leverage
similar design principles in own sub-systems</span></td>
</tr>
<tr height="34" style="height: 25.5pt;">
<td class="xl66" height="34" style="border-top: none; height: 25.5pt; width: 96pt;" width="128">Certification (Optional)</td>
<td class="xl68" style="border-left: none; border-top: none; width: 206pt;" width="275">None</td>
<td class="xl77" style="border-left: none; border-top: none; width: 206pt;" width="275"><a href="http://aws.amazon.com/certification/certification-levels/certified-developer-associate/"><span style="font-family: Arial, sans-serif; mso-font-charset: 0;">AWS Certified
Developer - Associate</span></a></td>
<td class="xl82" style="border-left: none; border-top: none; width: 206pt;" width="275"><a href="http://aws.amazon.com/certification/certification-levels/certified-developer-associate/"><span style="font-family: Arial, sans-serif; mso-font-charset: 0;">AWS Certified
Developer - Associate</span></a></td>
</tr>
<tr height="20" style="height: 15.0pt;">
<td class="xl75" height="20" style="border-top: none; height: 15.0pt; width: 96pt;" width="128">Supervision</td>
<td class="xl68" style="border-top: none; width: 206pt;" width="275">Close
supervision required</td>
<td class="xl64" style="border-left: none; border-top: none; width: 206pt;" width="275">Works
with average supervision</td>
<td class="xl81" style="border-left: none; border-top: none; width: 206pt;" width="275">Works
with minimal supervision</td>
</tr>
<tr height="20" style="height: 15.0pt;">
<td class="xl75" height="20" style="border-top: none; height: 15.0pt; width: 96pt;" width="128">Line reporting</td>
<td class="xl68" style="border-top: none; width: 206pt;" width="275">Reports to
Project Manager</td>
<td class="xl64" style="border-left: none; border-top: none; width: 206pt;" width="275">Reports
to Project Manager</td>
<td class="xl81" style="border-left: none; border-top: none; width: 206pt;" width="275">Reports
to Project Manager</td>
</tr>
<tr height="86" style="height: 64.5pt;">
<td class="xl76" height="86" style="border-top: none; height: 64.5pt; width: 96pt;" width="128">Interactions</td>
<td class="xl69" style="border-top: none; width: 206pt;" width="275">With Whom:
Technical team; No customer interaction</td>
<td class="xl79" style="border-left: none; border-top: none; width: 206pt;" width="275">With
Whom: Technical team; No customer interaction</td>
<td class="xl83" style="border-left: none; border-top: none; width: 206pt;" width="275">With
Whom: Technical team; Project Manager; Customers from design phase onwards
(Architects manage customer interactions during DD, Requirements and
Architecture definition phases)</td>
</tr>
<tr height="20" style="height: 15.0pt;">
<td height="20" style="height: 15.0pt;"></td>
<td></td>
<td></td>
<td></td>
</tr>
<tr height="20" style="height: 15.0pt;">
<td height="20" style="height: 15.0pt;"></td>
<td></td>
<td></td>
<td></td>
</tr>
<tr height="20" style="height: 15.0pt;">
<td class="xl65" colspan="4" height="20" style="height: 15.0pt; mso-ignore: colspan;">*
Elastic Compute Cloud (EC2); Elastic Block Storage (EBS); Relational Database
System (RDS); Elastic Load Balancer (ELB); Simple Storage Service (S3);
Identity and Access Management (AWS); ElastiCache; Simple Queue Service
(SQS); Simple Notification Service (SNS); CloudFront; DynamoDB; SimpleDB</td>
</tr>
<tr height="20" style="height: 15.0pt;">
<td class="xl72" colspan="4" height="20" style="height: 15.0pt; mso-ignore: colspan;">**
May need understanding of one or more of these: Multi-factor authentication (MFA); X.509
certificates; Public Key Infrastructure (PKI); Symmetric and Asymmetric
encryption algorithms (AES, DES & RSA etc.); Hashing algorithms (MD5,
SHA-1 & SHA-2 etc.); SSL/TLS; Claim based security/ Security Tokens;
Federated identity; Stateful and stateless firewalls; Port scans; IP
spoofing; IPsec; Intrusion Detection System (IDS); OS hardening; Hardware
Security Module (HSM); Understanding of cheat sheets available at
https://www.owasp.org/index.php/Cheat_Sheets#tab=Main</td>
</tr>
</tbody></table>
</div>
Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-692138374202603081.post-74967527470509906672014-02-23T02:56:00.002-08:002014-02-23T02:56:42.994-08:00Cloud Guidelines<div dir="ltr" style="text-align: left;" trbidi="on">
<table border="0" cellpadding="0" cellspacing="0" style="border-collapse: collapse; width: 1135px;">
<colgroup><col style="mso-width-alt: 5814; mso-width-source: userset; width: 119pt;" width="159"></col>
<col style="mso-width-alt: 13458; mso-width-source: userset; width: 276pt;" width="368"></col>
<col style="mso-width-alt: 18432; mso-width-source: userset; width: 378pt;" width="504"></col>
<col style="mso-width-alt: 3803; mso-width-source: userset; width: 78pt;" width="104"></col>
</colgroup><tbody>
<tr height="40" style="height: 30.0pt;">
<td class="xl63" height="40" style="height: 30.0pt; width: 119pt;" width="159">Area</td>
<td class="xl63" style="border-left: none; width: 276pt;" width="368">Title</td>
<td class="xl63" style="border-left: none; width: 378pt;" width="504">Description</td>
<td class="xl63" style="border-left: none; width: 78pt;" width="104">Platform
specific</td>
</tr>
<tr height="40" style="height: 30.0pt;">
<td class="xl64" height="40" style="border-top: none; height: 30.0pt; width: 119pt;" width="159">Architecture, Testing</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">HA
environment, Failover Testing</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Have
capability to artificially fail any system component. The system should
recover from failure and still meet NFRs</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="60" style="height: 45.0pt;">
<td class="xl64" height="60" style="border-top: none; height: 45.0pt; width: 119pt;" width="159">Design</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Check
feasibility of abstracting the Cloud provider API</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Helps
support Cloud agnostic development and avoid vendor lock-in; Faster time to
market since developers need not learn different APIs from multiple cloud
vendors</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="60" style="height: 45.0pt;">
<td class="xl64" height="60" style="border-top: none; height: 45.0pt; width: 119pt;" width="159">Coding</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Static
analysis</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Make
sure static analysis is incorporated into build process - High quality
changes are more important in cloud environment than in non-cloud environment</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="60" style="height: 45.0pt;">
<td class="xl64" height="60" style="border-top: none; height: 45.0pt; width: 119pt;" width="159">Architecture</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Multi-cloud
usage</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Evaluate
services from multiple cloud providers and chose the one that suits the
requirements the most; Architect application to be able to handle multi-cloud
(Both private and public) environments</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="40" style="height: 30.0pt;">
<td class="xl64" height="40" style="border-top: none; height: 30.0pt; width: 119pt;" width="159">Architecture</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Application
bifurcation</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Evaluate
if an application needs to be broken up to use private cloud for some
functionality and public for others</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="60" style="height: 45.0pt;">
<td class="xl64" height="60" style="border-top: none; height: 45.0pt; width: 119pt;" width="159">Security</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Use
appropriate algorithms</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Use
AES 256 bit symmetric encryption to encrypt sensitive data at rest<br />
Use RSA 2096 bits or higher for certificates<br />
Use SHA2-256 or higher for hash and message digest</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="40" style="height: 30.0pt;">
<td class="xl64" height="40" style="border-top: none; height: 30.0pt; width: 119pt;" width="159">Security</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Security
boundary</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Divide
security responsibilities clearly between cloud provider and consumer; Define
trust boundary clearly too</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="40" style="height: 30.0pt;">
<td class="xl64" height="40" style="border-top: none; height: 30.0pt; width: 119pt;" width="159">Security</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Key
storage</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Do
not store sensitive keys on your own if your cloud provider provides service
for key/certificate management</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="60" style="height: 45.0pt;">
<td class="xl64" height="60" style="border-top: none; height: 45.0pt; width: 119pt;" width="159">Architecture</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Difference
between claimed and actual SLAs</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Ascertain
any gap between claimed and actual SLAs and architect with the lower number
in mind. Don't blindly rely on numbers published by Cloud provider</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="40" style="height: 30.0pt;">
<td class="xl64" height="40" style="border-top: none; height: 30.0pt; width: 119pt;" width="159">Architecture</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Conformance
to standards</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Check
if a Cloud service meets any industry standard and give it a higher rating
than the one which does not</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="20" style="height: 15.0pt;">
<td class="xl64" height="20" style="border-top: none; height: 15.0pt; width: 119pt;" width="159">Deployment</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Repeatable
and automated</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Make
deployment completely automated</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="60" style="height: 45.0pt;">
<td class="xl64" height="60" style="border-top: none; height: 45.0pt; width: 119pt;" width="159">Security</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Security
planning</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Plan
for handling security breaches and how do you recover from them. This plan
may include notifying customers that a breach has occurred and how are they
impacted because of the breach</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="60" style="height: 45.0pt;">
<td class="xl64" height="60" style="border-top: none; height: 45.0pt; width: 119pt;" width="159">Architecture</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Software
fatigue</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Consider
automatically replacing instances (that have been running for quite some
time) with fresh instances to avoid software fatigue (undetected memory leaks
etc.)</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="60" style="height: 45.0pt;">
<td class="xl64" height="60" style="border-top: none; height: 45.0pt; width: 119pt;" width="159">Architecture</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Put
dynamic data near computing infrastructure and static data near users</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Keep
dynamic data near computing instances - (For example, move data to Cloud
first before processing); Move static data closer to users to avoid latency
(for example through AWS CloudFront)</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="100" style="height: 75.0pt;">
<td class="xl64" height="100" style="border-top: none; height: 75.0pt; width: 119pt;" width="159">Security</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Protect
cloud credentials</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Rotate
keys on a regular basis; Do not store keys on Cloud infrastructure or
storage<br />
Make sure certificates are renewed on an annual basis<br />
Use multi-factor authentication wherever feasible<br />
Use cloud infrastructure to store keys wherever such a service is available</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="40" style="height: 30.0pt;">
<td class="xl64" height="40" style="border-top: none; height: 30.0pt; width: 119pt;" width="159">Security</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Reduce
attack surface</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Keep
attack surface as low as possible by limiting number of ports that are open
and the IP's to which those ports are open</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="40" style="height: 30.0pt;">
<td class="xl64" height="40" style="border-top: none; height: 30.0pt; width: 119pt;" width="159">Security</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Certifications</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Check
and make sure the Cloud provider meets the minimum set of applicable
certifications (such as HIPPA, security etc.) and audit requirements</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="60" style="height: 45.0pt;">
<td class="xl64" height="60" style="border-top: none; height: 45.0pt; width: 119pt;" width="159">General</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Pricing</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Always
check if there is room for any price related negotiation with Cloud provider.
Cloud provider may be ready to offer volume based discounts beyond published
rates</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="40" style="height: 30.0pt;">
<td class="xl64" height="40" style="border-top: none; height: 30.0pt; width: 119pt;" width="159">Software development</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Guidelines</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Publish
cloud specific coding guidelines to the team at the start of the development
to avoid any surprises later</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="80" style="height: 60.0pt;">
<td class="xl64" height="80" style="border-top: none; height: 60.0pt; width: 119pt;" width="159">Architecture</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Tagging
cloud resources</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">See
if Cloud provider allows you to tag/name resources and make use of the tags
to manage cloud infrastructure more easily and efficiently. Naming
convention/requirements should be established as part of Cloud deployment
plan before actual roll-out</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="40" style="height: 30.0pt;">
<td class="xl64" height="40" style="border-top: none; height: 30.0pt; width: 119pt;" width="159">Architecture</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Disable
MySQL binary logs incase of large database loads</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">MySQL
Binary logging incurs significant costs and should be disabled in case of
large data loads</td>
<td class="xl65" style="border-left: none; border-top: none;">AWS</td>
</tr>
<tr height="80" style="height: 60.0pt;">
<td class="xl64" height="80" style="border-top: none; height: 60.0pt; width: 119pt;" width="159">Testing</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Simulate
customer distribution</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Use
Cloud's datacenters spread across the world to simulate the customers spread
across the globe and test for latency they are likely to experience. Having
databases spread across the globe (and working as read replicas) and CDNs are
some of the choices to provide better customer experience</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="100" style="height: 75.0pt;">
<td class="xl64" height="100" style="border-top: none; height: 75.0pt; width: 119pt;" width="159">Architecture</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Handle
possibility of longer disruptions</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Cloud
provider's implementation may have bugs and the service may see long duration
of interruptions much beyond committed SLAs. Sometimes, given the scale of
cloud provider, the service interruption may turn grave and result in domino
effect (with one service knocking off other services). Always architect with
failure in mind.</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
<tr height="100" style="height: 75.0pt;">
<td class="xl64" height="100" style="border-top: none; height: 75.0pt; width: 119pt;" width="159">Security</td>
<td class="xl64" style="border-left: none; border-top: none; width: 276pt;" width="368">Consider
using IDS/IPS in Cloud environments</td>
<td class="xl64" style="border-left: none; border-top: none; width: 378pt;" width="504">Use
SNORT (an open source IDS) to protect your infrastructure; Snort is usually
the first outward facing component. Snort can in turn send incoming requests
to load balancers/web servers etc. Also Restful APIs should be protected by
an API gateway (such as Oracle API gateway) that protects against DoS
attacks, bad input etc.</td>
<td class="xl65" style="border-left: none; border-top: none;">All</td>
</tr>
</tbody></table>
</div>
Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-692138374202603081.post-72049657726586607342014-02-07T01:30:00.000-08:002014-02-07T01:30:16.887-08:00Cloud Reference Architecture<div dir="ltr" style="text-align: left;" trbidi="on">
<table border="0" cellpadding="0" cellspacing="0" style="border-collapse: collapse; width: 1025px;">
<colgroup><col style="mso-width-alt: 2962; mso-width-source: userset; width: 61pt;" width="81"></col>
<col style="mso-width-alt: 6765; mso-width-source: userset; width: 139pt;" width="185"></col>
<col style="mso-width-alt: 27757; mso-width-source: userset; width: 569pt;" width="759"></col>
</colgroup><tbody>
<tr height="20" style="height: 15.0pt;">
<td class="xl64" height="20" style="height: 15.0pt; width: 61pt;" width="81"><span style="font-family: Arial, Helvetica, sans-serif;">Platform</span></td>
<td class="xl64" style="border-left: none; width: 139pt;" width="185"><span style="font-family: Arial, Helvetica, sans-serif;">Use case</span></td>
<td class="xl64" style="border-left: none; width: 569pt;" width="759"><span style="font-family: Arial, Helvetica, sans-serif;">Reference
Architecture</span></td>
</tr>
<tr height="20" style="height: 15.0pt;">
<td class="xl65" height="20" style="border-top: none; height: 15.0pt;"><span style="font-family: Arial, Helvetica, sans-serif;">AWS</span></td>
<td class="xl65" style="border-left: none; border-top: none;"><span style="font-family: Arial, Helvetica, sans-serif;">Multiple</span></td>
<td class="xl67" style="border-left: none; border-top: none;"><a href="http://aws.amazon.com/architecture/%E2%80%8E"><span style="font-family: Arial, Helvetica, sans-serif;">http://aws.amazon.com/architecture/</span></a></td>
</tr>
<tr height="20" style="height: 15.0pt;">
<td class="xl65" height="20" style="border-top: none; height: 15.0pt;"><span style="font-family: Arial, Helvetica, sans-serif;">Azure</span></td>
<td class="xl65" style="border-left: none; border-top: none;"><span style="font-family: Arial, Helvetica, sans-serif;">Desktop Hosting</span></td>
<td class="xl66" style="border-left: none; border-top: none;"><a href="http://www.microsoft.com/en-us/download/details.aspx?id=39285"><span style="font-size: 8pt;"><span style="font-family: Arial, Helvetica, sans-serif;">http://www.microsoft.com/en-us/download/details.aspx?id=39285</span></span></a></td>
</tr>
<tr height="20" style="height: 15.0pt;">
<td class="xl65" height="20" style="border-top: none; height: 15.0pt;"><span style="font-family: Arial, Helvetica, sans-serif;">NIST</span></td>
<td class="xl65" style="border-left: none; border-top: none;"><span style="font-family: Arial, Helvetica, sans-serif;">General</span></td>
<td class="xl66" style="border-left: none; border-top: none;"><a href="http://www.nist.gov/customcf/get_pdf.cfm?pub_id=909505"><span style="font-size: 8pt;"><span style="font-family: Arial, Helvetica, sans-serif;">http://www.nist.gov/customcf/get_pdf.cfm?pub_id=909505</span></span></a></td>
</tr>
<tr height="20" style="height: 15.0pt;">
<td class="xl65" height="20" style="border-top: none; height: 15.0pt;"><span style="font-family: Arial, Helvetica, sans-serif;">Rackspace</span></td>
<td class="xl65" style="border-left: none; border-top: none;"><span style="font-family: Arial, Helvetica, sans-serif;">Multiple</span></td>
<td class="xl66" style="border-left: none; border-top: none;"><a href="http://www.rackspace.com/knowledge_center/article/rackspace-open-cloud-reference-architecture"><span style="font-size: 8pt;"><span style="font-family: Arial, Helvetica, sans-serif;">http://www.rackspace.com/knowledge_center/article/rackspace-open-cloud-reference-architecture</span></span></a></td>
</tr>
<tr height="20" style="height: 15.0pt;">
<td class="xl65" height="20" style="border-top: none; height: 15.0pt;"><span style="font-family: Arial, Helvetica, sans-serif;">Oracle</span></td>
<td class="xl65" style="border-left: none; border-top: none;"><span style="font-family: Arial, Helvetica, sans-serif;">General</span></td>
<td class="xl66" style="border-left: none; border-top: none;"><a href="http://www.oracle.com/technetwork/topics/entarch/oracle-wp-cloud-ref-arch-1883533.pdf"><span style="font-size: 8pt;"><span style="font-family: Arial, Helvetica, sans-serif;">http://www.oracle.com/technetwork/topics/entarch/oracle-wp-cloud-ref-arch-1883533.pdf</span></span></a></td>
</tr>
<tr height="20" style="height: 15.0pt;">
<td class="xl65" height="20" style="border-top: none; height: 15.0pt;"><span style="font-family: Arial, Helvetica, sans-serif;">IBM</span></td>
<td class="xl65" style="border-left: none; border-top: none;"><span style="font-family: Arial, Helvetica, sans-serif;">General</span></td>
<td class="xl66" style="border-left: none; border-top: none;"><a href="https://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki/Wf3cce8ff09b3_49d2_8ee7_4e49c1ef5d22/page/IBM%20Cloud%20Computing%20Reference%20Architecture%203.0"><span style="font-size: 8pt;"><span style="font-family: Arial, Helvetica, sans-serif;">https://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki/Wf3cce8ff09b3_49d2_8ee7_4e49c1ef5d22/page/IBM%20Cloud%20Computing%20Reference%20Architecture%203.0</span></span></a></td>
</tr>
<tr height="20" style="height: 15.0pt;">
<td class="xl65" height="20" style="border-top: none; height: 15.0pt;"><span style="font-family: Arial, Helvetica, sans-serif;">Ubuntu</span></td>
<td class="xl65" style="border-left: none; border-top: none;"><span style="font-family: Arial, Helvetica, sans-serif;">General</span></td>
<td class="xl66" style="border-left: none; border-top: none;"><a href="http://www.ubuntu.com/cloud/tools/openstack/reference-architecture"><span style="font-size: 8pt;"><span style="font-family: Arial, Helvetica, sans-serif;">http://www.ubuntu.com/cloud/tools/openstack/reference-architecture</span></span></a></td>
</tr>
</tbody></table>
</div>
Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-692138374202603081.post-42666348614619621222013-10-06T04:13:00.001-07:002013-10-06T04:14:09.664-07:00s3stat.com<div dir="ltr" style="text-align: left;" trbidi="on">
<span style="font-family: Arial, Helvetica, sans-serif;">Check out s3stat.com for AWS CloudFront and S3 log based reporting. Its interesting site and that too at very low cost. Logging needs to be enabled explicitly for these services. The logs are stored again in an S3 bucket and this service needs complete access to the bucket. It costs USD 5/month ONLY!</span></div>
Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-692138374202603081.post-20885219844960972322013-10-03T22:54:00.003-07:002013-10-05T07:33:40.888-07:00Publish AWS CloudWatch Metrics using Mongo DB and JasperReport<div dir="ltr" style="text-align: left;" trbidi="on">
<h1 style="margin-left: .5in; mso-list: l2 level1 lfo2; text-indent: -.25in;">
<!--[if !supportLists]-->1.<span style="font-size: 7pt; font-weight: normal;">
</span><!--[endif]-->Background<o:p></o:p></h1>
<h1 style="margin-left: .5in; mso-list: l2 level1 lfo2; text-indent: -.25in;">
<div class="MsoNormal" style="margin-left: .25in;">
<span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">Amazon
Web Services (AWS) provide a CloudWatch service that allows users to get both
custom and AWS pre-defined metrics for various AWS services. These metrics can
be retrieved using command-line tools or APIs supported in various languages.<o:p></o:p></span></div>
<div class="MsoNormal" style="margin-left: .25in;">
<span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">This
paper demonstrates getting the pre-defined metrics for EC2 using Java
CloudWatch APIs and storing those metrics in Mongo DB database. Mongo DB is a
document based NoSQL database and is a good candidate to store non-transactional
data.</span></div>
<div class="MsoNormal" style="margin-left: .25in;">
<span style="text-indent: -0.25in;"><br /></span></div>
<div class="MsoNormal" style="margin-left: .25in;">
<span style="text-indent: -0.25in;">2.</span><span style="font-size: 7pt; font-weight: normal; text-indent: -0.25in;">
</span><span style="text-indent: -0.25in;">Pre-requisites</span></div>
</h1>
<h1 style="margin-left: .5in; mso-list: l2 level1 lfo2; text-indent: -.25in;">
<o:p></o:p></h1>
<h1 style="margin-left: .5in; mso-list: l2 level1 lfo2; text-indent: -.25in;">
<div class="MsoListParagraphCxSpFirst">
<br /></div>
<div class="MsoListParagraphCxSpLast" style="mso-list: l0 level2 lfo1; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt; mso-fareast-font-family: Arial;">a.<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal; line-height: normal;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">Download AWS SDK for Java and AWS Toolkit for Eclipse
from the following site:<o:p></o:p></span></div>
<div class="MsoNormal" style="margin-left: .25in;">
<span style="font-family: "Arial","sans-serif";"><a href="http://aws.amazon.com/sdkforjava/"><span style="font-size: x-small;">http://aws.amazon.com/sdkforjava/</span></a></span></div>
<div class="MsoNormal" style="margin-left: .25in;">
<span style="font-family: Arial, sans-serif; font-size: 10pt; line-height: 115%; text-indent: -0.25in;">b.<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal; line-height: normal;"> </span></span><span style="font-family: Arial, sans-serif; font-size: 10pt; line-height: 115%; text-indent: -0.25in;">Install Mongo DB from following site:</span></div>
<div class="MsoListParagraphCxSpMiddle">
<a href="http://www.mongodb.org/downloads"><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">http://www.mongodb.org/downloads</span></a><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;"><o:p></o:p></span></div>
<div class="MsoListParagraphCxSpMiddle" style="mso-list: l0 level2 lfo1; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt; mso-fareast-font-family: Arial;">c.<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal; line-height: normal;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">Install Ant from following site and set ANT_HOME
environment variable to path of Ant directory<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpMiddle" style="text-align: justify;">
<a href="http://ant.apache.org/bindownload.cgi%E2%80%8E"><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">http://ant.apache.org/bindownload.cgi</span></a><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;"><o:p></o:p></span></div>
<div class="MsoListParagraphCxSpMiddle" style="mso-list: l0 level2 lfo1; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt; mso-fareast-font-family: Arial;">d.<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal; line-height: normal;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">Install Cloud Watch toolkit (contains CloudWatch
command-line tools) and follow instructions for configuration provided in the
toolkit.<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpLast" style="mso-list: l0 level2 lfo1; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt; mso-fareast-font-family: Arial;">e.<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal; line-height: normal;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">Install JasperReport server and iReport server<o:p></o:p></span></div>
</h1>
<h1 style="margin-left: .5in; mso-list: l2 level1 lfo2; text-indent: -.25in;">
<!--[if !supportLists]-->3.<span style="font-size: 7pt; font-weight: normal;">
</span><!--[endif]-->Steps<o:p></o:p></h1>
<h1 style="margin-left: .5in; mso-list: l2 level1 lfo2; text-indent: -.25in;">
<div class="MsoListParagraphCxSpFirst">
<br /></div>
<div class="MsoListParagraphCxSpLast" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt; mso-fareast-font-family: Arial;">a.<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal; line-height: normal;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">Create AWS Client by providing credentials<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> </span><span style="color: #3f7f5f; font-family: Consolas; font-size: 10.0pt;">// define the
cloudwatch service (should be a singleton)</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> </span><b><span style="color: #7f0055; font-family: Consolas; font-size: 10.0pt;">private</span></b><span style="font-family: Consolas; font-size: 10pt;"> </span><b><span style="color: #7f0055; font-family: Consolas; font-size: 10.0pt;">static</span></b><span style="font-family: Consolas; font-size: 10pt;"> </span><b><span style="color: #7f0055; font-family: Consolas; font-size: 10.0pt;">final</span></b><span style="font-family: Consolas; font-size: 10pt;"> String _accessKeyId
= </span><span style="color: #2a00ff; font-family: Consolas; font-size: 10.0pt;">"AAAAA"</span><span style="font-family: Consolas; font-size: 10pt;">;</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> </span><b><span style="color: #7f0055; font-family: Consolas; font-size: 10.0pt;">private</span></b><span style="font-family: Consolas; font-size: 10pt;"> </span><b><span style="color: #7f0055; font-family: Consolas; font-size: 10.0pt;">static</span></b><span style="font-family: Consolas; font-size: 10pt;"> </span><b><span style="color: #7f0055; font-family: Consolas; font-size: 10.0pt;">final</span></b><span style="font-family: Consolas; font-size: 10pt;"> String
_secretAccessKey = </span><span style="color: #2a00ff; font-family: Consolas; font-size: 10.0pt;">"BBBBB"</span><span style="font-family: Consolas; font-size: 10pt;">;</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> </span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.5in;">
<b><span style="color: #7f0055; font-family: Consolas; font-size: 10.0pt;">private</span></b><span style="font-family: Consolas; font-size: 10pt;"> </span><b><span style="color: #7f0055; font-family: Consolas; font-size: 10.0pt;">static</span></b><span style="font-family: Consolas; font-size: 10pt;"> BasicAWSCredentials _awsCredentials = </span><b><span style="color: #7f0055; font-family: Consolas; font-size: 10.0pt;">new</span></b><span style="font-family: Consolas; font-size: 10pt;">
BasicAWSCredentials(_accessKeyId,_secretAccessKey);</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> </span><b><span style="color: #7f0055; font-family: Consolas; font-size: 10.0pt;">private</span></b><span style="font-family: Consolas; font-size: 10pt;"> </span><b><span style="color: #7f0055; font-family: Consolas; font-size: 10.0pt;">static</span></b><span style="font-family: Consolas; font-size: 10pt;">
AmazonCloudWatchClient _service = </span><b><span style="color: #7f0055; font-family: Consolas; font-size: 10.0pt;">new</span></b><span style="font-family: Consolas; font-size: 10pt;"> AmazonCloudWatchClient(</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;">
_awsCredentials);</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoListParagraphCxSpFirst" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt; mso-fareast-font-family: Arial;">b.<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal; line-height: normal;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">Setup the GetMetricStatisticsRequest object. Detailed
information on Request object parameters and their possible values is available
at following location. “mon-get-stats” command is CLI tool that allows user to
retrieve the metrics.<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpMiddle">
<br /></div>
<div class="MsoListParagraphCxSpLast" style="text-align: justify;">
<a href="http://docs.aws.amazon.com/AmazonCloudWatch/latest/DeveloperGuide/cli-mon-get-stats.html"><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">http://docs.aws.amazon.com/AmazonCloudWatch/latest/DeveloperGuide/cli-mon-get-stats.html</span></a><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> </span><span style="color: #3f7f5f; font-family: Consolas; font-size: 10.0pt;">// Start and End
Time</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> AWSTime startTime =
cwConfig.getStartTime();</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> request.setStartTime((</span><b><span style="color: #7f0055; font-family: Consolas; font-size: 10.0pt;">new</span></b><span style="font-family: Consolas; font-size: 10pt;">
GregorianCalendar(startTime.Year,startTime.Month,startTime.Day,startTime.Hour,startTime.Minute,startTime.Second)).getTime());</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> AWSTime endTime =
cwConfig.getEndTime();</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> request.setEndTime((</span><b><span style="color: #7f0055; font-family: Consolas; font-size: 10.0pt;">new</span></b><span style="font-family: Consolas; font-size: 10pt;">
GregorianCalendar(endTime.Year,endTime.Month,endTime.Day,endTime.Hour,endTime.Minute,endTime.Second)).getTime());</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> </span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;">
request.setPeriod(cwConfig.getPeriod());</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;">
request.setNamespace(cwConfig.getNamespace());</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;">
request.setStatistics(cwConfig.getStats());</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<br /></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;">
ArrayList<Dimension> colDimension = </span><b><span style="color: #7f0055; font-family: Consolas; font-size: 10.0pt;">new</span></b><span style="font-family: Consolas; font-size: 10pt;">
ArrayList<Dimension>();</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> </span><b><span style="color: #7f0055; font-family: Consolas; font-size: 10.0pt;">for</span></b><span style="font-family: Consolas; font-size: 10pt;">
(Map.Entry<String, String> entry : cwConfig.getDimensions().entrySet())</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> {</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> Dimension
dimension = </span><b><span style="color: #7f0055; font-family: Consolas; font-size: 10.0pt;">new</span></b><span style="font-family: Consolas; font-size: 10pt;"> Dimension();</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;">
dimension.setName(entry.getKey());</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;">
dimension.setValue(entry.getValue());</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;">
colDimension.add(dimension);</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> } </span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.75in; text-indent: 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;">request.setDimensions(colDimension);</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.5in; text-indent: 0.5in;">
<span style="font-family: Consolas; font-size: 10pt;">request.setMetricName(strDimension);</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoListParagraphCxSpFirst">
<br /></div>
<div class="MsoListParagraphCxSpLast" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt; mso-fareast-font-family: Arial;">c.<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal; line-height: normal;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">Get the result and store<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> GetMetricStatisticsResult
getMetricStatisticsResult = _service</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> .getMetricStatistics(request);</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> </span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> java.util.List<Datapoint>
datapointsList = getMetricStatisticsResult.getDatapoints();</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> </span><span style="color: #3f7f5f; font-family: Consolas; font-size: 10.0pt;">//Iterator<Datapoint>
dataPointListIterator = datapointsList.iterator();</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<br /></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> HashMap
<Date,Double> map = </span><b><span style="color: #7f0055; font-family: Consolas; font-size: 10.0pt;">new</span></b><span style="font-family: Consolas; font-size: 10pt;"> HashMap<Date,Double>();</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> </span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> </span><b><span style="color: #7f0055; font-family: Consolas; font-size: 10.0pt;">for</span></b><span style="font-family: Consolas; font-size: 10pt;"> (Datapoint
datapoints : datapointsList) {</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;">
map.put(datapoints.getTimestamp(), datapoints.getAverage());</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> }</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> </span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: Consolas; font-size: 10pt;"> metricMap.put( strDimension, map );</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoListParagraphCxSpFirst">
<br /></div>
<div class="MsoListParagraphCxSpLast" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt; mso-fareast-font-family: Arial;">d.<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal; line-height: normal;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">Start Mongo DB daemon in single instance mode. ‘--dbpath’
option specifies the directory where Mongo DB creates the database files.<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">D:\mongodb
2.4\bin></span><b><span style="font-family: "Courier New"; font-size: 12.0pt; mso-bidi-font-size: 11.0pt;">mongod
--dbpath "D:\mongodb 2.4\data" --port 12345<o:p></o:p></span></b></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">Thu
Oct 03 22:08:29.556 [initandlisten] MongoDB starting : pid=5184 port=12345
dbpath=D:\mongodb 2.4\data 64-bit host=LP-D4BED933F0A9<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">Thu
Oct 03 22:08:29.559 [initandlisten] db version v2.4.7-pre-<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">Thu
Oct 03 22:08:29.561 [initandlisten] git version:
9c032a641b278715e71129efe100db2b570ceeb0<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">Thu
Oct 03 22:08:29.564 [initandlisten] build info: windows
sys.getwindowsversion(major=6, minor=1, build=7601, platform=2,
service_pack='Service Pack 1') BOOST_LIB_VERSION=1_49<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">Thu
Oct 03 22:08:29.566 [initandlisten] allocator: system<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">Thu
Oct 03 22:08:29.569 [initandlisten] options: { dbpath: "D:\mongodb
2.4\data", port: 12345 }<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">Thu
Oct 03 22:08:29.606 [initandlisten] journal dir=D:\mongodb 2.4\data\journal<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">Thu
Oct 03 22:08:29.608 [initandlisten] recover : no journal files present, no
recovery needed<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">Thu
Oct 03 22:08:29.752 [FileAllocator] allocating new datafile D:\mongodb
2.4\data\local.ns, filling with zeroes...<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">Thu
Oct 03 22:08:29.754 [FileAllocator] creating directory D:\mongodb 2.4\data\_tmp<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">Thu
Oct 03 22:08:29.790 [FileAllocator] done allocating datafile D:\mongodb 2.4\data\local.ns,
size: 16MB, took 0.032 secs<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">Thu
Oct 03 22:08:29.792 [FileAllocator] allocating new datafile D:\mongodb
2.4\data\local.0, filling with zeroes...<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">Thu
Oct 03 22:08:29.923 [FileAllocator] done allocating datafile D:\mongodb
2.4\data\local.0, size: 64MB, took 0.128
secs<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">Thu
Oct 03 22:08:29.926 [initandlisten] command local.$cmd command: { create:
"startup_log", size: 10485760, capped: true } ntoreturn:1
keyUpdates:0 reslen:37 173ms<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">Thu
Oct 03 22:08:29.930 [initandlisten] waiting for connections on port 12345<o:p></o:p></span></div>
<div class="MsoNormal" style="margin-left: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">Thu Oct
03 22:08:30.029 [websvr] admin web console waiting for connections on port
13345<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpFirst" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt; mso-fareast-font-family: Arial;">e.<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal; line-height: normal;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">Create Mongo DB Client and create one document for each metric data.<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpMiddle" style="margin-bottom: 0.0001pt;">
<span style="color: #3f7f5f; font-family: Consolas; font-size: 10.0pt;">MongoClient mongoClient = new MongoClient(
cwConfig.getMongoDBHostName() , cwConfig.getMongoDBPort() );</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoListParagraphCxSpMiddle" style="margin-bottom: 0.0001pt;">
<span style="font-family: Consolas; font-size: 10pt;">DB db = mongoClient.getDB( cwConfig.getMongoDBName() );</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoListParagraphCxSpLast" style="margin-bottom: 0.0001pt;">
<span style="font-family: Consolas; font-size: 10pt;">DBCollection
collection = db.getCollection( cwConfig.getMongoDBCollection());</span><span style="font-family: Consolas; font-size: 10.0pt;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin-bottom: 0.0001pt;">
<br /></div>
<div class="MsoNormal" style="margin-bottom: 0.0001pt; text-indent: 0.5in;">
<span style="color: #3f7f5f; font-family: Consolas; font-size: 10.0pt;">BasicDBObject
documentDetail = new BasicDBObject();<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpFirst" style="margin-bottom: 0.0001pt;">
<span style="color: #3f7f5f; font-family: Consolas; font-size: 10.0pt;">documentDetail.put("MetricName",
mapMetricContents.getKey());<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpMiddle" style="margin-bottom: 0.0001pt;">
<span style="color: #3f7f5f; font-family: Consolas; font-size: 10.0pt;">documentDetail.put("Date",
mapContents.getKey().toString());<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpMiddle" style="margin-bottom: 0.0001pt;">
<span style="color: #3f7f5f; font-family: Consolas; font-size: 10.0pt;">documentDetail.put("Value",
mapContents.getValue().toString());<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpMiddle" style="margin-bottom: 0.0001pt;">
<span style="color: #3f7f5f; font-family: Consolas; font-size: 10.0pt;"> <o:p></o:p></span></div>
<div class="MsoListParagraphCxSpMiddle" style="margin-bottom: 0.0001pt;">
<span style="color: #3f7f5f; font-family: Consolas; font-size: 10.0pt;">collection.insert(documentDetail);<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpMiddle" style="margin-bottom: 0.0001pt;">
<br /></div>
<div class="MsoListParagraphCxSpLast" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt; mso-fareast-font-family: Arial;">f.<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal; line-height: normal;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">Compile and execute the program. Make sure all the necessary
paths and configuration parameters are set in Ant build script (</span><span style="font-family: "Courier New"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">build.xml</span><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">) and application
configuration file (</span><span style="font-family: "Courier New"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">AwsCloudWatch.properties</span><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">). Configuration file parameters are shown below:<o:p></o:p></span></div>
<div class="MsoNormal" style="margin-left: 0.25in;">
<span style="font-family: "Courier New"; font-size: 10.0pt; mso-bidi-font-size: 11.0pt;"># Mention start and end date and time for the
duration when metrics should be reported in
"Year,Month,Day,Hour,Minute,Second" format<br />
StartTime=2013,8,20,0,0,0<br />
EndTime=2013,8,26,0,0,0<br />
# Comma separated list of metrics<br />
Metrics=CPUUtilization,NetworkIn<br />
# Specify the granularity (in seconds) to retrieve statistics for<br />
Period=600<br />
# Comma separated list of dimensions<br />
Dimensions=InstanceId=AAAA<br />
Namespace=AWS/EC2<br />
# Comma separated list of statistics<br />
Statistics=Average<br />
# Optional<br />
Unit=<br />
# Metric output file<br />
OutputFile=d:\\stats.csv<br />
# Mongodb configuration parameters<br />
MongoDBHostName=localhost<br />
MongoDBPort=12345<br />
MongoDBName=test<br />
MongoDBCollection=testcol<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpFirst">
<br /></div>
<div class="MsoListParagraphCxSpLast" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt; mso-fareast-font-family: Arial;">g.<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal; line-height: normal;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">Check results in Mongo DB by having Mongo DB shell
connect to Mongo DB daemon at the specified port. The query searches for all
documents related to a specific metric – NetworkIn in this case.<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.5in;">
<br /></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.5in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">D:\mongodb
2.4\bin>mongo --port 12345<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.5in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">MongoDB
shell version: 2.4.7-pre-<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.5in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">connecting
to: 127.0.0.1:12345/test<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.5in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">>
use test<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.5in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">switched
to db test<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.5in;">
<b><span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">> db.testcol.find({MetricName:"NetworkIn"})<o:p></o:p></span></b></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.5in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">{
"_id" : ObjectId("524da0a09fd3216ff6835e6d"),
"MetricName" : "NetworkIn", "Date" : "Sun
Sep 22 20:00:00 IST 2013", "Value" : "206.2" }<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.5in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">{
"_id" : ObjectId("524da0a09fd3216ff6835e6e"),
"MetricName" : "NetworkIn", "Date" : "Sun
Sep 22 23:00:00 IST 2013", "Value" : "53.6" }<o:p></o:p></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt 0.5in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 11.0pt;">{
"_id" : ObjectId("524da0a09fd3216ff6835e6f"),
"MetricName" : "NetworkIn", "Date" : "Sun
Sep 22 15:00:00 IST 2013", "Value" : "5598304.4" }<o:p></o:p></span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoListParagraphCxSpFirst" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt; mso-fareast-font-family: Arial;">h.<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal; line-height: normal;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">Create a new report in iReport Designer. This creates a
“.jrxml” file that contains the report.<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpMiddle" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt; mso-fareast-font-family: Arial;">i.<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal; line-height: normal;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">View JasperServer reporistory by clicking on <b>Window -> JasperReports Server
Repository</b><o:p></o:p></span></div>
<div class="MsoListParagraphCxSpLast" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt; mso-fareast-font-family: Arial;">j.<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal; line-height: normal;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">In “JasperReports Server Repository” pane, click on <!--[if gte vml 1]><v:shape id="Picture_x0020_7"
o:spid="_x0000_i1028" type="#_x0000_t75" style='width:14.25pt;height:13.5pt;
visibility:visible;mso-wrap-style:square'>
<v:imagedata src="file:///C:\Users\gargi.a\AppData\Local\Temp\msohtmlclip1\01\clip_image008.png"
o:title=""/>
</v:shape><![endif]--><!--[if !vml]--><img border="0" height="18" src="file:///C:/Users/gargi.a/AppData/Local/Temp/msohtmlclip1/01/clip_image008.png" v:shapes="Picture_x0020_7" width="19" /><!--[endif]--> to add connection to JasperReport server
repository.<o:p></o:p></span></div>
<div align="center" class="MsoNormal" style="text-align: center;">
<!--[if gte vml 1]><v:shape id="Picture_x0020_8"
o:spid="_x0000_i1027" type="#_x0000_t75" style='width:312pt;height:257.25pt;
visibility:visible;mso-wrap-style:square'>
<v:imagedata src="file:///C:\Users\gargi.a\AppData\Local\Temp\msohtmlclip1\01\clip_image009.png"
o:title=""/>
</v:shape><![endif]--><!--[if !vml]--><img border="0" height="343" src="file:///C:/Users/gargi.a/AppData/Local/Temp/msohtmlclip1/01/clip_image009.png" v:shapes="Picture_x0020_8" width="416" /><!--[endif]--><span style="font-family: "Arial","sans-serif";"><o:p></o:p></span></div>
<div class="MsoListParagraph" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt; mso-fareast-font-family: Arial;">k.<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal; line-height: normal;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">Add a new report by clicking on JasperReportServer.<o:p></o:p></span></div>
<div align="center" class="MsoNormal" style="text-align: center;">
<span style="font-family: "Arial","sans-serif"; mso-no-proof: yes;"><!--[if gte vml 1]><v:shape
id="Picture_x0020_9" o:spid="_x0000_i1026" type="#_x0000_t75" style='width:238.5pt;
height:135.75pt;visibility:visible;mso-wrap-style:square'>
<v:imagedata src="file:///C:\Users\gargi.a\AppData\Local\Temp\msohtmlclip1\01\clip_image010.png"
o:title=""/>
</v:shape><![endif]--><!--[if !vml]--><img border="0" height="181" src="file:///C:/Users/gargi.a/AppData/Local/Temp/msohtmlclip1/01/clip_image010.png" v:shapes="Picture_x0020_9" width="318" /><!--[endif]--></span><span style="font-family: "Arial","sans-serif";"><o:p></o:p></span></div>
<div class="MsoListParagraph" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt; mso-fareast-font-family: Arial;">l.<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal; line-height: normal;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt;">Provide all information in Wizard and specify data source
as “Mongo DB data source”. Once report is created, right click on the report
and click “Run JasperServer Report. You can enhance report to add charts etc.<o:p></o:p></span></div>
<div align="center" class="MsoNormal" style="text-align: center;">
<br /></div>
<div align="center" class="MsoNormal" style="text-align: center;">
<span style="font-family: "Arial","sans-serif"; mso-no-proof: yes;"><!--[if gte vml 1]><v:shape
id="Picture_x0020_11" o:spid="_x0000_i1025" type="#_x0000_t75" style='width:467.25pt;
height:217.5pt;visibility:visible;mso-wrap-style:square'>
<v:imagedata src="file:///C:\Users\gargi.a\AppData\Local\Temp\msohtmlclip1\01\clip_image011.png"
o:title=""/>
</v:shape><![endif]--><!--[if !vml]--><img border="0" height="290" src="file:///C:/Users/gargi.a/AppData/Local/Temp/msohtmlclip1/01/clip_image012.jpg" v:shapes="Picture_x0020_11" width="623" /><!--[endif]--></span><span style="font-family: "Arial","sans-serif";"><o:p></o:p></span></div>
</h1>
<h1 style="margin-left: .5in; mso-list: l2 level1 lfo2; text-indent: -.25in;">
<!--[if !supportLists]-->4.<span style="font-size: 7pt; font-weight: normal;">
</span><!--[endif]-->Conclusion<o:p></o:p></h1>
<h1 style="margin-left: .5in; mso-list: l2 level1 lfo2; text-indent: -.25in;">
<div class="MsoNormal" style="margin-left: .25in;">
<span style="font-family: Arial, sans-serif; font-size: 10pt; font-weight: normal; line-height: 115%;">Although
AWS CloudWatch service provides pre-configured graphs for various metrics,
retrieving the data and storing the data provides for more possible use cases and
presentation formats. <o:p></o:p></span></div>
<div class="MsoNormal" style="margin-left: .25in;">
<span style="font-family: Arial, sans-serif; font-size: 10pt; font-weight: normal; line-height: 115%;">On
input side, applications can be enhanced to report custom metrics that an
application can retrieve using CloudWatch APIs. Also ‘Alarms’ can be tried
programmatically.<o:p></o:p></span></div>
<div class="MsoNormal" style="margin-left: .25in;">
<span style="font-family: Arial, sans-serif; font-size: 10pt; font-weight: normal; line-height: 115%;">On
output side, a reporting tool which is supported by Mongo DB can be used to
present the information in user required format. CloudWatch supports use of
Simple Notification Service (SNS) to send automatic notifications. Another possibility
is to integrate this with an incident management system.<o:p></o:p></span></div>
<div class="MsoNormal">
<br /></div>
</h1>
</div>
Unknownnoreply@blogger.com10tag:blogger.com,1999:blog-692138374202603081.post-48028794102638176212013-09-24T03:43:00.001-07:002013-09-24T03:43:51.732-07:00Setup Apache Hadoop and Crunch on AWS<div dir="ltr" style="text-align: left;" trbidi="on">
<h1 align="left" style="margin-left: 0in; text-indent: 0in;">
<a href="" name="_Toc367688047"><!--[if !supportLists]--><span style="color: #1f497d; font-family: "Calibri","sans-serif"; mso-bidi-font-size: 14.0pt; mso-fareast-font-family: Calibri;">1<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal;">
</span></span><!--[endif]--><span style="color: #1f497d; font-family: "Calibri","sans-serif"; font-size: 14.0pt;">Background</span></a><span style="color: #1f497d; font-family: "Calibri","sans-serif"; font-size: 14.0pt;"><o:p></o:p></span></h1>
<div class="MsoNormal" style="line-height: 9.05pt; margin-bottom: 2.0pt; mso-layout-grid-align: none; text-align: justify; text-autospace: none;">
<span style="font-family: Arial, sans-serif; font-size: 9pt;">The goal of this exercise is
to setup Apache Hadoop on Amazon Web Services (AWS) Cloud and demonstrate using
Hadoop for a typical Big Data problem i.e. counting number of words in
document(s). Brief introduction of technologies involved is listed below:<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpFirst" style="line-height: 9.05pt; margin-bottom: 2.0pt; mso-add-space: auto; mso-layout-grid-align: none; text-align: justify; text-autospace: none;">
<br /></div>
<div class="MsoListParagraphCxSpMiddle" style="line-height: 9.05pt; margin-bottom: 2.0pt; mso-add-space: auto; mso-layout-grid-align: none; mso-list: l0 level1 lfo2; text-align: justify; text-autospace: none; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9pt;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><b><span lang="EN-IN" style="font-family: Arial, sans-serif; font-size: 9pt;">Amazon Web
Services (AWS; aka Amazon Cloud)</span></b><span lang="EN-IN" style="font-family: Arial, sans-serif; font-size: 9pt;"> delivers a set of
services that together form a reliable, scalable, and inexpensive computing
platform “in the cloud”. AWS’s Elastic Compute Cloud (EC2) service provides the
servers which are used to setup and execute Hadoop jobs.<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpMiddle" style="line-height: 9.05pt; margin-bottom: 2.0pt; mso-add-space: auto; mso-layout-grid-align: none; mso-list: l0 level1 lfo2; text-align: justify; text-autospace: none; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9pt;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><b><span lang="EN-IN" style="font-family: Arial, sans-serif; font-size: 9pt;">Apache Hadoop</span></b><span lang="EN-IN" style="font-family: Arial, sans-serif; font-size: 9pt;"> is an open-source
software framework that supports data-intensive distributed applications,
licensed under the Apache v2 license. It supports the running of applications
on large clusters of commodity hardware. Hadoop was derived from Google's
MapReduce and Google File System (GFS) papers.<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpLast" style="line-height: 9.05pt; margin-bottom: 2.0pt; mso-add-space: auto; mso-layout-grid-align: none; mso-list: l0 level1 lfo2; text-align: justify; text-autospace: none; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9pt;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><b><span lang="EN-IN" style="font-family: Arial, sans-serif; font-size: 9pt;">Apache Crunch</span></b><span lang="EN-IN" style="font-family: Arial, sans-serif; font-size: 9pt;"> Java library
provides a framework for writing, testing, and running MapReduce pipelines. Its
goal is to make pipelines that are composed of many user-defined functions
simple to write, easy to test, and efficient to run.<o:p></o:p></span></div>
<h1 align="left" style="margin-left: 0in; text-indent: 0in;">
<a href="" name="_Toc367688048"></a><a href="" name="_Toc363750141"></a><a href="" name="_Toc363750149"></a><!--[if !supportLists]--><span style="color: #1f497d; font-family: "Calibri","sans-serif"; mso-bidi-font-size: 14.0pt; mso-fareast-font-family: Calibri;">2<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal;">
</span></span><!--[endif]--><span style="color: #1f497d; font-family: "Calibri","sans-serif"; font-size: 14.0pt;">Steps</span><span style="color: #1f497d; font-family: "Calibri","sans-serif"; font-size: 14.0pt;"><o:p></o:p></span></h1>
<h2>
<a href="" name="_Toc367688049"><!--[if !supportLists]-->2.1<span style="font-size: 7pt; font-weight: normal;"> </span><!--[endif]-->Start a new instance on AWS</a> <o:p></o:p></h2>
<div class="MsoNormal">
<span style="font-family: "Arial","sans-serif"; font-size: 10.0pt; mso-fareast-language: EN-IN;">Setup the instance using AWS Management Console
using following parameters:<o:p></o:p></span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoListParagraphCxSpFirst" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Operating
System: Ubuntu TLS 64-bit<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpMiddle" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Instance
type: t1.micro (although this is insufficient to do any decent Hadoop work, but chosen for this exercise as it is
experimental and ‘t1.micro’ only available instance type under ‘Free’ tier)<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpLast" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Storage:
Instance type (do not chose EBS since transfer in and out of EBS is paid)<o:p></o:p></span></div>
<div class="MsoNormal">
<span style="font-family: "Arial","sans-serif"; font-size: 9.0pt; mso-no-proof: yes;"><v:shapetype coordsize="21600,21600" filled="f" id="_x0000_t75" o:preferrelative="t" o:spt="75" path="m@4@5l@4@11@9@11@9@5xe" stroked="f">
<v:stroke joinstyle="miter">
<v:formulas>
<v:f eqn="if lineDrawn pixelLineWidth 0">
<v:f eqn="sum @0 1 0">
<v:f eqn="sum 0 0 @1">
<v:f eqn="prod @2 1 2">
<v:f eqn="prod @3 21600 pixelWidth">
<v:f eqn="prod @3 21600 pixelHeight">
<v:f eqn="sum @0 0 1">
<v:f eqn="prod @6 1 2">
<v:f eqn="prod @7 21600 pixelWidth">
<v:f eqn="sum @8 21600 0">
<v:f eqn="prod @7 21600 pixelHeight">
<v:f eqn="sum @10 21600 0">
</v:f></v:f></v:f></v:f></v:f></v:f></v:f></v:f></v:f></v:f></v:f></v:f></v:formulas>
<v:path gradientshapeok="t" o:connecttype="rect" o:extrusionok="f">
<o:lock aspectratio="t" v:ext="edit">
</o:lock></v:path></v:stroke></v:shapetype><v:shape id="Picture_x0020_1" o:spid="_x0000_i1026" style="height: 31.5pt; mso-wrap-style: square; visibility: visible; width: 450.75pt;" type="#_x0000_t75">
<v:imagedata o:title="" src="file:///C:\Users\gargi.a\AppData\Local\Temp\msohtmlclip1\01\clip_image001.png">
</v:imagedata></v:shape></span><span style="font-family: "Arial","sans-serif"; font-size: 9.0pt; mso-fareast-language: EN-IN;"><o:p></o:p></span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoListParagraphCxSpFirst" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Make
sure following software is setup on the server<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpMiddle" style="line-height: 9.05pt; margin-bottom: 2.0pt; margin-left: 1.0in; margin-right: 0in; margin-top: 0in; mso-add-space: auto; mso-layout-grid-align: none; mso-list: l1 level2 lfo3; text-align: justify; text-autospace: none; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: 'Courier New'; font-size: 9pt;">o<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: Arial, sans-serif; font-size: 9pt;">JDK version 1.6 or above<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpMiddle" style="line-height: 9.05pt; margin-bottom: 2.0pt; margin-left: 1.0in; margin-right: 0in; margin-top: 0in; mso-add-space: auto; mso-layout-grid-align: none; mso-list: l1 level2 lfo3; text-align: justify; text-autospace: none; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: 'Courier New'; font-size: 9pt;">o<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: Arial, sans-serif; font-size: 9pt;">Maven 2<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpMiddle" style="line-height: 9.05pt; margin-bottom: 2.0pt; margin-left: 1.0in; margin-right: 0in; margin-top: 0in; mso-add-space: auto; mso-layout-grid-align: none; mso-list: l1 level2 lfo3; text-align: justify; text-autospace: none; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: 'Courier New'; font-size: 9pt;">o<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: Arial, sans-serif; font-size: 9pt;">‘tree’ package. Can be installed using the following command:<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpLast" style="line-height: 9.05pt; margin-bottom: 2.0pt; margin-left: 1.0in; margin-right: 0in; margin-top: 0in; mso-add-space: auto; mso-layout-grid-align: none; text-align: justify; text-autospace: none;">
<span lang="EN-IN" style="font-family: Arial, sans-serif; font-size: 9pt;">sudo apt-get install tree<o:p></o:p></span></div>
<h2>
<a href="" name="_Toc367688050"><!--[if !supportLists]-->2.2<span style="font-size: 7pt; font-weight: normal;"> </span><!--[endif]-->Setup EC2 account and tools</a><o:p></o:p></h2>
<div class="MsoNormal" style="text-align: justify;">
<span style="font-family: "Arial","sans-serif"; font-size: 9.0pt; mso-bidi-font-size: 10.0pt; mso-fareast-language: EN-IN;">EC2 tools are used by Hadoop’s EC2 setup utilities to create instances
and launch them.<o:p></o:p></span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoListParagraph" style="mso-list: l2 level1 lfo4; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt;">
</span></span><!--[endif]--><span lang="EN-IN">Get the EC2 tools using following command:<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$
wget </span><a href="http://s3.amazonaws.com/ec2-downloads/ec2-api-tools.zip"><span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">http://s3.amazonaws.com/ec2-downloads/ec2-api-tools.zip</span></a><span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;"><o:p></o:p></span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoListParagraph" style="mso-list: l2 level1 lfo4; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt;">
</span></span><!--[endif]--><span lang="EN-IN">Unzip the compressed file<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$
unzip ec2-api-tools.zip<o:p></o:p></span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoListParagraph" style="mso-list: l2 level1 lfo4; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt;">
</span></span><!--[endif]--><span lang="EN-IN">Setup the </span><i><span lang="EN-IN" style="font-family: "Courier New"; font-size: 9.0pt; line-height: 115%; mso-bidi-font-size: 11.0pt; mso-fareast-language: EN-IN;">ec2-init.sh</span></i><span lang="EN-IN"> file using following
configuration:<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">export
JAVA_HOME=/usr<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">export
EC2_HOME=~/ec2-api-tools-1.6.10.0<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">export
PATH=$PATH:$EC2_HOME/bin<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">export
AWS_ACCESS_KEY=AKIAJYXX37NSBTETUVHA<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">export
AWS_SECRET_KEY=3uR3oJ4/JIVV6Dxe+V//gwHC0vKg2DaolJ1qrjeX<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">export
EC2_PRIVATE_KEY=~/.ec2/pk-unencrypt-test.pem<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">export
EC2_CERT=~/.ec2/cert-test.pem<o:p></o:p></span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoListParagraph" style="mso-list: l2 level1 lfo4; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt;">
</span></span><!--[endif]--><span lang="EN-IN">Execute following at prompt to set the parameters:<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$
<i>source ec2-init.sh</i><o:p></o:p></span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoListParagraphCxSpFirst" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Make
sure EC2 init file parameters are set at the system startup by adding above
command to .profile file<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpMiddle">
<br /></div>
<div class="MsoListParagraphCxSpLast" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Add
your private key file as shown below. Make sure the file has ‘chmod’ set to
‘400’.<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">.ec2/id_rsa-<key
name><o:p></o:p></span></div>
<h2>
<a href="" name="_Toc367688051"><!--[if !supportLists]-->2.3<span style="font-size: 7pt; font-weight: normal;"> </span><!--[endif]-->Setup Apache Hadoop on EC2</a> <o:p></o:p></h2>
<div class="MsoListParagraph" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Retrieve
Hadoop tools (Use a standard Apache URL to download if the below doesn’t work)<o:p></o:p></span></div>
<div class="MsoNormal" style="margin-left: .25in; tab-stops: list 1.0in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$ wget </span><a href="http://download.nextag.com/apache/hadoop/core/hadoop-1.0.0/hadoop-1.0.0.tar.gz"><span style="color: windowtext; font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-font-family: "Times New Roman"; mso-fareast-language: EN-IN; mso-fareast-theme-font: minor-fareast; text-decoration: none; text-underline: none;">http://download.nextag.com/apache//</span></a><a href="http://download.nextag.com/apache/hadoop/core/hadoop-1.0.0/hadoop-1.0.0.tar.gz"><span style="color: windowtext; font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-font-family: "Times New Roman"; mso-fareast-language: EN-IN; mso-fareast-theme-font: minor-fareast; text-decoration: none; text-underline: none;">Hadoop</span><span style="color: windowtext; font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; text-decoration: none; text-underline: none;">/core/Hadoop-1.2.1/Hadoop-1.2.1</span><span style="color: windowtext; font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-font-family: "Times New Roman"; mso-fareast-language: EN-IN; mso-fareast-theme-font: minor-fareast; text-decoration: none; text-underline: none;">.tar.gz</span></a><span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-font-family: "Times New Roman"; mso-fareast-language: EN-IN; mso-fareast-theme-font: minor-fareast;"><o:p></o:p></span></div>
<div class="MsoNormal" style="margin-left: .25in; tab-stops: list 1.0in;">
<br /></div>
<div class="MsoNormal" style="margin-left: .25in; tab-stops: list 1.0in;">
<br /></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$
tar –xzvf Hadoop-1.2.1<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<br /></div>
<div class="MsoListParagraph" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Create
Hadoop-ec2 initialization script<o:p></o:p></span></div>
<div class="MsoNormal" style="tab-stops: list 1.0in; text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$ vi hadoop-ec2-init.sh<o:p></o:p></span></div>
<div class="MsoNormal" style="tab-stops: list 1.0in; text-indent: .25in;">
<br /></div>
<div class="MsoListParagraph" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Add
following lines to the initialization script:<o:p></o:p></span></div>
<div class="MsoNormal" style="margin-left: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-fareast-language: EN-IN;">export HADOOP_EC2_BIN=~/Hadoop-1.2.1/src/contrib/ec2/bin<o:p></o:p></span></div>
<div class="MsoNormal" style="margin-left: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-fareast-language: EN-IN;">export
PATH=$PATH:$HADOOP_EC2_BIN</span><o:p></o:p></div>
<div class="MsoNormal" style="tab-stops: list 1.0in; text-indent: .25in;">
<br /></div>
<div class="MsoListParagraph" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Initialize
the variables:<o:p></o:p></span></div>
<div class="MsoNormal" style="tab-stops: list 1.0in; text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$ source hadoop-ec2-init.sh<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$
Put it in ~/.profile to have it done automatically on login<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<br /></div>
<div class="MsoListParagraph" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Configure
Hadoop with EC2 account<o:p></o:p></span></div>
<div class="MsoNormal" style="tab-stops: list 1.0in; text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$ vi ~/Hadoop-1.2.1/src/contrib/ec2/bin/Hadoop-ec2-env.sh<o:p></o:p></span></div>
<div class="MsoNormal" style="margin-left: 1.25in; mso-list: l4 level2 lfo5; tab-stops: list 1.0in 1.25in; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Verdana","sans-serif"; font-size: 9.0pt; mso-bidi-font-family: Verdana; mso-fareast-font-family: Verdana; mso-fareast-language: EN-IN;">◦<span style="font-family: 'Times New Roman'; font-size: 7pt;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 9.0pt; mso-fareast-language: EN-IN;">AWS_ACCOUNT_ID=283072064258<o:p></o:p></span></div>
<div class="MsoNormal" style="margin-left: 1.25in; mso-list: l4 level2 lfo5; tab-stops: list 1.0in 1.25in; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Verdana","sans-serif"; font-size: 9.0pt; mso-bidi-font-family: Verdana; mso-fareast-font-family: Verdana; mso-fareast-language: EN-IN;">◦<span style="font-family: 'Times New Roman'; font-size: 7pt;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 9.0pt; mso-fareast-language: EN-IN;">AWS_ACCESS_KEY_ID=< Get this from your account page ><o:p></o:p></span></div>
<div class="MsoNormal" style="margin-left: 1.75in; mso-list: l4 level3 lfo5; tab-stops: list 1.5in 1.75in; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Wingdings 2"; font-size: 9.0pt; mso-bidi-font-family: "Wingdings 2"; mso-fareast-font-family: "Wingdings 2"; mso-fareast-language: EN-IN;"><span style="font-family: 'Times New Roman'; font-size: 7pt;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 9.0pt; mso-fareast-language: EN-IN;">Looks like AKIAJ5U4QYDDZCNDDY5Q<o:p></o:p></span></div>
<div class="MsoNormal" style="margin-left: 1.25in; mso-list: l4 level2 lfo5; tab-stops: list 1.0in 1.25in; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Verdana","sans-serif"; font-size: 9.0pt; mso-bidi-font-family: Verdana; mso-fareast-font-family: Verdana; mso-fareast-language: EN-IN;">◦<span style="font-family: 'Times New Roman'; font-size: 7pt;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 9.0pt; mso-fareast-language: EN-IN;">AWS_SECRET_ACCESS_KEY=<Get this from your account page><o:p></o:p></span></div>
<div class="MsoNormal" style="margin-left: 1.75in; mso-list: l4 level3 lfo5; tab-stops: list 1.5in 1.75in; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Wingdings 2"; font-size: 9.0pt; mso-bidi-font-family: "Wingdings 2"; mso-fareast-font-family: "Wingdings 2"; mso-fareast-language: EN-IN;"><span style="font-family: 'Times New Roman'; font-size: 7pt;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 9.0pt; mso-fareast-language: EN-IN;">Looks like FtDMaAuSXwzD7pagkR3AfIVTMjc6+pdab2/2iITL<o:p></o:p></span></div>
<div class="MsoNormal" style="margin-left: 1.25in; mso-list: l4 level2 lfo5; tab-stops: list 1.0in 1.25in; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Verdana","sans-serif"; font-size: 9.0pt; mso-bidi-font-family: Verdana; mso-fareast-font-family: Verdana; mso-fareast-language: EN-IN;">◦<span style="font-family: 'Times New Roman'; font-size: 7pt;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 9.0pt; mso-fareast-language: EN-IN;">KEY_NAME=<group>-keypair<o:p></o:p></span></div>
<div class="MsoNormal" style="margin-left: 1.75in; mso-list: l4 level3 lfo5; tab-stops: list 1.75in; text-indent: -.25in;">
<!--[if !supportLists]--><span style="font-family: "Wingdings 2"; font-size: 9.0pt; mso-bidi-font-family: "Wingdings 2"; mso-fareast-font-family: "Wingdings 2"; mso-fareast-language: EN-IN;"><span style="font-family: 'Times New Roman'; font-size: 7pt;"> </span></span><!--[endif]--><span style="font-family: "Arial","sans-serif"; font-size: 9.0pt; mso-fareast-language: EN-IN;">The same keypair you set up earlier at ~/.ec1/ida_rsa-<key name><o:p></o:p></span></div>
<div class="MsoListParagraphCxSpFirst">
<br /></div>
<div class="MsoListParagraphCxSpMiddle" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Check
Hadoop configuration files in ‘hadoop-1.2.1’ directory to make sure all files
use a login which is supported by the OS. These configuration files use ‘root’
by default. However, Ubuntu in EC2 doesn’t allow a root access. Therefore ‘root’
needs to change to ‘ubuntu’.<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpMiddle">
<br /></div>
<div class="MsoListParagraphCxSpLast" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Create/launch
cluster<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$
Hadoop-ec2 launch-cluster <group>-cluster 2<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<br /></div>
<div class="MsoListParagraph" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Test
login to master node<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$
Hadoop-ec2 login test-cluster<o:p></o:p></span></div>
<h2>
<a href="" name="_Toc367688052"><!--[if !supportLists]-->2.4<span style="font-size: 7pt; font-weight: normal;"> </span><!--[endif]-->Setup Apache Crunch on EC2</a> <o:p></o:p></h2>
<div class="MsoListParagraph" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Retrieve
Apache Crunch<o:p></o:p></span></div>
<div class="MsoNormal" style="margin-left: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$
wget </span><a href="http://archive.apache.org/dist/crunch/crunch-0.6.0/apache-crunch-0.6.0-src.tar.gz"><span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">http://archive.apache.org/dist/crunch/crunch-0.6.0/apache-crunch-0.6.0-src.tar.gz</span></a><span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;"><o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<br /></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">tar
–xzvf apache-crunch-0.6.0-src.tar.gz<o:p></o:p></span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoListParagraph" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Make
sure ‘JAVA_HOME’ points to Open JDK (and not JRE). Command to install the
package on Ubuntu is:<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$
sudo apt-get install openjdk-6-jdk<o:p></o:p></span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoListParagraph" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Generate
simple project and answer questions as shown below:<o:p></o:p></span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoNormal" style="background: whitesmoke; line-height: 15.0pt; margin-bottom: 7.5pt; tab-stops: 45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt; word-break: break-all;">
<span style="color: #333333; font-family: Consolas; font-size: 10.0pt;">$ <b>mvn archetype:generate
-Dfilter=org.apache.crunch:crunch-archetype</b><o:p></o:p></span></div>
<div class="MsoNormal" style="background: whitesmoke; line-height: 15.0pt; margin-bottom: 7.5pt; tab-stops: 45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt; word-break: break-all;">
<span style="color: #333333; font-family: Consolas; font-size: 10.0pt;">[...]<o:p></o:p></span></div>
<div class="MsoNormal" style="background: whitesmoke; line-height: 15.0pt; margin-bottom: 7.5pt; tab-stops: 45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt; word-break: break-all;">
<span style="color: #333333; font-family: Consolas; font-size: 10.0pt;">1: remote ->
org.apache.crunch:crunch-archetype (Create a basic, self-contained job with the
core library.)<o:p></o:p></span></div>
<div class="MsoNormal" style="background: whitesmoke; line-height: 15.0pt; margin-bottom: 7.5pt; tab-stops: 45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt; word-break: break-all;">
<span style="color: #333333; font-family: Consolas; font-size: 10.0pt;">Choose a number or apply filter (format:
[groupId:]artifactId, case sensitive contains): : <b>1</b><o:p></o:p></span></div>
<div class="MsoNormal" style="background: whitesmoke; line-height: 15.0pt; margin-bottom: 7.5pt; tab-stops: 45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt; word-break: break-all;">
<span style="color: #333333; font-family: Consolas; font-size: 10.0pt;">Define value for property 'groupId': : <b>com.example</b><o:p></o:p></span></div>
<div class="MsoNormal" style="background: whitesmoke; line-height: 15.0pt; margin-bottom: 7.5pt; tab-stops: 45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt; word-break: break-all;">
<span style="color: #333333; font-family: Consolas; font-size: 10.0pt;">Define value for property 'artifactId': : <b>crunch-demo</b><o:p></o:p></span></div>
<div class="MsoNormal" style="background: whitesmoke; line-height: 15.0pt; margin-bottom: 7.5pt; tab-stops: 45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt; word-break: break-all;">
<span style="color: #333333; font-family: Consolas; font-size: 10.0pt;">Define value for property 'version': 1.0-SNAPSHOT: : <b>[HIT ENTER]</b><o:p></o:p></span></div>
<div class="MsoNormal" style="background: whitesmoke; line-height: 15.0pt; margin-bottom: 7.5pt; tab-stops: 45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt; word-break: break-all;">
<span style="color: #333333; font-family: Consolas; font-size: 10.0pt;">Define value for property 'package': com.example: : <b>[HIT ENTER]</b><o:p></o:p></span></div>
<div class="MsoNormal" style="background: whitesmoke; line-height: 15.0pt; margin-bottom: 7.5pt; tab-stops: 45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt; word-break: break-all;">
<span style="color: #333333; font-family: Consolas; font-size: 10.0pt;">Confirm properties configuration:<o:p></o:p></span></div>
<div class="MsoNormal" style="background: whitesmoke; line-height: 15.0pt; margin-bottom: 7.5pt; tab-stops: 45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt; word-break: break-all;">
<span style="color: #333333; font-family: Consolas; font-size: 10.0pt;">groupId: com.example<o:p></o:p></span></div>
<div class="MsoNormal" style="background: whitesmoke; line-height: 15.0pt; margin-bottom: 7.5pt; tab-stops: 45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt; word-break: break-all;">
<span style="color: #333333; font-family: Consolas; font-size: 10.0pt;">artifactId: crunch-demo<o:p></o:p></span></div>
<div class="MsoNormal" style="background: whitesmoke; line-height: 15.0pt; margin-bottom: 7.5pt; tab-stops: 45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt; word-break: break-all;">
<span style="color: #333333; font-family: Consolas; font-size: 10.0pt;">version: 1.0-SNAPSHOT<o:p></o:p></span></div>
<div class="MsoNormal" style="background: whitesmoke; line-height: 15.0pt; margin-bottom: 7.5pt; tab-stops: 45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt; word-break: break-all;">
<span style="color: #333333; font-family: Consolas; font-size: 10.0pt;">package: com.example<o:p></o:p></span></div>
<div class="MsoNormal" style="background: whitesmoke; line-height: 15.0pt; margin-bottom: 7.5pt; tab-stops: 45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt; word-break: break-all;">
<span style="color: #333333; font-family: Consolas; font-size: 10.0pt;"> Y: :
<b>[HIT ENTER]</b><o:p></o:p></span></div>
<div class="MsoNormal" style="background: whitesmoke; line-height: 15.0pt; margin-bottom: 7.5pt; tab-stops: 45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt; word-break: break-all;">
<span style="color: #333333; font-family: Consolas; font-size: 10.0pt;">[...]<o:p></o:p></span></div>
<div class="MsoNormal" style="background: whitesmoke; line-height: 15.0pt; margin-bottom: 7.5pt; tab-stops: 45.8pt 91.6pt 137.4pt 183.2pt 229.0pt 274.8pt 320.6pt 366.4pt 412.2pt 458.0pt 503.8pt 549.6pt 595.4pt 641.2pt 687.0pt 732.8pt; word-break: break-all;">
<span style="color: #333333; font-family: Consolas; font-size: 10.0pt;">$<o:p></o:p></span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoListParagraph" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Change
directory using:<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$
cd crunch-demo<o:p></o:p></span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoListParagraph" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">See
the directory structure:<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$
tree<o:p></o:p></span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoListParagraph" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Build
code. Sometimes Maven given error that indicates too many unlicensed products
are under use. To eliminated the error, set approved license limit to a high
number.<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$
mvn -Drat.numUnapprovedLicenses=100 package<o:p></o:p></span></div>
<h2>
<a href="" name="_Toc367688053"><!--[if !supportLists]-->2.5<span style="font-size: 7pt; font-weight: normal;"> </span><!--[endif]-->Execute sample Hadoop job using Crunch</a><o:p></o:p></h2>
<div class="MsoListParagraphCxSpFirst" style="mso-list: l1 level1 lfo3; text-indent: -.25in;">
<!--[if !supportLists]--><span lang="EN-IN" style="font-family: Symbol; font-size: 9.0pt; line-height: 115%; mso-bidi-font-family: Symbol; mso-fareast-font-family: Symbol; mso-fareast-language: EN-IN;">·<span style="font-family: 'Times New Roman'; font-size: 7pt; line-height: normal;">
</span></span><!--[endif]--><span lang="EN-IN" style="font-family: "Arial","sans-serif"; font-size: 9.0pt; line-height: 115%; mso-fareast-language: EN-IN;">Execute
the following command to run the sample word count application. ‘Input’ can be
either a file or a directory. ‘Output’ should be a directory.<o:p></o:p></span></div>
<div class="MsoListParagraphCxSpLast">
<br /></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$
~/Hadoop-1.2.1/bin/Hadoop jar ./target/crunch-demo-1.0-SNAPSHOT-job.jar input
output<o:p></o:p></span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$
cat input<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">dnasmdad
daksj d kdjkadmsak d james john james john john<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$
cd output<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$
ls<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">part-r-00000<o:p></o:p></span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">$
cat part-r-00000<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">[james,2]<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">[d,2]<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">[daksj,1]<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">[dnasmdad,1]<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">[john,3]<o:p></o:p></span></div>
<div class="MsoNormal" style="text-indent: .25in;">
<span style="font-family: "Courier New"; font-size: 9.0pt; mso-bidi-font-size: 12.0pt; mso-fareast-language: EN-IN;">[kdjkadmsak,1]<o:p></o:p></span></div>
<h1 align="left" style="margin-left: 0in; text-indent: 0in;">
<a href="" name="_Toc367688054"></a><a href="" name="_Toc363750151"></a><!--[if !supportLists]--><span style="color: #1f497d; font-family: "Calibri","sans-serif"; mso-bidi-font-size: 14.0pt; mso-fareast-font-family: Calibri;">3<span style="font-family: 'Times New Roman'; font-size: 7pt; font-weight: normal;">
</span></span><!--[endif]--><span style="color: #1f497d; font-family: "Calibri","sans-serif"; font-size: 14.0pt;">Summary</span><span style="color: #1f497d; font-family: "Calibri","sans-serif"; font-size: 14.0pt;"><o:p></o:p></span></h1>
<div class="MsoNormal" style="text-align: justify;">
<span style="font-family: "Arial","sans-serif"; font-size: 9.0pt; mso-bidi-font-size: 10.0pt; mso-fareast-language: EN-IN;">Apache Hadoop provides built-in EC2 support that allows user to setup
Hadoop cluster in a very easy manner. Although there are other options to setup
the Hadoop clusters (such as Cloudera Server Manager) but Apache Hadoop’s build
in capability allows greater control. <o:p></o:p></span></div>
<div class="MsoNormal" style="text-align: justify;">
<br /></div>
<br />
<div class="MsoNormal" style="text-align: justify;">
<span style="font-family: "Arial","sans-serif"; font-size: 9.0pt; mso-bidi-font-size: 10.0pt; mso-fareast-language: EN-IN;">During the installation process, some of the default options may need to
be adapted for the type of operating system under use.<o:p></o:p></span></div>
</div>
Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-692138374202603081.post-31497089925165191162013-08-30T22:29:00.001-07:002013-09-24T03:42:16.226-07:00Observations about Cloud<div dir="ltr" style="text-align: left;" trbidi="on">
<span style="font-family: Verdana, sans-serif;">1. IT companies should start investing heavily in training their workforce for the Cloud</span><br />
<span style="font-family: Verdana, sans-serif;">2. Cloud service providers should start involving student/communities on grand scale (hold roadshows, contests etc.)</span><br />
<span style="font-family: Verdana, sans-serif;">3. Cloud is NOT a threat. It is way to outsource redundant and repetitive jobs to someone else.</span><br />
<span style="font-family: Verdana, sans-serif;">4. Cloud service providers should re-look at their choice of naming conventions, documentation etc. and streamline. Cloud is going to become tool of the masses and not necessarily of IT users. So they should be adapted that way. Next wave is consumer and NOT business</span><br />
<span style="font-family: Verdana, sans-serif;">5. Create services for freelancing community. Anticipate their requirements. Freelancing communities are likely to grow and cloud can provide platform for freelancers to provision resources normally available to larger enterprises</span></div>
Unknownnoreply@blogger.com0